Big Data Architect

Full Time
Remote
Posted
Job description

About Kanini

Kanini provides Agile Software Development, Cloud Computing, Data Science, and Location Intelligence services to public and private organizations. We have successfully served our clients in government, finance, transportation, utility, and software industries since 2003.

Why you should join

Working at Kanini is flexible and personal. We are a highly motivated, collaborative team experimenting with the latest technologies. We are committed to everyone having a healthy work/life balance, and we provide extensive mentorship and training resources to help you succeed.

Kanini is looking for a Big Data Architect who has a deep experience in Data Engineering, AWS, Python, Data Lakes.

Job Description

  • Maintain a predictable, transparent, global operating rhythm that ensures always-on access to high-quality data for stakeholders across the company
  • Responsible for day-to-day data collection, transportation, maintenance/curation and access to the Data Lake/data repository
  • Work cross-functionally across the enterprise to centralize data and standardize it for use by business, data science or other stakeholders
  • Increase awareness about available data and democratize access to it across the company
  • Active contributor to code development in projects and services
  • Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products
  • Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality and performance
  • Responsible for implementing best practices around systems integration, security, performance and data management
  • Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape
  • Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions
  • Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects and strategic internal and external partners
  • Develop and optimize procedures to “productionalize” data science models
  • Define and manage SLA’s for data products and processes running in production
  • Support large-scale experimentation done by data scientists.
  • Prototype new approaches and build solutions at scale
  • Research in state-of-the-art methodologies
  • Create documentation for learnings and knowledge transfer
  • Create and audit reusable packages or libraries

Qualifications

  • Bachelor’s degree preferred; Experience with building solutions in the healthcare space is a plus
  • Fluent with AWS cloud services; AWS Certification is a plus
  • 6+ years of overall technology experience that includes at least 4+ years of hands-on software development, data engineering, and systems architecture
  • 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools and Snowflake required
  • 4+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.
  • 2+ years in cloud data engineering experience in Oracle OCI/AWS
  • Experience with integration of multi cloud services with on-premises technologies
  • Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines
  • Experience with data profiling and data quality tools like Apache Griffin, Deequ, and Great Expectations
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
  • Experience with MPP database technologies such as AWS Redshift, Vertica, or Snowflake
  • Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes
  • Experience with version control systems like GitHub and deployment & CI tools.
  • Experience with Glue, Data Factory, Databricks and Machine learning tools
  • Working knowledge of agile development, including DevOps and DataOps concept
  • Strong change manager. Comfortable with change, especially that which arises through company growth

Kanini Software Solutions, Inc. does not discriminate in employment matters based on race, gender, religion, age, national origin, citizenship, veteran status, family status, disability status, or any other protected class. We support workplace diversity. If you have a disability, please let us know if there is anything we can do to improve the interview process for you; we’re happy to accommodate.

Kanini Software Solutions, Inc., 25 Century Blvd., Ste. 602, Nashville, TN 37214

Job Types: Full-time, Contract

Pay: $68.00 - $75.00 per hour

Work Location: Remote

gatheringourvoice.org is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, gatheringourvoice.org provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, gatheringourvoice.org is the ideal place to find your next job.

Intrested in this job?

Related Jobs

All Related Listed jobs