Job description

Role: Data Engineer

Location: Houston, TX (Onsite) Fulltime

Technical/Functional Skills:

The Data Architect/Sr Data Engineer will be responsible for developing Python modules using NumPy multi-dimensional arrays, pandas, and dynamic programming in AWS and Snowflake and expanding and optimizing our ETL and data pipeline architecture and data flow and collection across our Business Portfolio.

The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Developer will support our data product owners, developers, data architects, data analysts, and data scientists on BI and Analytic initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

The Data Developer will also assist in issue resolution, job orchestration, automation, and continuous improvement of our data integration processes.

Experience Required:

The Data Architect/Sr Data Engineer will be responsible for developing Python modules using NumPy multi-dimensional arrays, pandas, and dynamic programming in AWS and Snowflake and expanding and optimizing our ETL and data pipeline architecture and data flow and collection across our Business Portfolio.

Roles & Responsibilities:

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Cloud Integration ETL Tools, Cloud Data Warehouse, SQL, DBT, AWS Services Lambda, SNS, SQS, Event Bridge, and IoT core.
• Design and develop ELT, ETL, and Event-driven data integration architecture solutions
• Work with the Data Analysts, Data Architects, BI Architects, Data Scientists, and Data Product Owners to establish an understanding of source data and determine data transformation and integration requirements
• Troubleshoot and tune complex SQL
• Utilize On-Prem and Cloud-based ETL platforms, Cloud Data warehouse, AWS, GitHub, various scripting languages, SQL, querying, data quality, and metadata management tools.
• Develop data validation processes to ensure data quality
• Demonstrated ability to work individually and as a part of the team in a collaborative manner

Qualifications

• The requirements listed below are representative of the qualifications necessary to perform the job.
• Education and Experience
• Bachelor's degree (or foreign equivalent) in Computer Science, Computer Engineering, or a related field.
• 8+ years of experience with Data Engineering, ETL, data warehouse/data mart development, data lake development
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience working with Cloud Datawarehouse like Snowflake, Google Big Query, Amazon Redshift
• Experience with AWS cloud services: EC2, S3, Lambda, SQS, SNS, etc.
• Experience with Cloud Integration Tools like Matillion, Dell Boomi, Informatica Cloud, Talend, AWS Glue
• Experience with GitHub and its integration with the ETL tools for version control
• Experience with Informatica PowerCenter, various scripting languages, SQL, and querying tools
• Familiarity with modern data management tools and platforms including Spark, Hadoop/Hive, NoSQL, APIs, Streaming, and other analytic data platforms
• Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc., a plus.
• Experience with Agile/Scrum is valuable

Job Type: Full-time

Salary: $100,000.00 - $115,000.00 per year

Benefits:

• 401(k)
• Dental insurance
• Health insurance
• Vision insurance

Compensation package:

• Yearly pay

Experience level:

• 8 years

Schedule:

• 8 hour shift
• Monday to Friday

Experience:

• AWS: 8 years (Preferred)
• SQL: 8 years (Preferred)
• Data warehouse: 8 years (Preferred)
• cloud integration tools: 8 years (Preferred)
• Scripting Language: 8 years (Preferred)

Work Location: On the road

gatheringourvoice.org is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, gatheringourvoice.org provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, gatheringourvoice.org is the ideal place to find your next job.