The Data Engineer II is responsible for capturing, ingesting, transforming, and integrating data to support business decisions. Responsibilities include designing and maintaining data pipelines, managing data integration processes, ensuring data accuracy, collaborating with various teams, and optimizing pipeline performance while documenting processes.
Job Title: Data Engineer II
Job Purpose:
Responsible for facilitating the capture, ingestion, transformation and integration of data that provides data assets to drive business decisions.
Job Duties & Responsibilities*:
- Collaborate with cross-functional teams to identify and implement data-driven solutions.
- Design, develop, and maintain data pipelines using Fivetran and dbt
- Implement and manage data integration processes to consolidate data from multiple sources, ensuring data accuracy and consistency.
- Implement and maintain Snowflake data warehouse.
- Work closely with our data science and analytics teams to ensure data is accurate, reliable, and accessible while maintaining proper security protocols.
- Create and maintain documentation of data pipeline processes and procedures
- Troubleshoot and optimize data pipeline performance
- Perform other duties and projects as requested
- Participate in code reviews and contribute to best practices for data engineering, develop, and maintain data pipelines.
- Perform other duties and projects as requested.
Job Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or related field
- 3+ years of experience in data engineering and integration or a related field
- Proficiency in Snowflake, dbt, SSIS, and SQL Server.
- Strong SQL skills and experience with relational databases.
- Experience with ETL/ELT processes and tools.
- Knowledge of data warehousing concepts and best practices.
- Problem-Solving: Strong analytical and problem-solving skills.
- Communication: Excellent communication and collaboration skills.
Other Job-Related Components:
- Travel: Minimal Travel
Top Skills
SQL
Similar Jobs
Healthtech • Logistics • Pharmaceutical
The Data Engineer II at Cencora is responsible for managing and analyzing data to support Legal and Compliance departments. This role includes data extraction, analysis, validating data quality, and developing analytics models. The engineer will also collaborate with various teams to improve data integrity, conduct root-cause analyses, and assist in training users on business analytics solutions.
Top Skills:
PythonRSQL
Healthtech • Logistics • Pharmaceutical
The Data Engineer II at Cencora will facilitate the enhancement of business analytics solutions, perform data mining, validate data quality, and assist in automated solutions development. Responsibilities also include collaborating across teams to prepare performance forecasts, conducting data research, and ensuring data integrity across various systems.
Top Skills:
SQLSsis
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
Top Skills:
PysparkScalaSpark
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
