Lead data engineering work: design, build, and troubleshoot ETL/data pipelines using Python and Airflow. Implement CI/CD and version control, optimize SQL in data warehouses (Snowflake preferred), apply DBT tests and automated testing, generate code via templates, and manage AWS data infrastructure (S3, ECS, IAM). Client-facing, hands-on individual contributor role.
Job Description Job Descriptions Data Engineer Must have below: 10+ Years Experience Great Communicator/Client Facing/ Attention to detail Individual Contributor and ability to work as a team. 100% Hands on in the mentioned skills Programming Skills: Python and Data Pipelines: Advanced Proficiency in Python concepts like Code Structures, Modules, Packages, Class, SubClass, Inheritance, Multi-Threading and Functional Programming. Experience in developing reusable Python packages for internal or public usage Ability to write automating ETL processes and scheduling jobs like Airflow DAG. Ability to track job pipeline runs to reprocess error records Ability to orchestration different pipelines to run in sequence or parallel. Troubleshoot data pipeline errors and fix issues Export or Import data to/from various formats like CSV, JSON, XML etc preferably from S3 or other cloud storage. Experience in using AI IDE tool SQL: Advanced SQL skills, including complex joins, CTE's and subqueries Experience in optimizing SQL queries for performance and optimization in data warehouse technologies preferably Snowflake Testing and documentation: Proficiency in Python unit, integration and system test. Proficiency in implementing DBT tests for data validation and quality checks Code Generation: Experience in generating code using configurations using python and jinja templates Version control: Experience in GitHub, including implementing CI/CD process from scratch AWS Expertise: Data Storage solutions: In depth understanding of AWS S3 for data storage, ECS, IAM including best practices for organization and security
Hexaware Technologies Pune, Mahārāshtra, IND Office
North Block, Plot No. 19, Rajiv Gandhi InfoTech Park, MIDC - SEZ, Phase 3, Hinjawadi, Pune, Maharastra, India, 411057
Similar Jobs
Information Technology • Consulting
Lead technical design and implementation of data-centric solutions: build high-performance ELT/ETL pipelines, author optimized production SQL (stored procedures, UDFs), tune queries, implement data models (star/snowflake), enforce data quality, lineage and metadata practices, and guide MDM and governance adoption.
Top Skills:
EltETLJSONRbacReltioSnowflakeSnowflake SchemaSQLSql UdfsStar SchemaStored ProceduresXML
Information Technology • Consulting
Lead development of Python applications that process large-scale data, write and tune complex SQL, profile and optimize performance, deploy containerized apps, build unit tests, and work with data frameworks and Snowflake datasets.
Top Skills:
Apache AirflowDockerKubernetesPandasPydanticPytestPythonSnowflakeSQL
Information Technology • Consulting
Design, develop, and maintain enterprise Power BI dashboards, semantic models, and optimized DAX/Power Query solutions. Collaborate with stakeholders and data engineers, validate data from Fabric/Azure platforms, ensure data quality and governance, and support requirements, UAT, and deployments.
Top Skills:
AzureAzure Data FactoryAzure SynapseDaxEtl/EltMicrosoft FabricPower BIPower QuerySQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
