Lead modernization of a large-scale AWS data platform: design, build, and optimize scalable ETL/ELT pipelines, migrate Airflow/EMR to AWS-native services (Glue, MWAA), implement data lake/warehouse solutions, enforce data governance/lineage/metadata, build data quality and monitoring frameworks, automate deployments with IaC, and support BI (QuickSight) and Power BI migration, UAT, and production support.
About us:
Working at Tech Holding isn't just a job, it's an opportunity to be a part of something bigger. We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-quality solutions to our clients. Our founders and team members have industry experience and have held senior positions in a wide variety of companies – from emerging startups to large Fortune 50 firms – and we have taken our combined experiences and developed a unique approach that is supported by the principles of deep expertise, integrity, transparency, and dependability.
About the Role
We are looking for a Senior AWS Data Engineer to join our team and lead the modernization of a large-scale cloud data platform. You will be responsible for designing, building, and optimizing scalable data pipelines, modernizing ETL/ELT workloads, implementing data governance, and enabling analytics and reporting solutions on AWS.
The ideal candidate has deep expertise in AWS data services, data engineering, pipeline orchestration, and data warehouse modernization, with a passion for building reliable, secure, and scalable data platforms.
Location: Remote
Experience Required: 5+ Years
Employment Type: Contract
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on AWS.
- Modernize legacy data platforms by migrating Apache Airflow/MWAA workloads to AWS-native orchestration services.
- Migrate and optimize Amazon EMR workloads to AWS Glue.
- Design and implement scalable data lake and data warehouse solutions using AWS services.
- Develop robust data models, semantic layers, and standardized KPI definitions to support business analytics.
- Build and maintain data quality, validation, anomaly detection, and monitoring frameworks.
- Implement metadata management, data lineage, and data governance best practices.
- Develop automated deployment pipelines and infrastructure using Infrastructure as Code (IaC).
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Collaborate with business stakeholders to understand reporting requirements and translate them into scalable data solutions.
- Support QuickSight semantic datasets, dashboard optimization, and Power BI migration initiatives.
- Participate in UAT, production deployments, knowledge transfer, and post-production support.
Required Skills & Qualifications
• 5+ years of experience in Data Engineering.
• Strong programming skills in Python and SQL.
• Hands-on experience with Apache Spark / PySpark.
• Extensive experience with AWS data services including:
- AWS Glue
- Amazon S3
- Amazon Redshift
- Amazon Athena
- AWS Lambda
- AWS Step Functions
- Amazon EventBridge
- AWS IAM
• Experience designing and implementing ETL/ELT pipelines.
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
- Experience with Power BI migration projects.
- Experience working with Healthcare or Life Sciences data platforms.
- Knowledge of Lake Formation, AWS Glue Data Catalog, and AWS security best practices.
- Familiarity with ML-ready data pipelines and feature engineering.
- AWS Certification (Data Engineer, Solutions Architect, or Developer) is a plus.
Tech Holding is proud to be an Equal Opportunity Employer and is committed to fostering a diverse and inclusive workplace. We welcome applicants from all backgrounds and experiences, and we consider qualified applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected characteristic. If you require accommodation in the application process, please contact our HR
Tech Holding Pune, Mahārāshtra, IND Office
91Springboard, SBC, Bangalore-Mumbai highway, Baner, Pune, Maharashtra , India, 411045
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead end-to-end delivery of Treasury and Collateral product initiatives, managing project plans, risks, IT integrations, Agile execution, cross-functional working groups, NFR/control frameworks, stakeholder communications, and senior-management reporting.
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Design and develop test automation tools and frameworks for automotive electronics. Implement SiL/HIL automation and virtual validation, write C++ code, leverage CANoe/CANalyzer, work with vehicle and embedded protocols and interfaces, and ensure compliance with AUTOSAR, ASPICE, ISO 26262 and cybersecurity standards. Support CI/CD and cloud-based vehicle testing as needed.
Top Skills:
(E)SataAspiceAuto EthernetAutosarAWSC++CanCanalyzerCanoeCaplCarlaCarmakerCybersecurity StandardsGithub ActionsHardware-In-The-LoopHilI2CIso 26262JenkinsPciePythonRs232SilSoftware-In-The-LoopSpiTcpUartUsb
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Lead end-to-end financial management for the Sricity CAPEX program: CAPEX planning, procurement controls, cash and payables, fixed asset lifecycle (CWIP, capitalization, depreciation), contract financial review, and audit readiness. Partner with site, engineering, procurement, cash COE, legal and regional finance to ensure disciplined spend, vendor controls, and capitalization aligned to project milestones.
Top Skills:
DashboardingExcelSAP
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
