The Data Engineer will design and maintain data pipelines, optimize workflows, ensure data quality, and implement CI/CD practices using AWS and other tools.
We are looking for an experienced Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have strong hands-on experience with cloud-based data platforms, big data processing, and analytics engineering best practices.
RequirementsKey Responsibilities
- Design, develop, and maintain scalable data pipelines using AWS EMR, PySpark, and Python
- Work closely with analytics and business teams to build reliable and high-performance data models
- Optimize data processing workflows for performance, reliability, and cost
- Ensure data quality, integrity, and consistency across data platforms
- Implement CI/CD practices for data pipelines using modern DevOps tools
- Collaborate using version control and follow best engineering practices
- Strong experience with AWS (especially EMR)
- Hands-on experience in Python and PySpark
- Strong SQL and analytical skills
- Experience with data pipeline orchestration and tooling
- Working knowledge of GitHub for version control
- Experience with Jenkins or similar CI/CD tools
- Familiarity with dbt
- Experience with Terraform or other Infrastructure-as-Code tools
- Deeper hands-on expertise with dbt
- Exposure to cloud cost optimization and data governance
- Experience working in Agile environments
- Strong communication and stakeholder collaboration skills
BenefitsWhat We Offer
- Opportunity to work on large-scale, modern data platforms
- Collaborative and engineering-driven culture
- Competitive compensation and benefits
Top Skills
Aws Emr
Dbt
Git
Jenkins
Pyspark
Python
SQL
Terraform
Similar Jobs
Artificial Intelligence • Productivity • Software • Automation
Lead and develop a team of backend engineers for Integration Quality at Zapier, focusing on reliability, security, and cross-functional collaboration to improve product outcomes.
Top Skills:
Node.jsTypescript
Cloud • Information Technology • Productivity • Software • Automation
As a Principal Engineer, you will develop software solutions, guide teams through the software lifecycle, resolve customer issues, mentor engineers, and own features from gathering requirements to deployment.
Top Skills:
AWSConfluenceDevops ToolsGraphQLJavaJIRAMySQLNoSQLPostgresRestRpcSoapWsdl
Artificial Intelligence • Consumer Web • Edtech • HR Tech • Information Technology • Software • Conversational AI
Negotiate and manage customer contracts, draft legal documents, ensure compliance, and collaborate with internal and external teams on contract terms.
Top Skills:
PeoplesoftSalesforceWord
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
