Maintains, cleans, manipulates, and secures operational and analytics databases. Designs scalable data pipeline architecture, builds complex data sets and analytics tools, automates manual processes, improves infrastructure, troubleshoots database issues, and supports software engineering, data science, analytics, product, design, and executive stakeholders.
Looking for a hands‑on Senior Data Engineer – AWS with experience to development, build, and maintain scalable, secure, and high‑performance data platforms on AWS.
This is an individual contributor role focused on data pipeline development, cloud data engineering, and analytics enablement. The role requires strong hands‑on skills in AWS data services, SQL, and Python, along with experience building reliable batch and streaming data pipelines in a global delivery environment.
This is an individual contributor role focused on data pipeline development, cloud data engineering, and analytics enablement. The role requires strong hands‑on skills in AWS data services, SQL, and Python, along with experience building reliable batch and streaming data pipelines in a global delivery environment.
Job Description:
Min 3 and max upto 5.
Must Have
'Cloud & Data Engineering (AWS)
Must Have
'Cloud & Data Engineering (AWS)
Strong hands‑on experience with AWS data services, including:
- Amazon S3
- AWS Glue
- Amazon Athena
- Amazon Redshift
- Amazon EMR
Experience designing cloud‑native data lakes and data warehouse architectures
Solid understanding of batch data pipelines and basic exposure to streaming concepts
SQL & Python (Mandatory)
Strong SQL skills (mandatory)
Writing complex queries, joins, aggregations, and transformations
Experience working with large datasets in Redshift / Athena
Strong Python skills (mandatory)
Python for data engineering and ETL use cases
Experience with PySpark / Spark is a strong plus
Good understanding of data modeling, transformations, and performance tuning
Data Processing & Engineering
Hands‑on experience with distributed data processing frameworks (Spark / PySpark)
Experience handling structured and semi‑structured data
Understanding of schema evolution, data quality checks, and validation logic
DevOps & Platform Basics
Working knowledge of Infrastructure as Code (Terraform and/or CloudFormation)
Basic experience with CI/CD pipelines for data workloads
Understanding of logging and monitoring using CloudWatch
Collaboration
Ability to work closely with architects, DevOps, QA, and business stakeholders
Good communication skills to explain technical concepts clearly
Good to Have
Key Responsibilities
Exposure to streaming technologies such as Amazon Kinesis or Kafka
Familiarity with Lakehouse and modern data platform patterns
Experience integrating AWS data platforms with BI / reporting tools
Basic knowledge of data governance, data quality, and metadata concepts
Awareness of AWS cost optimization best practices
Experience working in Agile delivery models, with global clients
Exposure to AI / ML
Key Responsibilities
Data Engineering & Development
Design and build scalable ETL / ELT pipelines on AWS
Develop SQL‑based data transformations and Python‑based data pipelines
Implement data ingestion pipelines using AWS services such as S3, Glue, EMR
Build data models optimized for analytics, performance, and cost efficiency
Platform & Operations
Support deployment and execution of data pipelines across environments
Monitor pipeline performance, reliability, and data quality
Troubleshoot data pipeline issues and perform root‑cause analysis
Apply best practices for security, reliability, and scalability
Collaboration & Delivery
Work closely with architects and product teams to understand requirements
Translate business and analytics needs into working AWS data solutions
Contribute to documentation, code reviews, and engineering standards
Location:
DGS India - Pune - Indiqube OrchidBrand:
MerkleTime Type:
Full timeContract Type:
PermanentSimilar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and build data services and pipelines supporting machine learning products. Develop automation tools for model deployment, maintain production data systems, improve infrastructure, participate in code reviews, and collaborate across engineering, data science, and product teams. The role requires expertise in distributed systems, large-scale data processing, CI/CD, container orchestration, and AI-enabled workflow improvements.
Top Skills:
AirflowAWSAws BatchCi/CdDockerEmrGlueGoKafkaKubernetesKv StoresLinuxPythonRelational DatabasesSagemakerSparkSpinnaker
Software
Design, optimize, and productionize scalable ETL/ELT pipelines using Databricks, PySpark, SQL, GCP, BigQuery, and Delta Lake. Build agentic workflows for data validation, troubleshooting, automation, and workflow execution. Develop reusable frameworks, implement data quality and monitoring controls, optimize workloads, support deployment and production operations, and collaborate with business, engineering, and platform teams.
Top Skills:
Agentic WorkflowsAi AgentsBigQueryData PipelinesData Quality MonitoringDatabricksDelta LakeDeploymentEltETLGoogle Cloud Platform (Gcp)Lakehouse ArchitectureOrchestration FrameworksPysparkSQLVersion Control
Artificial Intelligence • Fintech • Machine Learning • Natural Language Processing • Business Intelligence
Build and own the analytics data layer for AI governance, including data models, transformation pipelines, quality checks, lineage, reconciliations, metrics, control monitoring, and executive reporting. Ensure governance data is accurate, traceable, reproducible, and audit-ready. Partner with security, data, procurement, and governance teams to reconcile conflicting systems, support AI risk quantification, and provide defensible reporting for auditors, executives, the CISO, and the board.
Top Skills:
BigQueryCi/CdData WarehousingDatabricksDbtDimensional ModelingEtl/EltGitGithub ActionsLookerPandasPower BIPythonRedshiftSnowflakeSQLTableau
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
