Top Data Engineer Jobs in Pune

7 Days AgoSaved
Hybrid
Pune, MH
Entry level
Entry level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Build and support enterprise production data pipelines using Python, PySpark, Spark SQL, Databricks, Azure, ADLS, Delta Lake, and lakehouse architecture. Responsibilities include batch processing, ETL development, REST API integration, CI/CD, Terraform/IaC, and Spark performance optimization through partitioning, caching, distributed processing, and exception handling.
Top Skills: AdlsSparkAzureCi/CdDatabricksDelta LakeETLInfrastructure As CodeLakehouse ArchitecturePysparkPythonRest ApiSpark SqlTerraform
12 Days AgoSaved
Hybrid
Pune, MH
Junior
Junior
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Develop and maintain Azure Databricks data pipelines using PySpark, Spark SQL, SQL, and Delta Lake. Support Informatica-to-Databricks modernization and HR data integrations, build source-to-target mappings and dimensional models, perform profiling, testing, reconciliation, and defect resolution, and create technical documentation. Apply data governance and access controls through Unity Catalog, participate in agile ceremonies and code reviews, and escalate risks while working under senior direction.
Top Skills: SparkAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure SqlAzure SynapseCi/CdDelta LakeGitGithub CopilotInformaticaMicrosoft PurviewOracle Hcm CloudPysparkPythonSpark SqlSQLUnity Catalog
20 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Designs, develops, supports, and optimizes scalable data pipelines and distributed processing workloads. Writes production-grade Python, PySpark, and SQL; tunes Spark and SQL performance; troubleshoots Linux and AWS infrastructure; improves monitoring, reliability, security, and cost efficiency; performs root cause analysis; and collaborates with engineering, product, architecture, and operations teams. The role also supports AI-enabled data workflows using LLMs, Amazon Bedrock, Agentic AI, and MCP.
Top Skills: Agentic AiAmazon AthenaAmazon BedrockAmazon EmrAmazon S3Amazon SagemakerSparkAWSAws GlueCi/CdHadoopLarge Language ModelsLinuxModel Context ProtocolPysparkPythonSQL
Reposted 11 Hours AgoSaved
In-Office
Pune, MH
Senior level
Senior level
Software
Design, develop, optimize, and productionize scalable ETL/ELT pipelines and agentic data engineering workflows using Databricks, PySpark, SQL, GCP, BigQuery, and Delta Lake. Implement data quality checks, monitoring, validation, exception handling, testing, deployment, troubleshooting, and performance optimization while collaborating with business, engineering, and platform teams.
Top Skills: BigQueryDatabricksDelta LakeEltETLGCPLakehouse ArchitecturePysparkSQL
YesterdaySaved
In-Office
Pune, MH
Entry level
Entry level
Fintech • Financial Services
Build and maintain enterprise data architectures, ETL pipelines, data warehouses, and data lakes. Develop scalable processing and analysis algorithms, integrate enterprise data sources, ensure data quality and security, and collaborate with data scientists on machine learning deployments. The role also involves risk management, stakeholder influence, complex analysis, policy support, and potentially leading or coaching team members within Barclays’ Markets Post Trade Technology division.
Top Skills: Api IntegrationAWSData Catalogue QueryingData LakesData ModellingData PipelinesData Quality FrameworksData WarehousesDistributed SystemsETLSQL
Reposted YesterdaySaved
Hybrid
Pune, MH
Mid level
Mid level
Hardware • Software
Designs and develops scalable data management solutions, including data acquisition, integration, transformation pipelines, data structures, and cloud or edge infrastructure. Uses Azure Data Factory, ADLS, Databricks, SAP Data Services, DevOps pipelines, and containerization. Collaborates with analysts, architects, product owners, and technical leads to define requirements, deliver high-quality code, and support application enhancements.
Top Skills: AgileAzure Data FactoryAzure Data Lake StorageCi/CdContainerizationDatabricksDevOpsGitlabJenkinsAzureSap Data ServicesSQLTabular Models
7 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Develop and support enterprise production data pipelines using Python, PySpark, Spark SQL, Databricks, Azure, ADLS, Delta Lake, and lakehouse architecture. Responsibilities include batch processing, ETL development, REST API integration, CI/CD, Terraform-based infrastructure, and Spark performance optimization through partitioning, caching, distributed processing, and exception handling.
Top Skills: AdlsSparkCi/CdDatabricksDelta LakeETLInfrastructure As CodeLakehouse ArchitectureAzurePysparkPythonRest ApiSpark SqlTerraform
Reposted 2 Days AgoSaved
In-Office
Pune, MH
Entry level
Entry level
Fintech • Financial Services
Designs, builds, and supports scalable AWS data platforms, data lakes, warehouses, and production-grade batch and event-driven pipelines. Develops SQL, Python, and PySpark transformations; creates governed, reusable data products; and implements orchestration, monitoring, quality, lineage, security, and audit controls. Collaborates with architects, analysts, platform teams, and governance stakeholders while optimizing performance, reliability, scalability, and cost. Investigates production issues and delivers sustainable fixes.
Top Skills: Amazon CloudwatchAmazon DynamodbAmazon EmrAmazon KinesisAmazon RedshiftApache AirflowSparkAstronomerAWSAws AthenaAws CloudformationAws Ec2Aws GlueAws IamAws Lake FormationAws LambdaAws S3Aws Step FunctionsCi/CdDatabricksDelta LakeGitPysparkPythonSQLTerraform
2 Days AgoSaved
In-Office
Pune, MH
Expert/Leader
Expert/Leader
Fintech • Financial Services
Lead the design and delivery of secure, scalable cloud and data platforms. Build data pipelines, warehouses, lakes, transformation and integration solutions using AWS and Python. Drive infrastructure modernization, containerized deployments, DevOps, CI/CD, Infrastructure as Code, resilience, and operational excellence. Translate architecture into reusable engineering patterns, guide technical direction, collaborate with architecture and engineering teams, manage risk and governance, and mentor specialists. Experience with AWS analytics services, Databricks, dbt, Airflow, Iceberg, Kubernetes, and regulated environments is valued.
Top Skills: Amazon AthenaAmazon EksAmazon S3Apache AirflowApache IcebergAstronomerAWSAws GlueAws LambdaCi/CdDatabricksDbtDockerGenerative AiInfrastructure As CodeKubernetesMachine LearningNosql DatabasesPythonRelational Databases
12 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and deploys scalable Azure Databricks data pipelines using PySpark, Spark SQL, and Delta Lake across medallion layers. Builds HR data models, source-to-target mappings, reconciliation controls, governance, lineage, documentation, and data quality processes. Modernizes legacy Informatica and SQL integrations, including Oracle HCM feeds. Collaborates with distributed agile teams, mentors junior engineers, and supports production cutovers for sensitive employee data.
Top Skills: Ai/Copilot ToolingSparkAzure Data FactoryAzure Data Lake StorageAzure DevopsAzure SqlAzure SynapseCi/CdCrunchrDatabricksDelta LakeGitInformaticaOracle Hcm CloudPower BIPysparkSpark SqlSQLUnity Catalog
8 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Artificial Intelligence • Cloud • Fintech • Information Technology • Analytics • Financial Services • Cybersecurity
Designs and develops data engineering solutions supporting trading and brokerage applications. Responsibilities include building data warehouses, data marts, ETL/ELT pipelines, schemas, and cloud-based data architectures; optimizing SQL; developing Python components; supporting Snowflake or Databricks platforms; orchestrating batch workflows; and contributing to platform transformation. The role provides technical leadership, consulting, code quality oversight, and cross-functional delivery within an Agile environment.
Top Skills: AWSAzureControl-MData LakehouseData LakesData WarehousingDatabricksEtl/EltGCPMedallion ArchitecturePower BIPythonRdbmsSnowflakeSQLTableau
14 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs, builds, and maintains scalable batch and real-time data pipelines across Azure and on-premises environments. Develops data lakes, warehouses, marts, and Medallion architectures using Spark and modern big data technologies. Ensures pipeline reliability, performance, security, governance, privacy, and data quality while collaborating with business, technology, analytics, DevOps, and data governance teams. Supports platform modernization and continuous improvement.
Top Skills: Apache NifiSparkAzureAzure Data FactoryAzure DevopsAzure Event HubAzure FunctionsAzure Synapse AnalyticsCi/CdCosmos DbDatabricksEltETLGenerative AiGitHadoopHbaseHiveMongoDBPythonScalaSQLUnix Shell Scripting
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
14 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and delivers scalable data engineering solutions across Azure and on-premises environments. Builds batch and real-time ETL/ELT pipelines, data lakes, warehouses, marts, and streaming platforms using Spark and related Big Data technologies. Leads architecture, technical design, optimization, governance, and end-to-end implementation while ensuring quality, security, reliability, and performance. Collaborates with cross-functional stakeholders, mentors data engineers, and communicates technical recommendations to business and technology audiences.
Top Skills: Apache NifiSparkAzureAzure Data FactoryAzure DatabricksAzure DevopsAzure Event HubsAzure FunctionsAzure Synapse AnalyticsCi/CdCosmos DbData LakesData MartsData WarehousesEltETLGitHadoopHbaseHiveKafkaMedallion ArchitectureMongoDBNoSQLPythonScalaSQLUnix Shell Scripting
14 Days AgoSaved
Hybrid
Pune, MH
Expert/Leader
Expert/Leader
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Leads the design, development, and maintenance of enterprise-scale batch and real-time data pipelines across Azure and on-premises environments. Builds scalable ingestion and processing frameworks, optimizes reliability and performance, and ensures data quality, governance, security, and compliance. Provides solution architecture, technical leadership, stakeholder collaboration, mentoring, and engineering standards adoption across complex programs.
Top Skills: Apache NifiSparkAzureAzure Data FactoryAzure DatabricksAzure DevopsAzure Event HubsAzure FunctionsAzure Synapse AnalyticsCosmos DbGenerative AiGitHadoopHbaseHiveKappa ArchitectureLambda ArchitectureMedallion ArchitectureMongoDBPythonScalaSpark StreamingSQLUnix/Linux
3 Hours AgoSaved
In-Office or Remote
Pune, MH
Entry level
Entry level
Information Technology
Design, build, and maintain scalable data pipelines, ETL/ELT workflows, data warehouses, lakes, and lakehouse platforms. Integrate structured and unstructured data, support batch and real-time processing, and ensure data quality, governance, security, and compliance. Monitor and troubleshoot production pipelines, optimize performance, and collaborate with data scientists, BI developers, product owners, and business stakeholders. Required technologies include SQL, Python, cloud platforms, big data frameworks, streaming tools, and orchestration systems.
Top Skills: Amazon EmrAmazon RedshiftAmazon S3Apache AirflowApache KafkaSparkAWSAws GlueAzure Data FactoryAzure Data Lake StorageAzure DevopsAzure Synapse AnalyticsBigQueryCi/CdData LakesData WarehousingDatabricksDataflowEltETLGitGoogle Cloud PlatformHadoopJenkinsLakehouse ArchitectureAzureMicrosoft FabricMongoDBMySQLOraclePostgresPysparkPythonScalaSpark StreamingSQLSQL ServerTerraform
Reposted YesterdaySaved
Remote
Pune, MH
Junior
Junior
Software
Build and support scalable batch and streaming data pipelines, cloud-native data platforms, data lakes, warehouses, and real-time processing systems. Own data initiatives from solution design through deployment, monitoring, performance tuning, and production support. Develop ETL/ELT pipelines, data models, and integration frameworks while collaborating with product, analytics, platform, and DevOps teams. Troubleshoot production issues, improve reliability, and contribute to documentation and engineering best practices.
Top Skills: Amazon RedshiftAmazon S3Apache HiveApache IcebergApache KafkaSparkBigQueryClickhouseDockerGitlab Ci/CdJIRAKubernetesLanggraphMlopsMongoDBMySQLOraclePymongoPysparkPythonSnowflakeSQLSqlalchemyTrino
16 Days AgoSaved
Hybrid
Pune, MH
Entry level
Entry level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, develop, and optimize scalable big data applications and ETL/ELT pipelines using Scala, Apache Spark, and distributed data technologies. Build reusable processing frameworks, tune Spark jobs, troubleshoot production issues, implement data-quality monitoring, and collaborate with technical and business teams. Apply software engineering practices including testing, code reviews, Git, and CI/CD while working with Hadoop, HDFS, Hive, Kafka, and Spark SQL.
Top Skills: AirflowSparkAvroAWSAzureCi/CdDatabricksDelta LakeDockerGCPGitHadoopHdfsHiveJSONKafkaKubernetesParquetScalaSpark SqlSQL
2 Days AgoSaved
Remote
Pune, MH
Mid level
Mid level
Blockchain • Fintech • Financial Services • Cryptocurrency • Web3
Build and maintain scalable data pipelines, ETL processes, reconciliation systems, monitoring, alerting, and blockchain reporting infrastructure. Integrate external data sources, ensure data quality and auditability, and optimize systems for near-real-time processing. Collaborate with engineers, analysts, data scientists, product managers, and security teams while supporting testing, debugging, compliance, and on-call operations.
Top Skills: AirflowSparkBigQueryCi/CdConfluenceDbtGitGitJIRAKafkaMySQLPostgresPythonSnowflakeSQL
2 Days AgoSaved
In-Office or Remote
Pune, MH
Expert/Leader
Expert/Leader
Information Technology
Designs and manages scalable data platforms, pipelines, ETL/ELT frameworks, data warehouses, data lakes, and lakehouse architectures. Develops batch and real-time processing solutions using cloud-native services and big data technologies. Ensures data quality, governance, security, and compliance while optimizing large-scale data performance. Supports analytics, reporting, and AI/ML initiatives, contributes to architecture reviews, automates deployments through CI/CD, provides technical leadership, and mentors junior engineers.
Top Skills: Amazon EmrAmazon RedshiftAmazon S3Apache KafkaSparkAws GlueAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure Sql DatabaseAzure Synapse AnalyticsCi/CdDelta LakeGitGoogle BigqueryGoogle Cloud StorageGoogle DataflowHadoopJenkinsAzureMicrosoft FabricMySQLOraclePostgresPysparkPythonScalaShell ScriptingSnowflakeSQLSQL Server
3 Days AgoSaved
In-Office or Remote
Pune, MH
Entry level
Entry level
Information Technology
Develop and support batch and incremental data pipelines, ETL workflows, SQL transformations, and Airflow orchestration. Investigate data quality issues, perform lineage and reconciliation analysis, support cloud data migrations, validate datasets, resolve production incidents, and build reusable data engineering components. Collaborate with stakeholders and technical teams on data requirements, modernization, monitoring, and process improvements.
Top Skills: Apache AirflowBigQueryCloud ComposerGoogle Cloud PlatformGoogle Cloud StorageKafkaPl/SqlPub/SubPythonSQL
12 Days AgoSaved
In-Office
Pune, MH
Senior level
Senior level
Artificial Intelligence • Consulting
Develop and maintain batch and streaming data pipelines on Google Cloud. Build complex data transformations, orchestrate ETL workflows, perform data migrations, and maintain data warehouses and data lakes. The role requires expertise in BigQuery, Composer, GCS, Cloud SQL, Dataflow, Dataproc, IAM, Python, SQL, and PySpark, along with strong database, data modeling, communication, and problem-solving skills.
Top Skills: A2AAdkApache AirflowBigQueryClaude CodeCloud ComposerCloud SqlCodexConversational AiData FusionDataflowDataprocDatastreamDbtGemini Code AssistGithub CopilotGoogle Cloud PlatformGoogle Cloud StorageIamPysparkPythonSQL
Reposted 20 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead design and build cloud-native batch and real-time data platforms. Develop scalable ETL/ELT and streaming pipelines (Spark, Kafka, Flink), ensure data quality, governance, observability, security, cost optimization, and drive platform engineering excellence and team mentorship.
Top Skills: AdlsAirflowApache FlinkApache Spark (CoreArm TemplatesAvroAWSAzureBigQueryCloudFormationDatabricksDockerDynatraceEmrGatlingGCPGcsGdprGithub ActionsGoIamJava (Jdk 8+)JenkinsJmeterJunitKafkaKubernetesOrcParquetPci DssPrometheusPythonRedshiftS3SnowflakeSpark StreamingSplunkSQLSQLStructured Streaming)Terraform
One Month AgoSaved
Hybrid
Pune, MH
Expert/Leader
Expert/Leader
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Leads enterprise data quality strategy, architecture, platforms, frameworks, observability, governance, and automation. Designs reusable quality capabilities for batch, streaming, cloud, on-premises, and SaaS environments; establishes rules, metrics, alerts, and remediation workflows; integrates quality with metadata, lineage, catalogs, MDM, and data contracts; mentors engineering teams; evaluates tools; and applies AI and machine learning to anomaly detection, root-cause analysis, and trusted AI-ready data platforms.
Top Skills: SparkCi/CdCloud Data PlatformsData ContractsData GovernanceData LineageData ObservabilityData WarehousingGenerative AiLakehouse ArchitecturesMachine LearningMaster Data ManagementMetadata ManagementPysparkPythonSQLStreaming Technologies
16 Days AgoSaved
Hybrid
Pune, MH
Senior level
Senior level
Software • Business Intelligence
Build and operate Databricks data pipelines for Onit’s customer-facing benchmarking platform. Responsibilities include integrating and modeling multi-source data, resolving duplicate records, implementing data quality checks, orchestrating reliable workflows, optimizing Spark performance and costs, and applying governance, privacy, and multi-tenant isolation. The role collaborates with architects, data scientists, product, and engineering teams to productionize analytics and expose trustworthy curated data.
Top Skills: Auto LoaderAWSCi/CdClaudeDatabricksDatabricks AssistantDatabricks JobsDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotPysparkPythonSpark SqlSQLStructured StreamingUnity Catalog
Reposted 9 Days AgoSaved
Remote
Pune, MH
Junior
Junior
Other
Maintain Python-based web scraping configurations, monitor errors and data blockages, coordinate scraping requirements with stakeholders, and report on scraping activities. Build and optimize pipelines for data lake ingestion and transformation using ETL, data modeling, cloud, database, and infrastructure tools. Collaborate with data scientists and analysts while ensuring data security, compliance, testing, and maintainability.
Top Skills: AirflowAzureData LakesData WarehousingDbtETLGitNoSQLPythonSQLTerraform
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account