iLink Digital Logo

iLink Digital

Sr. Data Engineer

Reposted 2 Days Ago
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Senior level
In-Office
Pune, Maharashtra, IND
Senior level
Design, build, and maintain scalable ETL/data pipelines using PySpark, Python, SQL and Azure Databricks. Ensure data quality and performance, troubleshoot and optimize workflows, collaborate with data scientists and product teams, and follow data governance and agile practices.
The summary above was generated by AI
We are seeking a highly skilled Senior Data Engineer with 7–8 years of experience to design, develop, and optimize data pipelines and solutions. The ideal candidate will have expertise in PySpark, SQL, and Python, with solid knowledge of Azure Databricks. A strong understanding of agile methodologies will be an added advantage.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines and ETL processes.

  • Work with large datasets to ensure high data quality, accuracy, and performance.

  • Develop data solutions leveraging Azure Databricks, PySpark, and SQL.

  • Collaborate with cross-functional teams including Data Scientists, Analysts, and Product teams to support data-driven initiatives.

  • Troubleshoot and optimize data workflows to improve reliability and efficiency.

  • Ensure compliance with best practices in data governance, security, and performance.

  • Contribute to agile ceremonies and work in a collaborative, fast-paced environment.

Required Skills & Qualifications:

  • 7–8 years of experience in Data Engineering.

  • Strong programming skills in Python and SQL.

  • Hands-on experience with PySpark for large-scale data processing.

  • Good working knowledge of Azure Databricks.

  • Strong problem-solving and debugging skills.

  • Experience in designing and optimizing ETL pipelines.

  • Knowledge of Agile methodologies (Scrum/Kanban) is a plus.

Nice to Have:

  • Familiarity with other Azure services such as Data Lake, Synapse, or Data Factory.

  • Exposure to CI/CD practices and version control systems (e.g., Git).

  • Experience working in a cloud-first data ecosystem.



iLink Digital Pune, Mahārāshtra, IND Office

5th Floor, Malpani Agile, Pancard Club Road, Baner,, Pune, India, 411045

Similar Jobs

6 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design, implement, and optimize large-scale Hadoop-based data platforms using Cloudera and related tools. Build distributed data pipelines with Spark, manage storage with Ozone/Iceberg, orchestrate workflows with Airflow/NiFi, ensure SLA compliance, drive performance tuning, conduct PoCs, and mentor engineering teams.
Top Skills: Apache AirflowApache IcebergApache NifiApache OzoneSparkClouderaHadoopJavaPythonScala
6 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design, build, and maintain scalable batch and near-real-time data pipelines and curated datasets. Enable ML-ready feature datasets, implement reliability patterns, ensure secure data handling and governance, and drive engineering best practices in collaboration with data science, platform, and BI stakeholders.
Top Skills: AWSCi/CdDatabricksDatabricks LakehouseHadoopLakehouse PatternsMlopsObject StoragePysparkPythonS3ScalaSparkSQL
4 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Design, build, and maintain large-scale data platforms and pipelines to support analytics and ML; optimize performance, ensure data quality, collaborate with data scientists, and support production deployments.

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account