iLink Digital Logo

iLink Digital

Sr. Data Engineer

Posted 14 Days Ago
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Senior level
In-Office
Pune, Maharashtra, IND
Senior level
Design, build, and maintain scalable ETL/data pipelines using PySpark, Python, SQL and Azure Databricks. Ensure data quality and performance, troubleshoot and optimize workflows, collaborate with data scientists and product teams, and follow data governance and agile practices.
The summary above was generated by AI
We are seeking a highly skilled Senior Data Engineer with 7–8 years of experience to design, develop, and optimize data pipelines and solutions. The ideal candidate will have expertise in PySpark, SQL, and Python, with solid knowledge of Azure Databricks. A strong understanding of agile methodologies will be an added advantage.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines and ETL processes.

  • Work with large datasets to ensure high data quality, accuracy, and performance.

  • Develop data solutions leveraging Azure Databricks, PySpark, and SQL.

  • Collaborate with cross-functional teams including Data Scientists, Analysts, and Product teams to support data-driven initiatives.

  • Troubleshoot and optimize data workflows to improve reliability and efficiency.

  • Ensure compliance with best practices in data governance, security, and performance.

  • Contribute to agile ceremonies and work in a collaborative, fast-paced environment.

Required Skills & Qualifications:

  • 7–8 years of experience in Data Engineering.

  • Strong programming skills in Python and SQL.

  • Hands-on experience with PySpark for large-scale data processing.

  • Good working knowledge of Azure Databricks.

  • Strong problem-solving and debugging skills.

  • Experience in designing and optimizing ETL pipelines.

  • Knowledge of Agile methodologies (Scrum/Kanban) is a plus.

Nice to Have:

  • Familiarity with other Azure services such as Data Lake, Synapse, or Data Factory.

  • Exposure to CI/CD practices and version control systems (e.g., Git).

  • Experience working in a cloud-first data ecosystem.



iLink Digital Pune, Mahārāshtra, IND Office

5th Floor, Malpani Agile, Pancard Club Road, Baner,, Pune, India, 411045

Similar Jobs

Yesterday
In-Office
Senior level
Senior level
Fintech • Information Technology • Financial Services
Lead design and delivery of enterprise data platform capabilities, building scalable ingestion, transformation and orchestration pipelines using Python, Airflow, Snowflake and dbt. Drive metadata, lineage, data quality, observability, and Agentic AI integrations; support production L2/L3 operations, CI/CD deployments, POCs, cross-functional integration, and mentor engineering teams within an Agile framework.
Top Skills: AntigravityApache AirflowApache IcebergAWSAzureCi/CdCursorDbtDockerGCPGitKafkaKubernetesModel Context Protocol (Mcp)PythonRagSnowflakeSnowpipeSQLVector DatabasesWindsurf
8 Days Ago
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design and implement AI-driven data platforms and pipelines. Build GenAI/LLM workflows and agentic systems, develop production Python/PySpark applications and APIs, optimize Databricks and Snowflake analytics, architect AWS Glue ETL, and apply DBA fundamentals across relational and NoSQL stores.
Top Skills: Amazon RdsAws BedrockAws GlueAws LambdaAws SagemakerCi/CdDatabricksEmbeddingsFastapiFlaskGenaiLlmsMongodb AtlasMySQLPostgresPysparkPythonRagRest ApisSnowflakeTerraformVector Databases
6 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Lead design and hands-on implementation of scalable cloud microservices and platform solutions. Mentor engineers, drive architecture decisions (DDD, clean/hexagonal), ensure non-functional requirements, document designs, and collaborate across teams to deliver reliable RESTful services used by customers.
Top Skills: AgileAWSClean ArchitectureDomain Driven DesignGCPHexagonal ArchitectureJavaJSONJwtKubernetesMicroservicesExcelMicrosoft OutlookMicrosoft WordRestful ApisService-Oriented ArchitectureSpring BootSpring Framework

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account