Senior Data Engineer responsible for designing, building, and optimizing Azure data pipelines and ETL/ELT processes using ADF and Databricks. Implement Spark-based Lakeflow declarative pipelines, develop PySpark and SQL transformations, and integrate agentic AI components. Offshore role requiring 5–12 years' experience and immediate to 30-day availability.
High-level requirement details:
Role: Senior Data Engineer
Skills: Azure Data Engineering (ADF, Databricks with Spark Lakeflow Declarative Pipelines, SQL, PySpark and Agentic AI)
Experience: 5–12 years
Location: Offshore
Notice Period: Preferably Immediate to ≤ 30 days
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead 2–3 scrum teams comprising 12–20 people while shaping Jira Platform capabilities, technical strategy, architecture, and engineering practices. Drive AI transformation, enterprise readiness, scalability, security, reliability, and operational excellence. Mentor engineers, collaborate with principal engineers and global stakeholders, define direction amid ambiguity, and deliver strategic platform and product outcomes in a distributed SaaS environment.
Top Skills:
Agile Software DevelopmentAPIsContinuous DeliveryJira CloudSaaS
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Own the roadmap and execution of cross-cloud platform and data tooling. Lead, coach, hire, and develop engineers while establishing strong on-call and incident practices. Partner with product, customer-facing, product, and infrastructure teams to guide technical direction and deliver next-generation data platforms.
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Leads the TDP Insights and Atlassian Data Resiliency engineering team, owning people leadership, strategy, execution, reliability, and operational outcomes. The role guides telemetry, analytics, backup, restore, and recovery capabilities across multi-cloud environments; establishes technical standards, service objectives, and resiliency measures; manages incidents, costs, dependencies, and roadmaps; and partners with product, infrastructure, security, compliance, and customer-facing teams across multiple geographies.
Top Skills:
Analytical Query PlatformsBackup And Restore SystemsCloud InfrastructureData PlatformsDistributed StorageDistributed SystemsFlinkInternal Developer PlatformsKafkaMulti-Cloud Infrastructure
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
