Senior Data Engineer responsible for designing, building, and optimizing Azure data pipelines and ETL/ELT processes using ADF and Databricks. Implement Spark-based Lakeflow declarative pipelines, develop PySpark and SQL transformations, and integrate agentic AI components. Offshore role requiring 5–12 years' experience and immediate to 30-day availability.
High-level requirement details:
Role: Senior Data Engineer
Skills: Azure Data Engineering (ADF, Databricks with Spark Lakeflow Declarative Pipelines, SQL, PySpark and Agentic AI)
Experience: 5–12 years
Location: Offshore
Notice Period: Preferably Immediate to ≤ 30 days
Similar Jobs
Artificial Intelligence • Big Data • Information Technology • Consulting
The Azure Data Engineer will implement big data pipelines using Azure technologies, collaborate with stakeholders, and utilize tools like Data Factory and Databricks.
Top Skills:
Azure Data FactoryAzure Data LakesDatabricksGitPower BIPythonSQLSynapse
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead business analysis for Risk Weighted Assets (RWA) and Counterparty Credit Risk (CCR) initiatives. Translate Basel III/IV and SA-CCR/IMM/EAD regulatory requirements into BRDs, FRDs, user stories, process flows and data mappings. Liaise with Market Risk, CCR, Regulatory Reporting, Finance, Quant and Technology teams to support capital calculations, RWA optimization and regulatory reporting for transformation programs.
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Senior Test Automation Engineer will develop, test, and maintain payment applications, focusing on test automation and high-quality software delivery. Responsibilities include designing test cases, building automation frameworks, executing automated tests, and contributing to continuous improvement initiatives.
Top Skills:
BddBrunoCucumberDockerFortifyGitlabInsomniaIntellijJava 17Java 8JenkinsJmeterJSONJunitKarateMavenNexusiqOctaneOracleRallyRest ApiSonarqubeSQLSwaggerTestngXML
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
