M&G Logo

M&G

Senior Engineer - Data

Posted Yesterday
Be an Early Applicant
In-Office
Pune, Mahārāshtra, IND
Senior level
In-Office
Pune, Mahārāshtra, IND
Senior level
Build and operationalize Azure-based data engineering solutions using Data Factory, Databricks, Data Lake, Azure SQL, and PySpark. Responsibilities include data migration, ingestion and transformation, Lakehouse and data warehouse implementation, pipeline performance tuning, Python APIs, CI/CD, Power BI support, security controls, SDLC participation, stakeholder collaboration, and knowledge sharing.
The summary above was generated by AI

About M&G India


We are M&G India, the strategic innovation and digital hub for M&G. Established in 2003, we have offices in Mumbai and Pune.


Our teams work closely with colleagues across the Group worldwide to drive transformation, build digital capability, and support sustainable growth. By leveraging technology, AI, automation, and process excellence, we bring new ways of thinking to improve outcomes for both customers and colleagues.


Grounded in a vibrant culture with strong foundations, we are central to how M&G is transforming as a business.

 

About M&G


Our purpose is to give everyone real confidence to put their money to work. With a heritage dating back more than 175 years, we have a long history of innovation in savings and investments, combining asset management and insurance expertise to offer a wide range of solutions.


Our two distinct operating segments, Asset Management and Life, work together to provide access to balanced, long-term investment and savings solutions.


Through telling it like it is, owning it now, and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent.


At M&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a range of financial products and services through Asset Management, Life and Wealth. All three operating segments work together to deliver attractive financial outcomes for our clients, and superior shareholder returns.
Through our behaviours of telling it like it is, owning it now, and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent.

We are looking to expand the in-house expertise in Data Technology and we need talented and skilled colleagues to implement data engineering solutions using latest technologies available in Azure Cloud space conforming to the best in class design standard & agreed requirements

Accountabilities/Responsibilities

  • Build and operationalize data solutions for business using Azure services in combination with custom solutions – Azure Data Factory, Azure Data Flows, Azure Databricks, Azure Data Lake Gen 2, Azure SQL etc
  • Experience in migrating on-premise data warehouses to data platforms on AZURE cloud
  • Designing and implementing data engineering, ingestion and transformation functions using ADF, Databricks
  • Proficient in Py-Spark
  • Experience in building Python based APIs on Azure Function Apps
  • Experience on Azure Logic apps
  • Experience in Lakehouse/Datawarehouse implementation using modern data platform architecture
  • Capacity Planning and Performance Tuning on ADF & Databricks pipelines
  • Support data visualization development using Power BI
  • Exposure across all the SDLC process, including testing and deployment
  • Experience in relational and dimensional modelling, including big data technologies
  • Experience in Azure DevOps – Build CI/CD pipelines for ADF, ADLS, Databricks, Azure SQL  DB etc
  • Experience of working in secured Azure environments using Azure KeyVaults, Service Principals, and Managed Identities
  • Understanding of data masking, encryption and other practices used in handling sensitive data
  • Ability to interact with Business for requirement gathering and query resolutions
  • Working on off shore office based development teams, collaborating within a team environment and participating in typical project lifecycle activities such as requirement analysis, testing and release
  • Develop Azure Data skills within the team through knowledge sharing sessions, articles, etc.
  • Adherence to organisations Risk & Controls requirements
  • Participate in various initiatives/forums/groups and contribute effectively from idea creation to proto-type development. Support Strategic programs
  • Good to have knowledge on Apigee (Googles API Management)

Key Stakeholder Management

Internal

Business Teams

Project Manager

Tech Lead

Data Scientists

External

Knowledge, Skills, Experience & Educational Qualification

Knowledge & Skills:

  • Azure Data Factory,
  • Azure Data Lake Storage V2
  • Azure SQL
  • Azure DataBricks
  • Pyspark
  • Azure DevOps
  • Power BI Report
  • Confidence & excellent communication

Experience:

  • Overall 4-7 years of experience in Azure Data Engineering

Educational Qualification:

  • Graduate/Post-graduate. Preferably with specialisation in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline

Microsoft Azure certification (good to have)

M&G Behaviours relevant to all roles:

Tell it like it is

Own it Now

Move it forward together

with care and integrity


We have a diverse workforce and an inclusive culture at M&G Global Services, regardless of gender, ethnicity, age, sexual orientation, nationality, disability or long term condition, we are looking to attract, promote and retain exceptional people. We also welcome those who take part in military service and those returning from career breaks.

Similar Jobs

3 Days Ago
In-Office
Pune, Mahārāshtra, IND
Senior level
Senior level
Information Technology • Professional Services • Software • App development
Lead the design, implementation, maintenance, and monitoring of scalable Big Data pipelines. Build Java/Scala-based systems using distributed processing frameworks, ETL tools, and cloud-based infrastructure. Review and optimize existing pipelines, troubleshoot production issues, lead technical teams, coordinate with US and India engineers, and deliver new modules and features using Agile practices.
Top Skills: AkkaApache AirflowApache NifiSparkApache StormGitGradleHadoopJavaJIRAMavenSbtScala
4 Days Ago
In-Office
Pune, Mahārāshtra, IND
Senior level
Senior level
Automotive
Leads the design, development, deployment, and maintenance of enterprise data platforms and scalable data pipelines. Builds ETL/ELT, streaming, data quality, governance, storage, and analytics solutions using Azure, Databricks, Spark, Python, Scala, and SQL. Optimizes distributed workloads and cloud infrastructure, implements CI/CD and DevOps practices, ensures compliance and security, collaborates with technical and business stakeholders, and mentors data engineering team members.
Top Skills: Apache IcebergSparkAzure Blob StorageAzure Data Lake StorageAzure DatabricksAzure Sql Data WarehouseAzure Synapse AnalyticsDelta LakeGitHbaseHiveInfrastructure As CodeJenkinsKafkaMapreduceOrcParquetPythonQlik ReplicateScalaSnowflakeSQL
5 Days Ago
In-Office or Remote
India
Senior level
Senior level
Blockchain • Fintech • Software • Cryptocurrency • Metaverse
Build and operate production-grade AI data pipelines and financial knowledge services for equities content. Responsibilities include processing text, tables, documents, and multimedia; creating knowledge bases and search indexes; engineering RAG retrieval and citation systems; integrating LLMs and NLP models; managing orchestration, APIs, quality, cost, observability, reliability, and scalable production operations.
Top Skills: APIsAsynchronous Task ProcessingCachingDistributed SystemsFull-Text SearchJavaKnowledge EngineeringLlmsMachine LearningMessage QueuesNlpPythonRagVector Search

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account