Northern Trust Logo

Northern Trust

Lead, Data Engineer

Posted 9 Days Ago
Be an Early Applicant
Hybrid
Pune, Maharashtra, IND
Senior level
Hybrid
Pune, Maharashtra, IND
Senior level
Leads the design, modernization, and implementation of enterprise-scale cloud data platforms. Builds batch, micro-batch, real-time, and event-driven pipelines using Snowflake, Azure, Python, and Airflow/Astronomer. Develops ELT/ETL frameworks, data warehouses, data lakes, governance, monitoring, and CI/CD practices. Optimizes platform performance and cost while partnering with architects, analytics teams, product owners, and business stakeholders. Influences architecture, engineering standards, and technical strategy.
The summary above was generated by AI

About Northern Trust


As a global leader in innovative wealth management, asset servicing, asset management and banking services, Northern Trust (Nasdaq: NTRS) is proud to guide the world’s most successful individuals, families, corporations and institutions.


Since 1889, we have aligned our efforts with our three guiding Principles That Endure: Service, Expertise, and Integrity. Together, they reflect the three cornerstones of business conduct which we strive to instill in our employees, whom we call partners, and to provide to our clients and the communities we serve worldwide.


With more than 135 years of financial experience and over 24,000 partners, we serve the world’s most sophisticated clients using leading technology and exceptional service.


We are seeking a highly skilled and hands-on Lead Data Engineer to design, build, and modernize enterprise-scale data platforms supporting analytics, reporting, and data-driven decision making. This role will lead the technical implementation of cloud-native data solutions using Snowflake, Azure, Python, and Astronomer/Airflow, while partnering with architects, product owners, analytics teams, and business stakeholders to deliver scalable, secure, and high-performing data products.

This is a senior individual contributor role with significant influence on platform architecture, engineering standards, cloud modernization efforts, and data platform strategy.


Key Responsibilities

Design, build, and optimize scalable enterprise data platforms using Snowflake and Microsoft Azure.

Develop robust batch, micro-batch, and near real-time data pipelines using Python and Astronomer/Airflow.

Architect and implement modern cloud data warehouse and data lake solutions.

Design scalable ELT/ETL frameworks, reusable data ingestion patterns, and data transformation pipelines.

Leverage advanced Snowflake capabilities including: Streams & Tasks Dynamic Tables Snowpark Iceberg Tables Secure Data Sharing Materialized Views

Drive data platform reliability, operational excellence, monitoring, observability, and governance.

Optimize Snowflake workloads for performance, scalability, and cost efficiency.

Build and deploy cloud-native solutions using: Azure AKS Azure Blob Storage Azure Data Lake Storage Azure DevOps CI/CD

Design and support real-time and event-driven data processing architectures.

Partner with analytics, reporting, and business teams to provide trusted, analytics-ready data assets.

Establish engineering best practices, coding standards, and architectural patterns.

Participate in solution design, technical reviews, and architecture governance activities.


Required Qualifications

Bachelor's or master's degree in computer science, Engineering, Information Systems, or related field.

7+ years of experience in Data Engineering, Data Platform Engineering, or Data Warehousing.

5+ years of hands-on experience with Snowflake.

Strong expertise in Python and advanced SQL development.

Proven experience designing and implementing enterprise-scale data warehouses and analytical platforms.

Strong experience with Airflow and/or Astronomer for orchestration and workflow management.

Experience building cloud-native solutions on Microsoft Azure.

Strong understanding of: Data Modeling Data Warehousing Concepts ELT/ETL Frameworks Distributed Systems Data GovernanceCI/CD and DevOps Practices

Excellent analytical, problem-solving, and communication skills.

Technical Skills

Required

Snowflake

Python

SQL

Airflow / Astronomer

Azure Cloud Services

Data Warehousing

Data Modeling

Data Lake Architectures

ELT / ETL Development

Git

CI/CD Pipelines


Desired

Snowpark

Streams & Tasks

Dynamic Tables

Iceberg Tables

Data Sharing

CDC Frameworks

Real-Time Data Processing

Event-Driven Architectures

Azure AKS

Azure Blob Storage

Azure Data Lake Storage

Azure DevOps

REST APIs and Data Integrations


Domain Expertise (Preferred)

Experience working with Financial Services, Wealth Management, Asset Management, or Investment Analytics platforms.

Familiarity with:

Portfolio Management Data

Holdings & Positions

Transactions & Tax Lots

Client Reporting

Performance Reporting

Financial Analytics

Investment Operations Data


Nice to Have

Experience with modern BI and Analytics platforms such as ThoughtSpot, Power BI, Cognos, Tableau, or similar technologies.

Familiarity with semantic modeling, dashboard development, self-service analytics, and reporting solutions.

Experience designing analytics-ready data models to support enterprise reporting and business intelligence workloads.

Understanding of search-driven analytics, AI-assisted analytics, and embedded analytics capabilities.

Experience supporting the migration and modernization of legacy BI platforms to cloud-native analytics ecosystems.

Exposure to data governance, lineage, metadata management, and data catalog solutions.


Preferred Certifications

Snowflake

SnowPro Core Certification

SnowPro Advanced Data Engineer

SnowPro Advanced Architect

Microsoft Azure

Microsoft Certified: Azure Data Engineer Associate (DP-203)

Microsoft Certified: Azure Solutions Architect Expert (AZ-305)

Microsoft Certified: Azure Fundamentals (AZ-900)


What You'll Bring

Passion for building modern, scalable cloud data platforms.

Strong ownership mindset and ability to drive technical initiatives independently.

Deep technical expertise combined with practical problem-solving skills.

Ability to influence architecture and engineering decisions across teams.

Strong collaboration skills with engineers, architects, analysts, and business stakeholders.

Commitment to engineering excellence, reliability, and continuous improvement.t.


Working with Us


As a Northern Trust partner, you will be part of a flexible and collaborative work culture, which has a strong history of financial strength and stability. Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to an inclusive workplace and assisting the communities we serve.


Philanthropy is deeply rooted in Northern Trust’s history and is an essential element of our culture. Employees around the world give their time and talent to work for the greater good of their communities.


Reasonable Accommodation


Northern Trust is committed to working with and providing adjustments to individuals with health conditions and disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at [email protected], or alternatively you can discuss your individual requirements with the recruiter you are working with.


About Our Pune Office


The Northern Trust Pune office, established in 2016, is now home to over 3,000 employees. The office handles various functions, including Operations for Asset Servicing and Wealth Management, as well as delivering critical technology solutions that support business operations across the globe.


Our Pune team takes our commitment to service to heart. In 2024, they volunteered more than 10,000+ hours into the communities where they live and work. Learn more.

Northern Trust Kharadi, Maharashtra, IND Office

SEZ Unit, Tower A, 13th to 16th Floor and Tower B 9th Floor, Kharadi, Pune, India, 411014

Northern Trust Pune, Mahārāshtra, IND Office

Pune, India

Similar Jobs

10 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead technical design and engineering standards for scalable data platforms using Databricks, Spark, Python, PySpark, and dbt. Own architecture reviews, CI/CD, DataOps, observability, platform administration, deployment governance, migrations, and upgrades. Resolve complex platform challenges, mentor engineers, and guide code quality. Partner with stakeholders on roadmaps, prioritization, and technical trade-offs while supporting Mastercard’s cloud strategy.
Top Skills: SparkCi/CdDatabricksDatabricks Asset BundlesDataopsDbtGitlabJenkinsPysparkPythonTest-Driven Development (Tdd)
16 Days Ago
Hybrid
Pune, Maharashtra, IND
Expert/Leader
Expert/Leader
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Leads the design, development, and maintenance of scalable batch and real-time data pipelines across Azure and on-premises environments. Builds production-grade ETL/ELT solutions, optimizes performance and reliability, ensures data quality and compliance, and solves complex business problems. Collaborates with business and technology stakeholders, leads solution design and estimation, and coaches data and analytics talent.
Top Skills: SparkAzure Data FactoryAzure DevopsAzure Event HubsAzure FunctionsAzure SynapseCi/CdCosmos DbData LakesData MartsData WarehousesDatabricksEltETLGitHadoopHbaseHiveKappa ArchitectureLambda ArchitectureMedallion ArchitectureMongoDBNifiNoSQLPythonScalaSQLUnix Shell Scripting
25 Days Ago
Hybrid
Pune, Maharashtra, IND
Expert/Leader
Expert/Leader
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Leads the design, development, deployment, and support of scalable data pipelines and platforms across Hadoop, on-premises, and AWS cloud environments. Builds batch and near-real-time processing frameworks, modernizes ETL and data warehouse workloads, implements governance and observability capabilities, and troubleshoots production issues. Mentors engineers, collaborates with cross-functional stakeholders, evaluates emerging technologies, and ensures secure, high-quality delivery for enterprise-scale data ecosystems.
Top Skills: Amazon DynamodbAmazon EmrAmazon S3Apache AirflowApache HiveApache NifiSparkAWSAws GlueCassandraCloud Object StorageData LakehousesData LakesEnterprise Data WarehousesETLHadoopJavaOracleScalaSQLSQL Server

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account