Barclays Logo

Barclays

Senior Data Engineer

Sorry, this job was removed at 01:24 a.m. (IST) on Tuesday, Nov 03, 2026
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Senior level
In-Office
Pune, Maharashtra, IND
Senior level

Similar Jobs

3 Days Ago
Hybrid
Senior level
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Design, build, and operate enterprise-scale data pipelines and integration solutions on GCP. Lead the planned migration to Databricks, develop lakehouse and orchestration patterns, and maintain data quality, governance, observability, reliability, and cost optimization. Provide L2/L3 support, troubleshoot incidents, collaborate with stakeholders and vendors, guide technical initiatives, and mentor junior engineers.
Top Skills: AecorsoftAlteryxApache AirflowAtaccamaBashBigQueryCloud ComposerCloud FunctionsCloud LoggingCloud MonitoringCloud StorageDatabricksDatabricks SqlDatabricks WorkflowsDatadogDataflowDataprocDelta LakeDependabotExcelGithub ActionsGkeGoogle Cloud Platform (Gcp)GrafanaGreat ExpectationsIamJenkinsKubernetesLinuxPower BIPub/SubPysparkPythonRSonarqubeSparkSpark SqlSQLTableauTalendTerraformUnity CatalogWiz
10 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Develop and support enterprise production data pipelines using Python, PySpark, Spark SQL, Databricks, Azure, ADLS, Delta Lake, and lakehouse architecture. Responsibilities include batch processing, ETL development, REST API integration, CI/CD, Terraform-based infrastructure, and Spark performance optimization through partitioning, caching, distributed processing, and exception handling.
Top Skills: AdlsSparkCi/CdDatabricksDelta LakeETLInfrastructure As CodeLakehouse ArchitectureAzurePysparkPythonRest ApiSpark SqlTerraform
15 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and deploys scalable Azure Databricks data pipelines using PySpark, Spark SQL, and Delta Lake across medallion layers. Builds HR data models, source-to-target mappings, reconciliation controls, governance, lineage, documentation, and data quality processes. Modernizes legacy Informatica and SQL integrations, including Oracle HCM feeds. Collaborates with distributed agile teams, mentors junior engineers, and supports production cutovers for sensitive employee data.
Top Skills: Ai/Copilot ToolingSparkAzure Data FactoryAzure Data Lake StorageAzure DevopsAzure SqlAzure SynapseCi/CdCrunchrDatabricksDelta LakeGitInformaticaOracle Hcm CloudPower BIPysparkSpark SqlSQLUnity Catalog
Build and maintain secure, scalable data pipelines, warehouses, and lakes. Design distributed processing architectures using AWS and Hadoop technologies, develop ETL and analytical solutions, and collaborate with data scientists on machine learning deployment. The role also involves technical design, advanced SQL and programming, stakeholder partnership, risk management, and potentially leading and developing a team.
The summary above was generated by AI
Job Description

Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. 

Accountabilities

  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes.
  • Collaboration with data scientist to build and deploy machine learning models.

Analyst Expectations

  • To perform prescribed activities in a timely manner and to a high standard consistently driving continuous improvement.
  • Requires in-depth technical knowledge and experience in their assigned area of expertise
  • Thorough understanding of the underlying principles and concepts within the area of expertise
  • They lead and supervise a team, guiding and supporting professional development, allocating work requirements and coordinating team resources.
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others.
  • OR for an individual contributor, they develop technical expertise in work area, acting as an advisor where appropriate.
  • Will have an impact on the work of related teams within the area.
  • Partner with other functions and business areas.
  • Takes responsibility for end results of a team’s operational processing and activities.
  • Escalate breaches of policies / procedure appropriately.
  • Take responsibility for embedding new policies/ procedures adopted due to risk mitigation.
  • Advise and influence decision making within own area of expertise.
  • Take ownership for managing risk and strengthening controls in relation to the work you own or contribute to. Deliver your work and areas of responsibility in line with relevant rules, regulation and codes of conduct.
  • Maintain and continually build an understanding of how own sub-function integrates with function, alongside knowledge of the organisations products, services and processes within the function.
  • Demonstrate understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub-function.
  • Make evaluative judgements based on the analysis of factual information, paying attention to detail.
  • Resolve problems by identifying and selecting solutions through the application of acquired technical experience and will be guided by precedents.
  • Guide and persuade team members and communicate complex / sensitive information.
  • Act as contact point for stakeholders outside of the immediate function, while building a network of contacts outside team and external to the organisation.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.

Join us as a Senior Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. You'll be working on complex technical problems that will involve detailed analytical skills and analysis. This will be done in conjunction with fellow engineers, business analysts and business stakeholders. 

To be successful as a Senior Data Engineer, you should have experience with:

  • AWS hands on with S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, step function and knowledge of Analytical services.

  • Experience of distributed computing architecture, Core Hadoop components (HDFS, Spark, Yarn, HIVE, Impala).

  • Expertise in SQL, advanced SQL skills.

  • Expertise in shell scripting and programming (Scala/Python).

  • Knowledge of ETL technologies preferably Ab Initio.

  • Experience of Technical Design for ETL/Hadoop/AWS components.

  • Knowledge of Data Warehousing.

You may be assessed on key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen, strategic thinking and digital and technology, as well as job-specific technical skills.

This role is based in Pune.

Barclays Pune, Mahārāshtra, IND Office

Pune, Maharashtra , India, 411014

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account