Citi Logo

Citi

Applications Development Sr Programmer Analyst - Data Engineer (Pyspark/Snowflake/ AWS)- C12 - PUNE

Posted Yesterday
Be an Early Applicant
In-Office
Pune, Mahārāshtra
Senior level
In-Office
Pune, Mahārāshtra
Senior level
The Data Engineer will design, develop, and optimize ETL pipelines using PySpark and AWS for data processing, collaborate with teams, and ensure data compliance.
The summary above was generated by AI

Role Overview:

We are seeking an experienced Data Engineer with expertise in PySpark, Snowflake and AWS  to join our team. The ideal candidate will design, develop, and optimize data pipelines and workflows in a cloud-based environment, leveraging AWS services, PySpark, and Snowflake for data processing and analytics.

Key Responsibilities:

Design and implement scalable ETL pipelines using PySpark on AWS.
Develop and optimize data workflows for Snowflake integration.
Manage and configure AWS services such as S3, Lambda, Glue, EMR, and Redshift.
Collaborate with data analysts and business teams to understand requirements and deliver solutions.
Ensure data security and compliance with best practices in AWS and Snowflake environments.
Monitor and troubleshoot data pipelines and workflows for performance and reliability.
Write efficient, reusable, and maintainable code for data processing and transformation.

Required Skills:
Strong experience with AWS services (S3, Lambda, Glue, MSK, etc.).
Proficiency in PySpark for large-scale data processing.
Hands-on experience with Snowflake for data warehousing and analytics.
Solid understanding of SQL and database optimization techniques.
Knowledge of data lake and data warehouse architectures.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Strong problem-solving and debugging skills.

Experience with Terraform or CloudFormation for infrastructure as code.
Knowledge of Python for scripting and automation.
Familiarity with Apache Airflow for workflow orchestration.
Understanding of data governance and security best practices.
Certification in AWS or Snowflake is a plus.

Education and Experience:

Bachelor’s degree in Computer Science, Engineering, or related field with 6 to 10 years of experience.
5+ years of experience in AWS cloud engineering.
2+ years of experience with PySpark and Snowflake.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Digital Software Engineering

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Top Skills

Pyspark,Snowflake,Aws,S3,Lambda,Glue,Emr,Redshift,Sql,Git,Terraform,Cloudformation,Python,Apache Airflow

Similar Jobs

9 Hours Ago
Hybrid
Pune, Mahārāshtra, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Assistant Manager will oversee revenue accounting operations, ensuring compliance with US GAAP and SOX, lead a team, and drive process improvements.
Top Skills: Microsoft Office SuiteNetSuiteSalesforceTableau
Yesterday
Hybrid
Pune, Mahārāshtra, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves developing automation tools, conducting quality assurance testing for cloud-based systems, and enhancing test automation frameworks. Responsibilities include collaborating with engineering teams, writing test cases, and managing resource forecasts.
Top Skills: BambooCC++GitGoGrpcJIRAJSONLinuxmacOSPlaywrightPytestPythonRestRobot FrameworkRpcSeleniumStashWindowsXML
Yesterday
Hybrid
2 Locations
Senior level
Senior level
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
As a Scrum Master, you will facilitate scrum ceremonies, mentor teams on Agile methodology, manage PI processes, and enhance team performance.
Top Skills: Agile CentralConfluenceJIRA

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account