Lead design and implementation of AWS cloud data solutions using Python and PySpark. Build ETL pipelines, analytics (Glue, Athena, Redshift), and cloud architectures. Produce HLD/LLD, run cloud readiness assessments, cost estimates, DR planning, and provide technical leadership across onshore-offshore teams while liaising with customers and managed services.
Job Title: Sr Data Engineer / Lead
Location: Hinjewadi, Pune
Experience: 7-12 Years
Skills: Python, Pyspark, AWS
Role & Responsibilities
- 7 to 12 years of experience in designing, implementing, and managing cloud solutions on AWS.
- Design, develop, and implement cloud solutions on AWS, utilizing a wide range of AWS services, including Glue ETL, Glue Data Catalog, Athena, Redshift, RDS, DynamoDB, Step Function, Event Bridge, Lambda, API Gateway, ECS, and ECR.
- Demonstrate expertise in implementing AWS core services, such as EC2, RDS, VPC, ELB, EBS, Route 53, ELB, S3, Dynamo DB, and CloudWatch.
- Leverage strong Python and PySpark data engineering capabilities to analyze business requirements, translate them into technical solutions, and successful execution.
- Conduct cloud readiness assessments, define target architectures, and provide cost estimations for cloud solutions on AWS.
- expertise in AWS Data and Analytics Stack, including Glue ETL, Glue Data Catalog, Athena, Redshift, RDS, DynamoDB, Step Function, Event Bridge, Lambda, API Gateway, ECS, and ECR for containerization.
- In-depth knowledge of AWS core services, such as EC2, RDS, VPC, ELB, EBS, Route 53, ELB, S3, Dynamo DB, and CloudWatch.
- Develop HLDs, LLDs, test plans, and execution plans for cloud solution implementations, including Work Breakdown Structures (WBS).
- Provide design guidance and proof-of-concept (POC) support to our managed services team for continuous optimization of cloud solutions.
- Lead architectural decisions and strategies for migrating and hosting applications on AWS.
- Develop customer cloud strategies aligned with their business objectives, focusing on cloud migrations.
- Interact with customers to understand cloud service requirements, transform requirements into workable solutions, and build and test those solutions.
- Manage multiple cloud solution projects, demonstrating technical ownership and accountability.
- Capture and share best-practice knowledge within the AWS solutions architect community.
- Serve as a technical liaison between customers, service engineering teams, and support.
- Possess a strong understanding of cloud and infrastructure components, including servers, storage, networks, data, and applications, to deliver end-to-end cloud infrastructure architectures and designs.
- Demonstrate experience with AWS cloud environment sizing and disaster recovery architecture for applications.
- Effectively collaborate with team members from around the globe, including experience working with offshore models.
- Excellent analytical and problem-solving skills.
- Strong communication and presentation skills.
- Ability to work independently and as part of a team.
- Experience working with onshore - offshore teams.
About Company
YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.
At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.
Website: https://www.yash.com/
Similar Jobs
Fintech • Software • Financial Services
Maintain and transform investment data into actionable insights by building data systems and pipelines, performing complex analysis, visualizing results, improving data quality, and collaborating with clients and product teams.
Top Skills:
AWSAzureD3.JsData WarehouseETLGCPJavaExcelNoSQLPower BIPythonSQLTableauVBA
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Data Analyst, you'll analyze complex data sets using statistical techniques, collaborate with SMEs, and prepare reports for stakeholders.
Top Skills:
AlteryxPower BIQlikSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Support regulatory reporting and modelling activities: gather and cleanse model inputs, prepare datasets and run models, validate regulatory/financial data and outputs, translate regulatory rules into data, controls and reports, document requirements, work with testing/tooling for traceability and automation, and support ESG risk quantification, climate scenario design and capital/liquidity resilience analysis.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
