Easy Apply
Easy Apply
The Senior Data Engineer will lead AI initiatives, focusing on data engineering, machine learning, and analytics, driving technical direction and mentoring team members.
The Role (Describe the role):
Highly skilled and experienced Senior Data Engineer with AI/ML expertise. This role is essential to maintain continuity and leadership for our AI-driven initiatives, particularly Vantage AI, which is currently gaining significant traction across business units.
The candidate must possess strong technical knowledge in data engineering, orchestration, machine learning, and analytics, with the ability to independently drive the design, development, and deployment of data solutions.
Key Responsibilities:
- Technical leadership for Vantage AI. AI/ML initiatives in Anchanto. Set technical direction, ensure best practices, and mentor junior members.
- Insight generation. Apply statistical methods and predictive modeling to solve real-world problems.
- Machine learning and AI developments. Collaboration with team, product / business stakeholders. Lead AI/ML development, deployment, improvement from technical perspective.
- Lead Data engineering and orchestration. Optimize pipelines using tools like Airflow.
Essential Requirements:
- 5 - 6+ years of experience in data engineering or data science roles
- Ability to build and deploy machine learning models
- Expertise in AWS cloud platforms and containerization
- Hands on in data scraping techniques.
- Strong knowledge of Python and associated ML/data science libraries (e.g., scikit-learn, pandas, PySpark, Sagemaker)
- Expertise in ETL and data pipeline design.
Personal Attributes:
- Strong problem-solving skills.
- Strong stakeholder communication abilities
- Engineering degree.
- Ability to work independently.
Top Skills
Airflow
AWS
Pandas
Pyspark
Python
Sagemaker
Scikit-Learn
Anchanto Pune, Mahārāshtra, IND Office
401, Vascon ECO Tower, Behind Veritas, Baner Road, Pune, Maharashtra, India, 411045
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design and develop complex, large-scale data pipelines and end-to-end solutions across enterprise Big Data environments. Ensure data reliability, performance, and adherence to engineering best practices while collaborating in Agile teams.
Top Skills:
Apache Spark,Scala,Python,Java,Hadoop,Object Storage,Sql,Oracle,Netezza,Hive,Apache Nifi,Data Warehouse,Data Lake,Lakehouse
Artificial Intelligence • Big Data • Machine Learning
Design, build, and operate large-scale batch and real-time data pipelines using Spark, AWS (Glue, EMR, S3, Redshift). Implement observability, alerts, and drive technical deliverables while mentoring junior engineers.
Top Skills:
Spark Streaming,Aws Glue,Emr,Pyspark,Python,Kafka,Confluent Kafka,S3,Redshift,Cloudwatch,Secrets Manager,Datadog,Sql,Oracle,Medallion Architecture,Apache Airflow,Aws Step Functions,Sqoop,Hdfs,Hive,Nifi,Terraform,Ci/Cd
.png)
Big Data • Cloud • Digital Media • Machine Learning • Mobile • Software • Industrial
Design, implement, and manage data security solutions; perform security assessments and monitoring; enforce encryption and key management; lead breach investigations and incident response; collaborate with IT/dev teams; provide training and report security posture to senior management.
Top Skills:
Python,Pyspark,Sql,Aws,Azure,Google Cloud,Firewalls,Ids/Ips,Encryption,Iam,Penetration Testing,Vulnerability Scanning,Risk Assessment,Digital Forensics,Scripting/Automation
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
