Design and implement data pipelines, optimize processing and storage, ensure data accuracy and performance, provide technical support, and collaborate with data scientists, analysts, and stakeholders to resolve data issues and meet data requirements.
Data Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. You will collaborate with data scientists and analysts to meet data requirements and resolve data issues. Strong experience in data engineering and problem-solving skills are required.
ResponsibilitiesDesign and implement data pipelines, Optimize data processing and storage, Ensure data solutions meet performance standards, Provide technical support, Collaborate with stakeholders.
QualificationsBachelor's/Master's in Engineering 5-8 years
EXL Pune, Mahārāshtra, IND Office
Pune, India
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and build data services and pipelines supporting machine learning products. Develop automation tools for model deployment, maintain production data systems, improve infrastructure, participate in code reviews, and collaborate across engineering, data science, and product teams. The role requires expertise in distributed systems, large-scale data processing, CI/CD, container orchestration, and AI-enabled workflow improvements.
Top Skills:
AirflowAWSAws BatchCi/CdDockerEmrGlueGoKafkaKubernetesKv StoresLinuxPythonRelational DatabasesSagemakerSparkSpinnaker
Information Technology • Consulting
Designs and maintains scalable data pipelines and ETL/ELT workflows using Python, SQL, and Azure Databricks. Manages large structured and semi-structured datasets, data models, monitoring, quality controls, troubleshooting, and production support. Integrates LLM and Generative AI capabilities, including APIs, embeddings, prompt engineering, and RAG workflows, into data solutions. Collaborates with engineering, analytics, and business teams while following security, CI/CD, documentation, and maintainability best practices.
Top Skills:
Azure Data FactoryAzure Data Lake Storage (Adls)Azure DatabricksAzure DevopsAzure Openai ServiceAzure SqlAzure Synapse AnalyticsCi/CdEmbeddingsEtl/EltGenerative AiGitLarge Language Models (Llms)Llm ApisPrompt EngineeringPythonRest ApisRetrieval-Augmented Generation (Rag)SQLVector DatabasesVector Search
Information Technology • Database • Consulting
The job description does not provide information about responsibilities, qualifications, technologies, compensation, or other employment requirements.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
