The Data Engineer maintains and optimizes data infrastructure, automates processes, and collaborates with teams to improve data delivery and insights.
The purpose of this role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers, data analytics teams, data scientists and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyse performance, and troubleshoot any existent issues.
Job Description:
Key responsibilities: Creates and maintains optimal data pipeline architecture Assembles large, complex data sets that meet functional / non-functional business requirements Identifies, designs and implements internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc Builds analytics tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics Works with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs Keeps our data separated and secure Creates data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader Works with data and analytics experts to strive for greater functionality in our data systemsLocation:
India - Maharashtra- Pune - Baner - Amar Madhuban Tech ParkBrand:
MerkleTime Type:
Full timeContract Type:
PermanentTop Skills
Data Pipeline Architecture
Data Tools
Databases
Similar Jobs
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Lead projects using cloud technologies to address complex business challenges, mentor teams, and ensure scalable technology solutions, focusing on client satisfaction and project delivery.
Top Skills:
AWSAzureDatabricksGCPPower BIRedshiftSalesforceSnowflake
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design and deploy AI/ML solutions on AWS, build data pipelines using Databricks and PySpark, and maintain legacy systems. Collaborate with teams to ensure efficiency and performance optimization in data processing.
Top Skills:
APIsAWSCi/CdDatabricksDockerJavaKubernetesNetezzaNifiOraclePl/SqlPysparkScalaSparkSQLUnix
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The GCP Data Engineer will develop and maintain data pipelines and ETL/ELT processes using Python and SQL on Google Cloud Platform, working in a collaborative environment to ensure data quality and availability.
Top Skills:
BigQueryCloud ComposerCloud FunctionsDataflowGoogle Cloud PlatformPub/SubPythonSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
