The Lead Data Engineer will develop and maintain data products using cloud technologies, support teams, and resolve production issues while ensuring quality and effective communication.
Job Description:
Job Description:
We seek a skilled Senior Data Engineer with strong communication, AI-assisted coding knowledge, and big data processing experience. Join our team to build and maintain products supporting dentsu’s marketing vision using cutting-edge cloud technologies. You will collaborate with a passionate team solving complex problems and developing data analysis features. Adapt quickly, innovate solutions, and provide incremental business value for customers. You will also support client solution teams in their efforts.
Key Responsibilities
- Use Agile methodologies and AI tools for rapid feature releases
- Research and introduce new solutions and technologies, contributing to Snowflake Native App development
- Follow best practices throughout the development lifecycle: design, implement, test, review, and deliver with CI/CD
- Coordinate with other teams as part of a larger data-sharing system
- Engage in quality assurance and thorough testing
- Communicate effectively, understand business needs, and write clear user and technical documentation
- Resolve production issues, participate in on-call support, onboard clients, and communicate with client teams
- Foster a positive and collaborative team environment
Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent experience
- 4+ years in software development
- Strong database fundamentals, SQL skills, working knowledge of relational and non-relational data models
- Proficient with object-oriented programming languages (Java and Python)
- Experience with big data platforms/warehouses (Snowflake preferred, Hadoop a plus)
- Proficient in Agile Development, Vibe Coding, Issue Tracking (JIRA), code repositories (Git, Bitbucket), SDLC, testing methodologies, and continuous integration
- Excellent communication skills
- Detail-oriented with a sense of urgency
- Working knowledge with cloud technologies (AWS preferred, GCP, Azure)
- Knowledge of data processing workflows (Airflow, Snowflake streams/tasks)
- Understanding of data structures, algorithms, distributed systems
- Unix command line skills, Bash scripting
Location:
DGS India - Bengaluru - Manyata N1 BlockBrand:
MerkleTime Type:
Full timeContract Type:
PermanentTop Skills
Airflow
AWS
Azure
GCP
Hadoop
Java
Python
Snowflake
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead the design, development, and maintenance of Disability & Absence products at MetLife, focusing on Big Data technologies and solutions.
Top Skills:
HbaseHiveKafkaNoSQLPigPythonShell ScriptSolrSpark
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Lead Data Engineer will design and implement data pipelines, oversee data management, and work with large datasets in a Big Data environment, ensuring efficient and scalable data solutions.
Top Skills:
AirflowClouderaHadoopJavaNetezzaOraclePysparkPythonScalaSQL
Financial Services
The role involves leading data architecture and engineering for a health insurance platform, focusing on cloud-native solutions, scalable data pipelines, and ensuring data quality and governance while collaborating across teams.
Top Skills:
BigQueryConfluenceDockerETLGitGoogle Cloud BigtableGoogle Cloud ComposerGoogle Cloud DataflowGoogle Cloud DataprocGoogle Cloud PlatformGoogle Cloud Pub/SubGoogle Cloud StorageIcebergJavaJenkinsJIRAKubernetesLooker StudioParquetPower BI
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
