dentsu Logo

dentsu

Data Engineer - Lead Developer/Engineer

Posted 18 Days Ago
Be an Early Applicant
Baner, Pune, Maharashtra
Senior level
Baner, Pune, Maharashtra
Senior level
Seeking a Data Engineer to design and deploy cloud-based data solutions, utilizing Python and SQL, following Agile methodologies and best practices.
The summary above was generated by AI

We are looking for a talented Data Engineer with big data processing experience to join our Agile development team in building products to support Merkle’s people based marketing vision using the latest data and cloud technologies.  You will work with a team of passionate, experienced, nimble, and goal-oriented engineers that are solving complex problems and critical data analysis and reporting features. You will embrace change, and rapidly build, test, and scale solutions that drive incremental business value for our customers and partners.  We’re looking for smart, enthusiastic, driven individuals who are eager to contribute to our world class solutions.

Job Description:

Key Responsibilities

  • Design, implement, and deploy enterprise data solutions using cutting-edge cloud-based technologies
  • Follow Agile methodologies to release iterative feature sets very rapidly
  • Research and introduce new solutions and technologies to the project and stakeholders, provide technical guidance and suggest improvements in development
  • Work independently, without guidance, with broader overview on the project
  • Coordinate with other teams as part of a larger data-sharing system
  • Employ software development best practices such as automated testing, peer code reviews, continuous integration, and continuous delivery
  • Translate business requirements and develop technical specifications
  • Communicate clearly and document processes
  • Perform quality assurance and testing of your work
  • Contribute to a collaborative, positive, stimulating, and enjoyable environment for your development team

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, Information Systems or equivalent experience
  • Must have 5+ years of work experience with programming languages and object-oriented design (Python preferred)
  • Must have strong database fundamentals including SQL, relational and non-relational data models and schema designs, and understanding of database performance implications
  • Must have understanding of cloud-based technologies (AWS, GCP or Azure, AWS preferred)
  • Must have experience leveraging automated tests for code validation and test-driven development
  • Must have experience building and deploying products using continuous integration principles
  • Must have working knowledge of software engineering and development methodologies, techniques, and tools, including Issue Tracking (like JIRA), code repositories (like Git, Bitbucket) and the Software Development Lifecycle

Required Skills:

  • Experience building workflow orchestration, logging, error handling and automated testing utilizing Python and the Pytest framework
  • Understanding of “Big Data” ETL methodologies and managing large scale data sets
  • Strong understanding of data structures, algorithms, and distributed systems

Desired Skills:

  • Experience with Snowflake data warehouse including scheduled tasks, table streams and JavaScript stored procedures
  • Experience with AWS services (such as S3, EC2, RDS, EMR, Lambda or SNS/SQS)
  • Experience with data processing workflow systems (Apache Nifi, Talend or Airflow)
  • Experience with creating reports, dashboards and visualizations (Tableau preferred)

Location:

DGS India - Pune - Baner M- Agile

Brand:

Merkle

Time Type:

Full time

Contract Type:

Permanent

Top Skills

Airflow
Apache Nifi
AWS
Azure
Bitbucket
GCP
Git
JIRA
Python
Snowflake
SQL
Tableau
Talend

Similar Jobs

7 Days Ago
Pune, Maharashtra, IND
Senior level
Senior level
Healthtech • Logistics • Pharmaceutical
This role involves leading a team in designing and developing scalable cloud solutions on Azure, managing the environment, and ensuring security and performance standards are met.
Top Skills: AdfAdlsAdoAksAnsibleAzureAzure App ServicesAzure CliAzure PowershellC#GitJIRALinuxLogic AppsPuppetPythonServicenowTerraformWindows
7 Days Ago
Pune, Maharashtra, IND
Senior level
Senior level
Healthtech • Logistics • Pharmaceutical
Lead the design and automation of analytic data engineering products; optimize data processes and provide insights using statistical methodologies and machine learning while mentoring team members.
Top Skills: AlteryxPower BIPythonQliksenseRSASSpssSQLTableau
12 Days Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Financial Services
As a Lead Software Engineer, you will develop software solutions, ensure code quality, lead evaluation sessions, and drive technology innovation.
Top Skills: AWSData BricksJavaKafka

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account