Numerator Logo

Numerator

Sr. Data Engineer

Posted 24 Days Ago
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Design, build, and optimize high-volume data pipelines using Python, Databricks and Spark on Azure. Create and maintain automation test suites (Azure DevOps), perform manual/load/exploratory testing, collaborate with BAs and developers to meet sprint goals, and assist with sprint estimation and delivery.
The summary above was generated by AI

 We’re reinventing the market research industry. Let’s reinvent it together.

At Numerator, we believe tomorrow’s success starts with today’s market intelligence. We empower the world’s leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.

We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark.

Responsibilities

  • Adhere to coding and Numerator technology standards 

  • Build suitable automation test suites within Azure DevOps 

  • Maintain and update automation test suites as required 

  • Carry out manual testing, load testing, exploratory testing as required 

  • Work closely with Business Analysts and Senior Data Developers to consistently achieve sprint goals 

  • Assist in estimation of sprint-by-sprint stories and tasks 

  • Pro-actively take a responsible approach to product delivery

Requirements

  • 7-10 years of experience in data engineering roles

  • Good Python skills 

  • Experience working with Microsoft Azure Cloud 

  • Experience in Agile methodologies (Scrum/Kanban)

  • Experience with Apache Spark, PySpark, Databricks 

  • Experience working with Devops pipeline, preferably Azure DevOps

Preferred Qualifications

  • Bachelor's or master's degree in computer science, Information Technology, Data Science, or a related field.

  • Experience working in a support focused role 

  • Knowledge/experience in AI ML techniques

  • Certification in relevant Data Engineering discipline or related fields.

There is strength in numbers - We are the Numerati

Numerator is 5,800 employees strong. We have the confidence to be real and embrace what makes each Numerati unique. Our diverse experiences, ideas and backgrounds fuel our innovation.

Being part of the Numerati means that we’ll take care of you! From our Recharge Days, maximum flexibility policy, wellness resources for employees and their families, development opportunities and much more — we’re always finding ways to better support, celebrate and accelerate our team.

Numerator Pune, Mahārāshtra, IND Office

Bund Garden Road, Sangamvadi,, Pune, India, 411001

Numerator SangamWadi, Maharashtra, IND Office

Bund Garden Road, Raja Bahadur City Centre, SangamWadi, Pune, India, 411001

Similar Jobs

10 Days Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead and execute data engineering initiatives: define metrics, instrument logging, ingest and model data, build ETL/ELT pipelines, ensure data quality and governance, optimize processing performance, enable analytics/visualization, and lead projects that drive product and business strategy.
Top Skills: Anomaly DetectionDashboardingData ModelingData QualityData VisualizationEltETLLoggingProduct AnalyticsPythonRelational DatabasesSQL
Yesterday
Remote
IND
Senior level
Senior level
Artificial Intelligence • Blockchain • Software
Design, build, and optimize scalable data pipelines and data platforms using PySpark, Databricks, Azure Data Factory, SQL, and Delta Lake. Develop ingestion, orchestration, transformations, data models, and large-scale processing workflows. Ensure performance, reliability, data quality, consistency, and governance while collaborating with analysts, data scientists, and business stakeholders.
Top Skills: Azure Data FactoryAzure Data Lake StorageAzure Key VaultAzure SynapseDatabricksDelta LakeKafkaPysparkSQLStructured Streaming
2 Days Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Blockchain • Information Technology • Internet of Things
Designs, builds, and maintains scalable cloud data platforms and production pipelines across Azure, Databricks, Snowflake, and SAP. Responsibilities include ingestion, ETL/ELT, Lakehouse and dimensional modeling, CI/CD with Databricks Asset Bundles and Azure DevOps, data quality and observability, performance optimization, documentation, and stakeholder collaboration. The role also includes technical architecture, client advisory, engineering leadership, mentoring, and delivery of production Generative AI systems.
Top Skills: Adls Gen2Agentic Ai ArchitecturesApache AirflowApache KafkaSparkAzureAzure DatabricksAzure DevopsAzure Event HubsDatabricks Asset BundlesDatabricks Unity CatalogDatabricks WorkflowsDelta LakeDelta Live TablesDockerGenerative AiGitLarge Language ModelsPower BIPysparkPythonRetrieval-Augmented GenerationSAPSnowflakeSpark SqlSQLTableauTerraformYaml

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account