Ryan Specialty Logo

Ryan Specialty

Senior Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office
Mumbai, Maharashtra
Senior level
In-Office
Mumbai, Maharashtra
Senior level
The Senior Data Engineer will design and optimize data pipelines using Databricks and Spark, lead teams, and manage data workflows.
The summary above was generated by AI

Position Summary:

Job Title: Senior Data Engineer
Location: India
Project: Enterprise Data Hub (EDH)
About the Role
We are seeking a highly skilled and hands-on Senior Data Engineer to join our EDH initiative. This role demands deep expertise in building scalable data pipelines and automation frameworks using Databricks and the Azure ecosystem. The ideal candidate will have a strong engineering mindset, leadership experience, and a passion for solving complex data challenges.

Location:

Mumbai - India

What will your job entail?

Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using Databricks and Apache Spark

  • Implement job orchestration and automation using tools like Azure Data Factory, Azure Functions, and DevOps

  • Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions

  • Lead and mentor junior engineers, ensuring best practices in coding, testing, and deployment

  • Manage and monitor data workflows, ensuring reliability and performance

  • Contribute to architectural decisions and help shape the future of the EDH platform

Required Qualifications

  • 6–7 years of hands-on experience in Databricks and Spark-based data engineering

  • Strong proficiency in the Azure tech stack: Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Functions, etc.

  • Proven experience in job automation, CI/CD pipelines, and workflow orchestration

  • Solid understanding of data modeling, ETL/ELT processes, and performance tuning

  • Experience leading small teams or mentoring engineers in a fast-paced environment

  • Excellent problem-solving and communication skills

Preferred Qualifications

  • Experience with Delta Lake, Unity Catalog, and MLflow

  • Familiarity with data governance and security best practices in cloud environments

  • Exposure to Agile methodologies and DevOps practices

Disclaimer

Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or expression, sexual orientation, and many other characteristics bring together varied perspectives and add value to the service we provide our clients, trading partners, and communities. This policy extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, discipline, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms, conditions, and benefits of employment.

Top Skills

Spark
Azure Data Factory
Azure Data Lake
Azure Functions
Azure Synapse
Databricks

Similar Jobs

21 Days Ago
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
Senior level
Senior level
Enterprise Web • Fintech • Financial Services
As a Senior Data Engineer, you'll design and maintain data pipelines, implement data models, and ensure data governance while collaborating across teams to deliver insights and improve data quality.
Top Skills: AirflowDockerKafkaPower BIPythonSnowflakeSQLTableau
2 Days Ago
In-Office
Mumbai, Maharashtra, IND
Senior level
Senior level
Fintech • Software • Financial Services
The Senior Data Engineer is responsible for designing, building, and maintaining the data infrastructure and architecture. They ensure data accuracy and facilitate data accessibility for analytics and business intelligence purposes.
16 Days Ago
Remote or Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Seeking a Senior Data Engineer to design and implement ELT processes, build reliable data pipelines, and utilize AWS for data solutions.
Top Skills: Apache AirflowAWSDbtDockerFlinkHelmJenkinsKafkaKubernetesKustomizeSnowflakeSparkTerraform

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account