DeepIntent Logo

DeepIntent

Lead Software Engineer

Posted 16 Days Ago
Be an Early Applicant
Pune, Maharashtra
Senior level
Pune, Maharashtra
Senior level
Lead the design and optimization of data pipelines, mentor the engineering team, ensure data quality and compliance, and drive best practices in data architecture.
The summary above was generated by AI

With a core belief that advertising technology can measurably improve the lives of patients, DeepIntent is leading the healthcare advertising industry into the future. Built purposefully for the healthcare industry, the DeepIntent Healthcare Advertising Platform is proven to drive higher audience quality and script performance with patented technology and the industry’s most comprehensive health data. DeepIntent is trusted by 600+ pharmaceutical brands and all the leading healthcare agencies to reach the most relevant healthcare provider and patient audiences across all channels and devices. For more information, visit DeepIntent.com or find us on LinkedIn.

Who You Are:

  • Experience:
    • 5+ years of experience in data engineering or related roles, with at least 2 years in a leadership or senior technical position.
    • Extensive experience with data warehousing, ETL pipelines, data modeling, and data architecture.
    • Strong experience working with large-scale data processing frameworks (e.g., Hadoop, Apache Spark, Kafka).
  • Technical Skills:
    • Proficient in SQL, Python, Java, or other relevant programming languages.
    • Hands-on experience with cloud-based platforms (AWS, GCP, Azure).
    • Familiarity with data orchestration tools like Apache Airflow or similar.
    • Strong knowledge of databases (SQL and NoSQL) and data storage technologies.
  • Education:
    • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent work experience).
  • Soft Skills:
    • Excellent problem-solving and analytical skills.
    • Strong communication and interpersonal skills, with the ability to work effectively with both technical and non-technical teams.
    • Ability to manage multiple priorities in a fast-paced, dynamic environment.

What You’ll Do:

In this role, you will take the lead in designing, building, and optimizing data pipelines, ensuring high-quality data integration and real-time analytics. As a lead, you will mentor and guide a team of data engineers, collaborate with cross-functional teams, and drive best practices for data architecture and engineering.

  • Leadership & Mentorship:
    • Lead and mentor a team of engineers, ensuring technical excellence and continuous improvement.
    • Provide guidance on complex technical issues, and foster a culture of collaboration and innovation.
    • Develop and maintain data engineering processes, practices, and standards across the team.
  • Data Architecture & Engineering:
    • Design and develop robust, scalable, and efficient data pipelines for ETL (Extract, Transform, Load) processes.
    • Architect data solutions and ensure seamless integration of data from diverse sources, both on-premise and in the cloud.
    • Optimize data storage, retrieval, and processing for performance and scalability.
  • Collaboration & Stakeholder Management:
    • Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
    • Collaborate with the software engineering team to ensure smooth integration of data pipelines into applications.
  • Data Quality & Governance:
    • Ensure data integrity, quality, and consistency across systems.
    • Implement and enforce data governance policies and best practices, ensuring compliance with data privacy regulations.
  • Continuous Improvement:
    • Stay updated with the latest trends in data engineering, big data technologies, and cloud platforms.
    • Drive automation, testing, and optimisation within data pipelines to improve overall efficiency.
  • Technology Stack:
    • Lead the selection and implementation of appropriate technologies for data storage, processing, and retrieval (e.g., Hadoop, Spark, Kafka, Airflow).
    • Experience working with public clouds like GCP/AWS.
    • Proficient with SQL, Java, Spring boot, Python or at least one Object oriented language, Bash.
    • Experience with any of Apache open source projects such as Spark, Druid, Beam, Airflow etc. and big data databases like BigQuery, Clickhouse, etc

DeepIntent is committed to bringing together individuals from different backgrounds and perspectives. We strive to create an inclusive environment where everyone can thrive, feel a sense of belonging, and do great work together.

DeepIntent is an Equal Opportunity Employer, providing equal employment and advancement opportunities to all individuals. We recruit, hire and promote into all job levels the most qualified applicants without regard to race, color, creed, national origin, religion, sex (including pregnancy, childbirth and related medical conditions), parental status, age, disability, genetic information, citizenship status, veteran status, gender identity or expression, transgender status, sexual orientation, marital, family or partnership status, political affiliation or activities, military service, immigration status, or any other status protected under applicable federal, state and local laws. If you have a disability or special need that requires accommodation, please let us know in advance.

DeepIntent’s commitment to providing equal employment opportunities extends to all aspects of employment, including job assignment, compensation, discipline and access to benefits and training.

Top Skills

Apache Airflow
Spark
AWS
Azure
BigQuery
Clickhouse
GCP
Hadoop
Java
Kafka
NoSQL
Python
SQL

DeepIntent Pune, Mahārāshtra, IND Office

52/A Shivaji Housing Society, SB Road, Shivaji Nagar, , Pune, Maharashtra, India, 411016

Similar Jobs

5 Days Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Financial Services
The Lead Software Engineer will design and deliver technology solutions, focusing on software development, database management, data analytics, and community engagement.
Top Skills: Aws RedshiftPostgresPythonTerraformVertica
An Hour Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Financial Services
As a Lead Software Engineer, you will design and maintain ETL processes, collaborate with teams to address data requirements, optimize performance, and mentor junior engineers.
Top Skills: SparkAWSFlinkHadoopJavaKafkaMySQLOraclePythonScalaSQLSQL Server
7 Days Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Financial Services
Lead software engineer responsible for designing and delivering technology products, executing software solutions, creating production code, and contributing to team culture and improvements.
Top Skills: Ci/CdGuiceIgniteJavaKafkaKotlinSolaceSpring

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account