ProPharma Logo

ProPharma

Data Engineer

Posted 4 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
Seeking a Data Engineer to design and optimize data pipelines using Python, SQL, and AWS. Responsibilities include ETL pipeline development, database management, and collaboration with data analysts.
The summary above was generated by AI

For the past 20 years, ProPharma has improved the health and wellness of patients by providing advice and expertise that empowers biotech, med device, and pharmaceutical organizations of all sizes to confidently advance scientific breakthroughs and introduce new therapies. ProPharma partners with its clients through an advise-build-operate model across the complete product lifecycle. With deep domain expertise in regulatory sciences, clinical research solutions, quality & compliance, pharmacovigilance, medical information, and R&D technology, ProPharma offers an end-to-end suite of fully customizable consulting solutions that de-risk and accelerate our partners’ most high-profile drug and device programs.

Job Description

ProPharma are seeking a versatile Data Engineer with expertise in Python, SQL, and AWS cloud (Glue and Lambda) to design and optimize modern data pipelines and architectures. Skilled in data modeling, ETL, and database management across PostgreSQL, and SQL Server, this role blends technical problem-solving with strong communication and customer service. Ideal for a quick learner passionate about building scalable, high-performance data solutions in dynamic environments.

If this sounds like you - apply today!

Main Responsibilities:

  • Build scalable ETL/ELT pipelines using Python (e.g., Pandas, PySpark), AWS Glue for ingestion, AWS Lambda for transformations, and load into AWS data stores.

  • Design and manage schemas for relational databases (Amazon RDS, Aurora, PostgreSQL/MySQL).

  • Optimize queries and indexing for performance and cost efficiency.

  • Work with OLAP systems such as Amazon Redshift for analytical workloads.

  • Package Python-based data services with Docker and deploy on Amazon ECS or Amazon EKS.

  • Integrate databases and AWS services via psycopg2 and boto3.

  • Develop scripting and automation for recurring data workflows and monitoring tasks.

  • Maintain data lineage and catalogs using AWS Glue Data Catalog or Apache Atlas.

  • Ensure compliance with policies for GDPR, HIPAA, and SOC2.

  • Configure observability and monitoring with Amazon CloudWatch.

  • Implement error handling and retry strategies in ETL/ELT workflows.

  • Set up alerting for data pipeline failures or anomalies.

  • Collaborate with data analysts and scientists to make curated data accessible.

  • Document pipelines, schemas, and APIs for maintainability and knowledge sharing.

  • Follow up on tickets to ensure issues are resolved.

  • Keep good records of communications with colleagues.

  • Identify and suggest areas for improvement.

Necessary Skills and Abilities:

  • Python: data manipulation, ETL (Extract, Transform, Load) pipelines, automation, and integration tasks.

  • SQL: querying and manipulating databases

  • PostgreSQL, MySQL, Microsoft SQL Server: Experience designing schemas, writing queries, and managing data integrity.

  • AWS, Azure Data services S3, Lambda, Redshift, Glue (AWS)

  • Data Modeling: Understanding of star/snowflake schemas, normalization/denormalization., partitioning, and optimizing large datasets for analytics.

  • Data Lakes  Experience with modern architectures

  • CI/CD: Familiarity with tools for deploying data pipelines

  • Good understanding of computing systems and devices.

  • Ability to diagnose and resolve technical issues.

  • Excellent written and oral communications skills.

  • Strong customer service skills.

  • Efficient and quick learner.

  • Strong written and oral communication skills.

Educational Requirements:

  • Degree in relevant subject.

  • CompTIA Network+ Certification (desirable).

  • MCDST for Windows 10 Pro (desirable)

Experience Requirements:

  • Minimum three years' experience in technician or similar applicable role.

We celebrate our differences and strive to create a workplace where each person can be their authentic self. We are committed to diversity, equity, and inclusion. Employees are encouraged to unleash their innovative, collaborative, and entrepreneurial spirits. With a holistic approach as an Equal Opportunity Employer, we provide a safe space where all employees feel empowered to succeed.

All applications to roles at ProPharma are personally reviewed by a member of our recruitment team. We do not rely on AI screening tools to support our hiring process. You will always receive an outcome to your application so that you have an answer from us - whether you're successful or not.

Whilst ProPharma supports remote working, we also recognise the value that comes from in person collaboration. As such, we encourage any new hires that are based within a reasonably short commute of one of our offices to work on a hybrid basis and spend some time working from that office location, as agreed with your manager. All applications will be treated on their own merit and candidates will not be at any advantage or disadvantage based on their proximity to an office.

***ProPharma Group does not accept unsolicited resumes from recruiters/third parties. Please, no phone calls or emails to anyone regarding this posting.***

Top Skills

Amazon Ecs
Amazon Eks
Amazon Redshift
AWS
Aws S3
Ci/Cd
Docker
Glue
Lambda
Microsoft Sql Server
MySQL
Postgres
Python
SQL

Similar Jobs

2 Days Ago
Remote or Hybrid
India
Mid level
Mid level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The GEN BI Engineer will design and deliver innovative BI solutions, collaborate with stakeholders, and build scalable systems using data for strategic decisions.
Top Skills: BigQueryGCPPower BIPythonSQL
3 Days Ago
In-Office or Remote
Bengaluru, Bengaluru Urban, Karnataka, IND
Mid level
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Data Engineer, you'll build analytical data models, manage data pipelines, and evolve solutions to meet business needs within Atlassian's data engineering team.
Top Skills: AirflowAWSFlinkHiveJavaKafkaPythonSparkSQL
5 Hours Ago
In-Office or Remote
Bangalore, Bengaluru Urban, Karnataka, IND
Mid level
Mid level
Biotech
The Data Engineer will design and implement scalable data solutions, manage end-to-end data pipelines, ensure data quality, and collaborate with teams to meet project goals.
Top Skills: AzureDatabricksMicrosoft FabricPythonSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account