Palo Alto Labs Logo

Palo Alto Labs

Data Enigneer-III

Posted 2 Months Ago
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Senior level
In-Office
Pune, Maharashtra, IND
Senior level
Design, build, test, and maintain scalable data models and pipelines using Python, PySpark, and Apache Airflow. Administer and optimize Snowflake environments, virtual warehouses, and MLOps workflows. Enforce data governance, quality, and compliance standards while supporting self-service data ownership. Create technical designs, conduct code reviews, mentor engineers, support production services, and collaborate with architecture teams.
The summary above was generated by AI

Role: SDE III Data Engineer
Location: Remote
Employment Type: Contractor (6 months)

 

Application Stack 

·       Python/ PySpark

·       Apache AirFlow

·       Snowflake

·       SQL Database

·       MLOps

·       Snowpark

·       Azure/AWS Functions

·       Blob Storage

·       XML, JSON

·       GitHub

 

 

Essentials for Being Successful in This Role

·       Minimum 5 years of experience in software development and system design 

·       Minimum 2 years of experience as a Data Engineer focused on data modelling, governance, and platform administration.

·       Expertise in Snowflake or similar MPP databases.

·       Strong SQL skills.

·       Experience with multiple database technologies (MSSQL, PostgreSQL, OLAP, OLTP).

·       Familiarity with ETL/ELT tools and methodologies.

·       Experience with database health monitoring, stored procedures, and schema design.

·       Practical understanding of data governance principles.

·       Experience with cloud environments (SaaS, PaaS, IaaS).

·       Strong communication skills, both written and verbal.

·       Experience in technical design and documentation.

·       Proficiency with source control systems (Git, Gitflow).

·       Experience with Agentic AI (Claude, GPT, etc.).  

 

Desirables (Nice to Have) 

·       Familiarity with Generative AI and Spec-Driven Development.

·       Experience with test automation.

·       Experience with Kafka, Azure Event Hubs, Azure Service Bus.

·       Knowledge of CI/CD practices.

·       Ability to work independently and within Agile teams.

·       Experience with Azure cloud services.

·       Exposure to Master Data Management (MDM).

·       Python skills for data transformation and pipeline automation.

·       Understanding data mesh principles.

·       Strong prioritization and multitasking abilities.

 

Roles & Responsibilities 

·       Designing, building, testing, and maintaining scalable data models using Apache Airflow and Python.

·       Administering Snowflake environments, monitoring system health and performance.

·       Managing and optimizing Snowflake virtual warehouses for efficiency and cost-effectiveness.

·       Managing the MLOps workflow through Snowflake registrations and Snowpark.

·       Promoting self-service and decentralized data ownership across teams.

·       Enforcing data governance policies to ensure standardization, quality, and compliance.

·       Providing technical assistance and cross-training to team members.

·       Participating in design sessions and creating technical design documents and diagrams.

·       Conducting code reviews and offering constructive feedback.

·       Mentoring engineers to support team growth and development.

·       Collaborating with senior engineers in the Architecture Review Board.

·       Ensuring delivery quality and supporting production services.



Palo Alto Labs Pune, Mahārāshtra, IND Office

Pune, India, 411006

Similar Jobs

36 Minutes Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Develop and maintain scalable Java backend applications using Spring Boot, microservices, and REST APIs. Own features through design, development, testing, deployment, and production support. Collaborate with product, architecture, mobile, QA, and DevOps teams; participate in code reviews, troubleshooting, root cause analysis, and technical design discussions. Contribute to secure, resilient, maintainable services, coding standards, engineering best practices, and continuous improvement.
Top Skills: Design PatternsJavaMicroservicesObject-Oriented ProgrammingRest ApisSpring Boot
36 Minutes Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, develop, optimize, and support scalable batch and real-time data pipelines using Kafka, Spark, Scala/PySpark, SQL, Python, and orchestration tools. Build reliable ETL/ELT workflows, optimize distributed processing, manage cloud data lake storage, troubleshoot production incidents, perform root cause analysis, conduct code reviews, and mentor junior engineers. Independently deliver complex data engineering solutions with emphasis on scalability, performance, reliability, and maintainability.
Top Skills: Amazon S3Apache AirflowApache KafkaApache NifiSparkAzure Data FactoryAzure Data Lake StorageData LakesPysparkPythonScalaSQL
Yesterday
Hybrid
Expert/Leader
Expert/Leader
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Designs and maintains scalable UI and API automation frameworks using Playwright and TypeScript. Tests functional, regression, integration, smoke, and end-to-end scenarios for AI-powered applications, including LLMs, AI agents, prompts, and autonomous workflows. Develops evaluation frameworks for response quality, accuracy, safety, reliability, and performance; integrates automation into CI/CD pipelines; manages defects and quality reporting; and mentors junior QA engineers.
Top Skills: Agentic AiAi AgentsAi Evaluation FrameworksCi/CdLarge Language Models (Llms)PlaywrightRest ApisTypescript

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account