Role: SDE III Data Engineer
Location: Remote
Employment Type: Contractor (6 months)
Application
Stack
· Python/ PySpark
· Apache AirFlow
· Snowflake
· SQL Database
· MLOps
· Snowpark
· Azure/AWS Functions
· Blob Storage
· XML, JSON
· GitHub
Essentials for
Being Successful in This Role
· Minimum 5 years of
experience in software development and system design
· Minimum 2 years of
experience as a Data Engineer focused on data modelling, governance, and
platform administration.
· Expertise in Snowflake or
similar MPP databases.
· Strong SQL skills.
· Experience with multiple
database technologies (MSSQL, PostgreSQL, OLAP, OLTP).
· Familiarity with ETL/ELT tools
and methodologies.
· Experience with database health
monitoring, stored procedures, and schema design.
· Practical understanding of data
governance principles.
· Experience with cloud
environments (SaaS, PaaS, IaaS).
· Strong communication skills,
both written and verbal.
· Experience in technical design
and documentation.
· Proficiency with source control
systems (Git, Gitflow).
· Experience with Agentic AI
(Claude, GPT, etc.).
Desirables
(Nice to Have)
· Familiarity with Generative AI
and Spec-Driven Development.
· Experience with test
automation.
· Experience with Kafka, Azure
Event Hubs, Azure Service Bus.
· Knowledge of CI/CD practices.
· Ability to work independently
and within Agile teams.
· Experience with Azure cloud
services.
· Exposure to Master Data
Management (MDM).
· Python skills for data
transformation and pipeline automation.
· Understanding data mesh
principles.
· Strong prioritization and
multitasking abilities.
Roles &
Responsibilities
· Designing, building, testing,
and maintaining scalable data models using Apache Airflow and Python.
· Administering Snowflake
environments, monitoring system health and performance.
· Managing and optimizing
Snowflake virtual warehouses for efficiency and cost-effectiveness.
· Managing the MLOps workflow
through Snowflake registrations and Snowpark.
· Promoting self-service and
decentralized data ownership across teams.
· Enforcing data governance
policies to ensure standardization, quality, and compliance.
· Providing technical assistance
and cross-training to team members.
· Participating in design
sessions and creating technical design documents and diagrams.
· Conducting code reviews and
offering constructive feedback.
· Mentoring engineers to support
team growth and development.
· Collaborating with senior
engineers in the Architecture Review Board.
· Ensuring delivery quality and
supporting production services.
