Architects and maintains real-time and batch data pipelines using Azure services, Python/PySpark, and Databricks. Designs modern data warehouses, data models, and data lakes; integrates and transforms diverse data sources; implements security and governance; optimizes SQL and data workflows; and provides technical leadership through code reviews, mentoring, and standards development.
This is a remote position.
Overview :
- Data Pipeline Engineering: Architect, build, and maintain complex, real-time, and batch data pipelines using Azure Data Factory, Python/PySpark, and Databricks.
- • Architecture & Modelling: Design and implement modern data warehouse solutions, data models, and data lakes, optimizing for performance and scalability.
- • Data Ingestion & Integration: Ingest, cleanse, and transform data from diverse sources into usable data structures for analytics.
- • Security & Governance: Implement security features, including role-based access control (RBAC), data encryption, and governance via Azure Purview.
Requirements
- • Performance Optimization & Monitoring: Troubleshoot and tune data systems and SQL queries for efficiency; monitor data workflows.
- • Technical Leadership & Mentorship: Lead code reviews, mentor junior engineers, and define technical standards and best practices.
- • Collaboration: Work with data scientists, analysts, and stakeholders to deliver actionable business insights.
- • Azure Services: Azure Data Factory, Databricks, Synapse Analytics, Data Lake Storage.
- • Languages & Tools: Python/PySpark, SQL, Scala, CI/CD (DevOps) tools.
- • Processes: ETL/ELT, Data Modelling, Data processing
Benefits
Diversity Inclusion:
At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, color, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.
Exavalu also promotes flexibility depending on the needs of employees, customers and the business. It might be part-time work, working outside normal 9-5 business hours or working remotely.. We also have a welcome back program to help people get back to mainstream after a long break due to health or family reasons
Similar Jobs
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Manage end-to-end digital marketing campaigns and executions including builds, audience segmentation, testing, deployment, and optimization. Administer marketing automation stack, support integrations, track KPIs with channel managers, and improve lead lifecycle processes, nurturing, data hygiene, and workflow automation. Maintain documentation, templates, and share campaign best practices across stakeholders.
Top Skills:
6SenseAi Automation ToolsMarketoPendoSalesforceZuddl
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Support regulatory liquidity reporting by applying predefined rules and mappings, performing variance analysis and reconciliations, documenting business/functional requirements, coordinating BA/IT/testing streams, and contributing to governance, controls and audit readiness within regulatory change programmes.
.png)
Healthtech • Social Impact • Telehealth
As a Care Coordinator, you will guide older adults and their caregivers through the intake process, providing support and emotional guidance during their journey into care.
Top Skills:
CrmsEhr PlatformsGoogle Workspace
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
