Design, develop, and modernize enterprise-scale Azure data platforms. Lead solution architecture, refactor and optimize PySpark/Databricks pipelines, implement ETL/ELT and lakehouse/warehousing solutions, ensure performance, data quality, governance, and mentor junior engineers.
Enable Data seeking an experienced Azure Data Architect with strong hands-on engineering expertise to design, develop, optimize, and modernize enterprise-scale data platforms. The role combines solution architecture, technical leadership, and individual contributor responsibilities, requiring deep expertise in Azure data services, data engineering best practices, and large-scale data processing using PySpark, Python, SQL, and Azure Databricks.
The ideal candidate will be responsible for analyzing existing data products and pipelines, identifying improvement opportunities, leading refactoring and redesign initiatives, and implementing scalable, reliable, and high-performance data solutions on Azure.
Responsibilities- Architecture & Solution Design
- Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions.
- Design end-to-end data architectures on Microsoft Azure.
- Define data ingestion, transformation, storage, governance, and consumption strategies.
- Create scalable, secure, and cost-effective data solutions aligned with business objectives.
- Establish architectural standards, design patterns, and best practices for data engineering teams.
- Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions.
- Design, develop, and modernize enterprise data platforms on Azure. Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions.
- Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices.
- Strong hands-on experience in PySpark, Python, and SQL
- Expertise in Azure Databricks and Azure data ecosystem
- Experience designing and implementing scalable data architectures
- Ability to analyze, optimize, refactor, and redesign existing data pipelines
- Develop and maintain ETL/ELT solutions and data products
- Performance tuning, troubleshooting, and data quality implementation
- Mentor and guide junior developers and conduct code reviews
- Collaborate with cross-functional teams to deliver end-to-end data solutions
Required Experience
Requirements
- Azure Data Lake, Azure Data Factory, Azure Synapse
- Data warehousing, lakehouse architecture, and cloud migration
- CI/CD, Git, and Agile development practices
- Role Type: Senior Individual Contributor with Technical Leadership responsibilities.
Similar Jobs
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Manage corporate T&E card program including card issuance, activation/deactivation, limit management, and reconciliation with Concur. Provide cardholder support, enforce policy compliance, monitor aging reports, coordinate with payments, produce usage and delinquency reports, assist audits, and drive process improvements and automation.
Top Skills:
ConcurExcelSAP
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead and evolve Circle's visual identity across campaigns, product launches, events, social, and product marketing. Create scalable brand systems, storyboards, and launch assets; collaborate with Motion, Product Marketing, and Content; present concepts, iterate on feedback, and research AI tools to improve creative workflows and consistency.
Top Skills:
Adobe Creative SuiteAi-Powered Creative ToolsFigma
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead a distributed SRE team owning CI/CD platform reliability, automation, observability, and data infrastructure. Provide people management, technical direction, architecture input, operational excellence, and cross-team collaboration while driving automation, monitoring, and AI-assisted workflows.
Top Skills:
AnsibleApache AirflowSparkAWSAzureBashBazelBitbucketChefDatadogGCPGitGithub ActionsGitlabGitlab CiGoGrafanaHumio/LogscaleJenkinsKafkaKubernetesNasNfsObject StorageOpensearchOraclePostgresPowershellPrometheusPulsarPuppetPythonRedisRedpandaSanSli/SloSplunkTerraformValleyVarnish
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
