The Databricks Data Architect will design scalable data architectures, implement solutions on Databricks, lead ETL processes, and mentor teams.
Xenon7 is paving the way for data-driven decision-making through cutting-edge technology solutions. We are seeking a talented Databricks Data Architect to join our forward-thinking team. In this role, you will be instrumental in designing and implementing data architecture on the Databricks platform, ensuring that our data systems are scalable, efficient, and aligned with business objectives. You will collaborate with data engineers, data scientists, and stakeholders to transform business requirements into robust data models that enable advanced analytics and insights.
Responsibilities:- Design and implement scalable data architectures and data models using Databricks and Apache Spark.
- Lead the development of best practices for data integration, ETL processes, and data governance.
- Collaborate with cross-functional teams to understand business needs and translate them into technical specifications.
- Oversee the performance tuning of data systems and troubleshoot any issues that arise.
- Ensure data quality, integrity, and security across all data solutions.
- Stay abreast of advancements in data technologies and propose new solutions to enhance data management.
- Provide guidance and mentorship to data engineering teams in architectural best practices.
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- Minimum 11 years of experience in data architecture or data engineering roles, with a strong focus on Databricks.
- Deep understanding of Apache Spark and experience in building data architectures that leverage this technology.
- Strong experience with ETL processes, data modeling, and data warehousing concepts.
- Proficient in cloud services, especially AWS or Azure, and their integration with data solutions.
- Experience leading data architecture initiatives and collaborating with a diverse range of stakeholders.
- Excellent analytical problem-solving skills and attention to detail.
- Strong communication and interpersonal skills for effective collaboration.
- Experience in data governance, compliance, and security best practices is preferred.
Top Skills
Spark
AWS
Azure
Databricks
Similar Jobs
Cloud • Information Technology • Software
As a Data Architect, you will design modern data architectures on the Databricks platform, oversee data migration initiatives, implement CI/CD practices, and ensure compliance with industry standards.
Top Skills:
AlationSparkAWSAzureAzure DevopsCloudFormationCollibraDatabricks Unity CatalogDelta LakeDockerGCPGithub ActionsJenkinsKubernetesNoSQLPulumiPythonScalaSQLTerraform
Cloud • Information Technology • Software
The Data Architect will design and implement data architectures, lead migration initiatives, establish CI/CD pipelines, and mentor junior members. Focused on healthcare data, the role requires collaboration, technology evaluation, and compliance adherence.
Top Skills:
AlationSparkAWSAzureAzure DevopsCloudFormationCollibraDatabricksDatabricks Unity CatalogDelta LakeDockerGCPGithub ActionsJenkinsKubernetesNoSQLPulumiPythonScalaSQLTerraform
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Team Leader role involves analyzing business requirements and providing BI reporting solutions while managing analytics tools and leading a team in a fast-paced environment.
Top Skills:
Power BISQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.