Design and implement Databricks solutions, develop data pipelines, optimize performance, ensure security, and lead technical initiatives.
Job Title: Data Architect – Databricks
Company: V4C.ai
Type: Full-time
Experience Level: Senior
We're seeking a skilled Data Architect with hands-on Databricks experience to help build robust pipelines and support scalable analytics and machine learning initiatives.
Key Responsibilities
- Databricks Solution Architecture: Design and implement scalable, secure, and efficient Databricks solutions that meet client requirements.
- Data Engineering: Develop data pipelines, architect data lakes, and implement data warehousing solutions using Databricks.
- Data Analytics: Collaborate with data scientists and analysts to develop and deploy machine learning models and analytics solutions on Databricks.
- Performance Optimization: Optimize Databricks cluster performance, ensuring efficient resource utilization and cost-effectiveness.
- Security and Governance: Implement Databricks security features, ensure data governance, and maintain compliance with industry regulations.
- Client Engagement: Work closely with clients to understand their business requirements, provide technical guidance, and deliver high-quality Databricks solutions.
- Thought Leadership: Stay up to date with the latest Databricks features, best practices, and industry trends, and share knowledge with the team.
Requirements
- Databricks Experience: 5+ years of experience working with Databricks, including platform architecture, data engineering, and data analytics.
- Technical Skills: Proficiency in languages such as Python, Scala, or Java, and experience with Databricks APIs, Spark, and Delta Lake.
- Data Engineering: Strong background in data engineering, including data warehousing, ETL, and data governance.
- Leadership: Proven experience leading technical teams, mentoring junior engineers, and driving technical initiatives.
- Communication: Excellent communication and interpersonal skills, with the ability to work effectively with clients and internal stakeholders.
Good to Have
- Certifications: Databricks Certified Professional or similar certifications.
- Cloud Experience: Experience working with cloud platforms such as AWS, Azure, or GCP.
- Machine Learning: Knowledge of machine learning concepts and experience with popular ML libraries
Top Skills
AWS
Azure
Databricks
Databricks Apis
Delta Lake
GCP
Java
Python
Scala
Spark
Similar Jobs
Big Data • Cloud • Software • Database
The role involves managing projects in consulting for MongoDB, engaging with customers, driving service delivery, and developing strategies to meet targets.
Top Skills:
Cloud SolutionsEnterprise SoftwareMongoDBSoftware Solutions
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Unit Manager will lead business process excellence activities, implement lean methodologies, manage stakeholder relationships, and drive continuous improvement initiatives within the organization.
Top Skills:
Generative AiLean Six SigmaMicrosoft Power Platform ToolsMS OfficePower AppsPower AutomatePower BIPower PagesRpa ToolsTableauVba Macros
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Manager of Business Excellence will oversee operations, manage teams, and ensure optimal performance to enhance service delivery and efficiency within MetLife.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
