Design and implement Databricks solutions, develop data pipelines, optimize performance, ensure security, and lead technical initiatives.
Job Summary:
We're seeking an experienced Data Architect / Senior Data Architect/ Associate Data ArchitectExpertise in data engineering across major data platforms. The ideal candidate will have a
strong background in Python, SQL, ETL, and data modeling, with experience in tools like
Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud
knowledge (AWS, Azure, or GCP) is a plus. The role requires a willingness to transition and
upskill into Databricks & AI/ML projects.
Key Responsibilities:
● Design, develop, and maintain large-scale data systems
● Develop and implement ETL processes using various tools and technologies
● Collaborate with cross-functional teams to design and implement data models
● Work with big data tools like Hadoop, Spark, PySpark, and Kafka
● Develop scalable and efficient data pipelines
● Troubleshoot data-related issues and optimize data systems
● Transition and upskill into Databricks & AI/ML projects
Requirements:
● Relevent experience in data engineering
● Strong proficiency in Python, SQL, ETL, and data modeling
● Experience with one or more of the following:
○ Teradata
○ Informatica
○ Hadoop
○ Spark
○ PySpark
○ ADF
○ Snowflake
○ Big Data
○ Scala
○ Kafka
● Cloud knowledge (AWS, Azure, or GCP) is a plus
● Willingness to learn and adapt to new technologies, specifically Databricks & AI/ML
Nice to Have:
● Experience with Databricks
● Knowledge of AI/ML concepts and tools
● Certification in relevant technologies
What We Offer:
● Competitive salary and benefits
● Opportunity to work on cutting-edge projects
● Collaborative and dynamic work environment
● Professional growth and development opportunities
● Remote work opportunities & flexible hours
Top Skills
AWS
Azure
Databricks
Databricks Apis
Delta Lake
GCP
Java
Python
Scala
Spark
Similar Jobs
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Lead the development of Ab Initio applications at TransUnion, ensuring adherence to best practices and guiding junior developers.
Top Skills:
Ab InitioCi/CdHadoopJenkinsLinux
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Design, develop, and implement microservice-based applications using Java technologies. Collaborate with teams for high-quality software delivery while addressing scalability and performance issues.
Top Skills:
ActivemqAmqpApache CamelAWSAzureCi/CdDockerGCPGroovyJ2EeJavaJavaScriptJenkinsJmsKubernetesMavenMongoDBMqttOraclePostgresRdbmsRestful Web ServiceSpringSpring BootSQLTypescript
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Develop and integrate software solutions for engineering and manufacturing, collaborating with a diverse team to meet user requirements and solve complex problems.
Top Skills:
AgileAngularArtifactoryBootstrapCloudDevOpsDockerGitGitlabGradleHibernateJ2EeJavaJavaScriptJenkinsMavenMs SqlNode JsOraclePivotal Cloud FoundryPythonSonarSpring BootSpring MvcStrutsTfsVeracode
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
