InOrg Global Logo

InOrg Global

Data Engineer – Databricks

Posted 5 Days Ago
Be an Early Applicant
India
Mid level
India
Mid level
The Data Engineer will design and maintain scalable data pipelines using Databricks and Apache Spark, integrating data from multiple sources and ensuring data quality. Responsibilities include automating workflows and collaborating with analysts on data needs.
The summary above was generated by AI

Job Title: Data Engineer – Databricks

Company: Inorg Global

Type: Full-time

Experience Level: Mid to Senior

About Us

At Inorg Global, we deliver advanced data solutions that empower organizations to harness their data for strategic decision-making. We're seeking a skilled Data Engineer with hands-on Databricks experience to help build robust pipelines and support scalable analytics and machine learning initiatives.

Key Responsibilities

Design, build, and maintain scalable data pipelines using Databricks and Apache Spark.

Integrate data from various sources into data lakes or data warehouses.

Implement and manage Delta Lake architecture for reliable, versioned data storage.

Ensure data quality, performance, and reliability through testing and monitoring.

Collaborate with data analysts, scientists, and stakeholders to meet data needs.

Automate workflows and manage job scheduling within Databricks.

Maintain clear and thorough documentation of data workflows and architecture.

Requirements

Experience: 3+ years in data engineering with strong exposure to Databricks and big data tools.

Technical Skills:

Proficient in Python or Scala for ETL development.

Strong understanding of Spark, Delta Lake, and Databricks SQL.

Familiar with REST APIs, including Databricks REST API usage.

Cloud Platform: Experience with AWS, Azure, or GCP.

Data Modeling: Familiarity with data lakehouse concepts and dimensional modeling.

Version Control & CI/CD: Comfortable using Git and pipeline automation tools.

Soft Skills: Strong problem-solving abilities, attention to detail, and teamwork.

Nice to Have

Certifications: Databricks Certified Data Engineer Associate/Professional.

Workflow Tools: Experience with Airflow or Databricks Workflows.

Monitoring: Familiarity with Datadog, Prometheus, or similar tools.

ML Pipelines: Exposure to MLflow or model integration in pipelines.

Top Skills

Spark
AWS
Azure
Databricks
Databricks Sql
Delta Lake
GCP
Git
Python
Rest Apis
Scala

Similar Jobs

9 Days Ago
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Design and manage data infrastructure, optimizing data models, ETL processes, and providing mentorship to junior engineers, ensuring high-quality deliverables.
Top Skills: AWSAzure Data FactoryDatabasesDatabricksDlt PipelinesPysparkPython
22 Hours Ago
Hybrid
Bengaluru, Karnataka, IND
Mid level
Mid level
Financial Services
The Data Engineer III develops and maintains data pipelines and architectures, ensures data security, and contributes to agile team efforts in the Asset & Wealth Management sector.
Top Skills: AWSDatabricksPythonSparkSQL
9 Days Ago
Hybrid
Gurgaon, Gurugram, Haryana, IND
Senior level
Senior level
Cloud • Information Technology • Software
The Data Engineer III will manage cloud data platforms, perform troubleshooting, incident management, and lead communication with stakeholders, requiring 8+ years of experience.
Top Skills: Aws App FlowAws DwsDatabricksDbtPower BISQLSsisSsrsTableau

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account