emids Logo

emids

Senior Consultant

Posted 6 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in India
Senior level
In-Office or Remote
Hiring Remotely in India
Senior level
Design and build scalable data pipelines and modern data platform components on AWS Lakehouse using Databricks. Implement batch and streaming solutions, manage clusters and Delta Lake operations (vacuuming), optimize costs, and establish CI/CD, unit testing, security scanning, and AI-assisted development practices. Provide architect-level guidance and drive engineering standards.
The summary above was generated by AI

Databricks Engineer – Data Engineering (AWS) will build build scalable data pipelines and contribute to modern data platform development using AWS and Lakehouse architecture.

The candidate has solid hands-on Databricks experience and showed good engagement, passion, and familiarity with batch/streaming concepts, clustering, vacuuming, and cost-modeling considerations.

However, we do not recommend moving forward. The main concern is that the candidate frequently gave lengthy, indirect answers that did not address the specific questions asked, even after redirection. There were also notable gaps in modern data engineering practices, especially around CI/CD, unit testing, security scanning, and practical use of AI in development workflows.

Given the architect-level expectations for this role, the candidate may struggle to operate independently, provide clear guidance, and drive engineering standards effectively.

Similar Jobs

6 Days Ago
In-Office or Remote
India
Senior level
Senior level
Healthtech • Information Technology • Other • Software • Analytics
Design and build scalable data pipelines and a modern data platform on AWS using Databricks and Lakehouse architecture. Implement batch and streaming processing, cluster management, vacuuming, and pipeline cost modeling. Establish and drive engineering standards including CI/CD, unit testing, security scanning, and practical AI integration. Operate at an architect level to provide technical guidance and ownership.
Top Skills: AISparkAWSCi/CdDatabricksDelta LakeLakehouseSecurity ScanningUnit Testing
7 Days Ago
In-Office or Remote
India
Senior level
Senior level
Healthtech • Information Technology • Other • Software • Analytics
Design, develop, and maintain Splunk dashboards, reports, alerts and integrations. Administer Splunk Enterprise and forwarders, implement custom scripts (Python/PowerShell), analyze and optimize performance, collaborate with stakeholders in Agile ceremonies, mentor developers, and maintain documentation.
Top Skills: Data MiningPowershellPythonRegular Expressions (Regex)SplunkSplunk Dashboard DevelopmentSplunk EnterpriseSplunk ForwarderSQL
3 Days Ago
Remote
India
Senior level
Senior level
Security • Software
Lead design, develop, test and support SAP ABAP solutions, deliver RICEFW objects, integrate SAP with third-party systems, optimize performance, produce technical documentation, mentor junior developers, and help adopt AI/automation in the SAP ecosystem.
Top Skills: AbapAIBadisBapisCds ViewsData Dictionary ObjectsFunction ModulesMachine LearningOdataRicefwSap AbapSap EccSap Gateway Odata ServicesSecure Abap Coding StandardsSmart FormsThird-Party IntegrationsUser ExitsWeb Services

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account