The Senior Product Support Engineer will design and optimize Hadoop and Spark-based systems, troubleshoot performance issues, and support migrations while working in a 24/7 environment.
Position Summary:
We are seeking a Product Specialist - Hadoop SME (Subject Matter Expert) who will be responsible for designing, optimising, migrating and scaling Hadoop and Spark-based data processing systems. This role involves hands-on experience with Hadoop and other core data operations, focusing on building resilient, high-performance distributed data systems. You will collaborate with customer engineering teams to deliver high-throughput Hadoop and Spark applications and solve complex data challenges in migration, upgrades, reliability, and optimise post-migration system performance.
If you’re passionate about working in fast-paced, dynamic environments and want to be part of the cutting edge of data solutions, this role is for you.
We’re looking for someone who can:
- Design and optimise distributed Hadoop-based applications, ensuring low-latency, high-throughput performance for big data workloads.
- Troubleshooting: Provide expert-level support for data or performance issues in Hadoop and Spark jobs and clusters.
- Data Processing Expertise: Work extensively with large-scale data pipelines using Hadoop and Spark's core components
- Performance Tuning: Conduct deep-dive performance analysis, debugging, and optimisation of Impala and Spark jobs to reduce processing time and resource consumption.
- Cluster Management: Collaborate with DevOps and infrastructure teams to manage Impala and Spark clusters on platforms like Hadoop/YARN, Kubernetes, or cloud platforms (AWS EMR, GCP Dataproc, etc.).
- Migration: Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration. Promptly address evolving technical challenges and optimise system performance after migration to ODP.
- This role requires flexibility to work in rotational shifts, based on team coverage needs and customer demand.
Candidates should be comfortable supporting operations in a 24/7 environment and be willing to adjust their working hours accordingly.
Similar Jobs
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead sales enablement and end-to-end professional services for Mission Critical Networks (MCN). Act as single point of contact for commercial submissions, align integration and division of responsibility with SIs and partners, manage CoE systems and PoCs, develop E2E portfolio readiness, support CFRs on scope, timelines, and approvals, and provide early visibility of customer and SI requirements to inform roadmap and readiness.
Top Skills:
5GAutomationLteMission Critical Networks (Mcn)
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Own UK STDF actuals and stress testing outputs end-to-end, manage risk and control frameworks, maintain regulatory inventories, drive remediation in Helios, coordinate governance and approvals, prepare BCST 2027 readiness artifacts, and lead continuous improvement and automation of stress testing processes.
Top Skills:
HeliosSharepoint
.jpeg)
An Hour Ago
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Design, develop, and program QA disposition plans into Micron systems; automate QA disposition via scripting; execute fab lot dispositions; design and debug disposition rules; perform advanced data and statistical analysis; support automation and global metrics; and leverage AI/Generative AI for disposition, trend monitoring, and detection improvements.
Top Skills:
Ai ToolsData AnalysisGenerative AiMicron Disposition SystemSbl DispositionSoftware ScriptingStatistical Analytics
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
