Build and maintain large-scale PySpark/Spark data reconciliation pipelines on Hadoop/Big Data platforms; integrate with Kafka, APIs and microservices; support capital markets regulatory reporting and reconciliations; lead globally distributed teams, manage stakeholders, and deliver solutions with strong application design and optional UI integration.
Job Title: PySpark Data Reconciliation Engineer
- 7+ years of relevant experience in technology and development.
- Technical skillset required:
- (1) Language: Java or Python
- (2) Experience with BigData/Hadoop/Spark/Kafka
- (3) Experience with APIs and microservices architecture
- (4) UI Development and integration experience would be a plus.
- Domain required:
- Experience in a capital market domain.
- Experience in Regulatory reporting or reconciliations (tech) would be a big plus.
- Proven track record of delivering large scale projects with globally distributed teams.
- Strong experience in applications development, design paradigms. Previous experience with data domain would be a plus.
- Experience in stakeholder management and managing global technology team is a must.
- Consistently demonstrates clear and concise written and verbal communication
Similar Jobs
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Full Stack Engineer will manage technical roadmaps, develop software solutions, and lead projects for sourcing processes, ensuring quality and efficiency.
Top Skills:
.NetCoupaCSSHTMLJavaJavaScriptPegaPHPPythonRubySAP
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Technical leader driving architecture and delivery of large-scale full-stack, customer-facing products. Designs scalable distributed systems, modern UIs, and AI-powered experiences (LLMs, copilots). Mentors engineers, conducts architecture reviews, owns production reliability, and partners with product, UX, and data teams to deliver enterprise-scale solutions.
Top Skills:
Ai AgentsAnalyticsAPIsCloud-Native ArchitecturesDevOpsGenerative AiJavaScriptLlmsMicroservicesPrompt EngineeringRagReactServicenow PlatformTelemetryTypescriptVector DatabasesWeb Components
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Generate qualified meetings through outbound prospecting (phone, email, social), qualify interest per guidelines, document interactions in ServiceNow, support follow-up for marketing events, and meet KPIs while participating in development simulations and GBA training.
Top Skills:
Ai-Native ToolsCloud ComputingSaaSServicenow
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
