Build and maintain large-scale PySpark/Spark data reconciliation pipelines on Hadoop/Big Data platforms; integrate with Kafka, APIs and microservices; support capital markets regulatory reporting and reconciliations; lead globally distributed teams, manage stakeholders, and deliver solutions with strong application design and optional UI integration.
Job Title: PySpark Data Reconciliation Engineer
- 7+ years of relevant experience in technology and development.
- Technical skillset required:
- (1) Language: Java or Python
- (2) Experience with BigData/Hadoop/Spark/Kafka
- (3) Experience with APIs and microservices architecture
- (4) UI Development and integration experience would be a plus.
- Domain required:
- Experience in a capital market domain.
- Experience in Regulatory reporting or reconciliations (tech) would be a big plus.
- Proven track record of delivering large scale projects with globally distributed teams.
- Strong experience in applications development, design paradigms. Previous experience with data domain would be a plus.
- Experience in stakeholder management and managing global technology team is a must.
- Consistently demonstrates clear and concise written and verbal communication
Similar Jobs
Cloud • Information Technology • Security • Software
Provides Tier 1 technical support to SaaS customers through email, phone, chat, and remote sessions. Troubleshoots macOS, MDM, directory services, iOS management, software management, APIs, and user lifecycle issues. Manages high-priority tickets, reproduces defects, collaborates with engineering and product teams, supports customer onboarding, maintains knowledge-base content, and participates in on-call coverage.
Top Skills:
Ai Prompt EngineeringApple Mobile Device Management (Mdm)AptCentosDebianDepFilevaultGoogle WorkspaceiOSKeychainLdapLinuxmacOSOktaPamRest ApisRhelRpmScriptingSshUbuntuVolume Purchase Program (Vpp)Yum
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Performs complex semiconductor manufacturing operations independently, serves as a subject matter expert, troubleshoots equipment and process issues, and supports yield, scrap, cycle-time, and productivity improvements. Analyzes manufacturing data, trains production associates, supports engineering evaluations and product introductions, investigates root causes, implements corrective actions, and maintains safety, cleanroom, quality, and operational standards while working rotating 12-hour shifts.
Top Skills:
Cleanroom OperationsHigh-Volume Production OperationsManufacturing EquipmentManufacturing SystemsProcess ControlsSemiconductor Manufacturing
Artificial Intelligence • Hardware • Information Technology • Machine Learning
The GQ NVMQRA Manager oversees a team ensuring SSD product quality and reliability, manages workflows, budgets, and equipment, and supports team development.
Top Skills:
Data AnalysisProject ManagementQuality AssuranceSolid State Drives
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
