The Senior Data Engineer will build scalable data models and pipelines in Palantir Foundry, driving data ingestion, transformation, and enabling Power BI visualization. Responsibilities include normalizing data, integrating various tool datasets, automating ETL processes, and collaborating with key stakeholders for high-quality insights.
We are seeking a Data Engineer with expertise in Palantir Foundry to build scalable, normalized data models and pipelines. This role will drive data ingestion, transformation, and normalization while enabling visualization development in Power BI. The ideal candidate will work closely with the Product Manager, Data analysts, and key stakeholders to deliver clean, structured insights.
Key Responsibilities:
- Data Modeling and Normalization:
- Develop and implement scalable data models in Palantir Foundry.
- Normalize data from ERP systems (SAP, JD Edwards) to ensure cross-client consistency.
- ETL and Data Pipelines:
- Build and automate data ingestion pipelines to reduce manual intervention.
- Develop processes for cleaning, validating, and transforming large datasets.
- Visualization Development:
- Collaborate with analysts to design reusable Power BI dashboards and views.
- Ensure seamless integration of clean, normalized data into Power BI.
- Tool Integration:
- Integrate Cap IQ and other external datasets into Palantir pipelines.
- Optimize data workflows to accelerate the creation of industry-specific templates.
- Collaboration and Scalability:
- Work with the Product Manager and Data Analysts to align normalization rules and requirements, enabling modular and reusable data solutions.
- 7-10 years in data engineering
- Strong software engineering fundamentals to build high-quality pipelines
- Experience with Palantir Foundry (or similar big data platforms).
- Expertise in building ETL pipelines and automating data ingestion processes.
- Proficiency in data wrangling, normalization, and modeling.
- Hands-on experience with Power BI for creating dashboards and integrating data models.
- Strong SQL skills for data transformation and querying.
- Solid understanding of ERP data systems (SAP, JD Edwards) and attributes.
Nice-to-Have:
- Familiarity with Cap IQ APIs and integration processes.
Top Skills
Palantir Foundry
Power BI
SQL
Similar Jobs
Be an Early Applicant
The role involves designing and maintaining data infrastructure, focusing on integration, storage, processing, and analytics. Responsibilities include collaboration with teams to develop data products, mentor junior staff, and manage large-scale migrations and data governance.
Be an Early Applicant
As a Senior Data Engineer (Azure), you will develop software and systems for large-scale projects, manage the end-to-end execution of technology services, and innovate solutions for enterprise clients. You will work closely with the Technology team, applying your expertise in Azure and data engineering principles.
Be an Early Applicant
As a Data Engineer - Azure, you will innovate and maintain technology services for large-scale data engineering projects, focusing on Azure components while managing teams and problem-solving to deliver complex client solutions effectively.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
