Lead modernization of production data pipelines, designing architecture and incrementally migrating systems while preserving existing outputs. Perform hands-on engineering with Airflow, Spark, dbt, BigQuery, and Python. Establish testing, code review, incident management, and release processes; implement data security, retention, and deletion requirements. Mentor a Data Engineer and ensure reliable long-term ownership and maintenance of migrated pipelines.
Senior Data Engineer / Data Pipeline Architect
Location: Stockholm, Sweden (Hybrid – Travel Required)
Experience Required: 5 to 10 years
Duration: 6 months (Extendable)
Employment Type: FTE
Working Mode: Hybrid (Travel Required)
Language: English
Start: November 9, 2026 – April 30, 2027
We are looking for an experienced Senior Data Engineer / Data Pipeline Architect for an assignment in Stockholm focusing on data pipeline modernization, data security, and technical architecture.
The assignment involves leading the technical migration of existing data pipelines to meet stricter requirements for encryption, data retention, and deletion of user data, including historical and derived datasets.
Key Responsibilities- Design and drive the architecture, migrating pipelines incrementally while ensuring existing outputs remain unchanged.
- Establish sustainable engineering processes for testing, code reviews, incident management, and releases.
- Combine architectural leadership with hands-on engineering using Airflow, Spark, dbt, BigQuery, and Python.
- Collaborate closely with and mentor a Data Engineer within the team, ensuring long-term ownership, reliability, and independent maintenance of the migrated pipelines.
- Minimum 5 years of relevant professional experience (5–10 years overall).
- Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python.
- Proven experience technically leading at least one complete data pipeline migration from start to finish.
- Experience refactoring production data pipelines while verifying that their outputs remain unchanged.
- Experience establishing and implementing engineering processes for testing, code reviews, and incident management.
- Demonstrated mentoring experience with measurable outcomes.
- Minimum Bachelor's degree (or equivalent).
- Experience with encryption at rest, data retention, or data deletion compliance (e.g., GDPR).
- Experience with envelope encryption and key management solutions (e.g., GCP KMS, AEAD functions, or Tink).
- Knowledge of BigQuery column-level security, policy tags, and Data Catalog.
- Experience with Config Connector (KCC) for managing GCP resources through Kubernetes.
- Experience with event-driven architectures using Kafka.
Similar Jobs
Financial Services
Develop and maintain secure, scalable enterprise applications as a senior agile team member. Build Java and Spring Boot backends, React and TypeScript frontends, REST APIs, and AWS cloud solutions. Design architectures, troubleshoot complex technical issues, optimize PostgreSQL databases, and develop AWS Glue data workflows. Apply secure coding, resiliency, CI/CD, testing, and responsible AI-assisted development practices while analyzing data to improve systems and engineering effectiveness.
Top Skills:
AgileAi-Assisted Software Development ToolsAWSAws GlueCi/CdCSSHTML5JavaJavaScriptPostgresReactRestful ApisSpring BootTypescript
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Leads architecture, design, and delivery of scalable software and analytics platforms. Provides technical direction, mentors engineers, conducts code reviews, resolves complex development and production issues, and collaborates with global cross-functional teams. Develops backend applications using Java and PostgreSQL, contributes to ReactJS frontends, improves CI/CD and testing practices, and communicates technical decisions to diverse stakeholders.
Top Skills:
Automated TestingCi/CdJavaLoad TestingPostgresReactRestful Apis
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design, develop, test, deploy, and support secure, scalable payment-network software using Java, Spring Boot, microservices, REST APIs, Kafka, and event-driven architecture. Troubleshoot production and performance issues, contribute to CI/CD, observability, resiliency, and automation, and collaborate across engineering, product, architecture, and operations teams. Provide technical leadership, mentor team members, and drive decisions across workstreams.
Top Skills:
Ci/CdClaude CliCloud-Native PlatformsContainersEvent-Driven ArchitectureGitGithub CopilotJavaKafkaMicroservicesNoSQLRest ApisSpring BootSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
