Lead a team to develop a migration engine for transitioning Datastage workloads to modern data platforms while ensuring high performance and compliance with standards.
DataStage Migration LeadJob Description:
Join NucleusTeq as a Datastage Migration Lead and become a key member of the product development team for NuoData TransformX. We are building next-generation data transformation and migration solutions, and we need an experienced leader with deep expertise in IBM Datastage and modern data platforms such as Databricks and Snowflake. In this role, you will lead a small team to develop a migration engine that seamlessly transitions Datastage workloads to modern destinations based on Apache Spark or other cutting-edge technologies.
Key Responsibilities:- Lead and manage a small team responsible for the development of NuoData TransformX’s migration engine to transition Datastage workloads to modern data platforms.
- Design, develop, and implement a scalable migration framework to automate data movement from IBM Datastage to Databricks, Snowflake, or other target platforms.
- Collaborate with product managers, data architects, and engineers to shape the product roadmap and deliver high-impact solutions.
- Optimize data integration workflows, ensuring high performance, scalability, and cost efficiency.
- Troubleshoot and resolve issues related to data transformation, ingestion, and pipeline orchestration.
- Provide technical guidance, mentoring, and leadership to team members.
- Ensure compliance with data governance, security, and quality standards throughout the migration process.
- Keep up to date with the latest advancements in data integration, ETL modernization, and cloud-based data processing.
- 4+ years of experience in data engineering and integration, with at least 1+ years working with IBM Datastage.
- Experience leading data migration projects from legacy ETL tools to modern cloud-based solutions.
- Strong hands-on expertise in Databricks, Snowflake, Apache Spark, or other modern data platforms.
- Deep understanding of ETL/ELT processes, data integration, and data transformation strategies.
- Proficiency in SQL, Python, Scala, or Java for data processing and transformation.
- Experience working with cloud ecosystems (AWS, Azure, GCP) for data warehousing and pipeline development.
- Familiarity with orchestration tools like Apache Airflow, Prefect, or similar.
- Strong problem-solving skills and ability to work in a fast-paced, collaborative environment.
- Excellent communication skills to coordinate with stakeholders and present technical solutions effectively.
- Certification in Databricks, Snowflake, or IBM Datastage.
- Experience with real-time data streaming technologies (Kafka, Spark Streaming, etc.).
- Prior experience in leading migration automation initiatives.
- Work on an innovative product, NuoData TransformX, shaping the future of data migration.
- Be part of a dynamic, high-growth environment at NucleusTeq.
- Competitive salary and comprehensive benefits package.
If you are passionate about data modernization and have the technical expertise to lead a high-impact migration product, we’d love to hear from you!
Apply Now!
Top Skills
Apache Airflow
Spark
AWS
Azure
Databricks
GCP
Ibm Datastage
Java
Prefect
Python
Scala
Snowflake
SQL
Similar Jobs
Healthtech • Pharmaceutical • Manufacturing
Assist the quality control department by leading projects for analytical methods, ensuring compliance, documenting tests, and preparing regulatory inspections.
Top Skills:
Analytical MethodsQuality Control
HR Tech • Other • Professional Services
Join an expert annotation team to create training data for AI models. Evaluate AI-generated code, solve coding problems, and write test cases. Requires 3+ years in software engineering, mainly using Python.
Top Skills:
.NetApexCC#C++DartGoHTMLJavaJavaScriptMatlabPHPPythonRRubyRustShellSQLSwiftTypescript
HR Tech • Other • Professional Services
Join a team to create training data for AI models. Responsibilities include evaluating AI-generated code, building React components, and writing JavaScript. Requires strong coding skills with flexible hours.
Top Skills:
AngularContext ApiCypressJavaScriptJestMobxNext.JsReactReact Testing LibraryReduxTypescriptVue
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
