Lead the QA team, develop testing strategies for data pipelines, ensure software quality compliance, mentor junior members, and optimize QA processes.
The purpose of this role is to build, lead and continuously develop a high-performance QA team that ensures deliverables meet the high-quality standards of the company. To lead technical initiatives in order to optimise the quality assurance approach and tools and to grow the technical knowledge in the team by providing guidance and knowledge sharing.
Job Description:
Job Description:
The purpose of this role is to ensure the developed software meets the client requirements and the business’ quality standards within the project release cycle and established processes. To lead QA technical initiatives to optimize the test approach and tools.
Key responsibilities:
- Lead the QA strategy, planning, and execution for ADF-based data pipelines and workflows.
- Design and implement test plans, test cases, and test automation for data ingestion, transformation, and loading processes.
- Validate data accuracy, completeness, and integrity across source systems, staging, and target data stores (e.g., Azure SQL, Synapse, Data Lake).
- Collaborate with data engineers, architects, and business analysts to understand data flows and ensure test coverage.
- Develop and maintain automated data validation scripts using tools like PySpark, SQL, PowerShell, or Azure Data Factory Data Flows.
- Monitor and report on data quality metrics, defects, and test coverage.
- Ensure compliance with data governance, security, and privacy standards.
- Mentor junior QA team members and coordinate testing efforts across sprints.
Must have skills:
- At least 2 years in a lead role.
- Experience with Azure cloud.
- Testing file-based data lake solutions or Big data based solution.
- Worked on migration or implementation of Azure Data Factory projects.
- Strong experience in ETL/data pipeline testing, preferably with Azure Data Factory.
- Proficiency in SQL for data validation and test automation.
- Familiarity with Azure services: Data Lake, Synapse Analytics, Azure SQL, Key Vault, and Logic Apps.
- Experience with test management tools (e.g., Azure DevOps, JIRA, TestRail).
- Understanding of CI/CD pipelines and integration of QA in DevOps workflows.
- Experience with data quality frameworks (e.g., Great Expectations, Deequ).
- Knowledge of Python or PySpark for data testing automation.
- Exposure to Power BI or other BI tools for test result visualization.
- Azure Data Factory
- Exposure to Azure Databricks
- SQL/stored procedure on SQL Server
- ADLS Gen2
- Exposure to Python/ Shell script
Good to have skills:
- Exposure to any ETL tool experience.
- Any other Cloud experience (AWS / GCP).
- Exposure to Spark architecture, including Spark Core, Spark SQL, DataFrame, Spark
- Streaming, and fault tolerance mechanisms.
- ISTQB or equivalent QA certification.
- Working experience on JIRA and Agile
- Experience with testing SOAP / API projects
- Stakeholder communication
- Microsoft Office
Education Qualification:
- Bachelor’s or master’s Degree or equivalent Degree or related IT field
Certification If Any:
- Any Basic level certification in AZURE
- Snowflake Associate / Core
Shift timing:
- 12 PM to 9 PM and/or 2 PM to 11 PM - IST
Location:
DGS India - Bengaluru - Manyata N1 BlockBrand:
MerkleTime Type:
Full timeContract Type:
PermanentTop Skills
Azure
Azure Data Factory
Azure Devops
Azure Sql
Data Lake
JIRA
Powershell
Pyspark
SQL
Synapse
Testrail
Similar Jobs
AdTech • Marketing Tech
The QA Manager will lead a high-performance QA team, ensuring software quality, developing test plans, and optimizing QA strategies in Azure environments.
Top Skills:
Azure Data FactoryAzure DevopsAzure SqlData LakeJIRAPowershellPysparkSQLSynapseTestrail
Healthtech
The role involves ensuring compliance with manufacturing standards, managing CAPA processes, investigating market complaints, and overseeing quality metrics for third-party manufacturing sites. Key tasks include auditing, risk assessments, and cross-functional project support.
Top Skills:
CapaGood Manufacturing PracticesQuality Management SystemsTrackwise
Software
Oversee quality assurance processes, develop automated testing strategies, enhance production control, and manage cross-functional collaboration to improve IT solutions.
Top Skills:
CypressGitlab CiJavaJavaScriptJenkinsJunitPythonSelenium
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.