The role involves ensuring data quality through testing ETL workflows, developing test plans, and collaborating with technical teams to maintain data integrity.
Senior Data Quality / ETL Tester
We are seeking a highly motivated and detail-oriented Data Quality Engineer to join our growing team. You’ll work closely with Data Engineers, Data scientists, and business team to ensure the accuracy, completeness, and reliability of our data through rigorous testing of ETL workflows, data pipelines and building robust data quality checks. You will play a critical role in maintaining data integrity and supporting data-driven decision-making across the organization.
Roles and Responsibilities
- Analyze business and technical requirements to design, develop, and execute comprehensive test plans for ETL pipelines and data transformations.
- Perform data validation, reconciliation, and integrity checks across various data sources and target systems.
- Build and automate data quality checks using SQL and/or Python scripting.
- Identify, document, and track data quality issues, anomalies, and defects.
- Collaborate with data engineers, developers, QA, and business stakeholders to understand data requirements and ensure data quality standards are met.
- Define data quality KPIs and implement continuous monitoring frameworks.
- Participate in data model reviews and provide input on data quality considerations.
- Perform root cause analysis for data discrepancies and work with teams to drive resolution.
- Ensure alignment to data governance policies, standards, and best practices
- Experience with data quality frameworks (e.g., Soda, Great Expectations, Deequ, Monte Carlo, DBT Test).
- Experience with modern cloud data ecosystems (AWS, Snowflake, Apache Spark, Redshift).
- Advanced knowledge of SQL, including the ability to write stored procedures, triggers, analytic/windowing functions, and performance tuning.
- Familiarity with data pipeline tools like Airflow, DBT, or Informatica.
- Experience integrating data validation processes into CI/CD pipelines using tools like GitHub Actions, Jenkins, or similar.
- Background to big data platforms, data lakes, or non-relational databases.
- Understanding of data lineage, and master data management (MDM) concepts.
- Experience with Agile/Scrum development methodologies
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 8 plus years of experience as a Data Quality Engineer, ETL Tester, or a similar role.
- Strong understanding of ETL concepts, data warehousing principles, and relational database design.
- Proficiency in SQL for complex querying, data profiling, and validation tasks.
- Familiarity with data quality tools and testing methodologies.
Top Skills
Airflow
Spark
AWS
Dbt
Informatica
Python
Redshift
Snowflake
SQL
Similar Jobs
Financial Services
As a Trade Lifecycle Associate I, you will manage cash movements, coordinate funding, optimize operational processes, and support strategic projects.
Top Skills:
AlteryxBusiness Intelligence Tools (TableauCross Border PaymentsForeign ExchangeOwldq)SwiftUipath
Financial Services
As a Fund Services Associate I, you will ensure accurate fund servicing transactions, collaborate with teams, and enhance operational efficiency through process improvements and strong relationship-building skills.
Financial Services
The role involves executing fund servicing transactions, applying fund servicing policies to solve problems, understanding client needs, and improving operational processes.
Top Skills:
Anti-Fraud MeasuresCybersecurityDesign ThinkingFund Servicing OperationsInnovation
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
