Job Description

Data QA Engineer

A Data QA Engineer ensures data reliability and accuracy by testing data pipelines, ETL processes, and warehouses, focusing on completeness, consistency, and validity for business use, using tools like SQL and Python to build automated tests and find issues, crucial for trustworthy analytics and decisions. They work across the data lifecycle, defining quality rules, profiling data, and collaborating with data engineers and analysts to maintain high data integrity.

Core Responsibilities:

• Testing & Validation: Designing and running tests for data ingestion, transformation (ETL/ELT), and storage (data warehouses/lakes).
• Data Profiling & Monitoring: Analyzing data structure, identifying anomalies, and setting up continuous monitoring for quality issues.
• Automation: Building automated test frameworks using Python, Pytest, and SQL to catch defects early.
• Rule Definition: Creating and implementing data quality rules and metrics (e.g., completeness, accuracy).
• Collaboration: Working with data engineers, analysts, and business stakeholders to understand needs and resolve defects.

Key Skills & Tools:

• Technical: SQL (complex queries), Python (Pandas, PySpark), Data Warehousing (DWH), Cloud Platforms (AWS, Azure, GCP), BI Tools (Tableau, Power BI).
• Analytical: Strong problem-solving, attention to detail, understanding data modeling, data lifecycle, and governance.
• Methodologies: Familiarity with data testing processes, data governance, and CI/CD.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy.

Job Tags

Similar Jobs