Required Skills: T-SQL, SQL Testing & QA, ETL / Data Pipeline Validation
Job Description
Qual notes:
Focuses on validating the integrity, performance, and functionality of SQL-based processes. This role will not just be writing queries—will include testing, profiling, and ensuring correctness of data flows and transformations.
Core Responsibilities
- Unit Testing SQL Code
- Validate logic in stored procedures, views, and functions.
- Write test cases to verify expected vs. actual outputs.
- Use frameworks or custom scripts to automate test execution.
- Functionality Checks
- Ensure SQL code performs as intended across different scenarios.
- Validate joins, aggregations, filters, and business logic.
- Confirm that data transformations align with business rules.
- SQL Profiling & Performance Analysis
- Use tools like SQL Profiler to monitor query execution.
- Identify bottlenecks, long-running queries, and inefficient operations.
- Recommend indexing or query refactoring.
- EDI & ETL Validation
- Validate incoming/outgoing EDI files for structure and content.
- Ensure ETL pipelines correctly extract, transform, and load data.
- Perform reconciliation between source and target systems.
- Query Search for Automation
- Develop reusable queries/scripts to automate repetitive QA tasks.
- Build utilities for data comparison, anomaly detection, or regression testing.
Skills Needed
- T-SQL Expertise: Deep understanding of joins, subqueries, CTEs, window functions, etc.
- SQL Profiler: For performance tuning and debugging.
- Data Reconciliation: Ability to compare large datasets efficiently.
- Version Control: Git or similar tools for managing test scripts.
- Unit Testing Frameworks: Like tSQLt or custom-built solutions.
- Defect Tracking: Use of tools like Azure DevOps, JIRA, etc.
Nice to have
- ETL Tools: Familiarity with SSIS or other ETL platforms.
- EDI Standards: Understanding of formats like X12, EDIFACT, etc.
Soft Skills
-
Analytical Thinking: Ability to dissect complex logic and find edge cases.
-
Communication: Ask clarifying questions and document findings clearly.
-
Initiative: Proactively identify issues and suggest improvements.