Lead ETL Test

Hi, Hope you are doing well. IMMEDIATE INTERVIEW = Onshore Test Lead – Data / ETL Testing (Azure Databricks, PySpark) IN Dearborn, MI – HYBRID- (NEED LOCAL CANDIDATE) Please find the job details below and kindly revert if you’re interested in learning more about this opportunity. Job Title: Onshore Test Lead – Data / ETL Testing (Azure Databricks, PySpark) Location: Dearborn, MI – HYBRID- (NEED LOCAL CANDIDATE) Duration: 12 Months + Possible Extension Start: Immediate Engagement: Contract (C2C) Job Overview CLIENT: is seeking an experienced Onshore Test Lead with strong Data/ETL testing expertise to support analytics and AI-driven platforms. The role focuses on validating complex data pipelines, ETL processes, dashboards, and AI prompt-based tools within a modern Azure cloud data platform environment. This position requires hands-on experience with Azure Databricks, PySpark, and advanced SQL for data validation. Candidates with primarily UI automation experience (Selenium-only) will not be suitable. Key Responsibilities • Validate analytics dashboards and reporting metrics against underlying datasets. • Perform ETL and data pipeline testing using Azure Databricks and Azure Data Factory. • Conduct source-to-target data reconciliation across multiple data sources. • Validate Delta Lake tables, schema changes, partitions, and incremental loads in Databricks. • Write complex SQL queries and PySpark validations for ETL transformation testing. • Test APIs supporting data ingestion and reporting workflows. • Validate outputs of AI prompt-based tools against backend datasets. • Develop or enhance test automation using Python / PyTest. • Manage test cases, defects, and reporting using TestRail and Jira. • Collaborate with developers, product teams, and offshore QA teams in Agile environments. Required Skills • Azure Databricks • Delta Lake • PySpark (DataFrame validation) • Advanced SQL • ETL / Data Pipeline Testing • Azure Data Factory (ADF) • Data reconciliation & transformation testing • API testing • Python / PyTest automation • Jira / Agile methodologies Preferred Skills • Testing AI prompt-based applications • Validation of analytics dashboards and reporting pipelines • Experience with large-scale cloud data platforms • CI/CD test automation experience Ideal Candidate • Strong data engineering testing background • Hands-on experience with Databricks notebooks and PySpark • Comfortable validating complex ETL transformations • Able to independently test large data pipelines • Experience working in Agile, fast-paced environments Submission Requirements Please include: • Updated Resume • Current Location • Visa Status • Availability to Start • Confirmation of hands-on Databricks + PySpark experience