Data Testing Engineer (Lead)
Role Overview
The Lead Data Testing Engineer supports large-scale financial data platforms that power lending and credit operations. This role focuses on validating high-volume batches and streaming data pipelines, ensuring data accuracy, integrity, and regulatory compliance across Hadoop-based ecosystems and Kafka-driven real-time data flows. The ideal candidate brings deep expertise in data validation, automation, Agile delivery, and a strong passion for driving quality and innovation within the financial services platform. Key Responsibilities
Design, develop, and execute data validation and testing strategies for large-scale financial datasets exceeding 5M+ customer records
Validate batch and streaming data pipelines, including Kafka, ETL/ELT processes, and Hadoop-based platforms spanning multiple technologies
Perform end-to-end testing of lending and credit data flows from source systems through downstream analytics and reporting layers
Build and maintain automated data testing frameworks for regression, reconciliation, and anomaly detection
Develop SQL-based and programmatic test scripts to validate data completeness, accuracy, timeliness, and data lineage
Partner with data engineers, developers, and business stakeholders to define data quality standards and acceptance criteria
Identify root causes of data defects and collaborate with teams on remediation strategies
Support regulatory, audit, and compliance requirements through strong data governance and documentation practices
Actively participate in Agile ceremonies, sprint planning, and continuous improvement initiatives
Champion innovation by introducing modern testing tools, automation practices, and monitoring solutions
Required Qualifications/ Skills
5–10 years of experience in data testing, data quality, or analytics QA roles
- Strong experience within financial services, preferably lending, credit, or risk platforms
Proven experience testing high-volume datasets (5M+ records)
Hands-on experience with:
Hadoop ecosystem (Hive, HDFS, Spark, etc.)
Kafka or similar streaming platforms
Batch ETL/ELT pipelines
Relational and analytical databases
Advanced SQL skills for data validation and reconciliation
Experience with test automation frameworks and scripting languages (Python, Java, Scala, or similar)
Preferred Qualifications
- Preferred / Nice-to-Have Qualification
- Prior background as a software or data engineer.
- Experience building custom data testing tools or frameworks.
- Exposure to machine learning, data profiling, or anomaly detection tools.
- Experience with regulatory reporting and data governance in banking.
- Certifications in data engineering or quality assurance
Location: Pittsburgh, PA
About Techstra Solutions
Techstra Solutions is a certified woman-owned (WBENC) management consulting firm specializing in strategy, technology, and implementation services for large organizations undergoing digital and talent transformation. Our experienced team partners with clients to co-create innovative solutions in applications, data, AI, and automation that accelerate measurable, sustainable change. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results. For more information:
Equal Employment Opportunity Statement
Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender,, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.
Recommended Jobs
Enterprise Architecture Lead
Enterprise Architecture Lead JOB-10045832 Anticipated Start Date March 9, 2026 Location Taylor, TX Type of Employment Contract Hire Employer Info Our client is…
Mentorship Offered Through Working Student Position
North Star Farm has offered training, competition and horse care services for decades and prides themselves on helping many people and horses succeed and enjoy themselves within a supportive team. W…
Brand Promotions & Event Marketing Associate
Join Incline Marketing Executives and become the face of our events ! We’re looking for enthusiastic, high-energy individuals with a positive attitude and a strong work ethic. As a Brand Promotio…
Welder Helper
Thank you for your interest in joining the Phillips Tank & Structure team! We design, engineer, construct, and repair above-ground steel storage tanks and other related structures. Headquartered…
Engagement Manager
We are adding to our diverse team of experts and are looking to hire those who are committed to building a culture that enables the creation of innovative solutions for our business units and clients…
Private Dental Office FOR SALE
This modern, fully fee-for-service dental practice is seeking a motivated general dentist for a full buyout. With a strong patient base, excellent financials, and a skilled support team, this turnkey…
Farm Manager
Urgently Hiring! Apply Today! This Jobot Job is hosted by: Nicole Poley Are you a fit? Easy Apply now by clicking the "Apply" button and sending us your resume. Salary: $130,000 - $160,000 pe…
Anesthesiologist Opportunities Across the Pittsburgh Area
The Allegheny Health Network (AHN), Anesthesia Institute is recruiting an Anesthesiologist to join our team serving the greater Pittsburgh area. This is an excellent opportunity to be part of a fas…
Quality Control Intern - Summer 2026
Position Description: The QC Intern will support QC staff and gain hands-on, resume-building experience in the field. This is a Monday- Friday, 1st shift paid internship, located at our facility …
Job Fair-Cheyney University
Overview: OPEN INTERVIEWS AT CHEYNEY UNIVERSITY!! IMMEDIATE HIRE!! Starting Thursday January 8 We are currently seeking friendly, efficient, and customer-focused Team Members to join our team!!! …