Data Testing Engineer (Lead)

Techstra Solutions
Pittsburgh, PA

Role Overview
The Lead Data Testing Engineer supports large-scale financial data platforms that power lending and credit operations. This role focuses on validating high-volume batches and streaming data pipelines, ensuring data accuracy, integrity, and regulatory compliance across Hadoop-based ecosystems and Kafka-driven real-time data flows. The ideal candidate brings deep expertise in data validation, automation, Agile delivery, and a strong passion for driving quality and innovation within the financial services platform. Key Responsibilities

  • Design, develop, and execute data validation and testing strategies for large-scale financial datasets exceeding 5M+ customer records

  • Validate batch and streaming data pipelines, including Kafka, ETL/ELT processes, and Hadoop-based platforms spanning multiple technologies

  • Perform end-to-end testing of lending and credit data flows from source systems through downstream analytics and reporting layers

  • Build and maintain automated data testing frameworks for regression, reconciliation, and anomaly detection

  • Develop SQL-based and programmatic test scripts to validate data completeness, accuracy, timeliness, and data lineage

  • Partner with data engineers, developers, and business stakeholders to define data quality standards and acceptance criteria

  • Identify root causes of data defects and collaborate with teams on remediation strategies

  • Support regulatory, audit, and compliance requirements through strong data governance and documentation practices

  • Actively participate in Agile ceremonies, sprint planning, and continuous improvement initiatives

  • Champion innovation by introducing modern testing tools, automation practices, and monitoring solutions

Required Qualifications/ Skills

  • Bachelor’s degree in Computer Science, Information Technology, or related field
  • 5–10 years of experience in data testing, data quality, or analytics QA roles
  • Strong experience within financial services, preferably lending, credit, or risk platforms
  • Proven experience testing high-volume datasets (5M+ records)

  • Hands-on experience with:

  • Hadoop ecosystem (Hive, HDFS, Spark, etc.)

  • Kafka or similar streaming platforms

  • Batch ETL/ELT pipelines

  • Relational and analytical databases

  • Advanced SQL skills for data validation and reconciliation

  • Experience with test automation frameworks and scripting languages (Python, Java, Scala, or similar)

Preferred Qualifications

  • Preferred / Nice-to-Have Qualification
  • Prior background as a software or data engineer.
  • Experience building custom data testing tools or frameworks.
  • Exposure to machine learning, data profiling, or anomaly detection tools.
  • Experience with regulatory reporting and data governance in banking.
  • Certifications in data engineering or quality assurance

Location: Pittsburgh, PA


About Techstra Solutions
Techstra Solutions is a certified woman-owned (WBENC) management consulting firm specializing in strategy, technology, and implementation services for large organizations undergoing digital and talent transformation. Our experienced team partners with clients to co-create innovative solutions in applications, data, AI, and automation that accelerate measurable, sustainable change. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results. For more information:

Equal Employment Opportunity Statement

Techstra Solutions is an equal opportunity employer. The Company makes its decisions on merit, and its policy of equal opportunity prohibits discrimination in all phases of the employment process, including, but not limited to, recruitment, hiring, promotion, selection, transfer, demotion, layoff, termination, compensation, benefits, and other terms and conditions of employment. The policy of equal opportunity applies without regard to race, color, creed, religion, gender, sexual orientation, gender identification, pregnancy, marital status, national origin, ancestry, age, disability that can reasonably be accommodated without undue hardship, military status, veteran status, genetic predisposition or carrier status, alienage or citizenship, domestic partnership status, arrest or conviction record, status as a victim of domestic violence, or any other protected categories under federal, state, or local law. The Company also prohibits discrimination or harassment based upon the perception that a person has, or is associated with a person who has, any of these characteristics.

Posted 2026-04-06

Recommended Jobs

Clerical Support - EI

Northwest Tri-county Intermediate Unit 5
Edinboro, PA

Job Description Job Description Clerical Support- Early Intervention (Full- Time) This position comes with excellent benefits: ~15 paid holidays per year ~ Paid Vacation Days, Sick Days, an…

View Details
Posted 2026-03-20

Growing Interventional Radiology in Central Pennsylvania

Penn Highlands Healthcare, Inc
Pennsylvania

Penn Highlands Healthcare, an eight  (8) hospital system, in Dubois, PA is adding a BC/BE Interventional Radiology to our Group Practice. This will service our Penn Highlands Dub…

View Details
Posted 2026-03-18

Associate Senior Privacy Counsel

Cigna
Philadelphia, PA

Provides legal services on the most complex projects or cases and rapidly identifies key issues. Routinely looks for creative interpretations or application of law. Has developed subject matter exper…

View Details
Posted 2026-03-21

Horse Farm Hand

Farm Job Search
New Freedom, PA

Horse Farm Hand (6360) Location: New Freedom, Pennsylvania Job Number: 6360 Farm Hand Needed for Horse Farm in New Freedom, PA. Weekends are required. Main barn duties include, but are not l…

View Details
Posted 2025-12-19

Tool & Die Maker (Progressive Dies) - 2nd Shift

Strategic Employment
Red Lion, PA

Tool & Die Maker (Progressive Dies) – 2nd Shift (Confidential) Location: Red Lion, PA (on-site)  Pay: $26/hr + 10% additional hourly pay for 2nd shift (~$28.60/hr) Benefits: 100% Employer-pai…

View Details
Posted 2026-01-14

Director of Restaurants

Marriott
Philadelphia, PA

JOB SUMMARY Manages all restaurant operations and staff on a daily basis. Areas of responsibility include Restaurants/Bars and Room Service. As a department head, directs and works with the fo…

View Details
Posted 2026-03-21

Senior Electrical Engineer - PE

AE Works
Pennsylvania

Job Description Job Description Description JOIN OUR TEAM! Our team is redefining building design and engineering. AE Works is an award-winning firm ranked among the top U.S. A/E firms by Ar…

View Details
Posted 2026-03-27

Lead Direct Support Professional

Resources for Human Development
Philadelphia, PA

Lead Direct Support Professional (LDSP) RHD | Community-Based Residential Services $19/hour Sunday - Thursday 3-11pm Sunday-Thursday 7a-3pm Tuesday-Saturday 3p-11p Are you an experi…

View Details
Posted 2026-02-24

General Warehouse

Walgreens
Easton, PA

Job Summary: The General Warehouse Person is responsible for performing tasks involved in processing and shipping orders to the stores that service our customers. . Job Responsibilities…

View Details
Posted 2026-03-23

Associate Engineer Philadelphia (Center City)

Design Science Group LLC
Philadelphia, PA

Company Description Design Science is a human factors research firm, founded in 1991. Our mission is to be the trusted standard of integrity and expertise where human factors meets health care, br…

View Details
Posted 2026-01-29