Data engineer
Perpay, Inc. seeks a Data Engineer in Philadelphia, PA.
The Data Engineer will analyze, resolve, and optimize data-related challenges, implement solutions to unify application data from various sources, and facilitate automated data solutions across business domains for enhanced scalability.
Additional specific job duties will include:
Develop architecture and model important performance metrics and organize data models within a high-capacity analytical data lake house using SQL, Python, and Spark; Analyze the execution plan high latency and/or long run time data models and deploy optimized and efficient improvements by incorporating best practices such as CTEs, materialized views with incremental refresh rates, and data compression; Optimize analytical workflows by identifying opportunities and conducting automation; Construct entire data pipelines to support all business units by utilizing an Airflow orchestrator hosted in AWS EC2 and incorporate parallel processing methods to facilitate rapid
reporting; Implement solutions to bring together application data generated by distributed first and third-party systems driving our centralized data lake; Maintain Perpay's complex cloud-based data infrastructure using Terraform and build new infrastructure POCs to explore viable updates and upgrades in a staging environment; Contribute to a modern data architecture to ensure scalability, reliability, and data quality; Integrate with a variety of third part data sources via in house constructed Python API solutions as well as partnered ETL and Reverse-ETL solutions, such as Fivetran and Census; Utilize CI/CD tools, such as Circle CI, Travis, and Github Actions, to automate standard processes and test suites to reduce the labor time of manual procedures create a more robust data environment; Integrate with the data team's cloud data cataloging and lineage service as well as Perpay's BI tool, DOMO, to create and distribute the context and documentation for stakeholder use; Become the subject matter expert for any data focused question at Perpay and regularly update and present to the Perpay leadership and influence the data team's technical journey; Work on projects of growing responsibility, both individually and as part of a team, to build experience and skills at a pace matched to shown ability; and cultivate a comprehensive understanding of both the industry and company operations, laying the groundwork essential for fostering long-term career advancement.The Data Engineer must have at a minimum a Master's degree in Data Science, Information Science, or Health Data Science.
Email resumes to [email protected].
Recommended Jobs
Collective Investment Trust Officer
Collective Investment Trust Officer Location Oaks, PA : The Investment Manager Services Division (IMS) at SEI is growing rapidly and is seeking new members on our Collective Trust Admin team. As a Tru…
Executive Sous Chef
Little Nonna's is accepting resumes for Executive Sous Chef. We are looking for someone passionate about Italian American cuisine and who has the skill to bring creative and seasonal renditions of the…
Warehouse Specialist
Storekeeper JOB-10045250 Anticipated Start Date December 22, 2025 Location Mobile, AL Type of Employment Contract Hire Employer Info Our client is a global lea…
Psychiatrist Opportunity for Adult Inpatient Services at The Horsham Clinic in Southeastern Pennsylvania
The Horsham Clinic in southeastern Pennsylvania is seeking a BE/BC psychiatrist for adult inpatient services. Duties of the position will include admission evaluations, treatment team leadership, an…
EPC Pump Regional Sales Manager
Job Description: Regional Sales Manager Department: North America Sales - Original Equipment As a Regional Sales Manager for the Northeast , you will provide a single point contact for Ruh…
Commercial HVAC Service Technician
Commercial HVAC Service Technician - Reading, PA Are you looking for a career with a family-oriented company that values your growth? A growing team in the Reading area is looking for commercial …
Barista
Blondie Restaurant is hiring a qualified barista for our service bar. Must be available Friday, Saturday & Sunday from 10:30AM- 3pm Will be tipped out on the net coffee sales Qualified Bar…
Caregivers- Flexible Schedule!
ob description: Great people deserve a great place to work and Visiting Angels is hiring Caregivers! Join us and become an angel today and make a difference in the lives of seniors in the Vero…
Machinist III - Boring Mill Operator
Every day, ANDRITZ continues to deliver successful innovative solutions to our customers globally. Why are we so successful? Because we are passionate and love what we do! We are at the forefront of …
HVAC Truck Based Serviceman (union)
What you will do Johnson Controls the leading Building Technology OEM for Healthcare, Manufacturing, Higher Education, K12 and Commercial Real Estate is seeking skilled HVAC Servicemen to join our…