Software Engineer II, Data Engineering & Infrastructure
- Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes to ingest, transform, and load data from various sources into our data warehouse.
- Develop and manage data infrastructure components using AWS cloud services and infrastructure-as-code tools like Terraform.
- Collaborate with data scientists, analysts, autonomy engineering teams and product teams to understand their data needs and build solutions that meet their requirements.
- Optimize data processing systems for performance, reliability, and cost-efficiency.
- Implement monitoring, alerting, and logging for data pipelines and infrastructure to ensure operational stability.
- Champion best practices in data governance, data quality, and security.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- 3+ years of professional experience in software engineering, with a focus on data-related projects.
- Proficiency in at least one programming language commonly used for data engineering (e.g., Python, Go or C++).
- Solid experience with big data processing frameworks like Apache Spark, Flink, Kinesis Data Stream, or similar technologies.
- Hands-on experience with cloud platforms (AWS, GCP, or Azure) and their data services (e.g., S3, Redshift, BigQuery, Glue).
- Strong knowledge of SQL and experience working with relational and NoSQL databases.
- Intermediate knowledge of data analytics infrastructure, including data transformation tools such as DBT and visualization frameworks and tools
- Experience with building and managing data pipelines using an orchestrator like Apache Airflow.
- Able to systematically approach open-ended questions to identify pragmatic data solutions that scale
- Able to work effectively in a highly cross-functional, fast-moving and high-stakes environment
- Proven ability to communicate technical, data-driven solutions to both technical and non-technical audiences across stakeholders
- Experience with data warehousing solutions like Snowflake or data lake architectures.
- Familiarity with modern data stack tools and practices.
- A passion for building elegant, scalable, and maintainable systems.
- Experience using Amazon Web Services (AWS) tools
Recommended Jobs
Palliative Medicine Physician $60k Recruitment Incentive
Job SummaryGeisinger's Cancer Institute is seeking a Palliative Medicine Physician to join their talented team at Geisinger Medical Center (GMC) in Danville, PA. Location: Living in central PA offer…
General Anesthesiologist (BC/BE)
OPEN JOB: General Anesthesiologist (BC/BE) LOCATION: West Reading, Pennsylvania ***Relocation Assistance Available 3 Openings. SALARY: $522,500 to $577,500 FULL-TIME BENEFITS – Full …
Pennsylvania Teletherapy SLP Job Teaching License Required
Job Description Job Description Master's degree in Speech-Language Pathology, active SLP license and 1+ year of Speech-Language Pathology experience required. Applicants who do not meet these qua…
Shop Laborer
Shop Laborer Are you looking for a long term career where you can utilize your tool knowledge? Company Profile Manufacturer of metal parts and sub assemblies delivering parts as needed to man…
Tutor
Posting Number: S321 Classification Title: SUA1 Working Title: ASL Tutor (Temporary, Part-time) Department: Early Childhood Education & Exceptionality Programs Home Campus: Bloomsburg…
Temporary Support Associate
Coach is seeking a Temporary Support Associate in Pittsburgh to assist with retail operations, support sales staff, and ensure an exceptional customer experience. This role involves inventory manageme…
Mental Health Tech (MHT) - 7a - 3:30p
Responsibilities Foundations Behavioral Health is hiring Mental Health Techs for part-time day shift (7am – 3:30 pm) to support our Doylestown, PA campus. This position requires an every ot…
Medical Laboratory Scientist I
Medical Laboratory Scientist I - Erie, PA - Monday - Friday 07:30pm-04:00am Are you intrigued by the science of the human body? Curious about state-of-the-art laboratory instrumentation? Looking…
Entry-Level Remote Sales Representative - (Full Training Provided)
Overview: LifePro Recruitment, is expanding nationwide and looking for motivated individuals to join our growing team of remote sales professionals. Whether you’re new to sales or already lice…
Remote Recruiter - International Politic
Job Description: We are a leading headhunting firm specializing in international politics and global affairs. We are looking for a motivated and skilled Remote Recruiter to assist in sourcing and …