Data Engineer

job summary:
Responsibilities

Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.

Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions.

Experience building AWS cloud architecture and supporting services and technologies (Eg: ECS, Glue, S3, Glue Crawler, Redshift, Step Functions, Foundational Services like IAM, Cloud Watch, Cloud formation, Lambda, Secrets Manager, Sagemaker).

Translates business specifications into design specifications and code. Responsible for writing programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.

Partners with internal clients to gain a basic understanding of business functions and informational needs. Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.

Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.

Expert building Spark data processing applications (Python, Pyspark).

Expert with SQL development and Tableau Reporting.

Experience with test automation and test-driven development practices.

Experience with CI/CD pipeline tools like Github.

Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.

Provides tool and data support to business users and fellow team members.

Qualifications

Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.

Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions.

Experience building AWS cloud architecture and supporting services and technologies (Eg: ECS, Glue, S3, Glue Crawler, Redshift, Step Functions, Foundational Services like IAM, Cloud Watch, Cloud formation, Lambda, Secrets Manager, Sagemaker).

Translates business specifications into design specifications and code. Responsible for writing programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.

Partners with internal clients to gain a basic understanding of business functions and informational needs. Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.

Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.

Expert building Spark data processing applications (Python, Pyspark).

Expert with SQL development and Tableau Reporting.

Experience with test automation and test-driven development practices.

Experience with CI/CD pipeline tools like Github.

Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.

Provides tool and data support to business users and fellow team members.

location: Malvern, Pennsylvania
job type: Contract
salary: $56.33 - 61.33 per hour
work hours: 8am to 5pm
education: Bachelors

responsibilities:

Responsibilities

• Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
• Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions.
• Experience building AWS cloud architecture and supporting services and technologies (Eg: ECS, Glue, S3, Glue Crawler, Redshift, Step Functions, Foundational Services like IAM, Cloud Watch, Cloud formation, Lambda, Secrets Manager, Sagemaker).
• Translates business specifications into design specifications and code. Responsible for writing programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
• Partners with internal clients to gain a basic understanding of business functions and informational needs. Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
• Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
• Expert building Spark data processing applications (Python, Pyspark).
• Expert with SQL development and Tableau Reporting.
• Experience with test automation and test-driven development practices.
• Experience with CI/CD pipeline tools like Github.
• Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
• Provides tool and data support to business users and fellow team members.

qualifications:
Qualifications

Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.

Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions.

Experience building AWS cloud architecture and supporting services and technologies (Eg: ECS, Glue, S3, Glue Crawler, Redshift, Step Functions, Foundational Services like IAM, Cloud Watch, Cloud formation, Lambda, Secrets Manager, Sagemaker).

Translates business specifications into design specifications and code. Responsible for writing programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.

Partners with internal clients to gain a basic understanding of business functions and informational needs. Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.

Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.

Expert building Spark data processing applications (Python, Pyspark).

Expert with SQL development and Tableau Reporting.

Experience with test automation and test-driven development practices.

Experience with CI/CD pipeline tools like Github.

Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.

Provides tool and data support to business users and fellow team members.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact [email protected].


Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.

Any consideration of a background check would be an individualized assessment based on the applicant or employee's specific record and the duties and requirements of the specific job.