ETL Developer (Databricks)

Job Description

A health insurance client is hiring for ETL Developer to design, develop and implement complex ETL workflows from diverse sources. As an ETL Developer, you will join the Enterprise Data Office group focused on data ingestion and integration for the enterprise. This is a Databricks and Azure Cloud environment requiring someone to take on the following responsibilities:

• Design, develop and implement end-to-end data solutions using Azure Databricks.

• Convert legacy SQL workflows into modern Python-based pipelines.

• Maintain and optimize high-volume data pipelines in production.

• Write, test, and tune PySpark and SQL scripts for performance and scalability.

PLEASE NOTE: We are looking for someone who values in person collaboration and is willing to come onsite weekly in Newtown Square, PA 19073.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

• 5+ years experience designing ingestion of ETL pipelines

• 4+ years hands on experience writing PySpark and SQL scripts

• 5+ years experience designing ingestion pipelines in Databricks environment

• Experience working on event-based data warehousing with Azure

• Experience using Azure LogicApps to create and run automated workflows across systems - Experience in the healthcare domain

• Experience integrating ETL pipelines with other applications/systems