Manager data engineering

Job Description

We are seeking a dynamic and experienced Lead Data Engineer to mentor and guide a team of data engineers working on cloud-based technology products and initiatives. This role involves close collaboration with internal and external stakeholders to ensure seamless implementation of data features across solutions. The ideal candidate will partner with business and technical teams to deliver scalable, high-performance data solutions.

Detailed Responsibilities:

• Define and drive the technical direction, architecture, and implementation of a robust data platform supporting APIs, data models, self-service reporting, and interactive querying.

• Lead and manage a team of data engineers, focusing on career development, goal setting, and performance management.

• Oversee Agile delivery processes and DevOps/CI-CD practices to ensure efficient and reliable deployments.

• Conduct solution analysis and design, balancing technical feasibility with business needs.

• Design real-time and batch data interfaces and enrichment pipelines within a cloud-native ecosystem.

• Promote and enforce development standards and best practices across the team.

• Collaborate with users, engineers, and product partners to evolve the data infrastructure in line with changing requirements.

• Partner with IT leadership and business stakeholders to define and deliver features for the cloud data platform.

• Work with cutting-edge Microsoft Azure technologies including Azure SQL, Synapse, Data Lake, Data Factory, Databricks, Azure Functions, Service Bus, and Event Hub.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

• Minimum 6 years (8 preferred) in data engineering roles.

• At least 2 years of experience leading technical teams.

• 3 years required (5 preferred) working with Azure data services (Data Factory, Databricks, ADLS, Synapse, SQL DB).

• 1-3 years preferred experience in data architecture (evaluation, design, implementation).

• Strong understanding of real-time and batch data processing, pipelines, transformation, and modeling.

• Bachelor's degree in information technology, Computer Science, or a related data field preferred. - Experience in data architecture (evaluation, design, implementation).

• Familiarity with NoSQL databases (e.g., CosmosDB).

• Exposure to tools and languages such as Python, DAX, Azure Logic Apps, Azure Functions, IoT, Power BI, Power Apps, SSIS, Informatica, Teradata, Oracle DB, Snowflake.

• Strong communication skills and ability to work in a dynamic, fast-paced environment.

• Basic understanding of budgeting and financial documentation processes.