Data engineer

Reference #: 7245507

About AccuWeather AccuWeather, recognized and documented as the most accurate and most used source of weather forecasts and warnings in the world, has saved over 12,000 lives, prevented injury to over 100,000 people, and saved companies tens of billions of dollars through better planning and decision-making. Billions of people around the world rely on AccuWeather's proven Superior Accuracy across our consumer digital platforms.AccuWeather.comis the #1 weather destination and one of the top 100 most-visited websites in the world, and our award-winning AccuWeather app delivers detailed real-time forecasts to millions of smartphones. AccuWeather forecasts also appear on digital signage, in 700 newspapers, are heard on over 400 radio stations, and viewed on 100 television stations. The AccuWeather Network and AccuWeather NOW reach an audience of over 125 million on cable and streaming platforms including DirecTV, Charter Communications - Spectrum, Verizon, Philo, Frndly TV, Comcast's Xfinity X1 and Xfinity Stream, Roku, Xumo, Rockbot, LG, and Amazon Freevee. AccuWeather For Businessserves more than half of the Fortune 500 companies and thousands of other businesses and government agencies globally. Dr. Joel Myers, Founder and Executive Chairman, established AccuWeather in 1962 and is considered the "father of modern commercial meteorology." Myers, a leading creative thinker and visionary, has been called "the most accurate man in weather" byThe New York Timesand has been recognized as one of the top entrepreneurs in American history byEntrepreneur's Encyclopedia of Entrepreneurs..

Position Summary

In this role as aData Engineer II, you will directly impact AccuWeather's continued focus on innovation and generating superior weather products. You will play a critical role in building and maintaining our data infrastructure, enabling efficient data processing, analysis, and reporting. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure our data pipelines and platforms' availability, reliability, and performance. Your expertise in Databricks will be essential in optimizing data workflows, ensuring data quality, and contributing to the continuous improvement of our data engineering practices. We are open to hiring candidates to work from our global headquarters in State College, PA, USA, or remotely.

Key Responsibilities

Develop Data Pipelines: Design, develop, and maintain scalable and moderately complex data pipelines using Databricks, Spark, and related technologies. Data Processing Optimization: Optimize data workflows to build performant, reliable, and efficient data solutions. Collaboration Excellence: Contribute positively to a highly collaborative work environment by working closely with cross-functional teams, including data scientists, analysts, and software engineers. In this role, you'll be responsible for understanding requirements and implementing robust solutions that meet their needs. Additionally, you'll collaborate with other data engineers to ensure the smooth deployment and operation of data solutions. Monitoring and Troubleshooting: Monitor, troubleshoot, and resolve issues related to data pipelines and platform performance. Implement Best Practices: Implement best practices for data modeling, ETL processes, and data ingestion, and enhance data engineering practices. Stay current with industry trends and advancements in data engineering, Databricks, and related technologies. Documentation: Create and maintain detailed documentation of data solutions for knowledge sharing and future reference.

Qualifications

Bachelor's degree in Computer Science, Engineering, or a related field. 2-4 years of experience as a Data Engineer, with a strong focus on Databricks, Spark, and cloud-based data platforms (e.g., AWS, Azure, Google Cloud). Expertise in designing, developing, and optimizing complex ETL processes and data pipelines. Proficiency in programming languages like Python, Scala, or Java. Solid understanding of data modeling, data warehousing, and data integration concepts. Familiarity with DevOps practices and tools for CI/CD and infrastructure automation. Strong problem-solving skills and ability to troubleshoot and resolve complex technical issues. Excellent communication and teamwork skills, with the ability to collaborate effectively with cross-functional teams. Experience with big data technologies, real-time data processing, and machine learning pipelines is a plus. Familiarity with weather data is a plus Relevant certifications in Databricks, Spark, or cloud platforms are a strong advantage.

Why Join Us

Are you passionate about working with data? Are you eager to solve challenging problems and deliver innovative solutions? Do you enjoy using the latest technology in data engineering? Then, we'd love to have you join our team. We are a passionate data team that embraces tackling some of the weather industry's most challenging problems. Our ideal candidate thrives in a deeply collaborative, innovative, and fast-paced environment where you can transform your passion for data into building meaningful solutions that contribute to our mission of saving lives, protecting property, and helping people and business prosper. Successful candidates will have opportunities to advance their careers and grow as a data engineer. Join us in our journey to shape the future of data engineering and industry innovation.

AccuWeather is proud to be an Equal Opportunity/Affirmative Action Employer. We are committed to equal employment opportunity to all applicants and existing employees and we evaluate qualified applicants without regard to race, creed, color, national origin, sex (including pregnancy and gender identity/expression), sexual orientation, age, ancestry, physical or mental disability, marital status, political affiliation, religion, citizenship status, genetic information, veteran status, or any other basis protected under applicable federal, state, or local law. View the EEO is the Law posterand its supplement. The pay transparency policy is available.

AccuWeather is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail [email protected] let us know the nature of your request and your contact information.

We are an Equal Opportunity Employer. We provide equal opportunity to all qualified individuals regardless of race, color, religion, age, genetic information, gender, gender expression or identity, sexual orientation, national origin, veteran orientation, or veteran status, pregnancy, disability, marital status or any other legally protected categories under local, state of federal laws. We believe a culture of diversity and inclusion provides unique perspectives that help make the workplace more innovative, engaging and profitable.