Data Engineer
Robert Half Technology
Description
Our client is seeking a Data Architect with an expertise in Airflow. This role focuses on the integration and optimization of Airflow workflows, collaboration with cross-functional teams, and the establishment of secure and efficient data platforms.
Responsibilities:
• Lead the full implementation process of Airflow (Astronomer) in a structured, phased approach
• Collaborate with data engineering teams to ensure smooth data flow from APIs and other data sources into cloud data platforms such as Snowflake
• Migrate orchestration jobs out of Databricks into Airflow focusing on efficiency and scalability
• Utilize Azure DevOps and GitHub for version control, including configurations and setup
• Perform regular cost reviews and optimize schedules to ensure resource efficiency
• Migrate and manage data pipelines from Databricks to Airflow while maintaining seamless integration with Azure Blob Storage
• Set up Sumo Logic for monitoring workflows, system health, and performance in Airflow and integrated platforms
• Work with Azure Key Vault to manage authentication and ensure secure access
• Write and maintain detailed documentation on all stages of the Airflow implementation and job migration process
• Build and manage DevOps pipelines (Azure Pipelines/GitHub Actions) for continuous integration and deployment.
Requirements
• Minimum of 7 years of experience in a Data Engineering role.
• Proficiency in cloud technologies is required.
• Demonstrated ability in data visualization and analytics.
• Experience in API development is necessary.
• Familiarity with Apache Airflow is essential.
• Experience with Azure Blob Storage is required.
• Proficiency in Azure DevOps is necessary.
• Working knowledge of GitHub is expected.
• Expertise in Snowflake is essential.
• Familiarity with Sumo Logic is a plus.
• Background in the Apparel Manufacturing industry is highly desired
Technology Doesn't Change the World, People Do.®
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
© 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .
Confirm your E-mail: Send Email
All Jobs from Robert Half Technology