Chicago, IL, 60684, USA
1 day ago
Data Engineer
Description We are looking for a highly motivated and experienced Implementation/Technical Lead to oversee the end-to-end deployment and operationalization of our Privates data platform. The ideal candidate will need to have a strong background in data engineering, platform architecture, sound technical knowledge on full stack technologies - Java/Python and will work on diverse projects from building APIs and web applications to data processing and automation around the data platform while ensuring alignment with business and technical requirements. This role requires Java/Python programming and related frameworks along with strong data engineering and problem solving skills mindset. Key Responsibilities + Architect, develop, and deploy scalable and reliable data pipelines, storage solutions, and analytical tools on Azure and Snowflake. + Ensure platform scalability, reliability, and security to meet current and future business needs. + Implement and manage data lakes, warehouses, and ELT/ETL processes. + Lead code reviews, enforce development best practices, and drive continuous improvement within the team. + Integrate real-time and batch data processing capabilities. + Implement and enforce data governance policies, security protocols, and regulatory requirements. + Establish robust data quality, lineage, and cataloging processes. + Develop and integrate APIs and backend systems using frameworks like Django, Flask, or FastAPI. + Create scripts and tools for data analysis, transformation, and automation. + Write and execute unit and integration tests and perform debugging to ensure software quality. + Collaborate effectively with developers, product managers, business analysts, and other stakeholders. + Translate business requirements into scalable technical solutions. + Manage code deployments through CI/CD pipelines and utilize GitHub for version control. Requirements + Proven experience leading the design and development of large-scale data platforms. + Demonstrated experience as a full-stack developer (or similar role) with strong Java/Python skills. + Deep expertise in data platform technologies, including Snowflake and Azure SQL Server. + Proficiency with data engineering tools and frameworks like Apache Kafka and Spark. + Strong understanding of cloud platforms (Azure) and containerization (Docker, Kubernetes). + Experience with both batch and real-time data processing. + Extensive knowledge of SQL and programming languages (Java/Python). + Excellent problem-solving, communication, and leadership skills. + Experience with CI/CD pipelines and GitHub. + Proficiency in developing RESTful APIs. Technology Doesn't Change the World, People Do.® Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles. Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more. All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information. © 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .
Confirm your E-mail: Send Email