**Job Title: Principle Software Engineer** **Location: Boston, MA or Raleigh, NC (hybrid)** **Permanent role (No C2C candidates please)** Our client’s AI platform is a flexible, scalable artificial intelligence (AI) and machine learning (ML) platform that enables enterprises to create and deliver AI-enabled applications at scale across hybrid cloud environments. Built using open-source technologies, OpenShift AI provides trusted, operationally consistent capabilities for teams to experiment, serve models, and deliver innovative apps. The OpenShift AI team seeks a Principal Software Engineer with Kubernetes and Model Inference Runtimes experience to join our rapidly growing engineering team. Our team focuses on making machine learning model deployment and monitoring seamless and scalable across the hybrid cloud and the edge. This is a fascinating opportunity to build and impact the next generation of hybrid cloud MLOps platforms. **What will you do?:** Develop and maintain a high-quality, high-performing ML inference runtime platform for multi-modal and distributed model serving. • Contribute directly to upstream inference runtime communities such as vLLM, TGI, PyTorch, OpenVINO, and others. • Maintain CI/CD build pipelines for container images that allow faster, more secure, reliable, and frequent releases • Coordination and communication with various stakeholders • Applying a growth mindset by staying up to date with AI and ML advancements **What will you bring?** • Highly experienced with programming in Python and PyTorch Familiarity with model parallelization, quantization, and memory optimization using vLLM, TGI, and other inference libraries. • Experience with Python packaging such as PyPI libraries • Development experience with C++ especially with the CUDA APIs is a big plus • Solid understanding of the fundamentals of model inferencing architectures • Experience with Jenkins, Git, shell scripting, and related technologies • Experience with the development of containerized applications in Kubernetes • Experience with Agile development methodologies Experience with Cloud Computing using at least one of the following Cloud infrastructures AWS, GCP, Azure, or IBM Cloud • Ability to work across a large, distributed hybrid engineering team • Experience with open-source development is a plus The salary range for this position is $163,420.00 - $269,640.00. Actual offer will be based on your qualifications. If this is a role that interests you and you’d like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you! **About ManpowerGroup, Parent Company of:** **Manpower, Experis, Talent Solutions, and Jefferson Wells** _ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands –_ **_Manpower, Experis, Talent Solutions, and Jefferson Wells_** _–_ creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2022 ManpowerGroup was named one of the World's Most Ethical Companies for the 13th year - all confirming our position as the brand of choice for in-demand talent. ManpowerGroup is committed to providing equal employment opportunities in a professional, high quality work environment. It is the policy of ManpowerGroup and all of its subsidiaries to recruit, train, promote, transfer, pay and take all employment actions without regard to an employee's race, color, national origin, ancestry, sex, sexual orientation, gender identity, genetic information, religion, age, disability, protected veteran status, or any other basis protected by applicable law.