Our team builds the Microsoft Inference Cloud, a scalable and reliable service that delivers SaaS inferencing with large language models (LLMs) on multi-billion dollar GPU capacity. Inference cloud is the foundational service for all Microsoft Copilots, Azure OpenAI, and ISV hosted models like Llama, Mistral, Cohere, and others, providing a unified and consistent experience for customers and developers. 

As the number of scenarios and customer usage of Copilot(s) increases, an efficient fabric optimizing availability and utilization of inference capacity is the key to fulfilling the fast-pace demand growth.   

We are looking to hire a Senior Software Engineer to join our team.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.