Microsoft’s bold vision of Azure Machine Learning (ML) is to democratize ML and make it available to every enterprise, developer and data scientist.  

Do you want to join the team entrusted with serving all internal and external OpenAI workloads at Azure? We are already serving millions of requests per day for Microsoft and 3P Copilots.

You will be joining the Inference team that works directly with OpenAI to host models efficiently on Azure.

We are looking for a Senior Software Engineer who is passionate about LLM (Large Language Model) infrastructure, optimizing LLMs and Diffusion models for inference at high scale and low latency.  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.