Campus Pride Jobs

Microsoft’s bold vision of Azure Machine Learning (ML) is to democratize ML and make it available to every enterprise, developer and data scientist. Do you want to join a team that builds the platform to run all internal and external ML workloads? We are already serving billions of requests per day on the most cutting-edge scenarios and models across the industry.

You will be joining the Inference team that builds the model-serving platform for large models including the OpenAI generative models. We host models at the scale of Bing and Office and solve exciting problems on the intersection of AI and Cloud. As part of the Inference team, you'll be working with the Front Door team, which oversees the Data plane layer that handles inference requests post model creation and deployment. Front Door is a multi-tenant ingress service, offering a range of admission control, routing customization, and observability options.

We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios, drive performance optimization capabilities, bringing parity between OAI and AOAI routing capabilities.

Responsibilities

• Design and build complex high scale services : Lead the architectural design of complex software systems, considering security, scalability, maintainability, and cost-effectiveness

• Code Review and Quality Assurance : Conduct code reviews with a focus on delivering a high-quality product and ensuring compliance with standards that safeguard customer security & privacy and modeling the engineering culture we aspire to for other engineers on the team

• Problem Solving : Solve complex technical issues to improve the service & our customer's experience

• Project Leadership : Take ownership of and drive key cross-team development projects, ensuring the results align with business goals and timeline requirements while managing risks. This includes collaborating with key stakeholders and partners across geos

• Production Service Support : Work as part of an on-call rotation to support the services within the team's ownership, mitigating customer impacting incidents, driving clarity, and providing guidance and leadership to other engineers on the team when handling incidents

Qualifications

• B Tech or M Tech in computer science, engineering, mathematics or a related field, or equivalent industry experience

• 7+ years of software development experience

• C++ is strongly preferred

• Work experience of running a real time service with high throughput and low latency requirements is a plus

#IDCAIPlatformHiring

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .