Software Engineer II - CoreAI

As an AI Engineer on the CoreAI Platform team, you will apply artificial intelligence to solve real, productioncritical problems across Microsoft's AI systems. You will use AI/ML models, statistical modeling, intelligent automation to detect anomalies, identify emerging patterns, and predict system behaviors before they impact customers. Your work will drive reliability, performance, and efficiency across AI model-serving pipelines which power experience such as Copilot and Azure OpenAI Foundry models.

This is working at the intersection of C++ systems and AI model serving pipelines and your work will increase overall engineering velocity. We value engineers who think systemically, communicate clearly, and thrive in an ambiguous problem space.

AI-Driven Problem Solving

• Design, build, and scale AImodels to detect anomalies,identifyregressions across large-scale AI systems.

• Analyze patterns in telemetry, logs, and realtime signals to uncover root causes, predict failures, and drive proactive mitigations.

• Apply AI to identify emerging usage trends, performance hotspots, and workload irregularities that impact system health and user experience.

Platform Coding

• Build lightweight automation thatleveragesanomaly detection signals and pattern analysis to improve livesite reliability and engineering velocity.

• Contribute to hotfixes, performance tuning, and reliability improvements inproductionAI engines (e.g., GPU savings, SLA reliability, customer satisfaction).

• Build intuitive, responsive UI components for AI dashboards andtelemetrytools using React and modern web technologies.

Collaboration & Impact

• Communicate technical concepts with clarity and initiative, proactively seeking feedback and driving continuous improvement.

• Stay current with industry trends inappliedAI, observability, and performance engineering.

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

• Familiarity with embeddings, semantic search, or LLMbased analysis used for system intelligence or reasoning.

• Familiaritywith agentic frameworks (LangChain,Autogen,DSPy)

• Exposure to React or frontend observability dashboardsis a plus

• Persuasive communication and collaboration abilities; comfortable working in ambiguous, fast-moving environments.

#CoreAI
#AIplatform