Microsoft has expanded the capabilities of Azure API Management (APIM) with the introduction of a Unified Model API and enhanced content safety features during Build 2026.

The Unified Model API, now in public preview, enables clients to communicate using a single API format while APIM automatically transforms requests to various backend providers, including Anthropic and Google Vertex AI. This addresses a significant operational challenge for enterprises that utilize multiple AI models from different vendors, each with its own API format.

The APIM team emphasized that this approach allows organizations to maintain consistent governance policies across their AI workloads without the need for separate governance platforms for different agents.

By centralizing model access behind a single API surface, organizations can apply governance policies, rate limits, and content safety checks uniformly, regardless of the backend provider handling inference.

In addition to the Unified Model API, Microsoft has also enhanced content safety policies to cover MCP (Multi-Cloud Platform) tool calls and Agent-to-Agent (A2A) communication.

The updated policies now include category-based filtering for various harmful content types, with configurable severity thresholds. Notably, the policy behaves differently for streaming responses, requiring teams to manage abrupt stops in data flow without explicit error codes.

Furthermore, APIM has expanded its token metrics to reflect the multi-provider landscape, logging reasoning tokens and cached tokens for better visibility into usage patterns. The Azure API Center has also reached general availability, serving as a unified discovery endpoint for registered MCP servers and AI assets, simplifying access for developers and agents.

This comprehensive update positions Azure API Management as a competitive player in the AI gateway space, particularly against offerings from AWS and Google, which lack similar multi-provider governance capabilities. The AI gateway features are available across all APIM tiers, with the Unified Model API currently in public preview.

Published On Jun 10, 2026 at 04:12 PM IST

Join the community of 2M+ industry professionals.
Subscribe to Newsletter to get latest insights & analysis in your inbox.

Get updates on your preferred social platform
Follow us for the latest news, insider access to events and more.