microsoft/azure-skills · Official

azure-aigateway

Configure Azure API Management as an AI Gateway for AI models, MCP tools, and agents. WHEN: semantic caching, token limit, content safety, load balancing, AI model governance, MCP rate limiting, jailbreak detection, add Azure OpenAI backend, add AI Foundry model, test AI gateway, LLM policies, configure AI backend, token metrics, AI cost control, convert API to MCP, import OpenAPI to gateway.

All-time #90 Trending #262 First seen Feb 4, 2026

8-week activity · all time api

Installation

$ npx skills add microsoft/azure-skills --skill azure-aigateway

View on skills.sh ↗ GitHub repository ↗

Feature your product here Skill page unit · reach builders installing agent skills View pricing →

Summary

Configure Azure API Management as an AI Gateway for models, MCP tools, and agents with built-in governance policies.
Supports semantic caching (60-80% cost savings), token rate limiting, content safety filtering, and jailbreak detection across AI backends Add Azure OpenAI, AI Foundry models, or convert existing APIs to MCP tools as managed backends with load balancing Includes five core policy categories: authentication, semantic cache lookup, token limits, content safety, and token metrics for observability Requires Azure CLI for configuration and testing; integrates with managed identity for secure backend access

Similar popular skills

Related neighbors and high-traction skills in the same topics — useful to compare before installing.

agent-browser Shared topics

vercel-labs/agent-browser

Browser automation CLI for AI agents. Use when the user needs to interact with websites, includ…

11.9K installs

supabase-postgres-best-practices Shared topics

supabase/agent-skills

Postgres best practices maintained by Supabase, for Postgres running anywhere. Load this skill …

1.4K installs

playwright-cli Shared topics

microsoft/playwright-cli

Automate browser interactions, test web pages and work with Playwright tests.

1.3K installs

firebase-basics Shared topics

firebase/agent-skills

>- Provides foundational Firebase CLI setup, CLI installation, version checks (`firebase-tools@…

545 installs

Security audits

Partner security reviews for this skill.

agent-trust-hub Reviewed

Analyzed Sep 15, 2026

snyk Reviewed

Analyzed Sep 15, 2026

socket Score 0.9000 · 0 alerts

Analyzed Sep 15, 2026

license 1
maintenance 1
quality 0.9
supply chain 1
vulnerability 1

0 alerts

Also in this package

Other skills from microsoft/azure-skills · top by installs.

npx skills add microsoft/azure-skills

microsoft-foundry 1.7K azure-diagnostics 1.6K azure-prepare 1.5K azure-ai 1.5K azure-deploy 1.5K azure-validate 1.5K azure-storage 1.5K entra-app-registration 1.5K appinsights-instrumentation 1.5K azure-resource-lookup 1.5K

Browse all from microsoft/azure-skills

More details

Agent compatibility

Declared targets from SKILL.md / docs. Unmarked agents are not listed — the skill may still install via the CLI.

Claude Code Not declared

Cursor Not declared

Codex Not declared

GitHub Copilot Not declared

Windsurf Not declared

Gemini CLI Not declared

Cline Not declared

OpenCode Not declared

Repository health

Stars 1.5K

License MIT

Default branch main

Open issues 9

Last push Sep 10, 2026

Status Active

Skill metadata

Parsed from SKILL.md frontmatter.

Version3.2.1

LicenseMIT

CompatibilityRequires Azure CLI (az) for configuration and testing

More metadata

author: Microsoft
version: 3.2.1

Package contents

Files included with this skill beyond the listing page.

skill md SKILL.md 5,029 B
docs SUMMARY.md 418 B

History

Feb 4, 2026 First seen on skills.sh
Sep 9, 2026 First recorded snapshot · 567,510 installs

SKILL.md

Azure AI Gateway

Configure Azure API Management (APIM) as an AI Gateway for governing AI models, MCP tools, and agents.

To deploy APIM, use the azure-prepare skill. See APIM deployment guide.

When to Use This Skill

Category	Triggers
Model Governance	"semantic caching", "token limits", "load balance AI", "track token usage"
Tool Governance	"rate limit MCP", "protect my tools", "configure my tool", "convert API to MCP"
Agent Governance	"content safety", "jailbreak detection", "filter harmful content"
Configuration	"add Azure OpenAI backend", "configure my model", "add AI Foundry model"
Testing	"test AI gateway", "call OpenAI through gateway"

Quick Reference

Policy	Purpose	Details
`azure-openai-token-limit`	Cost control	[Model Policies](references/policies.md#token-rate-limiting)
`azure-openai-semantic-cache-lookup/store`	60-80% cost savings	[Model Policies](references/policies.md#semantic-caching)
`azure-openai-emit-token-metric`	Observability	[Model Policies](references/policies.md#token-metrics)
`llm-content-safety`	Safety & compliance	[Agent Policies](references/policies.md#content-safety)
`rate-limit-by-key`	MCP/tool protection	[Tool Policies](references/policies.md#request-rate-limiting)

Get Gateway Details

# Get gateway URL
az apim show --name <apim-name> --resource-group <rg> --query "gatewayUrl" -o tsv

# List backends (AI models)
az apim backend list --service-name <apim-name> --resource-group <rg> \
  --query "[].{id:name, url:url}" -o table

# Get subscription key
az apim subscription keys list \
  --service-name <apim-name> --resource-group <rg> --subscription-id <sub-id>

Test AI Endpoint

GATEWAY_URL=$(az apim show --name <apim-name> --resource-group <rg> --query "gatewayUrl" -o tsv)

curl -X POST "${GATEWAY_URL}/openai/deployments/<deployment>/chat/completions?api-version=2024-02-01" \
  -H "Content-Type: application/json" \
  -H "Ocp-Apim-Subscription-Key: <key>" \
  -d '{"messages": [{"role": "user", "content": "Hello"}], "max_tokens": 100}'

Common Tasks

Add AI Backend

See [references/patterns.md](references/patterns.md#pattern-1-add-ai-model-backend) for full steps.

# Discover AI resources
az cognitiveservices account list --query "[?kind=='OpenAI']" -o table

# Create backend
az apim backend create --service-name <apim> --resource-group <rg> \
  --backend-id openai-backend --protocol http --url "https://<aoai>.openai.azure.com/openai"

# Grant access (managed identity)
az role assignment create --assignee <apim-principal-id> \
  --role "Cognitive Services User" --scope <aoai-resource-id>

Apply AI Governance Policy

Recommended policy order in <inbound>:

Authentication - Managed identity to backend
Semantic Cache Lookup - Check cache before calling AI
Token Limits - Cost control
Content Safety - Filter harmful content
Backend Selection - Load balancing
Metrics - Token usage tracking

See [references/policies.md](references/policies.md#combining-policies) for complete example.

Troubleshooting

Issue	Solution
Token limit 429	Increase `tokens-per-minute` or add load balancing
No cache hits	Lower `score-threshold` to 0.7
Content false positives	Increase category thresholds (5-6)
Backend auth 401	Grant APIM "Cognitive Services User" role

See [references/troubleshooting.md](references/troubleshooting.md) for details.

References

[Detailed Policies](references/policies.md) - Full policy examples
[Configuration Patterns](references/patterns.md) - Step-by-step patterns
[Troubleshooting](references/troubleshooting.md) - Common issues
AI-Gateway Samples
GenAI Gateway Docs

SDK Quick References

Content Safety: [Python](references/sdk/azure-ai-contentsafety-py.md) | [TypeScript](references/sdk/azure-ai-contentsafety-ts.md)
API Management: [Python](references/sdk/azure-mgmt-apimanagement-py.md) | [.NET](references/sdk/azure-mgmt-apimanagement-dotnet.md)

npx skills add microsoft/azure-skills --skill azure-aigateway