Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
863aab7
feat(realtime): add realtime voice agents with OpenAI, Azure OpenAI, …
adamdougal Feb 10, 2026
087a3eb
fix(realtime): track connection state in OpenAI and Azure OpenAI clients
adamdougal Feb 11, 2026
ff7c2cf
fix(realtime): clear pending function names on disconnect
adamdougal Feb 11, 2026
d41bffd
chore: remove calculate tool from realtime_with_tools sample
adamdougal Feb 11, 2026
6adf02a
fix: preserve chronological message order in RealtimeAgent
adamdougal Feb 11, 2026
fb56e1c
chore: remove calculate tool from multi-agent realtime sample
adamdougal Feb 11, 2026
3270ffd
fix: bound audio queue in VoiceSession to prevent unbounded memory gr…
adamdougal Feb 11, 2026
9e3c917
fix: pass api_version to Voice Live SDK connect call
adamdougal Feb 11, 2026
0b07834
test: add missing event types to realtime types test
adamdougal Feb 11, 2026
084bb43
fix: return clear error for non-FunctionTool in realtime execute_tool
adamdougal Feb 11, 2026
3acd603
fix: remove unnecessary name assignment in websocket_audio_client
adamdougal Feb 11, 2026
b9c51e9
fix: consolidate contextlib imports in fastapi websocket sample
adamdougal Feb 11, 2026
4487ae4
fix: replace bare pass comment with debug log in _send_audio_loop
adamdougal Feb 11, 2026
633c490
fix: replace bare except pass with debug logging in realtime samples
adamdougal Feb 11, 2026
07a8603
chore: add PEP 723 inline script metadata to realtime samples
adamdougal Feb 11, 2026
d75fc6a
fix: handle missing id in tool_call events gracefully
adamdougal Feb 11, 2026
c6700a6
fix: update imports after main merge (ToolProtocol → FunctionTool, Ch…
adamdougal Feb 11, 2026
fe36453
Fix samples link for realtime
adamdougal Feb 11, 2026
f1f9eed
Remove mention of maths questions
adamdougal Feb 11, 2026
88f0ed6
fix: align tool call output formatting in realtime_with_tools sample
adamdougal Feb 11, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions python/packages/azure-ai-voice-live/LICENSE
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
MIT License

Copyright (c) Microsoft Corporation.

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE
47 changes: 47 additions & 0 deletions python/packages/azure-ai-voice-live/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
# Get Started with Microsoft Agent Framework Azure Voice Live

Please install this package via pip:

```bash
pip install agent-framework-azure-voice-live --pre
```

## Azure Voice Live Integration

The Azure Voice Live integration provides real-time voice conversation capabilities using Azure's Voice Live SDK, supporting bidirectional audio streaming with Azure Speech Services and generative AI models.

### Features

- **Real-time Audio Streaming**: Bidirectional audio communication with AI models
- **Voice Selection**: Support for OpenAI voices (alloy, echo, shimmer, etc.) and Azure Neural voices
- **Tool Calling**: Function calling support during voice conversations
- **Environment Variables**: Easy configuration via AZURE_VOICELIVE_* environment variables
- **Authentication**: Support for both API keys and Azure identity credentials

### Basic Usage Example

```python
from agent_framework import RealtimeAgent
from agent_framework_azure_voice_live import AzureVoiceLiveClient

# Create client
client = AzureVoiceLiveClient(
endpoint="https://myresource.services.ai.azure.com",
model="gpt-4o-realtime-preview",
api_key="your-api-key",
)

# Create agent
agent = client.as_agent(
name="voice-assistant",
instructions="You are a helpful voice assistant.",
voice="alloy",
)

# Run voice conversation
async for event in agent.run(audio_input=microphone_stream()):
if event.type == "audio":
play_audio(event.data["audio"])
```

For more examples, see the [Azure Voice Live examples](https://github.com/microsoft/agent-framework/tree/main/python/samples/getting_started/realtime/).
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# Copyright (c) Microsoft. All rights reserved.

import importlib.metadata

from ._client import AzureVoiceLiveClient
from ._settings import AzureVoiceLiveSettings

try:
__version__ = importlib.metadata.version(__name__)
except importlib.metadata.PackageNotFoundError:
__version__ = "0.0.0" # Fallback for development mode

__all__ = [
"AzureVoiceLiveClient",
"AzureVoiceLiveSettings",
"__version__",
]
Loading
Loading