Skip to content

Realtime: forward all raw model events #1252

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 29, 2025
Merged

Realtime: forward all raw model events #1252

merged 1 commit into from
Jul 29, 2025
+30 −16

Conversation

rm-openai
Copy link
Collaborator

@rm-openai rm-openai commented Jul 25, 2025 •
edited
Loading

No description provided.

@rm-openai rm-openai changed the base branch from main to rm/pr1216 July 25, 2025 17:56
This was referenced Jul 25, 2025
Merged
Merged
Merged
@seratch seratch added enhancement New feature or request feature:realtime labels Jul 26, 2025
seratch
seratch approved these changes Jul 26, 2025
View reviewed changes
Copy link
Member

@seratch seratch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Once the tests pass, we can merge this enhancement

@apiltamang
Copy link

just out of curiousity, what is this PR about? What does it mean to pass "raw model events to server", and can you give one or two example use cases?

rm-openai added a commit that referenced this pull request Jul 29, 2025
@rm-openai
Realtime: enable a playback tracker (#1242)
b459cc4 
So far, we've been assuming that audio is played:
- immediately (i.e. with 0 delay/latency)
- at realtime

This causes issues with our interrupt tracking. The model wants to know
how much audio the user has actually heard. For example in a phone call
agent, this wouldn't work (bc theres a delay of a few hundred ms between
model sending audio and the user hearing it). This PR allows you to pass
a playback tracker.






---
[//]: # (BEGIN SAPLING FOOTER)
* #1252
* #1216
* #1243
* __->__ #1242
rm-openai added a commit that referenced this pull request Jul 29, 2025
@rm-openai
Realtime: only cancel response if necessary (#1243)
c37c007 
We need not cancel a response if the server will cancel it.








---
[//]: # (BEGIN SAPLING FOOTER)
* #1252
* #1216
* __->__ #1243
rm-openai added a commit that referenced this pull request Jul 29, 2025
@rm-openai
Realtime: Twilio example (#1216)
bdc91df 
---
[//]: # (BEGIN SAPLING FOOTER)
* #1252
* __->__ #1216
Base automatically changed from rm/pr1216 to main July 29, 2025 18:21
@rm-openai rm-openai merged commit 8541956 into main Jul 29, 2025
10 checks passed
@rm-openai rm-openai deleted the rm/pr1252 branch July 29, 2025 18:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@seratch seratch seratch approved these changes

Assignees
No one assigned
Labels
enhancement New feature or request feature:realtime
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@rm-openai @apiltamang @seratch