OpenAI launches new API for natural speech conversations

OpenAI launches new API for natural speech conversations

At the DevDay 2024 developer event, OpenAI is launching the new Realtime API. It supports natural voice conversations in six different voices.

During OpenAI’s developer event in San Francisco, the AI company unveiled four major API updates for developers. One of the most important is the Realtime API. This API supports natural speech-to-speech conversations based on six different voices. It is available in public beta for developers.

Real-time API

OpenAI is unveiling four new APIs for developers at its DevDay 2024 developer event, the most important of which is Realtime API. This API supports natural speech-to-speech conversations based on six preset voices. This allows developers to build features into their applications, similar to ChatGPT’s Advanced Voice Mode. This API is available in public beta.

According to OpenAI, the Realtime API can streamline the process for creating speech assistants. Initially, developers had to use different models for both speech recognition, text processing and text-to-speech conversion. With the new API, they can handle this entire process all at once.

read also

OpenAI launches new API for natural speech conversations

In addition, OpenAI is introducing two more new APIs to help developers balance performance and cost when creating AI applications. “Model Distillation” allows developers to refine smaller models based on the output of more advanced models. In addition, “Prompt Caching” can speed up inference by remembering frequently used prompts. Finally, “Vision Fine-tuning” allows developers to customize GPT-4o by providing both custom graphics and text.

Developer Event

OpenAI’s annual developer event took place Monday in San Francisco. This event is by invitation only. OpenAI’s top executive, Sam Altman, took a global approach this year. In fact, the event will be held in multiple locations and last only one day. The next locations are London (Oct. 30) and Singapore (Nov. 21).