Announcing Amazon Nova Sonic, a new speech-to-speech model that brings real-time voice conversations to Amazon Bedrock
Today, Amazon introduces Amazon Nova Sonic, a new foundation model that unifies speech understanding and generation into a single model, to enable human-like voice conversations in artificial intelligence (AI) applications. Amazon Nova Sonic enables developers to build real-time conversational AI applications in Amazon Bedrock, with industry-leading price performance and low latency. It can understand speech in different speaking styles and generate speech in expressive voices, including both masculine-sounding and feminine-sounding voices, in English accents including American and British. Amazon Nova Sonic's novel architecture can adapt the intonation, prosody, and style of the generated speech response to align with the context and content of the speech input. Additionally, Amazon Nova Sonic allows for function calling and knowledge grounding with enterprise data using Retrieval-Augmented Generation (RAG). Amazon Nova Sonic is developed with responsible AI in mind and features built-in protections including content moderation and watermarking.
To help developers build real-time application with Amazon Nova Sonic, AWS is also announcing the launch of a new bidirectional streaming API in Amazon Bedrock. This API enables two-way streaming of content, which is critical for low latency interactive communication between a human user and the AI model.
Amazon Nova Sonic can be used to voice-enable virtually any application. It has been extensively tested for a wide range of applications, including enabling customer service call automation at contact centers, outbound marketing, voice-enabled personal assistants and agents, and interactive education and language learning.
The Amazon Nova Sonic model is now available in Amazon Bedrock in the US East (N. Virginia) AWS Region. To learn more, read the AWS News Blog, Amazon Nova Sonic product page, and Amazon Nova Sonic User Guide. To get started with the Amazon Nova Sonic in Amazon Bedrock, visit the Amazon Bedrock console.