Skip to main content

What Is Automatic Speech Recognition (ASR)?

Automatic speech recognition (ASR) is technology that converts spoken language into written text in real time. It uses machine learning models trained on millions of hours of speech to recognize words, phrases and intent across accents, languages and background noise. In a contact center, ASR is the engine behind voice-activated IVR menus, real-time call transcription and conversational AI. 

When a caller says "I want to check my order status" instead of pressing a button, ASR is what turns that spoken sentence into text your system can act on. The IVR or intelligent virtual agent (IVA) then interprets the text, identifies the intent, and either handles the request or routes the call to the right agent. Five9 uses ASR as a core component of its Genius AI suite. Five9 AI Agents use ASR combined with natural language processing (NLP) to power voice self-service that handles multi-turn conversations, detects interruptions and responds with low latency. Five9 AI Agent Assist also uses ASR to generate real-time transcriptions during live calls, giving agents and supervisors instant visibility into the conversation. 

 

How Is ASR Used in Contact Centers?

Contact centers use automatic speech recognition across several key workflows:   

  • Conversational IVR lets callers speak naturally instead of pressing buttons.  

  • ASR converts their words into text, and NLP determines the intent so the system can route or resolve the request.   

  • Real-time transcription converts agent-customer conversations into text as they happen.  

  • Five9 AI Agent Assist uses this to surface knowledge base articles, compliance prompts and next-best-action suggestions.   

  • Post-call analytics transcribes recorded calls so you can search, categorize and analyze interactions at scale.  

  • Five9 Interaction Analytics uses ASR-powered transcription to identify trends, sentiment and compliance risks.   

  • Voice biometrics pairs ASR with speaker recognition to authenticate callers by their voice, reducing the need for security questions and speeding up verification.   

  • Quality management scores interactions based on transcribed content, flagging calls where agents missed required disclosures or deviated from scripts. 

Image
Woman using Phone