Large language model (LLM)
A large language model is an AI model trained on large amounts of text to understand and generate language, and is the part of a voice agent that decides what to say and which tools to use.
In a voice agent the LLM reads the conversation so far, the agent’s instructions (its system prompt) and any knowledge it has been given, then writes the next reply or calls a tool such as an order lookup. For live calls, smaller and faster models are often preferred, because every extra fraction of a second is heard as a pause.
