The Coding Train

Coding Challenge 188: Voice Chatbot

The video presents a coding challenge to create a conversational voice chatbot within a p5.js sketch. The project aims to integrate speech-to-text, text-to-speech, and a "brain" for the bot to process inputs and generate outputs. The creator emphasizes demystifying AI technology, enabling viewers to understand and use it, and exploring possibilities for individuals with open-source models on consumer hardware. The approach highlights learning by doing and critical examination through creative play. For speech-to-text, the chosen model is Whisper, an open-source model developed by OpenAI that can run locally. For text-to-speech, the Cocooro TTS model, pointed out by Zenova from HuggingFace, is selected. The "brain" is presented as a flexible component, not necessarily requiring a large language model. Alternatives like Markov chains, context-free grammars, and pattern-matching systems such as RiveScript are suggested, encouraging creativity from the audience. The project also utilizes P52 features like async and await.