NVIDIA PersonaPlex: Custom Voice AI with Simple Prompts
NVIDIA PersonaPlex enables users to create custom AI voice personas through simple text prompts, allowing for personalized conversational AI experiences
Someone found that NVIDIA’s PersonaPlex lets you create voice AI with custom personalities using surprisingly simple prompts.
The model does full-duplex speech (talk while it’s talking, like real conversation) and you control the persona two ways:
Text prompts - Define the character:
"You are a friendly barista who loves coffee trivia"Audio conditioning - Upload a 3-10 second voice sample and it mimics the speaking style.
Quick start on Colab: https://colab.research.google.com/#fileId=https://huggingface.co/nvidia/personaplex-7b-v1.ipynb
The code’s on GitHub if you want to self-host: https://github.com/NVIDIA/personaplex
Pretty cool that it maintains character consistency across the whole conversation without needing complex system prompts. The demos at https://research.nvidia.com/labs/adlr/personaplex/ show it handling interruptions naturally, which most voice models completely botch.
Runs on the 7B parameter version, so it’s actually runnable on consumer hardware if you’ve got decent VRAM.
Related Tips
"Take a Deep Breath" Boosts AI Accuracy on Hard Tasks
Research reveals that adding the phrase 'take a deep breath' to AI prompts significantly improves performance on complex reasoning tasks by encouraging more
LLMs Can Now Play Balatro Autonomously via API
An article discusses how large language models have gained the ability to autonomously play the poker-themed roguelike deck-building game Balatro through API
GLM-4-Flash-7B Benchmarked: Strong Performance on Consumer GPUs
GLM-4-Flash-7B demonstrates competitive benchmark performance on consumer-grade GPUs, offering efficient inference speeds and strong accuracy across language