Reading the repo
Opening the box…
Reading the repo
Opening the box…
How to install on macOS
This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.
Saved setup from 10 h ago
Will it work on macOS?
Then run bash setup.sh. It stops at the first error and is safe to run again. Servers and tests aren't started; it lists them at the end. Read it first.
Needs Git: xcode-select --install
git clone https://github.com/asanchezyali/talking-avatar-with-ai.git cd talking-avatar-with-ai
Node.js LTS (no version pinned), FFmpeg
# needs nvm: brew install nvm (or https://github.com/nvm-sh/nvm) nvm install --lts brew install ffmpeg
corepack enable yarn install
yarn dev
Before using this system, ensure you have the following prerequisites:
/bin directory in the backend and move all the contents of the unzipped rhubarb-lip-sync.zip into it.
Sometimes, the operating system requests permissions, so you need to enable them.ffmpeg for Mac OS, Linux or Windows.git@github.com:asanchezyali/talking-avatar-with-ai.git
cd digital-human
yarn
/apps/backend/ of the project and add the following environment variables:# OPENAI
OPENAI_MODEL=<YOUR_GPT_MODEL>
OPENAI_API_KEY=<YOUR_OPENAI_API_KEY>
# Elevenlabs
ELEVEN_LABS_API_KEY=<YOUR_ELEVEN_LABS_API_KEY>
ELVEN_LABS_VOICE_ID=<YOUR_ELEVEN_LABS_VOICE_ID>
ELEVEN_LABS_MODEL_ID=<YOUR_ELEVEN_LABS_MODEL_ID>
yarn dev
yarn add --dev -W <PACKAGE_NAME>
yarn
Open http://localhost:5173/ with your browser to see the result.
No reports for macOS yet.
GitManual AI Agent reads the 2 key files and writes a step-by-step guide for macOS. Once written, it's saved for everyone.