banner
Rating
Voted0

Cloning the Wendigos' voice

0
Mod version:1
Game version:1.0.7
The mod has been successfully tested for the absence of viruses
1749.29K21.24K

Report mod

  • image
modalImage

About This Mod

Wendigos Voice Cloning (Lethal Company mod)

LC Nail 2


Masked has learned to copy your friends' voices. Can you tell who's real and who's fake?


In order for this mod to work properly, it must be installed in all players.


Here's a video I made to present this mod.


The second video is a real-time fashion demonstration.


Disclaimer.

If you are not using Elevenlabs, this mod loads an external binary (about 350 MB) from my github and locally loads an AI model to generate audio clips of masked people. The external binary is 350 MB and the voice clone model is 1.75 GB.


Privacy.

Your voice is cloned entirely locally at runtime. This means that (1) your audio clones are not stored, cloning occurs at runtime, and (2) all processing occurs locally on your machine. It is not externally transmitted. Only generated audio clips are transmitted between players.


When you use Elevenlabs, everything is stored in your account.


Initial configuration (not real-time)

When using Elevenlabs, clone each player's voice beforehand.

Enable mod in Wendigos.cfg. Optionally, enable Elevenlabs and add the API key and voice ID. Also, be sure to set the language and add custom voice replicas (see the "Bonus Features" section).

(Only for local AI models - Elevenlabs users are already disabled.) When you first start the game, you will be prompted to record multiple voice replicas. The currently selected microphone is displayed.

If the selected microphone is not the one you want to use, click Close, set the microphone in Settings, and restart the game.


Controls


'R' starts recording.

'Q' stops recording.

'N' displays the following sound.

If your working language is not English, say what you want in this step and then press "Q".


When you stop recording or leave the list of voiced strings, the mode will start generating the voiced strings.


This step can take a long time. When the generation is complete, the game will notify you.

The first time this happens, the mod will load the audio duplication model (1.75 GB) into the Wendigos MOD folder. Since this model is already loaded, subsequent line generation will be much faster.

If you make a mistake and need to record the audio again, quit the game and set 'Record new player sample audio.' to true in the Thunderstone configuration 'BepInEx/config/Wendigos.cfg'.


Bonus opportunities

Custom voice line.

If you don't like the default voice string. You can customize what Masked can say in different categories of behavior by editing the following file:


BepInEx/config/Wendigos/player_sentences/player0_chasing_sentences.txt

BepInEx/config/Wendigos/player_sentences/player0_idle_sentences.txt

BepInEx/config/Wendigos/player_sentences/player0_nearby_sentences.txt

BepInEx/config/Wendigos/player_sentences/player0_damaged_sentences.txt

New sentences are separated by a new line; you can force AI to say anything (yes, anything).


Each player can have their own voice dialog.


Mask enhancements.

This mod removes the mask and zombie hands from the mask, allowing it to better fool the player. The player's clothes will also be emulated.


Eleven Labs.

Players can use Elevenlabs to clone their voice. This gives much better results and can be more deceptive for the mask. To use this feature, all client voices must already be cloned by Elevenlabs. Everyone can use the same api key, but each player needs a unique voice identifier.


Reaction in real time with Azure and ChatGPT (experimental)

Allows masked people to react to player expressions in real time. This feature does not support push-to-talk.


What you need.

Eleven Labs Subscription ($5+)

Free Azure Speech to Text service

ChatGPT account with purchased api credits (not subscribed)

Eleven Labs.

Create an account and sign up for a subscription starting at $5 or more. Click on your profile and select "API Keys". Generate a key and save it somewhere. To copy your own voice (and the voices of others you share with), click your voice under Voices, Personal, and then click ID to copy your voice ID. Save this ID as well.


Lazuli.

0] and create an account and a new resource group. You will be prompted to create a subscription, but you can safely choose a free subscription. For best results, try to select the region closest to your actual location.


Then go to the new resource group and click create, locate Azure AI Services, and click create, enter all of the information, and select the nearest region again.


After that, go to the new Azure AI service and click Keys and Endpoint, in the wendigos.cfg file enter KEY 1 for AZURE API KEY and Location/Region for Region.


ChatGPT

and create an account. Profile -> (in the Organization section) Billing -> Add a payment method. Buy as many credits as you want. These loans do not expire at the end of the month.


Then go back to Your Profile -> User API keys -> View project API keys, create a new project, create a new key in project API keys, save it, and enter the API ChatGPT key in wendigos.cfg.


If you can't find the API key, see here: https://help.openai.com/en/articles/4936850-where-do-i-find-my-openai-api-key.  


Configuration Settings

Configure all API keys (Elevenlabs, Azure, ChatGPT).


Set the voice ID to Elevenlabs.


Set the Azure region as the newly selected region.


Set General -> Enable mod. and Experimental -> Realtime Responses to true.


If you want AI to know who is who, add your name to your name preference.


Advanced Settings

Optimize Eleven Labs for speed: Speeds up sound playback by losing most of the emotion in your voice. The general style and emotionality of speech are reduced.


Speech probability: The probability that Masked will play a pre-rendered sound line.


Possible problems.

Voice lines are out of sync.

Players hear different voices (rarely, but can occur due to jumps in delay).

Writing out of buffer results in unity errors (the rows generated are too large).

Your computer doesn't have enough storage space for models and sound lines.

Each player stores voice clone models (1.75 GB), sound samples (~10 MB), and audio tracks (<500 KB each) locally.

FREQUENTLY ASKED QUESTIONS.

What languages does this mod support?


This mod uses XTTSv2 and supports 17 languages: English (en), Spanish (es), French (fr), German (de), Italian (it), Portuguese (pt), Polish (pl), Turkish (en), Russian (ru), Dutch (nl), Czech (cs), Arabic (ar), Chinese (zh-cn), Japanese (ja), Hungarian (hu), Korean (hko), Hindi (hi).


Eleven Labs is available in 32 languages. For more information, see https://elevenlabs.io/languages.  


Can I use it with Mirage?


Not yet tested, but probably not (at least when audio is enabled).


Why does it take so long to create audio clips?


The first time you run a mod, you must download the ai model (1.75 GB) and the ai script (350 MB). These may take a long time to download depending on your internet speed. This is done only once and should be faster in subsequent generations. The scripts also load ai models and create audio files for all sound lines. Depending on your computer's capabilities, this may take a while.


Will audio replicas be automatically translated into my language?


No, you need to write a sound string to a text file in your language.


Does my voice's clone keep the mod?


No, sound clones are created during the game and are not saved. Only the audio file is saved.


When does mod listen to my voice?


If real-time reaction is on, the mod will only hear my voice during the tour. If real-time response is turned off, the mod won't hear your voice.


Can I share my Eleven Labs account? Yes, you can share your Eleven Labs account! Everyone can use the same account. Just set your voice ID in the settings.


TODO.

[x] Add broken line categories.

[x] Masked must play certain categories of lines (such as Chasing or Idle) depending on what they do.

[x] Allow players to use ElevenLabs API keys to better clone sounds.

[AI generates new sound lines between rounds.

[Allow voice cloning of any enemy.

Credits

https://github.com/coqui-ai/tts

Skinwalkers mod by RugbugRedfern

@Kalthun and @notgarrett for their help in testing this fashion.

The Lethal Company Modding Discord

Similar Mods/Addons

Game Version *

1.0.7 (Tim_Shaw-Wendigos_Voice_Cloning-1.0.7.zip)