Sep 23:

• Automatically use CUDA for MMS.

Sep 22:

• Added ffmpeg metadata extension to React UI.
• Added mono-only notice for Maha TTS.
• Hotfix to avoid Node 20.17.0 installation failure.

Sep 21:

• Added stable audio demo to React UI.
• Improved UI layout.

Sep 19:

• Upgraded React UI visual look with new Sliders and better layout.
• Optimized RVC UI, fixed Colab, and added a search command box.
• Upgrade Node.js to 20.17.0.

Sep 2:

• Fixed Dockerfile and updated docker-compose.yml.
• Fixed bug in npz loading.

Aug 31:

• Upgrade model inference framework to decorators.
• Moved Python files from src to tts_webui folder.
• Rewrote the MusicGen tab and fixed related bugs.

Aug 20:

• Upgraded to Gradio 4 and added theme.
• Added model loading messages for Tortoise.
• Fixed ReactUI's RVC.
• Refactored hyperparameters.
• Added management to extensions list, XTTS-Simple extension.

Aug 5:

• Fix Bark in React UI, add Max Generation Duration.
• Change AudioCraft Plus extension models directory to ./data/models/audiocraft_plus/
• Improve model unloading for MusicGen and AudioGen. Add unload models button to MusicGen and AudioGen.
• Add Huggingface Cache Manager extension.

Aug 4:

• Add XTTS-RVC-UI extension, XTTS Fine-tuning demo extension.

Aug 3:

• Add Riffusion extension, AudioCraft Mac extension, Bark Legacy extension.

Aug 2:

• Add deprecation warning to old installer.
• Unify error handling and simplify tab loading.

Aug 1:

• Add "Attempt Update" button for external extensions.
• Skip reinstalling packages when pip_packages version is not changed.
• Synchronize Gradio Port with React UI.
• Change default Gradio port to 7770 from 7860.

July 31:

• Fix React UI's MusicGen after the Gradio changes.
• Add unload button to Whisper extension.

July 29:

• Change FFMpeg to 4.4.2 from conda-forge in order to support more platforms, including Mac M1.
• Disable tortoise CVVP.

July 26:

• Whisper extension
• Experimental AMD ROCM install support. (Linux only)

July 25:

• Add diagnostic scripts for MacOS and Linux.
• Add better error details for tabs.
• Fix .sh script execution permissions for the installers on Linux and MacOS.

July 21:

• Add Gallery History extension (adapted from the old gallery view)
• Convert Simple Remixer to extension
• Fix update.py to use the newer torch versions (update.py is only for legacy purposes and will likely break)
• Add Diagnostic script and Force Reinstall scripts for Windows.

July 20:

• Fix Discord join link
• Simplify Bark further, removing excessive complexity in code.
• Add UI/Modular extensions, these extensions allow installing new models and features to the UI. In the future, models will start as extensions before being added permamently.
• Disable Gallery view in outputs
• Known issue: Firefox fails at showing outputs in Gradio, it fails at fetching them from backend. Within React UI this works fine.

July 15:

• Comment - As the React UI has been out for a long time now, Gradio UI is going to have the role of serving only the functions to the user, without the extremely complicated UI that it cannot handle. There is a real shortage of development time to add new models and features, but the old style of integration was not viable. As the new APIs and 'the role of the model' is defined, it will be possible to have extensions for entire models, enabling a lot more flexibility and lighter installations.
• Start scaling back Gradio UI complexity - removed send to RVC/Demucs/Voice buttons. (Remove internal component Joutai).
• Add version.json for better updates in the future.
• Reduce Gradio Bark maximum number of outputs to 1.
• Add unload model button to Tortoise, also unload the model before loading the next one/changing parameters, thus tortoise no longer uses 2x model memory during the settings change.

July 14:

• Regroup Gradio tabs into groups - Text to Speech, Audio Conversion, Music Generation, Outputs and Settings
• Clean up the header, add link for feedback
• Add seed control to Stable Audio
• Fix Stable Audio filename bug with newlines
• Disable "Simple Remixer" Gradio tab
• Fix bark voice clone & RVC once more
• Add "Installed Packages" tab for debugging

July 13:

• Major upgrade to Torch 2.3.1 and xformers 0.0.27
  • All users, including Mac and CPU will now have the same PyTorch version.
• Upgrade CUDA to 11.8
• Force python to be 3.10.11
• Modify installer to allow upgrading Python and Torch without reinstalling (currently major version 2)
• Fix magnet default params for better quality
• Improve installer script checks to avoid bugs
• Update StyleTTS2

July 11:

• Improve Stable Audio generation filenames
• Add force reinstall to torch repair
• Make the installer auto-update before running

July 9:

• Fix new installer and installation instructions thanks to https://github.com/Xeraster !

July 8:

• Change the installation process to reduce package clashes and enable torch version flexibility.

July 6:

• Initial release of new mamba based installer.
• Save Stable Audio results to outputs-rvc/StableAudio folder.
• Add a disclaimer to Stable Audio model selection and show better error messages when files are missing.

July 1:

• Optimize Stable Audio memory usage after generation.
• Open React UI automatically only if gradio also opens automatically.
• Remove unnecessary conda git reinstall.
• Update to lastest Stable Audio which has mps support (requires newer torch versions).

June 21:

• Add Vall-E-X demo to React UI.
• Open React UI automatically in browser, fix the link again.
• Add Split By Length to React/Tortoise.
• Fix UVR5 demo folders.
• Set fairseq version to 0.12.2 for Linux and Mac. (#323)
• Improve generation history for all React UI tabs.

May 17:

• Fix Tortoise presets in React UI.

May 9:

• Add MMS to React UI.
• Improve React UI and codebase.

May 4:

• Group Changelog by month

Apr 6:

• Add Vall-E-X generation demo tab.
• Add MMS demo tab.
• Add Maha TTS demo tab.
• Add StyleTTS2 demo tab.

Apr 5:

• Fix RVC installation bug.
• Add basic UVR5 demo tab.

Apr 4:

• Upgrade RVC to include RVMPE and FCPE. Remove the direct file input for models and indexes due to file duplication. Improve React UI interface for RVC.

Mar 28:

• Add GPU Info tab

Mar 27:

• Add information about voice cloning to tab voice clone

Mar 26:

• Add Maha TTS demo notebook

Mar 22:

• Vall-E X demo via notebook (#292)
• Add React UI to Docker image
• Add install disclaimer

Mar 16:

• Upgrade vocos to 0.1.0

Mar 14:

• StyleTTS2 Demo Notebook

Mar 13:

• Add Experimental Pipeline (Bark / Tortoise / MusicGen / AudioGen / MAGNeT -> RVC / Demucs / Vocos) (#287)
• Fix RVC bug with model reloading on each generation. For short inputs that results in a visible speedup.

Mar 11:

• Add Play as Audio and Save to Voices to bark (#286)
• Change UX to show that files are deleted from favorites
• Fix images for bark voices not showing
• Fix audio playback in favorites

Mar 10:

• Add Batching to React UI Magnet (#283)
• Add audio to audio translation to SeamlessM4T (#284)

Mar 5:

• Add Batching to React UI MusicGen (#281), thanks to https://github.com/Aamir3d for requesting this and providing feedback

Mar 3:

• Add MMS demo as a notebook
• Add MultiBandDiffusion high VRAM disclaimer

Feb 21:

• Fix Docker container builds and bug with Docker-Audiocraft

Feb 8:

• Fix MultiBandDiffusion for MusicGen's stereo models, thank you https://github.com/mykeehu
• Fix Node.js installation steps on Google Colab, code by https://github.com/miaohf

Feb 6:

• Add FLAC file generation extension by https://github.com/JoaCHIP

Jan 21:

• Add CPU/M1 torch auto-repair script with each update. To disable, edit check_cuda.py and change FORCE_NO_REPAIR = True

Jan 16:

• Upgrade MusicGen, adding support for stereo and large melody models
• Add MAGNeT

Jan 15:

• Upgraded Gradio to 3.48.0
  • Several visual bugs have appeared, if they are critical, please report them or downgrade gradio.
  • Gradio: Suppress useless warnings
• Supress Triton warnings
• Gradio-Bark: Fix "Use last generation as history" behavior, empty selection no longer errors
• Improve extensions loader display
• Upgrade transformers to 4.36.1 from 4.31.0
• Add SeamlessM4T Demo

Jan 14:

• React UI: Fix missing directory errors

Jan 13:

• React UI: Fix missing npm build step from automatic install

Jan 12:

• React UI: Fix names for audio actions
• Gradio: Fix multiple API warnings
• Integration - React UI now is launched alongside Gradio, with a link to open it

Jan 11:

• React UI: Make the build work without any errors

Jan 9:

• React UI
  • Fix 404 handler for Wavesurfer
  • Group Bark tabs together

Jan 8:

• Release React UI

Oct 26:

• Improve model selection UX for Musicgen

Oct 24:

• Add initial React UI for Musicgen and Demucs (#202)
• Fix Bark long generation seed drifting (thanks to https://github.com/520Pig520)

Sep 21:

• Bark: Add continue as semantic history button
• Switch to github docker image storage, new docker image:
  • docker pull ghcr.io/rsxdalv/tts-generation-webui:main
• Fix server_port option in config #168 , thanks to https://github.com/Dartvauder

Sep 9:

• Fix xdg-open command line, thanks to https://github.com/JFronny
• Fix multi-line bark generations, thanks to https://github.com/slack-t and https://github.com/bkutasi
• Add unload model button to Bark as requested by https://github.com/Aamir3d
• Add Bark details to README_Bark.md as requested by https://github.com/Maki9009
• Add "optional" to burn in prompt, thanks to https://github.com/Maki9009

Sep 5:

• Add voice mixing to Bark
• Add v1 Burn in prompt to Bark (Burn in prompts are for directing the semantic model without spending time on generating the audio. The v1 works by generating the semantic tokens and then using it as a prompt for the semantic model.)
• Add generation length limiter to Bark

Aug 27:

• Fix MusicGen ignoring the melody #153

Aug 26:

• Add Send to RVC, Demucs, Vocos buttons to Bark and Vocos

Aug 24:

• Add date to RVC outputs to fix #147
• Fix safetensors missing wheel
• Add Send to demucs button to musicgen

Aug 21:

• Add torchvision install to colab for musicgen issue fix
• Remove rvc_tab file logging

Aug 20:

• Fix MBD by reinstalling hydra-core at the end of an update

Aug 18:

• CI: Add a GitHub Action to automatically publish docker image.

Aug 16:

• Add "name" to tortoise generation parameters

Aug 15:

• Pin torch to 2.0.0 in all requirements.txt files
• Bump audiocraft and bark versions
• Remove Tortoise transformers fix from colab
• Update Tortoise to 2.8.0

Aug 13:

• Potentially big fix for new user installs that had issues with GPU not being supported

Aug 11:

• Tortoise hotfix thanks to manmay-nakhashi
• Add Tortoise option to change tokenizer

Aug 8:

• Update AudioCraft, improving MultiBandDiffusion performance
• Fix Tortoise parameter 'cond_free' mismatch with 'ultra_fast' preset

Aug 7:

• add tortoise deepspeed fix to colab

Aug 6:

• Fix audiogen + mbd error, add tortoise fix for colab

Aug 4:

• Add MultiBandDiffusion option to MusicGen #109
• MusicGen/AudioGen save tokens on generation as .npz files.

Aug 3:

• Add AudioGen #105

Aug 2:

• Fix Model locations not showing after restart

July 26:

• Voice gallery
• Voice cropping
• Fix voice rename bug, rename picture as well, add a hash textbox
• Easier downloading of voices (#98)

July 24:

• Change bark file format to include history hash: ...continued_generation... -> ...from_3ea0d063...

July 23:

• Docker Image thanks to https://github.com/jonfairbanks
• RVC UI naming improvements

July 21:

• Fix hubert not working with CPU only (#87)
• Add Google Colab demo (#88)
• New settings tab and model locations (for advanced users) (#90)

July 19:

• Add Tortoise Optimizations, Thank you https://github.com/manmay-nakhashi #79 (Implements #18)

July 16:

• Voice Photo Demo
• Add a directory to store RVC models/indexes in and a dropdown
• Workaround rvc not respecting is_half for CPU #74
• Tortoise model and voice selection improvements #73

July 10:

• Demucs Demo #67

July 9:

• RVC Demo + Tortoise, v6 installer with update script and automatic attempts to install extra modules #66

July 5:

• Improved v5 installer - faster and more reliable #63

July 2:

• Upgrade bark settings #59

July 1:

• Studio-tab #58

Jun 29:

• Tortoise new params #54

Jun 27:

• Fix eager loading errors, refactor #50

Jun 20

• Tortoise: proper long form generation files #46

Jun 19

• Tortoise-upgrade #45

June 18:

• Update to newest audiocraft, add longer generations

Jun 14:

• add vocos wav tab #42

June 5:

• Fix "Save to Favorites" button on bark generation page, clean up console (v4.1.1)
• Add "Collections" tab for managing several different data sets and easier curration.

June 4:

• Update to v4.1 - improved hash function, code improvements

June 3:

• Update to v4 - new output structure, improved history view, codebase reorganization, improved metadata, output extensions support

May 21:

• Update to v3 - voice clone demo

May 17:

• Update to v2 - generate results as they appear, preview long prompt generations piece by piece, enable up to 9 outputs, UI tweaks

May 16:

• Add gradio settings tab, fix gradio errors in console, improve logging.
• Update History and Favorites with "use as voice" and "save voice" buttons
• Add voices tab
• Bark tab: Remove "or Use last generation as history"
• Improve code organization

May 13:

• Enable deterministic generation and enhance generated logs. Credits to suno-ai/bark#175.

May 10:

• Enable the possibility of reusing history prompts from older generations. Save generations as npz files. Add a convenient method of reusing any of the last 3 generations for the next prompts. Add a button for saving and collecting history prompts under /voices. #10

May 4:

• Long form generation (credits to https://github.com/suno-ai/bark/blob/main/notebooks/long_form_generation.ipynb and suno-ai/bark#161)
• Adapt to fixed env var bug

May 3:

• Improved Tortoise UI: Voice, Preset and CVVP settings as well as ability to generate 3 results (#6)

May 2:

• Added support for history recylcing to continue longer prompts manually
• Added support for v2 prompts

Before:

• Added support for Tortoise TTS

• Download the new version and run the start_tts_webui.bat (Windows) or start_tts_webui.sh (MacOS, Linux)
• Once it is finished, close the server.
• Recommended: Copy the old generations to the new directory, such as favorites/ outputs/ outputs-rvc/ models/ collections/ config.json
• With caution: you can copy the whole new tts-generation-webui directory over the old one, but there might be some old files that are lost.

• Update the existing installation using the update_platform script
• After the update run the new start_tts_webui.bat (Windows) or start_tts_webui.sh (MacOS, Linux) inside of the tts-generation-webui directory
• Once the server starts, check if it works.
• With caution: if the new server works, within the one-click-installers directory, delete the old installer_files.

Not exactly, the dependencies clash, especially between conda and python (and dependencies are already in a critical state, moving them to conda is ways off). Therefore, while it might be possible to just replace the old installer with the new one and running the update, the problems are unpredictable and unfixable. Making an update to installer requires a lot of testing so it's not done lightly.

• suno-ai/bark - MIT License

  • Description: Inference code for Bark model.
  • Repository: suno/bark

• tortoise-tts - Apache-2.0 License

  • Description: A flexible text-to-speech synthesis library for various platforms.
  • Repository: neonbjb/tortoise-tts

• ffmpeg - LGPL License

  • Description: A complete and cross-platform solution for video and audio processing.
  • Repository: FFmpeg
  • Use: Encoding Vorbis Ogg files

• ffmpeg-python - Apache 2.0 License

  • Description: Python bindings for FFmpeg library for handling multimedia files.
  • Repository: kkroening/ffmpeg-python

• audiocraft - MIT License

  • Description: A library for audio generation and MusicGen.
  • Repository: facebookresearch/audiocraft

• vocos - MIT License

  • Description: An improved decoder for encodec samples
  • Repository: charactr-platform/vocos

• RVC - MIT License

  • Description: An easy-to-use Voice Conversion framework based on VITS.
  • Repository: RVC-Project/Retrieval-based-Voice-Conversion-WebUI