1. DREAMIO: AI-Powered Adventures
  2. News
  3. Local inference is now available!

Local inference is now available!

[h3]It has been just over two months since the game's release, and I have closely monitored player feedback. The vast majority of the criticism has been related to two main issues:[/h3]
[h2]
  • In-game currency
  • Censorship
[/h2]
To address these concerns, I have added support for local inference. From now on, you will be able to run the game using only your own hardware. This allows you to use any LLM, Stable Diffusion, and TTS models, and also eliminates the need to pay for cloud services. Moreover, it's fully self-contained, so you don't need to install Python, separate server executables, or WebUIs (although support for external API endpoints is coming soon too).

[previewyoutube][/previewyoutube]
[h2]Text Generation[/h2]
I have integrated llama.cpp directly into the game. This way, I get closer to the actual models and have full control over sampling. It runs on Vulkan, so no NVIDIA GPU is needed. It accepts models in .gguf format.

[h2]Image Generation[/h2]
Also integrated directly into the game with no dependencies. Runs on CUDA, so NVIDIA GPU is preferred. It accepts models in .ckpt, .safetensors, .diffusers, and .gguf formats.

[h2]Speech Synthesis[/h2]
I have integrated two options:
  • VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
  • JETS: Jointly Training FastSpeech2 and HiFi-GAN for End to End Text to Speech
Both options use Unity Sentis as the backend and run on any hardware.

[h2]Other[/h2]
Depth estimation, speech recognition, and classifications all use Unity Sentis as the backend and run on any hardware.

[hr][/hr][h3]Full patch notes[/h3][hr][/hr]
Regarding Censorship and NSFW content


It is not my intention to limit the actions you can take in the game. If the narrator rejects some of your actions (due to them being immoral, unethical, etc.), this is not the intended behavior and should be corrected by either adjusting the narrator's instructions or by switching to a different language model. However, as long as Steam prohibits certain types of content, including live-generated adult-only sexual content, hate speech, and others, the Steam version of this game will continue to censor these types of content, even when using local models. I am not trying to get the game banned from Steam again; it has been hard enough to get here. Currently, Steam is not the place for live-generated adult-only AI games.

[h2]Endless Replayability Fest[/h2]
Dreamio will be participating in Steam Endless Replayability Fest on May 13-20 with a 10% discount!

[hr][/hr]
Safe travels!
- Oleg


https://store.steampowered.com/app/2795060/

Discord: https://discord.gg/ZmWvM49cd6