Shivaraj B H (Feb 20 2024 at 17:25): Shivaraj B H (Feb 20 2024 at 17:25):https://github.com/nixified-ai/flake
Haven’t tried it yet, but hoping to play around with it this weekend and give me thoughts
Srid (Feb 20 2024 at 17:26):I think @Andreas has a few thoughts on its shortcomings.
Andreas (Feb 20 2024 at 17:30):Well the shortcomings are obviously that you can run two things and not more it seems: InvokeAI and textgen. But what if I want to run Automatic1111 Webui or ComyUI for stable diffusion? And I want to get several LoRAs from civit.ai? Not really a straightforward path.
Like right now I am playing with LLMs using ollama. Which is really nice. But I use the ollama docker images for ROCm because setting up ROCm with StableDiffusionWebUI kinda taught me that the components going into ROCm and their interaction with PyTorch and all the rest of the Python ecosystem might be a bit finicky and you better take a working setup when you find one and never touch it again unless you have a day for experimenting...
Last updated: Nov 15 2024 at 11:45 UTC