https://github.com/NixOS/nixpkgs/pull/305586
https://github.com/zylon-ai/private-gpt
Oops, fails to build on macOS:
yeah interesting, open-webui, what @Shivaraj B H was using so far, also has some RAG capabilities, but I haven't really been testing them in depth. I am not clear yet which is the best way to generate the embeddings.
Apparently you can use ollama with specific models to get that done.
private-gpt
build failure on aarch64-darwin
should be solved after https://github.com/NixOS/nixpkgs/issues/313403
Until then, I will override in the nixpkgs
flakeModule
of ollama-flake
to make it work on aarch64-darwin
https://nixos.zulipchat.com/#narrow/stream/426237-nixify-llm/topic/ollama/near/440651465
Last updated: Nov 13 2024 at 11:45 UTC