Stream: nixify-llm

Topic: private-gpt


view this post on Zulip Srid (May 16 2024 at 05:30):

https://github.com/NixOS/nixpkgs/pull/305586

https://github.com/zylon-ai/private-gpt

view this post on Zulip Srid (May 16 2024 at 05:33):

Oops, fails to build on macOS:

image.png

view this post on Zulip Andreas (May 16 2024 at 08:04):

yeah interesting, open-webui, what @Shivaraj B H was using so far, also has some RAG capabilities, but I haven't really been testing them in depth. I am not clear yet which is the best way to generate the embeddings.

Apparently you can use ollama with specific models to get that done.

view this post on Zulip Shivaraj B H (May 21 2024 at 17:40):

private-gpt build failure on aarch64-darwin should be solved after https://github.com/NixOS/nixpkgs/issues/313403

Until then, I will override in the nixpkgs flakeModule of ollama-flake to make it work on aarch64-darwin

view this post on Zulip Shivaraj B H (May 25 2024 at 17:22):

private-gpt in ollama-flake:

https://nixos.zulipchat.com/#narrow/stream/426237-nixify-llm/topic/ollama/near/440651465


Last updated: Nov 15 2024 at 11:45 UTC