Stream: nixify-llm

Topic: ollama image analysis?

Srid (Jul 04 2024 at 15:24):

Interesting question,

can you paste an image to the chat ui for the chatbot to analyze?

https://old.reddit.com/r/NixOS/comments/1dujxu4/run_local_ai_chatbot_using_nix/

Andreas (Jul 04 2024 at 15:40):

Supposedly open webui supports something in that direction...

Andreas (Jul 04 2024 at 15:41):

you might need to run a specific model for that. Like this one: https://ollama.com/library/llava:13b

Srid (Jul 04 2024 at 15:41):

Looks like it may work: https://openwebui.com/m/dwbranson/image-analysis-using-llava-1:latest

Srid (Jul 04 2024 at 15:43):

Is it just me or is the Add Model button basically broken for others too?

image.png

Srid (Jul 04 2024 at 15:48):

Okay, it works, but not the greatest quality:

image.png

Srid (Jul 04 2024 at 15:51):

Compare with Claude:

image.png

Andreas (Jul 04 2024 at 15:54):

at least it works :smile:

Andreas (Jul 04 2024 at 15:54):

but yeah I'd say that might be a bit neglected so far in the open LLM space

Last updated: Nov 15 2024 at 11:45 UTC