Hey can you guys elaborate how this works? I'm looking at the Ollama section in ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		lubesGordi on April 17, 2024 \| parent \| context \| favorite \| on: Mixtral 8x22B Hey can you guys elaborate how this works? I'm looking at the Ollama section in their docs and it talks about load balancing? I don't understand what that means in this context.

SushiHippie on April 18, 2024 [–]

You probably want to look at the getting started guide

https://docs.openwebui.com/getting-started/

IIUC the load balancing page is for people who want to run openwebui at a larger scale

https://en.wikipedia.org/wiki/Load_balancing_(computing)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact