I never bet on vector database tech (and I don't like RAG in general). Reasons:
- You create a new problem to solve an already tough problem (information retrieval)
- You bill people for storing vectors and searching when they are already paying for information storage and search
- You overcomplicate a retrieval problem that has well-defined solutions
- All the BS HYPE
The LLM wiki is one good option.
At WAIC, I saw a company change the filesystem to store the document index as you save documents so they never go out of sync.
- You create a new problem to solve an already tough problem (information retrieval) - You bill people for storing vectors and searching when they are already paying for information storage and search - You overcomplicate a retrieval problem that has well-defined solutions - All the BS HYPE
The LLM wiki is one good option. At WAIC, I saw a company change the filesystem to store the document index as you save documents so they never go out of sync.
Think harder boys.