Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Aren't streams write-only? Can you delete parts of the stream if it is later deemed incorrect somehow?


There's some secret sauce here, but since we intercept each chunk as the LLM pushes them out, we can perform evaluations on them and decide what gets sent back to the client if we detect a fault.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: