Thanks! Is there something about their platform that prevents caching? Or are th...

eli · 2026-09-03T20:02:08.000000Z

The session had a 91.4% cache hit rate. They just give zero discount.

imtringued · 2026-09-04T09:40:18.000000Z

It sounds to me that they don't have enough capacity and they want to discourage people from using the service.

There is nothing about their architecture that prevents reusing the KV cache other than the opportunity cost of keeping the memory occupied.