Elasticsearch is easier than mongo in some ways and harder in others.
I run a few 10TiB ES clusters (which, is not much to be fair) but infrequently find that I have to reindex or reshard the cluster because I can’t just add another node. There’s something to be said for understanding the index rotation too, and access patterns.
It’s easy to make an ES cluster, it’s difficult to maintain one, it’s nearly impossible to debug one.
- if you consider that “it’s slow” is what you have to debug.
That's approximately how large our clusters are. Fortunately, ours are read-only, so our admin story is:
- Hey, a node died!
- Run Terraform to stand up a whole new cluster and restore it from a snapshot.
- Update the app to point at the new cluster.
- Run Terraform to delete the old cluster.
> if you consider that “it’s slow” is what you have to debug.
This is exactly it. This is a problem you encounter with every database engine, but in most of them you can quickly find the bottleneck and fix it. With elasticsearch... it's a frustrating and expensive game of trial and error.
I run a few 10TiB ES clusters (which, is not much to be fair) but infrequently find that I have to reindex or reshard the cluster because I can’t just add another node. There’s something to be said for understanding the index rotation too, and access patterns.
It’s easy to make an ES cluster, it’s difficult to maintain one, it’s nearly impossible to debug one.
- if you consider that “it’s slow” is what you have to debug.