Any stats on how much documents or GB is in the index, how big the cluster is, a... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

PanMan on Jan 23, 2013 | parent | context | favorite | on: A Whole New Code Search

Any stats on how much documents or GB is in the index, how big the cluster is, and how long this took to build?

pea53 on Jan 23, 2013 [–]

For those interested:

1212672153 documents across 2866400 repositories taking up 17 TB of disk space over 23 elasticsearch storage nodes fronted by 8 elasticsearch compute nodes

It took about a month to iterate over all the repositories stored on the file servers and index the source code.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact