Featured post
out of memory - Solr - Faceted navigation on large index -
i have index containing 1.2 billion of documents (solr 1.4.1). want enable faceted navigation on field (int type) containg around 250 unique values.
i getting java heap space java.lang.outofmemoryerror
default method (facet.method=fc), while enum method slow (but works).
what best approach given number of documents , unique values?
updated:
so if understand correctly:
memory usage faceting using fc method is: maxdoc * 4bytes (the field type int, 64bit jvm), is: 1118950216 * 4bytes = 4.1gb (aprox.)
memory usage faceting using enum method is: numberofuniquevalues * sizeofbitset = 250 * (1118950216 / 8) = 32gb
is correct?
i try again fc method (and give more ram solr).
thanks!
you'll have tune jvm memory allocation settings and/or add more memory server; or alternatively sharding index.
- Get link
- X
- Other Apps
Comments
Post a Comment