ApacheCon EU 2014

The traditional and typical search use case is the one large search collection distributed among many nodes and shared by all users. However, there is a class of applications which need a large number of small or medium collections which can be used, managed and scaled separately. This talk will cover Shalin and LucidWorks' efforts in helping a client set up a large scale SolrCloud setup with thousands of collections running on hundreds of nodes. Shalin will describe the bottlenecks that were found in SolrCloud when running a large number of collections and also the many features and optimisations that were contributed to Apache Solr to reduce or remove the choke points in the system. Finally, Shalin will talk about the benchmarking process and the lessons learned from supporting such an installation in production.