Comments on: Open Source Search Engine Comparison http://lucene.grantingersoll.com/2007/12/04/open-source-search-engine-comparison/ Thoughts on Apache Lucene, Mahout, Solr, Tika and Nutch Fri, 05 Sep 2008 16:23:16 +0000 http://wordpress.org/?v=2.6.1 By: marc http://lucene.grantingersoll.com/2007/12/04/open-source-search-engine-comparison/#comment-5340 marc Fri, 25 Jan 2008 14:33:23 +0000 http://lucene.grantingersoll.com/2007/12/04/open-source-search-engine-comparison/#comment-5340 I was also surprised to see they neglected to mention any assumptions -- default language for all engines was English. A very poor assumption for a comparison of this sort, especially with globalization on all our minds. I grabbed the Zettair package to take a peek. At first glance it appears to be English only... and its possible romance languages w/stoplist or stemmers could be added. But that is a serious limitation. I wouldn't even touch a search engine toolkit if it was limited to one language or just romance languages these days. -marc ((Note -- your CAPTCHA has the letter l or i -- could not tell which.)) I was also surprised to see they neglected to mention any assumptions — default language for all engines was English. A very poor assumption for a comparison of this sort, especially with globalization on all our minds. I grabbed the Zettair package to take a peek. At first glance it appears to be English only… and its possible romance languages w/stoplist or stemmers could be added. But that is a serious limitation.

I wouldn’t even touch a search engine toolkit if it was limited to one language or just romance languages these days.

-marc

((Note — your CAPTCHA has the letter l or i — could not tell which.))

]]> By: grant_ingersoll http://lucene.grantingersoll.com/2007/12/04/open-source-search-engine-comparison/#comment-5202 grant_ingersoll Fri, 18 Jan 2008 12:50:57 +0000 http://lucene.grantingersoll.com/2007/12/04/open-source-search-engine-comparison/#comment-5202 I should also follow up on this that I think it is the duty of people publishing works like this to also publish the code used to do the evaluation. What good is research if you can't replicate it? I know several others who have been able to do large scale evaluations of Lucene and have not run into some of the issues mentioned in the article. I should also follow up on this that I think it is the duty of people publishing works like this to also publish the code used to do the evaluation. What good is research if you can’t replicate it?

I know several others who have been able to do large scale evaluations of Lucene and have not run into some of the issues mentioned in the article.

]]>