Acta Mathematica Academiae Paedagogicae Nyíregyháziensis, Vol. 20, No. 1, pp. 105-113 (2004)

Statistical methods in measuring search engine performance

Erzsébet Tóth

College of Nyíregyháza, Hungary

Abstract: There is a growing need for a set of benchmarking tests for measuring search engines, because research on search engine evaluation is inconsistent in methods and approaches. Using these tests researchers can make comparisons between different search engines and carry out longitudinal studies on a particular search engine with a degree of consistency. Several problems emerge during the evaluations of search engines which are needed to be solved to measure search engine performance objectively. This paper presents a brief review of the different statistical methods and approaches utilized in search engine evaluations. It describes six significant research projects with their fulfilled activities and statistical findings. It also serves as a guideline for choosing an appropriate statistical method for use in search engine evaluations.

Keywords: Performance evaluation, measurement of search engines.

Classification (MSC2000): 62P30; 68M20

Full text of the article:

[Previous Article] [Contents of this Number]
© 2004 ELibM and FIZ Karlsruhe / Zentralblatt MATH for the EMIS Electronic Edition