Ever wonder why you can get thousands of results from a search engine, yet can't seem to find anything useful? There are a myriad of reason as to why this happens, for example over the past couple of years I have noticed in particular the google search engine results have been less accurate & relevant.
Traditionally this is considered the fate of all search engines, why? Are the goals of representing relative data to the user & indexing the greatest portion of the Internet mutually exclusive?
I have put together some basic tests, which anyone can reproduce highlighting some of the different approaches, strengths & weaknesses of some of the current engines.
Note: the results were accurate at the time of writing, due to the nature of the internet/search engine technology these results may differ.
search term A, ordered by total number of results
over-search, number of results for a non term
engine, results (lower is better)
www.google.com, 34360000000
www.altavista.com, 27800000000
www.yahoo.com, 26900000000
www.alltheweb.com, 17000000000
www.bing.com, 6410000000
www.lycos.com, 1344243025
www.ask.com, 1120000000
www.webwombat.com.au, 0
Is full-text indexing of the entire Internet really useful ? useful to who ? google or the end user ? Do we need 34,360,000,000 results for the letter A ?www.google.com, 34360000000
www.altavista.com, 27800000000
www.yahoo.com, 26900000000
www.alltheweb.com, 17000000000
www.bing.com, 6410000000
www.lycos.com, 1344243025
www.ask.com, 1120000000
www.webwombat.com.au, 0
search term “Bill Clinton”, ordered by number of subjective relevant results in first page (out of 10, but excluding Wikipedia)
subjective relevancy, number of results deemed useful
engine, results (higher is better)
www.alltheweb.com, 7
www.lycos.com, 6
www.altavista.com, 3
www.google.com, 3
www.bing.com, 2
www.ask.com, 2
www.yahoo.com, 2
www.webwombat.com.au, 0
This is a subjective test, in this case I was looking for useful information on the search term. Kudos to alltheweb for providing the most relevant & useful results & tsk tsk @ google for failing this one...www.alltheweb.com, 7
www.lycos.com, 6
www.altavista.com, 3
www.google.com, 3
www.bing.com, 2
www.ask.com, 2
www.yahoo.com, 2
www.webwombat.com.au, 0
search term ladel, ordered by number of irrelevant results in first page (out of 10)
incorrect results, number of results that do not contain the search term at all.
engine, results (lower is better)
www.lycos.com, 7
www.google.com, 7
www.ask.com, 6
www.alltheweb.com, 6
www.yahoo.com, 5
www.altavista.com, 5
www.bing.com, 1
www.webwombat.com.au, 0
This clearly shows how some search engines possibly through the use of phonetics are actually out-smarting themselves. In this case lycos & google returned 7 out of 10 results which were not relevant (to the point of not even containing) the search query. Bing was quite impressive and the results returned were both accurate and relevant.www.lycos.com, 7
www.google.com, 7
www.ask.com, 6
www.alltheweb.com, 6
www.yahoo.com, 5
www.altavista.com, 5
www.bing.com, 1
www.webwombat.com.au, 0
search term "Australia", ordered by rank of Wikipedia results in the first page (out of 10)
over-reliance on 3rd party information sources (inaccurate)
engine, uses wiki?, rnk of wiki, no. of wiki no.of s-relv
www.alltheweb.com, yes, 2, 3, 2
www.lycos.com, yes, 2, 3, 1
www.google.com, yes, 3, 1, 2
www.ask.com, yes, 4, 1, 3
www.yahoo.com, yes, 5, 1, 2
www.altavista.com, yes, 8, 1, 2
www.bing.com, no, n/a, 0, 7
www.webwombat.com.au, no, n/a, 0, 0
uses wiki?, is a Wikipedia result displayed in the first 10 results www.alltheweb.com, yes, 2, 3, 2
www.lycos.com, yes, 2, 3, 1
www.google.com, yes, 3, 1, 2
www.ask.com, yes, 4, 1, 3
www.yahoo.com, yes, 5, 1, 2
www.altavista.com, yes, 8, 1, 2
www.bing.com, no, n/a, 0, 7
www.webwombat.com.au, no, n/a, 0, 0
rnk of wiki, how high (relevant) is the Wikipedia result
no. of wiki, number of references to Wikipedia or wiki's in general
no.of s-rel, number of subjective relative results (excluding Wikipedia)
Here I was interested as to how wiki has influenced search results, so here I am looking at how high wiki is ranked, how many wiki references then to see how many useful results were returned. Kudos again to bing which returned the most relevant results to the search term without resorting to what is (in this case) an atrocious and factually inaccurate wiki article (see how many errors you can find).
Overall the tests were interesting and showed some varied results which may give some insight as to why it is sometimes difficult to find information in a modern search engine.
No comments:
Post a Comment