Jure Cuhalev

1 | aquatix

October 13th, 2006 at 9:41 am

Interesting stuff! It’s nice to see our beloved encyclopedia in the results from a lot of searches, as it generally has nice concises data about the subject. Also, I won’t see Encyclopedia Britannica equal this feat any time soon

2 | Rough Type: Nicholas Carr's Blog

October 31st, 2006 at 8:39 pm

Evidence of attraction…

Over the last few months, I’ve made a number of observations, starting here, about the growing dominance of Wikipedia over search engine results for common terms. My findings were anecdotal, drawn from the searches I do day-in and day-out as well as a…

3 | ashkan karbasfrooshan

October 31st, 2006 at 10:15 pm

http://www.watchmojo.com/web/blog/?p=655

4 | Swiss Metablog

October 31st, 2006 at 11:06 pm

Yahoo und Google lieben Wikipedia; Microsoft hasst es…

OK, das war jetzt arg verkürzt. Doch die Seminararbeit von Jure Cuhalev (komplette Studie als PDF, Zusammenfassung im Blog) deutet darauf hin, dass Google und Yahoo ausgesprochen häufig Wikipedia-Artikel in den Suchresultaten anzeigen, MSN das jed…

5 | Bertil

October 31st, 2006 at 11:33 pm

Hi!
Great study: I’ve just overlooked it, but there are three “obvious” remarks to be made.

1. What about Ask.com? Have you considered smaller, alternative search-engines for comparison purpose. I’m thinking of an open-source one (sic) that might be a good base line.

2. Please, please, do it again, to have some dynamic data… I’d love to help, if it too much work. (You’ve got my e-mail, though it’s not public, right?)

3. Could you use Zeitgest info, instead of a Wikipedia biased query file?
This only has 10 items or so, http://www.google.com/press/zeitgeist.html
but I believe you might obtain an list of the top 100, unweighted, sorted alphabetically, from one of the four big SE; you can even sign an agreement not to publish it.

I might post another comment when I’m over with the full detail reading.

6 | Jure Cuhalev

November 1st, 2006 at 12:41 am

Bertil, thanks for the comments. I’ll email you about the details, but until then here are quick answers to the questions:

1. About ask.com: I would live to include more search engines, but only “big tree” offer public API’s that I could use to query the data without having to write my own search engine scrapper.

If you know any other search engines that offer some sort of API or other way to automaticly query for data I would be happy to include it.

2. What kind of dynamic data? I have another version that I also tested but didn’t publish results yet where I take queries from WP:RecentChanges in a certain time window to query only for pages that are active. Those number would probably give me even more pro-wikipedia results.

If there is a good source of data it would certainly be interesting to do it on them.

3. Sure, zeitgeist sounds like a good idea, but it’s probably easier if you just do it manualy then for me to feed it into my system.

If you can email me with details how to get more detailed zeitgeist information I would be *very* happy to repeat it again on that dataset.

7 | Philipp Lenssen

November 1st, 2006 at 12:04 pm

I think to determine “how much Wikipedia people see on top of Google” you’d have to change your methodology — e.g. use actual AOL query data (and even then you’d have the big constraint that AOL searchers may not be typical, but it would be a start, and as bonus you’d also know where they clicked on).

The fact that searching for Wikipedia titles often brings up Wikipedia doesn’t, IMO, yield relevant results, unless you want to show that Wikipedia has lots of pages indexed in search engines (around over 53 million in Google, according to Google’s “site” operator). But lots of pages indexed does not mean lots of pages will show up in search results. For Wikipedia, we all *know* that’s the case from our searching experience, but to come up with statistically relevant data you’d have to use actual real sample queries for probing.

8 | Undercurrent

November 9th, 2006 at 4:11 pm

Wikipedia search engine dominance revisited…

Recently many have noted that Wikipedia articles show up on the first page of hits in the big search engines (samples: Nicholas Carr, myself.) g. (a.k.a. Jure Cuhalev, according to Wikipedia Signpost), checked the tendency more thoroughly by reviewing …

9 | Micro Persuasion

November 9th, 2006 at 7:08 pm

Study Finds Google Favors Wikipedia…

Use Google? Well there’s an 81% likelihood that you will see results from Wikipedia in the top 10 search results, according to an analysis performed recently by Jure Cuhalev. He ran 1000 random terms from Wikipedia into Google, MSN Search…

10 | Jure Cuhalev

November 9th, 2006 at 11:56 pm

Philipp Lenssen: I agree with you and I’m working on some better methodology. Still, it’s a full disclosure of methodology so at least I’m not pulling results/queries of the air and claiming something.

11 | eszter

November 10th, 2006 at 7:34 am

I’ve posted this comment over on Nick Carr’s blog and Micropersuasion, but thought I’d add it here as well. I agree with Philipp that the methodology is flawed.

The starting point needs to be what users search for not what Wikipedia covers. By sampling from existing Wikipedia entries you are sampling on the dependent variable. By definition the study is controlling for the fact that a relevant Wikipedia entry exists using that query since you derived the search terms from existing Wikipedia titles. Queries on those exact terms are going to favor pages that have the term in the title. But who is to say that people search for those topics using those terms?

You could try using the AOL data for some possibilities (like Philipp suggests), but we don’t really know how representative AOL users are of all Internet users. You could get some ideas from Google’s Zeitgeist (as per Bertil’s suggestion), although that will only give you extremely common topics that may have tons of results and so may well be atypical results not reflecting the likelihood of a Wikipedia result for less common terms and topics.

I do research on how users look for various types of information online. If interested, we could discuss the possibility of you using some of the terms people in my study – average Internet users – entered on search forms for various types of content. I may not have quite the sample size you’re looking for, but I’d have some queries from real folks. (I also happen to know what they clicked on when using a particular search engine so that could also be interesting additional data.)

12 | WikiAngela

November 11th, 2006 at 2:45 am

MSN doesn’t like Wikipedia… or Encarta…

[Trackback] Jure ÄŒuhalev has published some interesting results from a small study of how three search engines rank Wikipedia in a search for Wikipedia article titles.
…
A really odd result that Jure sent me by email is that MSN does not link to…..

13 | 垂死爭扎

November 13th, 2006 at 3:34 pm

Wikipedia 攻佔 Search Engine…

當大家用 Google、Yahoo search 的時候，會發覺在頭幾個結果裡面，總會有一個 Wikipedia çš„ entry，而且更有越來越多的趨勢。…

14 | goabroad

April 29th, 2009 at 8:14 am

good work. I like Wiki in google search results as it gives you most relevant and comprehensive information.