• This is a political forum that is non-biased/non-partisan and treats every persons position on topics equally. This debate forum is not aligned to any political party. In today's politics, many ideas are split between and even within all the political parties. Often we find ourselves agreeing on one platform but some topics break our mold. We are here to discuss them in a civil political debate. If this is your first visit to our political forums, be sure to check out the RULES. Registering for debate politics is necessary before posting. Register today to participate - it's free!

on the "Who's Online page"

cherokee

Devil Dog
Banned
DP Veteran
Joined
Aug 26, 2005
Messages
7,486
Reaction score
789
Gender
Undisclosed
Political Leaning
Undisclosed
what is "Yahoo! Slurp Spider"?
Is that like a guest?
 

Naughty Nurse

Banned
DP Veteran
Joined
Feb 5, 2005
Messages
1,972
Reaction score
12
Location
The UK
Gender
Male
Political Leaning
Very Liberal
I guess that's an automatic program that gathers information for the Yahoo search engine?
 

TheAnonymous

New member
Joined
Feb 26, 2006
Messages
9
Reaction score
0
Gender
Male
Political Leaning
Slightly Liberal
Yeah, If I'm not mistaken, it's some client that views pages and puts the pages viewed onto the Yahoo! search engine.

But if you want a better explanation, Google saves the day!

http://help.yahoo.com/help/us/ysearch/slurp/

Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.

As part of the crawling effort, the Yahoo! Slurp crawler will take robots.txt standards into account to ensure we do not crawl and index content from those pages whose content you do not want included in Yahoo! Search Technology. If a page is disallowed to be crawled by robots.txt standards, Yahoo! will not read or use the contents of that page. The URL of a protected page may be included in Yahoo! Search Technology as a "thin" document with no text content. Links and reference text from other public web pages provide identifiable information about a URL and may be indexed as part of web search coverage.
 
Last edited:

Schweddy

Benevolent Dictator
Administrator
DP Veteran
Joined
May 19, 2004
Messages
12,178
Reaction score
6,283
Location
Plano, TX
Gender
Male
Political Leaning
Libertarian - Right
Yep, yahoo loves us.
Now if we can get the same lovin' from google our signups will skyrocket.
 
Top Bottom