Whos Yahoo! Slurp Spider?

Search
BettingFoodStamps

BettingFoodStamps

New member
Joined
Nov 12, 2007
Messages
3,738
Tokens
he is a search engine program that crawls websites and puts information into the yahoo search engine for people when they search.
 
hellah10

hellah10

New member
Joined
Sep 21, 2004
Messages
4,935
Tokens
these are the "spiders" that "crawl" websites... basically, the algorithms behind the search engines... Slurp is one of many... there is

Yahoo Slurp
Googlebot
MSNBot-media
MSNBot
Alexa (IA Archiver)
Internet Shinchakubin
Scooter
ZyBorg
Askbot
WebCollage
Voila

at my last job, we always disabled these as it always slowed down our sites since it kills bandwith
 
You must log in or register to reply here.

Forum statistics

Threads
1,108,591
Messages
13,452,744
Members
99,426
Latest member
bodyhealthtechofficia

Share this page

The RX is the sports betting industry's leading information portal for bonuses, picks, and sportsbook reviews. Find the best deals offered by a sportsbook in your state and browse our free picks section.FacebookTwitterInstagramContact Usforum@therx.com
@2023 TheRX. All rights reserved.21+. Bet Responsibly: If you or someone you know has a gambling problem, seek help at 1-800-Gambler