Googlebots a porn whore

Maz · 11-16-2007, 10:24 AM

Who knew bots liked porn so much - in the last 36 hours :

Hits
42568 11.88%
Files
30167 12.37%
KBytes
909460 2.35%
Hostname
crawl-66-249-65-168.googlebot.com

seeandsee · 11-16-2007, 10:30 AM

Quote:

Googlebots a porn whore

Google wants all internet porn

Head Boy · 11-16-2007, 10:57 AM

Are you sure it isn't a picture leech scamming you?

Maz · 11-16-2007, 11:22 AM

I thought that at first head but all the logs show its googlebot .... any suggestions on confirming?

Head Boy · 11-16-2007, 11:28 AM

I guess it depends how many files you've got. Is it looking at the pictures? - if so, I guess you could ask it not to by using robots.txt. That will stop your images getting listed, but it might be worth the experiment. The leeches won't bother with the robots file.

11-16-2007, 10:24 AM	#1 (permalink)
Maz Netpond tadpole in training Join Date: Jul 2007 Posts: 73 Points: 360	Googlebots a porn whore Who knew bots liked porn so much - in the last 36 hours : Hits 42568 11.88% Files 30167 12.37% KBytes 909460 2.35% Hostname crawl-66-249-65-168.googlebot.com __________________ Maz ------------------- OMG Fuck Dump Links @ Dumpity.com Oh My God ! Mom

11-16-2007, 10:57 AM	#3 (permalink)
Head Boy c@rnage Join Date: Feb 2004 Location: England Posts: 44,079 Points: 3,981	Are you sure it isn't a picture leech scamming you? __________________ Domains for Porn - Domain registration and management services for adult webmasters.

11-16-2007, 11:22 AM	#4 (permalink)
Maz Netpond tadpole in training Join Date: Jul 2007 Posts: 73 Points: 360	I thought that at first head but all the logs show its googlebot .... any suggestions on confirming? __________________ Maz ------------------- OMG Fuck Dump Links @ Dumpity.com Oh My God ! Mom

11-16-2007, 11:28 AM	#5 (permalink)
Head Boy c@rnage Join Date: Feb 2004 Location: England Posts: 44,079 Points: 3,981	I guess it depends how many files you've got. Is it looking at the pictures? - if so, I guess you could ask it not to by using robots.txt. That will stop your images getting listed, but it might be worth the experiment. The leeches won't bother with the robots file. __________________ Domains for Porn - Domain registration and management services for adult webmasters.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Netpond Resources
Resource Directory	Tutorials & Articles	Webmaster Tools	Netpond News

Netpond Resources
LoveDollars	WildCash	PussyCash	TopBucks
Fetish Hits	Cyberwurx	BoobBucks.NET	Python
AEBN	GroobyBucks	Score-Cash	PluginFeeds
Rabbits Reviews	CraziesCash	TrafficCashGold	EvilAngelCash
Orgycash	BigClicks	Webcams	TubeClicks
Free Porn Paradise	British Porno	British Porn Models	ShanesworldCash