Are You Being Crawled?

I've noticed that much of my web traffic has come from Google and MSN bots crawling my site - they count for almost fifty percent of my traffic!

So I found this interesting script that you can include on your site that will email you a notification everytime a googlebot crawls your site:

if(eregi("googlebot",$HTTP_USER_AGENT)) { if ($QUERY_STRING != "") {$url = "http://".$SERVER_NAME.$PHP_SELF.'?'.$QUERY_STRING;} else {$url = "http://".$SERVER_NAME.$PHP_SELF;} $today = date("F j, Y, g:i a"); mail("you@youremail.com", "Googlebot detected on http://$SERVER_NAME", "$today - Google crawled $url"); }
  • posted on 15 February 2005
  • by Jesse


(Minutia)

  • Author:
    Jesse
  • Published:
    Feb 15, 2005
  • Chapters:

GetUpdated

ElseWhere

Find me on aim Find me on delicious Find me on digg Find me on dopplr Find me on facebook Find me on lastfm Find me on linkedin Find me on livejournal Find me on msn Find me on pownce Find me on skype Find me on technorati Find me on twitter Find me on vox Find me on yahoo Find me on youtube