Edwin has made the best point with blocking spiders due to spiders cultivating e-mail addresses for Spam programs.
you can always block the goofy looking referrer-agents one by one. like: User-agent: The Intraformant Disallow: / User-agent: Mail-Sweeper Disallow: /
Drop me a line if you want me to post it. It the recommended list and keep out bandwith hogs... :roll: Michael www.lingerieblowout.com
I'd have to say like Edwin.. I'm too chicken to risk blocking anyone.... Knowing my luck it would mess with the "big boys" BTW :) Welcome Michael :welcome
No Problem .... I am new here and just thought I give you my two cents worth... :lol: michael www.lingerieblowout.com
Hey.. thats what we are all here for... 2 cents.. that hopefully will someday be worth lots more :) Share and Share some more I say! Look forward to hearing from you!
Not all spiders are bad. Some are crawlers from search engines like google. The problem with those is that they might index pages that you don't want people to access at all or at least directly. Then there are those little nasty spiders that will look for any e-mails you might have listed and then send you tons of spam :x