WhiteHouse.gov and robots.txt
November 9, 2004
I am doing some research into the robots.txt to work with our SharePoint 2003 implementation at work. I googled ‘robots.txt’ and the first several entries were tutorials on how to implement robots.txt. The 5th entry was for the www.whitehouse.gov/robots.txt.
It is almost 2000 lines long and seems to disallow search engine access to pretty much everything.
I wonder what they are trying to hide. Of course, I can go throught the robots.txt file and find out for myself.
Popularity: 3% [?]
Spam is out of control
November 1, 2004
Another month has passed and time for an update on my latest spam statistics. In my previous post on spam stats, for the month of September, my domain, smitty.net, had received ~76,400 spam emails. As of the end of October, the total spam directed at smitty.net was 133,328 messages! That is almost double the month of September. Crazy!
The good news is that I don’t see but about 2 spam emails a week. Once again, I tout the capabilities of www.SpamStopsHere.com. In addition, I made some changes to my account that not only helps me out, but also helps SpamStopsHere perform better. Prior to October, I had smitty.net configured to forward all non-existant mailbox emails to my email address. Several years ago, it was an interesting feature because you could see emails that were misaddressed or just phishing for valid addresses. Now, it is a blackhole for spammers. So, I turned on the feature to block emails that aren’t to valid addresses. For the month of October, smitty.net received 100,154 emails to non-existant email addresses! Apparently turning this feature on helps out SpamStopsHere because they can then reject the email outright without having to process it using any of their other filters.
Popularity: 4% [?]