TikiRobot!, Mai Tais and Blinky Lights, Ahoy! » Cybersquatters block the Internet Archive Wayback Machine

Cybersquatters block the Internet Archive Wayback Machine

posted by rajbot on April 7th, 2007

We know that domain squatters are scummy, but I never knew they were this scummy. The squatters who picked up http://goldengatetunnel.com/ are specifically blocking the Wayback Machine. Their robots.txt file not only prevents any new crawls, but since the Wayback Machine applies robots.txt retroactively, we can’t even see the previoiusly-archived (pre-squatter) web site :(
[nocode]
User-agent: ia_archiver
Disallow: /
User-agent: *
Disallow:
[/nocode]

Anyway, Dodger pointed me to this awesome bumper sticker.. Those who know, go below!

Filed under: archive, san francisco, transportation · 1 Comment

One Response to “Cybersquatters block the Internet Archive Wayback Machine”

Herve

April 9th, 2007 | 1:54 pm

The golden gate tunnel has a donut court with NINE different donut vendors. Don’t miss it next time you go to Marin.
I have some extra stickers. I can be bribed with donuts…

Twittering

Commenting

rajbot on Replacing URLs with links… halp?: Thanks AGAIN! Updated!!
shag on Replacing URLs with links… halp?: Ok, here’s a revised regex: prog = re.compile(r'(?#FQUR L)(?:(?#Protoco...
shag on Replacing URLs with links… halp?: Looks like there is a bug: it turned the ‘unresponded&# 8217; in...
shag on Fast manipulation of tar files using 7zip: maybe you can file a bug with john gilmore the next time you see him :-)
rajbot on Replacing URLs with links… halp?: Thanks again, shag! The hashtags should now be linked! Stupid WP keeps...
rajbot on Replacing URLs with links… halp?: stupid wordpress is stupid
shag on Replacing URLs with links… halp?: yuck, wordpress totally mangled teh python! lame :-( that <1 rel...
shag on Replacing URLs with links… halp?: This should convert the #foo and @bar… #!/usr/bin/python import re def...
rajbot on Replacing URLs with links… halp?: Converting <code> to <pre lang=”python&# 8221;> on the...
rajbot on Replacing URLs with links… halp?: Finally found these in the akismet spam panel.. sigh
shag on Replacing URLs with links… halp?: Here are the test cases I used, most from your earlier tests Raj: #single url...
shag on Replacing URLs with links… halp?: Okay, this one passes all of the current test cases, plus some new ones: prog =...
shag on Replacing URLs with links… halp?: here’s a version that adds support for a concluding period on the DNS...
shag on Replacing URLs with links… halp?: bah, guess we need to fix it for “http://to./&# 8221;
shag on Replacing URLs with links… halp?: btw here’s a version of the regex that handles the case anyway. something...
shag on Replacing URLs with links… halp?: yay! another proj idea for the twitter sidebar: link the #whatever and the...
rajbot on Replacing URLs with links… halp?: Yay!!! Thanks for the debugging help, shag :) This is why I love the...
shag on Replacing URLs with links… halp?: took a quick look. it’s not the anchor that causes it to break....

Cybersquatters block the Internet Archive Wayback Machine

One Response to “Cybersquatters block the Internet Archive Wayback Machine”

Leave a reply

Commenting

Stuff You Need

Pineapple Peeps

Tags

Archives