Quantcast

Internet Archive Brings Free Ultra High-Speed Internet to Public Housing

Go Brewster and Ralf!!

The Internet Archive, a San Francisco-based organization dedicated to preserving a record of the Internet and to increasing access to the Internet, today began offering free Internet service to public housing projects at speeds far greater than any other city resident can receive.

Valencia Gardens Housing, with 240 units, is the first area to be connected in a pilot project that expects to wire more than 2,500 units in the city in the next eight months, according to Internet Archive founder Brewster Kahle.

What makes the project unique is that the apartments will be connected to the Internet, and to the educational resources at the Internet Archive, at 100 megabits per second (Mbits/second). That speed contrasts sharply with the normal Internet service offered by telephone companies, which is usually less than 6 Mbits/second.

The residents can instantly view DVD-quality videos of the thousands of lectures and other educational information from the Internet Archive’s collections, as well as traditional Internet access.

The Internet Archive is able to achieve this high speed by connecting the San Francisco municipal fiber optic network, which runs through the public housing developments, to an Archive switching center, which connects to the Internet.

“We are pleased to be the first non-profit organization to bring public housing online,” Kahle said.

He added: “We are excited to see much faster access to the Internet as a way to experiment with advanced applications, and are pleased that the underserved get first access to advanced technology.”

See also: NYTimes Bits Blog, The Reg, Cnet article by Greeter Dan.

Zara and Raj



photo.jpg, originally uploaded by tiki.robot.

Sent by Lisa R.

Zara and Bob



photo.jpg, originally uploaded by tiki.robot.

Sent by Lisa R.

They Want You Dead



They Want You Dead, originally uploaded by tiki.robot.

Seen near Flowercrack on Bayshore

Bring Your Own Big Wheel Races 2008

Last year a small crew showed up at Vermont St. after the official races ended, and we had an absolute blast. This year, the official races were on Vermont St., and it was awesome:

(click play to start) (link to other sizes)

IMG_4029

IMG_4023

IMG_4027

Happy Holi!

We went to the Holi festival in Sunnyvale today! Lots of fun :)


(click play to start) (Link to other sizes)

Happy Holi!

Radish research labs party



Radish research labs party, originally uploaded by tiki.robot.

Sent from Lisa R.

Radish Research Labs partay



Radish Research Labs partay, originally uploaded by tiki.robot.

Sent from Lisa R

In case you were wondering who the real tikirobot is

may

modeselektor

We went to see modeselektor last night at Mighty! It was super-packed.. a huge crowd for a Wednesday:
IMG_3943

The Camo Bus was rockin outside… I love the fact that no one complains that there is an absolutely thunderous soundsystem set up on the street :)
IMG_3945

Here is a short video of modeselektor being introduced. The Mighty soundsystem absolutely crushes the little microphone in my camera, so this video is kind of pointless but still fun. What you can’t hear in the video is an insane amount of soul-destroying bass:

(click play to start video)

I’ve watched this video at least 20 times

because I’m pretty sure I could learn a few things from these guys.

Where *IS* this prison??!!

Gorgeous Sunset over the Pacific… With Paragliders!

Check out this sunset timelapse that Mike shot using CHDK. Paragliders streak across the sky like lasers!

(click play to start) (link to other sizes)

Using git For Large Scale Digital Archiving: An Outline

Here are some notes on how one might re-architect Internet Archive infrastructure to meet some additional goals:

  • easy to set up and replicate
  • provide versioning and transactions
  • handle more media types well
  • better ingest/locate/read apis
  • better search

The current architecture looks like this:
iaarch.png

The diagram is simplified a lot. There are currently about 1800 nodes in the cluster, most of which are storage nodes (low power 1U nodes with 4 1TB hard drives). The deriver nodes are used for crunching things like pdfs and h.264s, and there are about 300 of those. There are 5 www frontends, hidden behind a couple load balancers, and database server has at least one read-only secondary.

What I like about the current infrastructure:

  • Easy to add more storage. Some other archival solutions do not scale well, since they insist all hard drives be connected to the same machine. This starts to break down at the petabox scale.
  • Easy to add more bandwidth. Currently IA is pushing 5+Gbps of outbound bandwidth. Every storage node runs an Apache server, which lessens load on the homenode, which is a problem with other archival systems.
  • Database hits are not required to locate an item on the cluster. When an item is requested through the Locator service, a multicast is sent, and machines that have the item will respond. The lessens load to the DB server, which is important when getting thousands of web requests per second.

What I find interesting about the current infrastructure:
  • RAID is not used. Items are backed up on to a secondary machine when added to the archive.
  • This is mostly due to “RAID is hard to get right” and cost
  • This means there are two machines (and two apaches) ready to serve the same content.
  • One machine can be taken down for repair while the content is still online.
  • I would like to see use of either RAID or maybe RAID_Z

An idea on how to re-architect things using git as a storage backend to provide versioning and transactions
  • git is the version control system used for the linux kernel.
  • git is a totally new way to operate on data. Read this if you are a non-believer.
  • We could keep the infrastructure mostly the same as IA, but store items as git repositories. This would not be a large architecture change.
  • git would become a supported access protocol, in addition to http, ftp, and rsync. Backups could be simple a git pull. We could git clone the entire cluster.
  • We would get versioning!

Changes needed to repo.git to make it useful in an archive cluster:
  • Change reguser.cgi to tie into the existing user database (talk to dbserver)
  • Change regprog.cgi to work in a cluster environment. Repositories are inited in /{0-4}/items/id/id.git on a primary node (talk to catalog/homenode)
  • Use post-commit hook to queue backup and derive tasks (talk to catalog)
  • Change gitweb to show custom view of movie, audio, texts (book), and photo collections. Software collections would show standard gitweb view.

I don’t think this would take too long to implement, but I’m lacking co-conspirators these days.. Maybe when shag makes it to SF we will have to knock something out :)

People Lovers

People Lovers, originally uploaded by tiki.robot.

on old stage road in pescadero (shotgun in tow and electric fences around the property!)
may

While you slept in this morning…… There was a glorious sunrise. (Nice bene of working the night shift -saz)

If Saul Bass did the opening sequence to Star Wars…

It might have looked like this! (This was a school project by bhilmers)

Digitizing old books with large foldouts

This panorama is one of the first images from our test of digitizing books with foldouts. It is from this book. The full-size image is here.

These foldouts are hard to image.. This picture shows how it was placed under the camera.

Robot Fabric!

robot-fabric.jpg

Found on Etsy by my friend mikepop (check out his new blog Grok Robots - a blog all about robots)

Bernal Sunset



Bernal Sunset, originally uploaded by tiki.robot.

-Bob and Zara

Our last Kauai sunset (notice the sail boat in the distance). See you all soon. Aloha. -Mike and Saz

The Mushroom Theory of Management

I decided to check out The Soul of a New Machine after reading this account of working at Atari and writing the Donkey Kong cart for the 2600 (if you are an Atari or DK fan, read this).

Anyway, the wiki page for The Soul of a New Machine talks about the Mushroom Theory of Management:

Tom West practices the “Mushroom Theory of Management” - “keeping them in the dark and feeding them shit.” That is, isolating the design team from outside influences and instead using the fear of the unknown to motivate the team.

I’ve encountered this a lot over the years, most notably at Apple, where Mushroom Management was one of my manager’s only motivational techniques.


CC by-nc-sa licensed photo by 23bit_grrrl

See also: Mikee’s awesome mushroom pictures

Kauai wild rooster. There are tons of them here! This one keeps crowing next to our cabin in waimea canyon .

Tiki of the day Koloa Kauai. - Saz and Mike

Smelly Dog!!



Smelly Dog!!, originally uploaded by tiki.robot.

Older Posts »