From Archiveteam
Revision as of 20:59, 23 December 2009 by Jscott (talk | contribs)
Jump to navigation Jump to search


STARWARS.YAHOO.COM was a Star Wars themed user site, containing forums, user pages, and general movie information. Announced as a beta in October of 2007, it successfully suckered many users into posting, uploading, and sharing information on it before it was summarily shut off by Yahoo with a 30 day notice in December of 2009. On Dec 15, 2009, Yahoo shut the site down completely and redirected all queries to

Archive Team sprung into action and saved 99.9% of /users/, /forums/, /links/, and a smaller percentage of the other content on the site. (Most of the general star wars information was duplicated on anyway - we focused our efforts on user-generated content.)

Problems encountered:

  • Yahoo issues an error 999 after about 30 minutes of fetching from a certain IP. We used two approaches to get around this.
    • TOR (slow as molasses, but worked) - collected using httrack
    • multiple IPs (fast, but needs large IP resources) - collected using wget

The tarballs in the archive reflect both archiving methods:

-rw-r--r--  1 root   root   228855239 Dec 15 13:35
-rw-r--r--  1 root   root    36529217 Dec 20 15:53

This archive of the collected remnants is located here.

Ywosw-200x200.jpg Just Kidding!, 2007-2009