Difference between revisions of "Current Projects"
Jump to navigation
Jump to search
(<@Kaz> updated projects.json to say don't run newsgrabber in the warrior, we'll see if that works) |
(NewsGrabber is scripts-only, not manual.) |
||
| Line 18: | Line 18: | ||
=== Scripts only === | === Scripts only === | ||
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''. | * [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''. | ||
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more news sites. '''IRC Channel {{IRC|newsgrabber}}'''. | |||
== Manual projects == | == Manual projects == | ||
| Line 24: | Line 25: | ||
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''. | * [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''. | ||
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''. | * [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''. | ||
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''. | * [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''. | ||
Revision as of 00:19, 4 April 2019
Archive Team recruiting
- Want to code for Archive Team? Here's a starting point.
- Help us: ☞ Download and run your warrior ☜.
- What's on: online tracker.
Warrior-based projects
- Flickr:
Yahoo!SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. IRC Channel #flickrfckr (on hackint). - Tumblr: Yahoo! considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. IRC Channel #tumbledown (on hackint).
- URLTeam: URL shorteners were a fucking awful idea. IRC Channel #urlteam (on hackint).
- WikiTeam: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, everyone can help (you choose the size of your downloads). IRC Channel #wikiteam (on hackint).
Scripts only
- FTP: Download all the FTP sites! IRC Channel #effteepee (on hackint).
- NewsGrabber: Saving all news articles. Help with server power or by finding more news sites. IRC Channel #newsgrabber (on hackint).
Manual projects
- ArchiveBot: For those with lots of disk space, bandwidth and long-term commitment. IRC Channel #archivebot (on hackint).
- FTP: Help us find all FTP sites! IRC Channel #effteepee (on hackint).
- INTERNETARCHIVE.BAK: Grab a slice of the big cake of The Archive! IRC Channel #internetarchive.bak (on hackint).
- ISP Hosting: Finding ISP web hosting services before the Grim Reaper finds them. IRC Channel #webroasting (on hackint).
- Project Newsletter: Archiving e-newsletters, currently in development. IRC Channel #projectnewsletter (on hackint).
Active Projects Not Yet Ingesting
Proposed projects
- Angelfire: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. IRC Channel #angelonfire (on hackint).
- JamiiForums: the Tanzanian government would like this gone. IRC Channel #jammedforums (on hackint).
- GitHub: Embraced-uh, I mean, bought by Microsoft. IRC Channel #getgit (on hackint).
- Imgur: Image hoster decided that using it for hosting images is not permitted. IRC Channel #imgone (on hackint).
- LiveJournal: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. IRC Channel #recordedjournal (on hackint).
- Ownlog: Ownlog is losing popularity and support from its owners. IRC Channel #pwnlog (on hackint).
- Reddit: Banning communities that generate bad PR for Reddit Inc. IRC Channel #shreddit (on hackint).
- The Pirate Bay: Recently came back up, grabbing an archive for sanity's sake. IRC Channel #yarharfiddlededee (on hackint).
- Valhalla: Where to store what even the Internet Archive doesn't have space for? IRC Channel #huntinggrounds (on hackint).
Recently finished projects
- GeoCities Japan: It's GeoCities all over again... The Japanese version shuts down in March 2019. IRC Channel #notagain (on hackint).
- Google+: Google finally realised they failed. Shutting down by April 2019. Archive Team's largest grab to date with just short of 1.4 PiB (1424 TiB) saved. IRC Channel #googleminus (on hackint).
Hiatus / Missed the Mark
- Textream: Yahoo! Japan killing yet another platform... Large Japanese discussion forum going down in early January 2019 (?). IRC Channel #textreamer (on hackint).
- Google News Archive: Let's store all newspapers at Google, WCGW? IRC Channel #papersplease (on hackint).
- Quizlet: Flashcards and other learning tools IRC Channel #quizletusin (on hackint).
- yuku: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. IRC Channel #archiveteam (on hackint).
- Audit 2014: It's time to verify our shit. IRC Channel #auditteam (on hackint). THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS A AUDIT2018.
- Google Groups: "Gone within a year" (SketchCow, 2016-06-07).
- The Escapist: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. IRC Channel TBD.
- YTMND: Supposed to be "shutting down soon" in 2016, but still up 2 years later. IRC Channel TBD.
- DevPort: This portfolio SaaS provider has reportedly been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – More info