Difference between revisions of "Current Projects"

From Archiveteam
Jump to navigation Jump to search
(Add Bintray and LiveLeak; Y!A to finished)
 
(216 intermediate revisions by 25 users not shown)
Line 2: Line 2:
 
== Archive Team recruiting ==
 
== Archive Team recruiting ==
 
* [[Dev|Want to code for Archive Team? Here's a starting point.]]
 
* [[Dev|Want to code for Archive Team? Here's a starting point.]]
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br>
+
* Help us: '''[[ArchiveTeam_Warrior|☞ Download and run your warrior ☜]]'''.<br>
* What's on: [http://tracker.archiveteam.org/ online tracker].<br>
+
* What's on: [https://tracker.archiveteam.org/ online tracker].<br>
 
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].-->
 
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].-->
  
== Warrior based projects ==
+
== Warrior-based projects ==
 
{{:CurrentWarriorProject}}
 
{{:CurrentWarriorProject}}
  
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. '''IRC Channel {{IRC|archiveteam}}'''.
+
<!-- Urgent projects -->
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more newssites. '''IRC Channel {{IRC|newsgrabber}}'''.
+
* [[Bintray]]: JFrog is dismantling the software distribution platform used by numerous projects in May. '''IRC Channel {{IRC|binnedtray|network=hackint}}'''.
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.
+
* [[LiveLeak]]: Suddenly disappearing as of 2021-05-05. '''IRC Channel {{IRC|deadleak|network=hackint}}'''.
* [[WikiTeam]] ([[WARC]] format): Saving wikis and their external links for the Wayback Machine. '''IRC Channel {{IRC|wikiteam}}'''.
+
* [[Webs]]: Vistaprint is killing off the Freewebs you knew from the 2000s on <s>March 31</s> June 30, 2021, unless you pay up. '''IRC Channel {{IRC|webbed|network=hackint}}'''.
 +
* [[Periscope]]: Another Twitter acquisition, another shutdown. This time, its live-streamer gets to join Vine in the bin at the end of March. '''IRC Channel {{IRC|microscope|network=hackint}}'''.
 +
<!-- Long-term projects -->
 +
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam|network=hackint}}'''.
 +
 
 +
''An updated Warrior virtual appliance (v3.2) is now available with better support for newer projects that utilize wget-at. Please download it using the link above.''
  
 
=== Scripts only ===
 
=== Scripts only ===
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
+
* [[MediaFire]]: [https://twitter.com/textfiles/status/1349516443654758401 Not 'at-risk' but grabbing speculatively to save historic files] '''IRC Channel {{IRC|mediaonfire|network=hackint}}'''.
 
+
* Classic [[Google Sites]]: Making more sites inaccessible to the public starting September 1, 2021. '''IRC Channel {{IRC|nearlylostmygoogles|network=hackint}}'''.
== [[ArchiveBot]] projects==
+
* [[Reddit]]: Banning communities that generate bad PR for Reddit Inc. Currently grabbing ''new'' material. '''IRC Channel {{IRC|shreddit|network=hackint}}'''.
* [[Ars Technica UK]]: UK staff all laid off. [https://twitter.com/textfiles/status/936328601095626752 Jason asked us to.] '''IRC Channel {{IRC|archivebot}}'''.
+
* [[GitHub]]: Embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|gitgud|network=hackint}}'''.
* [[Raptr]]: AMD's cash went away, and now it's running out, closing on September 30th. '''IRC Channel {{IRC|archivebot}}'''.
+
* [[URLs]]: A random collection of stuff. '''IRC Channel {{IRC|//|network=hackint}}'''.
* [[Sears Canada]]: Reinventing the bankruptcy process through early 2018. '''IRC Channel {{IRC|archivebot}}'''.
 
* [[The Consumerist]]: Consumer Reports: "Having Lots of Loyal Readers is Greatly Overrated". '''IRC Channel {{IRC|archivebot}}'''.
 
  
 
== Manual projects ==
 
== Manual projects ==
* [[AOL]]: Climbing into the decaying walled garden. '''IRC Channel {{IRC|aohell}}'''
+
* [[Coronavirus|2019-2020 coronavirus outbreak]]: Documenting and preserving data, events, and impacts of the virus on society. '''IRC Channel {{IRC|coronarchive|network=hackint}}'''
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.
+
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot|network=hackint}}'''.
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''.
+
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam|network=hackint}}'''.
* [[Froogle]]: Let's do a census of all of Google's products. '''IRC Channel {{IRC|froogle}}'''.
 
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
 
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.
 
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.
 
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
 
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.
 
* [[WikiTeam]] (XML dumps): Exporting Mediawiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.
 
* [[Woohoo]]: Yahoo is untrustworthy, let's do a census of all their products. '''IRC Channel {{IRC|woohoo}}'''.
 
  
== Upcoming projects ==
+
== Upcoming & proposed projects ==
 +
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). -->
 
<!-- Top priority: could disappear anytime now -->
 
<!-- Top priority: could disappear anytime now -->
* [[DNAinfo]] and Gothamist: Abruptly ceased operations and was briefly taken offline after a unionization occurred. '''IRC Channel {{IRC|archiveteam}}'''.
 
 
<!-- Shutting down, definite deadline given -->
 
<!-- Shutting down, definite deadline given -->
* [[Vidme]]: Newer products are better! So let's put the old one in the shredder on December 14th. '''IRC Channel {{IRC|vidmeh}}'''.
+
* [[Google Poly]]: A 3D art repository that Google will send to the trash compactors on June 30, 2021. New uploads cease April 30. '''IRC Channel {{IRC|polygone|network=hackint}}'''.
 +
* [[Chrome Web Store]]: Google has announced a timeline of policy changes that will lead to content being removed between December 1, 2020 and June 2022. '''IRC Channel {{IRC|chromeweblore|network=hackint}}'''.
 
<!-- Shutting down, vague deadline given -->
 
<!-- Shutting down, vague deadline given -->
 +
* [[Kinja]]: Deleting all user pages, maybe? '''IRC Channel {{IRC|gokinjagokinjago|network=hackint}}'''.
 +
* [[Twitter]]: Deleting inactive accounts <s>2019-12-11</s> sometime. '''IRC Channel {{IRC|twitterdead}}'''.
 
<!-- Shutting down, no deadline given -->
 
<!-- Shutting down, no deadline given -->
 
<!-- Archiving the archives -->
 
<!-- Archiving the archives -->
 
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
 
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
 
+
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. '''IRC Channel {{IRC|imgone}}'''.
== Proposed projects ==
+
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums}}'''.
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). -->
 
* [[NeoGAF]]: Currently undergoing [[reddit]]-like riots due to a sexual harassment scandal involving the site owner. '''IRC Channel {{IRC|neogaffe}}'''.
 
* [[The Escapist]]: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. '''IRC Channel TBD'''.
 
* [[NCIX]] and [[DirectCanada]]: An investigation into recent telltale signs of a demise, including whole-province closures and alarm bells rung by customers, distributors, and even YouTube hosts. '''IRC Channel TBD'''.
 
* [[DeviantART]]: Being [https://techcrunch.com/2017/02/23/website-builder-wix-acquires-art-community-deviantart-for-36m/ bought by Wix], users may be unhappy with "access to that work to use in their own site building" on Wix. '''IRC Channel {{IRC|devianttart}}.
 
 
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.
 
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
 
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired. '''IRC Channel {{IRC|stumblr}}'''.
 
 
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.
 
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).
 
 
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.
 
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.
 +
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.
 +
* [[Giphy]]: Bought by Facebook, to be "integrated" (assimilated) into Instagram https://news.knowyourmeme.com/news/facebook-to-buy-giphy
  
== Recently finished ==
+
== Recently finished projects ==
 
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
 
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
* [[Miiverse]]: Nintendo's Switching away from Miiverse on November 8th (UTC). '''IRC Channel {{IRC|miiworse}}'''.
+
* [[Super Mario Maker Bookmark]]: Nintendo making discovery of courses far more difficult. Now focused on manually archiving course data. '''IRC Channel {{IRC|nintendone|network=hackint}}'''.
* [[Slingshot Esports]]: Announced a sudden shutdown with approximately 24 hours' notice. '''IRC Channel {{IRC|archivebot}}'''.
+
* [[Yahoo! Answers]]: This website, bought by Verizon, is the largest Q&A repository on the internet, but its answers to users' questions will be discarded on May 4, 2021. "What is Yahoo! Answers?" '''IRC Channel {{IRC|noanswers|network=hackint}}'''.
  
 
== Hiatus / Missed the Mark ==
 
== Hiatus / Missed the Mark ==
 +
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.
 +
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.
 +
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr|network=hackint}}'''.
 +
* [[FTP]]: Help us find and download all FTP sites! '''IRC Channel {{IRC|effteepee|network=hackint}}'''.
 +
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).
 +
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.
 +
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
 +
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.
 +
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting|network=hackint}}'''.
 +
* [[NewsGrabber]]: Saving all news articles. <!-- Help with server power or by finding more news sites.-->Currently paused. '''IRC Channel {{IRC|newsgrabber|network=hackint}}'''.
 +
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
 +
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.
 +
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. '''IRC Channel {{IRC|tumbledown|network=hackint}}'''.
 +
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam|network=hackint}}'''.
  
* [[Yahoo! Answers]]: It's Yahoo. It's been acquired. More questions? '''IRC Channel {{IRC|noanswers}}'''.
+
<small>ArchiveTeam primarily uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/ – [[Archiveteam:IRC|More info]]
* [[Flickr]]: [[Yahoo!]] decided to kill it, now Yahoo has been acquired. '''IRC Channel {{IRC|flickrfckr}}'''.
+
<small>ArchiveTeam also has some channels left on the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[Archiveteam:IRC|More info]]</small><br>
* [[Vine]]: [[Twitter]] killed the app and left an archive up, but videos likely won't last forever. Project currently on hiatus due to technical issues. '''IRC Channel {{IRC|vinewhine}}'''.
 
* [[PDF 2016]]: We've been given a long list of PDF files. We'll get'em. '''IRC Channel {{IRC|pdflush}}.'''
 
 
 
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]]</small>
 

Latest revision as of 01:34, 6 May 2021

Archive Team recruiting

Warrior-based projects

Current Running Warrior Project: Reddit
  • Bintray: JFrog is dismantling the software distribution platform used by numerous projects in May. IRC Channel #binnedtray (on hackint).
  • LiveLeak: Suddenly disappearing as of 2021-05-05. IRC Channel #deadleak (on hackint).
  • Webs: Vistaprint is killing off the Freewebs you knew from the 2000s on March 31 June 30, 2021, unless you pay up. IRC Channel #webbed (on hackint).
  • Periscope: Another Twitter acquisition, another shutdown. This time, its live-streamer gets to join Vine in the bin at the end of March. IRC Channel #microscope (on hackint).
  • URLTeam: URL shorteners were a fucking awful idea. IRC Channel #urlteam (on hackint).

An updated Warrior virtual appliance (v3.2) is now available with better support for newer projects that utilize wget-at. Please download it using the link above.

Scripts only

Manual projects

  • 2019-2020 coronavirus outbreak: Documenting and preserving data, events, and impacts of the virus on society. IRC Channel #coronarchive (on hackint)
  • ArchiveBot: For those with lots of disk space, bandwidth and long-term commitment. IRC Channel #archivebot (on hackint).
  • WikiTeam: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, everyone can help (you choose the size of your downloads). IRC Channel #wikiteam (on hackint).

Upcoming & proposed projects

Recently finished projects

  • Super Mario Maker Bookmark: Nintendo making discovery of courses far more difficult. Now focused on manually archiving course data. IRC Channel #nintendone (on hackint).
  • Yahoo! Answers: This website, bought by Verizon, is the largest Q&A repository on the internet, but its answers to users' questions will be discarded on May 4, 2021. "What is Yahoo! Answers?" IRC Channel #noanswers (on hackint).

Hiatus / Missed the Mark

ArchiveTeam primarily uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/More info ArchiveTeam also has some channels left on the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090More info