Difference between revisions of "Current Projects"

From Archiveteam
Jump to navigation Jump to search
(Add URLs, link .eu domains page)
 
(144 intermediate revisions by 22 users not shown)
Line 3: Line 3:
 
* [[Dev|Want to code for Archive Team? Here's a starting point.]]
 
* [[Dev|Want to code for Archive Team? Here's a starting point.]]
 
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br>
 
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br>
* What's on: [http://tracker.archiveteam.org/ online tracker].<br>
+
* What's on: [https://tracker.archiveteam.org/ online tracker].<br>
 
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].-->
 
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].-->
  
== Warrior based projects ==
+
== Warrior-based projects ==
 
{{:CurrentWarriorProject}}
 
{{:CurrentWarriorProject}}
  
 
<!-- Urgent projects -->
 
<!-- Urgent projects -->
 
<!-- Long-term projects -->
 
<!-- Long-term projects -->
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more newssites. '''IRC Channel {{IRC|newsgrabber}}'''.
+
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam|network=hackint}}'''.
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.
+
 
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as xporting Mediawiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.
+
''There will be fewer Warrior projects than usual due to the virtual appliance being unable to run many newer projects that utilize wget-at. It will take a little bit of time before an updated version is available that can run it.''
 +
 
 
=== Scripts only ===
 
=== Scripts only ===
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
+
* [[MediaFire]]: [https://twitter.com/textfiles/status/1339625133363912706 Setting fire to accounts and files it deems "abandoned" starting in January 2021.] '''IRC Channel {{IRC|mediaonfire|network=hackint}}'''.
 +
* [[.eu domains]]: The Brexit deal is done, and with that comes a purge of UK-based sites no longer eligible to use the .EU domain as of 2021. '''IRC Channel {{IRC|noteurdomain|network=hackint}}'''.
 +
* [[Endomondo]]: GPS workout tracker with optional social networking features, shutting down 2020-12-31. '''IRC Channel {{IRC|findelmundo|network=hackint}}'''.
 +
* [[Flash]] domains: An effort to preserve what remains of a storied legacy of websites hosting Adobe Flash Player content before the web industry takes it behind the shed. '''IRC Channel {{IRC|flashbang|network=hackint}}'''.
 +
* Classic [[Google Sites]]: Making more sites inaccessible to the public starting September 1, 2021. '''IRC Channel {{IRC|nearlylostmygoogles|network=hackint}}'''.
 +
* [[Reddit]]: Banning communities that generate bad PR for Reddit Inc. Currently grabbing ''new'' material. '''IRC Channel {{IRC|shreddit|network=hackint}}'''.
 +
* [[GitHub]]: Embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|gitgud|network=hackint}}'''.
 +
* [[URLs]]: A random collection of stuff. '''IRC Channel {{IRC|//|network=hackint}}'''.
  
 
== Manual projects ==
 
== Manual projects ==
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.
+
* [[Coronavirus|2019-2020 coronavirus outbreak]]: Documenting and preserving data, events, and impacts of the virus on society. '''IRC Channel {{IRC|coronarchive|network=hackint}}'''
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
+
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot|network=hackint}}'''.
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.
+
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam|network=hackint}}'''.
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.
+
* [[MP3.com]]: Digging through the WayBack Machine's archives to build a database of all the DAM CDs made available through the site.
* [[Mozilla Addons]] (aka addons.mozilla.org, AMO): deleting legacy addons in October 2018. '''IRC Channel {{IRC|outofammo}}'''.
 
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
 
  
* [[GeoCities Japan]]: It's GeoCities all over again... The Japanese version shuts down in March 2019. '''IRC Channel {{IRC|notagain}}'''.
+
== Upcoming & proposed projects ==
 
+
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). -->
== Active Projects Not Yet Ingesting ==
 
 
<!-- Top priority: could disappear anytime now -->
 
<!-- Top priority: could disappear anytime now -->
 
<!-- Shutting down, definite deadline given -->
 
<!-- Shutting down, definite deadline given -->
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr}}'''.
+
* [[Halo]]: Back to finishing off unfinished business before Bungie kills the original website on February 9, 2021. '''IRC Channel {{IRC|yolohalo|network=hackint}}'''.
 
+
* [[Webs]]: Vistaprint is killing off the Freewebs you knew from the 2000s on March 31, 2021, unless you pay up. '''IRC Channel {{IRC|webbed|network=hackint}}'''.
== Proposed projects ==
+
* [[Periscope]]: Another Twitter acquisition, another shutdown. This time, its live-streamer gets to join Vine in the bin at the end of March. '''IRC Channel {{IRC|microscope|network=hackint}}'''.
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). -->
+
* [[Google Poly]]: A 3D art repository that Google will send to the trash compactors on June 30, 2021. New uploads cease April 30. '''IRC Channel {{IRC|polygone|network=hackint}}'''.
 +
* [[Chrome Web Store]]: Google has announced a timeline of policy changes that will lead to content being removed between December 1, 2020 and June 2022. '''IRC Channel {{IRC|chromeweblore|network=hackint}}'''.
 
<!-- Shutting down, vague deadline given -->
 
<!-- Shutting down, vague deadline given -->
* [[AccuWeather#AccuWeather_Forums|AccuWeather Forums]]: discussion forum for meteorologists is going down the drain sometime in 2018. '''IRC Channel {{IRC|accio-weather}}'''.
+
* [[Kinja]]: Deleting all user pages, maybe? '''IRC Channel {{IRC|gokinjagokinjago|network=hackint}}'''.
* [[Google+]]: Google finally realised they failed. Shutting down by August 2019. '''IRC Channel {{IRC|googleminus}}'''.
+
* [[Twitter]]: Deleting inactive accounts <s>2019-12-11</s> sometime. '''IRC Channel {{IRC|twitterdead}}'''.
 
<!-- Shutting down, no deadline given -->
 
<!-- Shutting down, no deadline given -->
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. '''IRC Channel {{IRC|imgone}}'''.
 
 
<!-- Archiving the archives -->
 
<!-- Archiving the archives -->
 
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
 
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
 +
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. '''IRC Channel {{IRC|imgone}}'''.
 
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums}}'''.
 
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums}}'''.
* [[ZAM Network]]: Setting several sites on fire in autumn 2018.
 
* [[GitHub]]: Reportedly embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|getgit}}'''.
 
 
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.
 
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired. '''IRC Channel {{IRC|stumblr}}'''.
 
 
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.
 
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.
 
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.
 
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.
+
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for?
+
* [[Giphy]]: Bought by Facebook, to be "integrated" (assimilated) into Instagram https://news.knowyourmeme.com/news/facebook-to-buy-giphy
  
== Recently finished ==
+
== Recently finished projects ==
 
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
 
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
* [[TF2 Outpost]]: Setting itself and TF2 trades on fire after September in brazen act of insurance fraud due to costs. '''IRC Channel TBD'''.
+
* [[SmackJeeves]]: Webcomics host being tossed into the incinerator on 2020-12-31. '''IRC Channel {{IRC|archiveteam-bs|network=hackint}}'''.
* [[Tindeck]]: Creative Commons audio hosting site going silent on 2018-08-01. '''IRC Channel {{IRC|findeck}}'''.
+
* [[Voat]]: A reddit competitor from the Ellen Pao days gives its users a Christmas present: it's fucking dead! '''IRC Channel {{IRC|scrapevoat|network=hackint}}'''.
  
 
== Hiatus / Missed the Mark ==
 
== Hiatus / Missed the Mark ==
* [[Bazaar.tf]]: TF2 item trading site <s>is calling it quits and closing its shop for good in December</s> changed its mind on quitting after TF2 Outpost's closure. '''IRC Channel TBD'''.
+
* [[Fast.io]]: A CDN for cloud storage services which will evaporate completely on 2021-01-15. '''IRC Channel {{IRC|slowio|network=hackint}}'''.
 +
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.
 +
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.
 +
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr|network=hackint}}'''.
 +
* [[FTP]]: Help us find and download all FTP sites! '''IRC Channel {{IRC|effteepee|network=hackint}}'''.
 +
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).
 
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.
 
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.
 +
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
 +
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.
 +
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting|network=hackint}}'''.
 +
* [[NewsGrabber]]: Saving all news articles. <!-- Help with server power or by finding more news sites.-->Currently paused. '''IRC Channel {{IRC|newsgrabber|network=hackint}}'''.
 +
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
 
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.
 
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam}}'''.
+
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. '''IRC Channel {{IRC|tumbledown|network=hackint}}'''.
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS A AUDIT2018.
+
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam|network=hackint}}'''.
* [[Woohoo]]: Yahoo is untrustworthy, let's do a census of all their products. '''IRC Channel {{IRC|woohoo}}'''. WELL YAHOO IS SORTA DEADISH.
 
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).
 
* [[The Escapist]]: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. '''IRC Channel TBD'''.
 
* [[YTMND]]: Supposed to be "shutting down soon" in 2016, but still up 2 years later. '''IRC Channel TBD'''.
 
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
 
  
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]]</small>
+
<small>ArchiveTeam primarily uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/ – [[Archiveteam:IRC|More info]]
 +
<small>ArchiveTeam also has some channels left on the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[Archiveteam:IRC|More info]]</small><br>

Latest revision as of 03:26, 20 January 2021

Archive Team recruiting

Warrior-based projects

Current Running Warrior Project: URLTeam 2
  • URLTeam: URL shorteners were a fucking awful idea. IRC Channel #urlteam (on hackint).

There will be fewer Warrior projects than usual due to the virtual appliance being unable to run many newer projects that utilize wget-at. It will take a little bit of time before an updated version is available that can run it.

Scripts only

Manual projects

  • 2019-2020 coronavirus outbreak: Documenting and preserving data, events, and impacts of the virus on society. IRC Channel #coronarchive (on hackint)
  • ArchiveBot: For those with lots of disk space, bandwidth and long-term commitment. IRC Channel #archivebot (on hackint).
  • WikiTeam: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, everyone can help (you choose the size of your downloads). IRC Channel #wikiteam (on hackint).
  • MP3.com: Digging through the WayBack Machine's archives to build a database of all the DAM CDs made available through the site.

Upcoming & proposed projects

  • Halo: Back to finishing off unfinished business before Bungie kills the original website on February 9, 2021. IRC Channel #yolohalo (on hackint).
  • Webs: Vistaprint is killing off the Freewebs you knew from the 2000s on March 31, 2021, unless you pay up. IRC Channel #webbed (on hackint).
  • Periscope: Another Twitter acquisition, another shutdown. This time, its live-streamer gets to join Vine in the bin at the end of March. IRC Channel #microscope (on hackint).
  • Google Poly: A 3D art repository that Google will send to the trash compactors on June 30, 2021. New uploads cease April 30. IRC Channel #polygone (on hackint).
  • Chrome Web Store: Google has announced a timeline of policy changes that will lead to content being removed between December 1, 2020 and June 2022. IRC Channel #chromeweblore (on hackint).
  • Kinja: Deleting all user pages, maybe? IRC Channel #gokinjagokinjago (on hackint).
  • Twitter: Deleting inactive accounts 2019-12-11 sometime. IRC Channel #twitterdead (on EFnet).
  • Imgur: Image hoster decided that using it for hosting images is not permitted. IRC Channel #imgone (on EFnet).
  • JamiiForums: the Tanzanian government would like this gone. IRC Channel #jammedforums (on EFnet).
  • LiveJournal: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. IRC Channel #recordedjournal (on EFnet).
  • Ownlog: Ownlog is losing popularity and support from its owners. IRC Channel #pwnlog (on EFnet).
  • The Pirate Bay: Recently came back up, grabbing an archive for sanity's sake. IRC Channel #yarharfiddlededee (on EFnet).
  • Valhalla: Where to store what even the Internet Archive doesn't have space for? IRC Channel #huntinggrounds (on EFnet).
  • Giphy: Bought by Facebook, to be "integrated" (assimilated) into Instagram https://news.knowyourmeme.com/news/facebook-to-buy-giphy

Recently finished projects

  • SmackJeeves: Webcomics host being tossed into the incinerator on 2020-12-31. IRC Channel #archiveteam-bs (on hackint).
  • Voat: A reddit competitor from the Ellen Pao days gives its users a Christmas present: it's fucking dead! IRC Channel #scrapevoat (on hackint).

Hiatus / Missed the Mark

ArchiveTeam primarily uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/More info ArchiveTeam also has some channels left on the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090More info