Difference between revisions of "Current Projects"

From Archiveteam
Jump to navigation Jump to search
(change IRC channels into links)
(Add TJ)
 
(440 intermediate revisions by 41 users not shown)
Line 2: Line 2:
== Archive Team recruiting ==
== Archive Team recruiting ==
* [[Dev|Want to code for Archive Team? Here's a starting point.]]
* [[Dev|Want to code for Archive Team? Here's a starting point.]]
* Help us: '''[[ArchiveTeam_Warrior|☞ Download and run your warrior ☜]]'''.<br>
* What's on: [https://tracker.archiveteam.org/ online tracker].<br>
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].-->


== Warrior based projects ==
== Warrior-based projects ==
{{:CurrentWarriorProject}}
<!-- Urgent projects -->
* Ukraine/Russian invasion: Archiving various .ua sites in the wake of the Russian government's invasion. '''IRC Channel {{IRC|ucryne}}'''.
<!-- Longer but finite projects -->
* Classic [[Google Sites]]: Making more sites inaccessible to the public starting <s>September 1, 2021</s> January 1, 2023 with Workspace accounts. '''IRC Channel {{IRC|nearlylostmygoogles}}'''.
<!-- Long-term projects -->
* [[Telegram]]: Archiving public messages in various newsworthy and/or otherwise notable Telegram channels. '''IRC Channel {{IRC|telegrab}}'''.
* [[GitHub]]: Embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|gitgud}}'''.
* [[MediaFire]]: [https://twitter.com/textfiles/status/1349516443654758401 Not 'at-risk' but grabbing speculatively to save historic files] '''IRC Channel {{IRC|mediaonfire}}'''.
* [[Google Drive]]: Same as MediaFire. '''IRC Channel {{IRC|googlecrash}}'''.
* [[Reddit]]: Banning communities that generate bad PR for Reddit Inc. Currently grabbing ''new'' material. '''IRC Channel {{IRC|shreddit}}'''.
* [[URLs]]: A random collection of stuff. '''IRC Channel {{IRC|//}}'''.
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.
* [[Halo]]: Downloading all the read-only data from Halo. '''IRC Channel {{IRC|yolohalo}}'''. (Rate-limited, generally has enough volunteers.)
* [[Trovebox]]: Closing March 31, 2015. '''IRC Channel {{IRC|treasuretrove}}'''.
* [[Blogger]]: Google was to restrict public access to adult blogs, but they backed down. We're backing up Blogger anyway. '''IRC Channel {{IRC|frogger}}'''. (Content grab coming soon.)


Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br>
''An updated Warrior virtual appliance (v3.2) is now available with better support for newer projects that utilize wget-at. Please download it using the link above.''
What's on: [http://tracker.archiveteam.org/ online tracker].<br>
<!--
Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].
=== Scripts only === -->


== Manual projects ==
== Manual projects ==
* [[AOL]]: Climbing into the decaying walled garden. '''IRC Channel {{IRC|aohell}}'''
* [[Coronavirus|2019-202? coronavirus outbreak]]: Documenting and preserving data, events, and impacts of the virus on society. '''IRC Channel {{IRC|coronarchive}}'''
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''.
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
* Dead people: When people die, their webpages and/or social media might go "Poof!" due to fees and other knick-knack. '''IRC Channel {{IRC|archiveteam}}'''
* [[Froogle]]: Let's do a census of all of Google's products. '''IRC Channel {{IRC|froogle}}'''.
* [[INTERNETARCHIVE.BAK]]: How do we archive an archive? '''IRC Channel {{IRC|internetarchive.bak}}'''.
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
* [[WikiTeam]]: permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.
* [[Woohoo]]: Yahoo is untrustworthy, let's do a census of all their products. '''IRC Channel {{IRC|woohoo}}'''.


== Upcoming projects ==
== Upcoming & proposed projects ==
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). -->
<!-- Top priority: could disappear anytime now -->
<!-- Top priority: could disappear anytime now -->
* [[RadioShack]]: RadioShack is going bankrupt. '''IRC Channel {{IRC|unshackled}}'''.
* [[TJ]] (aka TJournal): Russian news platform shutting down 2022-09-10 over Ukraine reporting. '''IRC Channel {{IRC|journalthis}}'''.
<!-- Shutting down, definite deadline given -->
<!-- Shutting down, definite deadline given -->
* [[GitHost]]: Shutting down on April 30, 2015. '''IRC Channel {{IRC|gitghost}}'''.
* [[Chrome Web Store]]: Google has announced a timeline of policy changes that will lead to content being removed between December 1, 2020 and 2023. '''IRC Channel {{IRC|chromeweblore}}'''.
* [[Google Moderator]]: "July 31, 2015 is Moderator’s last day." (Goes read-only on June 30.) '''IRC Channel {{IRC|moderhater}}'''.
* [[Club Nintendo]]: Ran out of lives. Game over for North America on July 30, 2015, September 30, 2015 for Europe and Japan. '''IRC Channel {{IRC|clubnintendont}}'''.
* [[Google Code]]: Google likes [[Github]] more. Shutting down on January 26, 2016. '''IRC Channel {{IRC|googlecodeblue}}'''.
<!-- Shutting down, vague deadline given -->
<!-- Shutting down, vague deadline given -->
* Abandoned iOS App Store & Google Play apps: Both Apple and Google are slimming down on abandoned apps, [https://www.cnet.com/tech/mobile/one-third-of-apple-and-google-apps-are-so-outdated-they-could-get-removed/ with an estimated ~1.5M of them at risk]. '''IRC Channel {{IRC|appocalypse}}'''.
* [[Kinja]]: Deleting all user pages, maybe? '''IRC Channel {{IRC|gokinjagokinjago}}'''.
* [[Twitter]]: Deleting inactive accounts <s>2019-12-11</s> sometime. '''IRC Channel {{IRC|twitterdead|EFnet|abandoned}}'''.
<!-- Shutting down, no deadline given -->
<!-- Shutting down, no deadline given -->
* [[Panoramio]]: [[Google]] is migrating photos only (no metadata!) to Maps. '''IRC Channel {{IRC|paranormio}}'''.
<!-- Archiving the archives -->
<!-- Archiving the archives -->
* [[Orkut]]: Orkut got kut on September 30, 2014. It lives on as a public archive. '''IRC Channel {{IRC|throatkut}}'''.
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
<!-- Misc. projects (unmaintained sites, distrust in owners) -->
* [[Blipfoto]]: <s>Went into liquidation on March 11, 2015, future uncertain.</s> Acquired on March 25, 2015, we're still grabbing it anyway. '''IRC Channel {{IRC|fotofinish}}'''.
* [[VKontakte]]: A Russian equivalent of Facebook carries the risk of tumbling down under the weight of sanctions as a result of the government's invasion of Ukraine. '''IRC Channel {{IRC|lostkontakt}}'''.
* [[Comcast Personal Web Pages]]: Time Warner Cable closed their web hosting before it could be archived, let's make sure that doesn't happen with Comcast as well. '''IRC Channel {{IRC|comclose}}'''.
* [[YouTube]]: Archiving all YouTube metadata and selected videos afterwards soon. '''IRC Channel {{IRC|down-the-tube}}'''.
* [[SourceForge]]: Old, ad supported, adware supported. '''IRC Channel {{IRC|coldstorage}}'''.
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. (Now it's been bought by MediaLab.) '''IRC Channel {{IRC|imgone}}'''.
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums|EFnet|abandoned}}'''.
* [[Picasa|Picasa Web Albums]]: Main page redirecting to Google Plus, future uncertain. '''IRC Channel {{IRC|picasso}}'''.
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal|EFnet|abandoned}}'''.
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog|EFnet|abandoned}}'''.
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee|EFnet|abandoned}}'''.
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.
* [[Giphy]]: Bought by Facebook, to be "integrated" (assimilated) into Instagram https://news.knowyourmeme.com/news/facebook-to-buy-giphy


== Recently finished ==
== Recently finished projects ==
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people -->
* [[Google Baraza]]: Read-only, getting deleted on April 30, 2015. '''IRC Channel {{IRC|bonanza}}'''.
* [[Coub]]: Coub's looping videos will loop <s>no more come April 1, 2022</s> for some time longer after an aborted shutdown. '''IRC Channel {{IRC|coup}}'''.
* [[Last.fm]]: Switching codebases in the first two weeks of April, some user-generated content might be lost. '''IRC Channel {{IRC|lastchance.fm}}'''.
* [[Radikal]]: Panic grab of a Russian image host with "a billion" images and "a million" videos which shut down on 2022-03-10. '''IRC Channel {{IRC|deradikalize}}'''.
* [[FurAffinity]]
* [[Game Jolt]]: Deleting games it thinks are adult, with poor accuracy. '''IRC Channel {{IRC|gamejilt}}'''.


<!-- == Hiatus / Missed the Mark == -->
== Hiatus / Missed the Mark ==
* [[Webs]]: Vistaprint is killing off the Freewebs you knew from the 2000s on <s>March 31</s> <s>June 30, 2021</s> sometime, unless you pay up. '''IRC Channel {{IRC|webbed}}'''.
* [[Tinkercad]]: Autodesk announced its intent to put designs from inactive OAuth accounts back into minds around May 24, 2021. '''IRC Channel {{IRC|tinkerhad}}'''.
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr}}'''.
* [[FTP]]: Help us find and download all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.
* [[NewsGrabber]]: Saving all news articles. <!-- Help with server power or by finding more news sites.-->Currently paused. '''IRC Channel {{IRC|newsgrabber}}'''.
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. Tumblr has since been sold to Automattic. '''IRC Channel {{IRC|tumbledown}}'''.
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam-bs}}'''.


<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]]</small>
<small>ArchiveTeam uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/ – [[Archiveteam:IRC|More info]]</small>

Latest revision as of 22:38, 22 August 2022

Archive Team recruiting

Warrior-based projects

Current Running Warrior Project: Telegram

An updated Warrior virtual appliance (v3.2) is now available with better support for newer projects that utilize wget-at. Please download it using the link above.

Manual projects

  • 2019-202? coronavirus outbreak: Documenting and preserving data, events, and impacts of the virus on society. IRC Channel #coronarchive (on hackint)
  • ArchiveBot: For those with lots of disk space, bandwidth and long-term commitment. IRC Channel #archivebot (on hackint).
  • WikiTeam: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, everyone can help (you choose the size of your downloads). IRC Channel #wikiteam (on hackint).
  • Dead people: When people die, their webpages and/or social media might go "Poof!" due to fees and other knick-knack. IRC Channel #archiveteam (on hackint)

Upcoming & proposed projects

Recently finished projects

  • Coub: Coub's looping videos will loop no more come April 1, 2022 for some time longer after an aborted shutdown. IRC Channel #coup (on hackint).
  • Radikal: Panic grab of a Russian image host with "a billion" images and "a million" videos which shut down on 2022-03-10. IRC Channel #deradikalize (on hackint).
  • Game Jolt: Deleting games it thinks are adult, with poor accuracy. IRC Channel #gamejilt (on hackint).

Hiatus / Missed the Mark

  • Webs: Vistaprint is killing off the Freewebs you knew from the 2000s on March 31 June 30, 2021 sometime, unless you pay up. IRC Channel #webbed (on hackint).
  • Tinkercad: Autodesk announced its intent to put designs from inactive OAuth accounts back into minds around May 24, 2021. IRC Channel #tinkerhad (on hackint).
  • Angelfire: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. IRC Channel #angelonfire (on hackint).
  • Audit 2014: It's time to verify our shit. IRC Channel #auditteam (on hackint). THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.
  • Flickr: Yahoo! SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. IRC Channel #flickrfckr (on hackint).
  • FTP: Help us find and download all FTP sites! IRC Channel #effteepee (on hackint).
  • Google Groups: "Gone within a year" (SketchCow, 2016-06-07).
  • Google News Archive: Let's store all newspapers at Google, WCGW? IRC Channel #papersplease (on hackint).
  • DevPort: This portfolio SaaS provider has reportedly been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.
  • INTERNETARCHIVE.BAK: Grab a slice of the big cake of The Archive! IRC Channel #internetarchive.bak (on hackint).
  • ISP Hosting: Finding ISP web hosting services before the Grim Reaper finds them. IRC Channel #webroasting (on hackint).
  • NewsGrabber: Saving all news articles. Currently paused. IRC Channel #newsgrabber (on hackint).
  • Project Newsletter: Archiving e-newsletters, currently in development. IRC Channel #projectnewsletter (on hackint).
  • Quizlet: Flashcards and other learning tools IRC Channel #quizletusin (on hackint).
  • Tumblr: Yahoo! considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. Tumblr has since been sold to Automattic. IRC Channel #tumbledown (on hackint).
  • yuku: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. IRC Channel #archiveteam-bs (on hackint).

ArchiveTeam uses the hackint IRC network – ircs://irc.hackint.org:6697 (TLS required) – webchat: https://webirc.hackint.org/More info