https://wiki.archiveteam.org/api.php?action=feedcontributions&user=Jrwr&feedformat=atomArchiveteam - User contributions [en]2024-03-28T09:49:19ZUser contributionsMediaWiki 1.37.1https://wiki.archiveteam.org/index.php?title=User:Jrwr&diff=48071User:Jrwr2021-12-31T07:57:46Z<p>Jrwr: </p>
<hr />
<div><br />
== Fixer of wikis and caller of the black magic ==<br />
Here is what I did<br />
<br />
PHP is located in ~/.local/bin/php-cgi<br />
I used a .htaccess to register a new cgi handler its in ~/www<br />
<br />
SSL is handled in ~/letsencrypt there is a shellscript in there talking to the cpanel to install new SSL certs, I used acme.sh for most of that.<br />
<br />
<br />
<br />
For anyone coming in behind me.... I'm sorry<br />
<br />
[[File:H97A49856.jpg]]<br />
<br />
<br />
This ia test edit after upgrading mediawiki - 12/31/2021</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=File:031822-wall.PNG&diff=46226File:031822-wall.PNG2021-01-23T23:24:38Z<p>Jrwr: </p>
<hr />
<div></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Sitenotice&diff=46154MediaWiki:Sitenotice2021-01-11T16:21:03Z<p>Jrwr: Replaced content with "-"</p>
<hr />
<div>-</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Parler&diff=46153Parler2021-01-11T16:20:42Z<p>Jrwr: -Redacted for a rewrite by sketchcow</p>
<hr />
<div>{{Infobox project<br />
| title = Parler<br />
| logo = Parler-logo.png<br />
| image = Parler - 1-9-21.png<br />
| URL = https://parler.com/<br />
| project_status = {{offline}}<br />
| tracker = [https://tracker.archiveteam.org/parler/ parler]<br />
| archiving_status = {{inprogress}}<br />
| source = [https://github.com/ArchiveTeam/parler-grab parler-grab]<br />
| irc = neparlepas<br />
| irc_network = hackint<br />
}}<br />
<br />
'''Parler''' is an American social network primarily used by Donald Trump supporters, conspiracy theorists, and far-right extremists. It drew criticism following the storming of the US Capitol on 2021-01-06. In the following days, its app was removed from Google Play Store, Apple threatened<ref>{{URL|https://www.reuters.com/article/us-apple-parler-idUSKBN29D34N}}</ref> and later followed through with<ref>{{URL|https://9to5mac.com/2021/01/09/apple-parler-app-store-removed/}}</ref> removal from their App Store, and Amazon announced that they would suspend Parler's AWS account at 2021-01-10 23:59 PST (2021-01-11 07:59 UTC)<ref>{{URL|https://www.buzzfeednews.com/article/johnpaczkowski/amazon-parler-aws}}</ref>. Parler had previously said that they would not play a game of provider Whac-A-Mole<ref>{{URL|https://twitter.com/disclosetv/status/1347712855844544513}}</ref>, which means the site is likely to stay down after that. On 2021-01-10, they stated that they were working on migration but are likely to be down for a while.<ref>{{URL|https://www.foxbusiness.com/technology/parler-down-amazon-web-services-ban}}</ref><br />
<br />
<br />
== External links ==<br />
<br />
* [https://github.com/d0nk/parler-tricks API information]<br />
* [https://gizmodo.com/every-deleted-parler-post-many-with-users-location-dat-1846032466 Every Deleted Parler Post, Many With Users' Location Data, Has Been Archived]<br />
<br />
== References ==<br />
<references /></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Anonnotice&diff=46152MediaWiki:Anonnotice2021-01-11T16:20:00Z<p>Jrwr: Replaced content with "-"</p>
<hr />
<div>-</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Anonnotice&diff=46151MediaWiki:Anonnotice2021-01-11T16:18:44Z<p>Jrwr: Created page with "=== Archive Team Statement about the Parler Project ==="</p>
<hr />
<div>=== [[Parler|Archive Team Statement about the Parler Project]] ===</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Sitenotice&diff=46150MediaWiki:Sitenotice2021-01-11T16:15:27Z<p>Jrwr: Created page with "=== Archive Team Statement about the Parler Project ==="</p>
<hr />
<div>=== [[Parler|Archive Team Statement about the Parler Project]] ===</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-editing-your-version&diff=45847MediaWiki:Moderation-editing-your-version2020-12-03T16:45:46Z<p>Jrwr: </p>
<hr />
<div>You are editing your version of this article. It is currently awaiting moderation.<br>Once approved, it will be visible to other users.<br><strong>For any questions, Please see the [[IRC]] channel {{IRC|archiveteam-bs|network=hackint}} for more details</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-editing-your-version&diff=45846MediaWiki:Moderation-editing-your-version2020-12-03T16:45:14Z<p>Jrwr: </p>
<hr />
<div>You are editing your version of this article. It is currently awaiting moderation.<br>Once approved, it will be visible to other users.<br><strong>For any questions, Please see the [[IRC]] at the {{IRC|archiveteam|network=hackint}} channel</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-editing-your-version&diff=45845MediaWiki:Moderation-editing-your-version2020-12-03T16:45:02Z<p>Jrwr: </p>
<hr />
<div>You are editing your version of this article. It is currently awaiting moderation.<br>Once approved, it will be visible to other users.<br><strong>For any questions, Please see the [[IRC]] at the {{IRC|archiveteam|network=hackint}} channel on Hackint.</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-edit-queued&diff=45844MediaWiki:Moderation-edit-queued2020-12-03T16:44:27Z<p>Jrwr: </p>
<hr />
<div>Success: your edit has been sent to moderation.<br>You can continue editing <a href='$1'>your version of this page</a>.<br><strong>For any questions, Please see the IRC at the <a href="https://webirc.hackint.org/#irc://irc.hackint.org/#archiveteam-bs">#archiveteam-bs</a> channel on hackint.</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Main_Page&diff=45842Main Page2020-12-03T16:40:12Z<p>Jrwr: </p>
<hr />
<div>__NOTOC__<br />
<center><br />
<!-- [[Image:Jasonappeal.png|center|link=Introduction]]--><br />
<table style="width:100%;border-spacing:8px;margin:12px 0px 0px 0px"><br />
<tr><td style="width:60%;border:1px solid #FFB9B9;background-color:#FFFFF0;vertical-align:top;color:#000"><br />
<table class="thumb" width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#FFFFF0;"><br />
<tr><td><br />
<td style="color:#000;text-align:left;vertical-align:top"><br />
<br />
=== HISTORY IS OUR FUTURE ===<br />
[[Image:Archiveteam.jpg|right|200px]]<br />
''And we've been trashing our history''<br />
<br />
Archive Team is a loose collective of rogue archivists, programmers, writers and loudmouths dedicated to saving our digital heritage. Since 2009 this variant force of nature has caught wind of shutdowns, shutoffs, mergers, and plain old deletions - and done our best to save the history before it's lost forever. Along the way, we've gotten attention, resistance, [[In_The_Media|press and discussion]], but most importantly, we've gotten the message out: '''IT DOESN'T HAVE TO BE THIS WAY'''.<br />
<br />
This website is intended to be an offloading point and information depot for a number of archiving projects, all related to saving websites or data that is in danger of being lost. Besides serving as a hub for team-based pulling down and mirroring of data, this site will provide advice on managing your own data and rescuing it from the brink of destruction.<br />
<!-- featured article ends --><br />
<br />
===Currently Active Projects (Get Involved Here!) ===<br />
{{:Current_Projects}}<br />
<br />
</td></tr><br />
</table><br />
<td style="width:40%;border:1px solid #cedff2;background-color:#f5faff;vertical-align:top"><br />
<table width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#f5faff"><br />
<tr><td><br />
[[Image:Archivetime.png]]<br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">What is What</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<!-- links starts --><br />
* [[Who We Are]] and how you can join our cause!<br />
<br />
* [[Deathwatch]] is where we keep track of sites that are sickly, dying or dead.<br />
<br />
* [[Fire Drill]] is where we keep track of sites that seem fine but a lot depends on them.<br />
<br />
* [[Projects]] is a comprehensive list of AT endeavors.<br />
<br />
* [[Philosophy]] describes the ideas underpinning our work.<br />
<br />
<!-- links ends --><br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Some Starting Points</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<br />
* [[Introduction|The Introduction]] is an overview of basic archiving methods.<br />
<br />
* [[Why Back Up?]] Because they don't care about you.<br />
<br />
* [[Facebook|Back Up your Facebook Data]] Learn how to liberate your personal data from Facebook.<br />
<br />
* [[Software]] will assist you in regaining control of your data by providing tools for information backup, archiving and distribution. <br />
<br />
* [[Formats]] will familiarize you with the various data formats, and how to ensure your files will be readable in the future.<br />
<br />
* [[Storage Media]] is about where to get it, what to get, and how to use it.<br />
<br />
* [[Recommended Reading]] links to others sites for further information.<br />
<br />
* [[Frequently Asked Questions]] is where we answer common questions.<br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Quote of the Moment</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<tr><td style="margin:20;background-color:#000000;font-size:200%;font-weight:bold;border:1px solid #a3b0bf;text-align:center;color:#fff;" ><br />
"[Yahoo!] found the way to destroy <br />
the most massive amount of history<br />
in the shortest amount of time <br />
with absolutely no recourse"<br />
</td></tr><br />
<tr><td style="text-align:right"><br />
[http://www.time.com/time/business/article/0,8599,1936645,00.html Internet Atrocity! GeoCities' Demise Erases Web History] <br />
<br>By Dan Fletcher, TIME Magazine, Monday, Nov. 09, 2009<br />
</td></tr><br />
<tr><td><br />
<br />
=== In The Media ===<br />
{{:Main Page/In The Media}}<br />
<td></tr><br />
</table><br />
</td></tr><br />
</table><br />
'''Archive Team is in no way affiliated with the fine folks at [http://www.archive.org ARCHIVE.ORG]'''<br />
'''Archive Team can always be reached by e-mail at [mailto:archiveteam@archiveteam.org archiveteam@archiveteam.org] or by [[IRC]] at the {{IRC|archiveteam|network=hackint}} channel on Hackint.'''</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Main_Page&diff=45841Main Page2020-12-03T16:38:46Z<p>Jrwr: </p>
<hr />
<div>__NOTOC__<br />
<center><br />
<!-- [[Image:Jasonappeal.png|center|link=Introduction]]--><br />
<table style="width:100%;border-spacing:8px;margin:12px 0px 0px 0px"><br />
<tr><td style="width:60%;border:1px solid #FFB9B9;background-color:#FFFFF0;vertical-align:top;color:#000"><br />
<table class="thumb" width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#FFFFF0;"><br />
<tr><td><br />
<td style="color:#000;text-align:left;vertical-align:top"><br />
<br />
=== HISTORY IS OUR FUTURE ===<br />
[[Image:Archiveteam.jpg|right|200px]]<br />
''And we've been trashing our history''<br />
<br />
Archive Team is a loose collective of rogue archivists, programmers, writers and loudmouths dedicated to saving our digital heritage. Since 2009 this variant force of nature has caught wind of shutdowns, shutoffs, mergers, and plain old deletions - and done our best to save the history before it's lost forever. Along the way, we've gotten attention, resistance, [[In_The_Media|press and discussion]], but most importantly, we've gotten the message out: '''IT DOESN'T HAVE TO BE THIS WAY'''.<br />
<br />
This website is intended to be an offloading point and information depot for a number of archiving projects, all related to saving websites or data that is in danger of being lost. Besides serving as a hub for team-based pulling down and mirroring of data, this site will provide advice on managing your own data and rescuing it from the brink of destruction.<br />
<!-- featured article ends --><br />
<br />
===Currently Active Projects (Get Involved Here!) ===<br />
{{:Current_Projects}}<br />
<br />
</td></tr><br />
</table><br />
<td style="width:40%;border:1px solid #cedff2;background-color:#f5faff;vertical-align:top"><br />
<table width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#f5faff"><br />
<tr><td><br />
[[Image:Archivetime.png]]<br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">What is What</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<!-- links starts --><br />
* [[Who We Are]] and how you can join our cause!<br />
<br />
* [[Deathwatch]] is where we keep track of sites that are sickly, dying or dead.<br />
<br />
* [[Fire Drill]] is where we keep track of sites that seem fine but a lot depends on them.<br />
<br />
* [[Projects]] is a comprehensive list of AT endeavors.<br />
<br />
* [[Philosophy]] describes the ideas underpinning our work.<br />
<br />
<!-- links ends --><br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Some Starting Points</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<br />
* [[Introduction|The Introduction]] is an overview of basic archiving methods.<br />
<br />
* [[Why Back Up?]] Because they don't care about you.<br />
<br />
* [[Facebook|Back Up your Facebook Data]] Learn how to liberate your personal data from Facebook.<br />
<br />
* [[Software]] will assist you in regaining control of your data by providing tools for information backup, archiving and distribution. <br />
<br />
* [[Formats]] will familiarize you with the various data formats, and how to ensure your files will be readable in the future.<br />
<br />
* [[Storage Media]] is about where to get it, what to get, and how to use it.<br />
<br />
* [[Recommended Reading]] links to others sites for further information.<br />
<br />
* [[Frequently Asked Questions]] is where we answer common questions.<br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Quote of the Moment</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<tr><td style="margin:20;background-color:#000000;font-size:200%;font-weight:bold;border:1px solid #a3b0bf;text-align:center;color:#fff;" ><br />
"[Yahoo!] found the way to destroy <br />
the most massive amount of history<br />
in the shortest amount of time <br />
with absolutely no recourse"<br />
</td></tr><br />
<tr><td style="text-align:right"><br />
[http://www.time.com/time/business/article/0,8599,1936645,00.html Internet Atrocity! GeoCities' Demise Erases Web History] <br />
<br>By Dan Fletcher, TIME Magazine, Monday, Nov. 09, 2009<br />
</td></tr><br />
<tr><td><br />
<br />
=== In The Media ===<br />
{{:Main Page/In The Media}}<br />
<td></tr><br />
</table><br />
</td></tr><br />
</table><br />
'''Archive Team is in no way affiliated with the fine folks at [http://www.archive.org ARCHIVE.ORG]'''<br />
'''Archive Team can always be reached by e-mail at [mailto:archiveteam@archiveteam.org archiveteam@archiveteam.org] or by [[IRC]] at the {{IRC|archiveteam|network=hackint}} channel on Hackit.'''</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=File:Lidl-service.com-20201130.png&diff=45817File:Lidl-service.com-20201130.png2020-11-30T02:04:54Z<p>Jrwr: </p>
<hr />
<div></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=File:119191392_1860915604050122_6822417657363610923_n.png&diff=45816File:119191392 1860915604050122 6822417657363610923 n.png2020-11-30T01:55:47Z<p>Jrwr: </p>
<hr />
<div></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=User:Jrwr&diff=45423User:Jrwr2020-08-24T00:49:02Z<p>Jrwr: </p>
<hr />
<div><br />
== Fixer of wikis and caller of the black magic ==<br />
Here is what I did<br />
<br />
PHP is located in ~/.local/bin/php-cgi<br />
I used a .htaccess to register a new cgi handler its in ~/www<br />
<br />
SSL is handled in ~/letsencrypt there is a shellscript in there talking to the cpanel to install new SSL certs, I used acme.sh for most of that.<br />
<br />
<br />
<br />
For anyone coming in behind me.... I'm sorry<br />
<br />
[[File:H97A49856.jpg]]</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=File:Kalen-Emsley-photo-1464822759023-fed622ff2c3b.jpg&diff=45421File:Kalen-Emsley-photo-1464822759023-fed622ff2c3b.jpg2020-08-23T20:57:31Z<p>Jrwr: </p>
<hr />
<div></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Move_Archiveteam_to_Hackint&diff=45380Move Archiveteam to Hackint2020-08-18T20:54:55Z<p>Jrwr: /* In Favor of Move to Hackint */ :P</p>
<hr />
<div>__NOTOC__<br />
<big>PROPOSED: MOVE ARCHIVETEAM IRC COMMUNICATION PRIMARILY TO HACKINT FROM EFNET</big><br />
<br />
Proposed by JAA a good long while ago, the proposal is to move Archive Team's IRC channels (and many project sub-channels) from EFNet to HackINT.<br />
<br />
As is typical, we're currently split between the two networks, with many channels in HackInt and many others in EFNet, depending on the preferences and inclinations of various members. Honestly, this can't continue. As most activity is happening in Hackint anyway, and because we might as well use this for a quorum discussion, this page exists for discussion (along with the talk page) *NOW* (Mid-August) to September 30th, at which point it will (hopefully) be very clear which direction we should go. This page is likely to get increased changes and traffic as time goes, so check back often.<br />
<br />
* Information on hackint is here: https://www.hackint.org/<br />
* Information on EFNet is here: http://www.efnet.org/<br />
<br />
= Arguments for moving Archive Team to Hackint =<br />
* IRC Services: No need to micromanage ops in each project channel, ease of administration<br />
* Stability: Handful of netsplits that lasted just a few minutes on Hackint compared to the ones on EFnet<br />
* Support: IRC staff has proven to be very helpful and useful and helped us get running with channel and user administration<br />
* Limits: Per-connection channel limits are much higher on Hackint and do not differ across servers<br />
<br />
= Arguments for keeping Archive Team on EFnet =<br />
* IRC Services: Inherently leads to a certralisation of permissions vs current system.<br />
* It has Always Been EFNet, we shouldn't uproot our long-standing relationship and work with that network.<br />
* EFNet is the longest-lived Network, showing it's here to stay.<br />
* We should just engage with EFNet to make them more hospitable for Archive Team needs.<br />
<br />
== How Moving to HackInt would Work ==<br />
<br />
Jason says "There would almost certainly be a #archiveteam channel on EFNet forever, with some people sitting in related long-time channels like #archiveteam-bs and #archiveteam-ot - but project channels would shut down and move to HackInt. So we'd still have a split, but the channels on EFNet would be more like either social hangouts or represent outreach to guide people to the other location."<br />
<br />
== Signatories ==<br />
<br />
* This is not a vote; this is a show of support in one direction.<br />
<br />
Edit and add your name to one of the lists below if you have a strong opinion one way or another. Describe your thinking, if you'd like. Do not add others if they are not on the Wiki.<br />
<br />
=== In Favor of Move to Hackint ===<br />
* [[User:Kiska]]<br />
* [[User:wessel1512]]<br />
* [[User:Aoede]]<br />
* [[User:Fusl]]<br />
* [[User:Katocala]]<br />
* [[User:ivan]]<br />
* [[User:JAA]]<br />
* [[User:Flashfire42]]<br />
* [[User:Jake]]<br />
* [[User:Kaz]]<br />
* [[User:Maxfan8]]<br />
* [[User:Jrwr]]<br />
<br />
=== In Favor of Staying at EFNet ===</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-edit-queued&diff=44957MediaWiki:Moderation-edit-queued2020-07-02T20:09:21Z<p>Jrwr: </p>
<hr />
<div>Success: your edit has been sent to moderation.<br>You can continue editing <a href='$1'>your version of this page</a>.<br><strong>For any questions, Please see the IRC at the <a href="http://chat.efnet.org:9090/?channels=%23archiveteam">#archiveteam</a> channel on EFnet.</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-edit-queued&diff=44956MediaWiki:Moderation-edit-queued2020-07-02T20:08:10Z<p>Jrwr: </p>
<hr />
<div>Success: your edit has been sent to moderation.<br>You can continue editing <a href='$1'>your version of this page</a>.<br><strong>For any questions, Please see the IRC at the #archiveteam channel on EFnet.</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-editing-your-version&diff=44955MediaWiki:Moderation-editing-your-version2020-07-02T20:05:34Z<p>Jrwr: Created page with "You are editing your version of this article. It is currently awaiting moderation.<br>Once approved, it will be visible to other users.<br><strong>For any questions, Please se..."</p>
<hr />
<div>You are editing your version of this article. It is currently awaiting moderation.<br>Once approved, it will be visible to other users.<br><strong>For any questions, Please see the [[IRC]] at the {{IRC|archiveteam}} channel on EFnet.</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=MediaWiki:Moderation-edit-queued&diff=44954MediaWiki:Moderation-edit-queued2020-07-02T20:05:26Z<p>Jrwr: Created page with "Success: your edit has been sent to moderation.<br>You can continue editing <a href='$1'>your version of this page</a>.<br><strong>For any questions, Please see the IRC at..."</p>
<hr />
<div>Success: your edit has been sent to moderation.<br>You can continue editing <a href='$1'>your version of this page</a>.<br><strong>For any questions, Please see the [[IRC]] at the {{IRC|archiveteam}} channel on EFnet.</strong></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Coronavirus&diff=44953Coronavirus2020-07-02T17:51:16Z<p>Jrwr: Reverted edits by 8.29.212.226 (talk) to last revision by Gridkr</p>
<hr />
<div>[[File:2019-nCoV-CDC.jpg|thumb|right|300px|Illustration of a SARS-CoV-2 virion.]]<br />
Archiving sites related to the '''2019-2020 coronavirus outbreak'''.<br />
<br />
IRC Channel: {{IRC|coronarchive}}<br />
<br />
== Main sites ==<br />
<br />
=== Information ===<br />
<br />
==== Global ====<br />
[[File:WHO-coronavirus.jpg|thumb|right|300px|WHO site.]]<br />
* https://www.who.int/emergencies/diseases/novel-coronavirus-2019/ | note = COVID-19 Disease info (WHO)<br />
* https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports/ | note = COVID-19 situation reports (WHO)<br />
* https://www.who.int/news-room/q-a-detail/q-a-coronaviruses/ | note = COVID-19 Questions & Answers (WHO)<br />
* https://www.un.org/en/coronavirus/<br />
* https://www.ecdc.europa.eu/en/novel-coronavirus-china/ | note = COVID-19 (European Centre for Disease Prevention and Control)<br />
* http://en.nhc.gov.cn/antivirusfight.html | note = COVID-19 (China National Health Commission)<br />
* https://bnonews.com/index.php/2020/02/the-latest-coronavirus-cases/ | note = Tracking coronavirus: Map, data and timeline (BNO News)<br />
* https://bnonews.com/index.php/2020/03/the-latest-coronavirus-cases/<br />
* https://bnonews.com/index.php/2020/04/the-latest-coronavirus-cases/<br />
* https://en.wikipedia.org/wiki/2019%E2%80%9320_coronavirus_outbreak | note = 2019–20 coronavirus outbreak (Wikipedia)<br />
* https://en.wikipedia.org/wiki/2019%E2%80%9320_coronavirus_pandemic | note = 2019–20 coronavirus pandemic (Wikipedia)<br />
* https://en.wikipedia.org/wiki/Template:COVID-19<br />
* https://en.wikipedia.org/wiki/Template:2019%E2%80%9320_coronavirus_pandemic<br />
* https://en.wikipedia.org/wiki/Category:2019%E2%80%9320_coronavirus_outbreak<br />
* https://en.wikipedia.org/wiki/Category:2019%E2%80%9320_coronavirus_pandemic<br />
<br />
==== Canada ====<br />
<br />
* https://www.gov.mb.ca/covid19/index.html<br />
* https://www.saskatchewan.ca/government/health-care-administration-and-provider-resources/treatment-procedures-and-guidelines/emerging-public-health-issues/2019-novel-coronavirus<br />
* https://www.alberta.ca/coronavirus-info-for-albertans.aspx<br />
* http://www.bccdc.ca/health-info/diseases-conditions/covid-19<br />
* https://www.ontario.ca/page/2019-novel-coronavirus<br />
* https://www.quebec.ca/sante/problemes-de-sante/a-z/coronavirus-2019/<br />
* https://www.quebec.ca/en/health/health-issues/a-z/2019-coronavirus/ | note = English version<br />
* https://www.gov.nl.ca/covid-19/<br />
* https://www2.gnb.ca/content/gnb/en/departments/ocmoh/cdc/content/respiratory_diseases/coronavirus.html<br />
* https://www.princeedwardisland.ca/en/topic/covid-19<br />
* https://novascotia.ca/coronavirus/<br />
* https://yukon.ca/en/health-and-wellness/health-concerns-diseases-and-conditions/find-information-about-coronavirus-covid<br />
* https://www.gov.nt.ca/en/public-safety-notices<br />
* https://gov.nu.ca/health/information/covid-19-novel-coronavirus<br />
<br />
==== Finland ====<br />
[[File:Pandemia dot fi.jpg|thumb|right|300px|[https://www.pandemia.fi/ Pandemia.fi]]]<br />
<br />
* https://corona.matsu.fi/<br />
* https://www.pandemia.fi/<br />
* https://korona.kans.io/<br />
* https://koronapaniikki.fi/<br />
* https://korona.mehilainen.fi/<br />
* https://koronakartta.info/<br />
* https://experience.arcgis.com/experience/d40b2aaf08be4b9c8ec38de30b714f26<br />
* https://thl.fi/fi/web/infektiotaudit-ja-rokotukset/ajankohtaista/ajankohtaista-koronaviruksesta-covid-19<br />
<br />
==== Hungary ====<br />
<br />
* https://koronavirus.gov.hu/ | note = Main page<br />
* https://koronavirus.gov.hu/terkepek/fertozottek | note = Map of infections<br />
* https://koronavirus.gov.hu/elhunytak | note = Details about death cases<br />
<br />
==== Indonesia ====<br />
<br />
* http://covid19.go.id/<br />
* http://covid19.kemkes.go.id/<br />
* http://corona.jakarta.go.id/<br />
* http://pikobar.jabarprov.go.id/<br />
* http://dinkes.kalbarprov.go.id/covid-19/<br />
* http://corona.sumbarprov.go.id/<br />
* http://corona.ntbprov.go.id/<br />
* http://corona.jatengprov.go.id/<br />
* http://infocorona.bantenprov.go.id/<br />
* http://corona.jogjaprov.go.id/<br />
* http://checkupcovid19.jatimprov.go.id/<br />
<br />
==== Lithuania ====<br />
<br />
* http://koronastop.lt/ | note = the page goverment is pushing as a goto place for information<br />
* http://sam.lrv.lt/lt/naujienos/koronavirusas<br />
<br />
;News<br />
<br />
* https://www.lrt.lt/tema/koronavirusas<br />
* https://www.15min.lt/projektas/koronavirusas<br />
* https://www.delfi.lt/multimedija/koronavirusas-lt/<br />
* https://www.delfi.lt/temos/koronavirusas<br />
<br />
;Civil initiatives<br />
<br />
* https://activeyouth.lt/pagalba-koronaviruso-metu/<br />
* https://apiekorona.lt/<br />
* https://stipruskartu.lt/<br />
<br />
==== Spain ====<br />
[[File:Covid19-spain.jpg|thumb|right|300px|[https://covid19.isciii.es/ covid19.isciii.es]]]<br />
* https://covid19.isciii.es/<br />
* https://www.mscbs.gob.es/profesionales/saludPublica/ccayes/alertasActual/nCov-China/ciudadania.htm<br />
* http://infocoronavirus.gva.es/<br />
* https://www.juntadeandalucia.es/organismos/saludyfamilias/areas/salud-vida/paginas/Nuevo_Coronavirus.html<br />
* https://www.aragon.es/-/coronavirus-covid-19-en-aragon<br />
* https://www.coronamadrid.com/<br />
* https://www.caib.es/sites/covid-19/ca/covid-19/<br />
* https://coronavirus.sergas.gal/<br />
* http://www.euskadi.eus/nuevo-coronavirus-covid-19/<br />
* https://web.gencat.cat/es/coronavirus/index.html<br />
* https://civio.es/coronavirus/<br />
* https://frenalacurva.net/<br />
* https://www.informecovid.org/<br />
<br />
==== Switzerland ====<br />
<br />
* https://www.coronavirus.bs.ch/ | note = Info page of the government of canton Basel-Stadt, Switzerland<br />
* https://www.bag.admin.ch/bag/de/home/krankheiten/ausbrueche-epidemien-pandemien/aktuelle-ausbrueche-epidemien/novel-cov.html | note = Info pages of the Bundesamt für Gesundheit (Ministry of Health) in Switzerland<br />
* https://www.bag.admin.ch/bag/fr/home/krankheiten/ausbrueche-epidemien-pandemien/aktuelle-ausbrueche-epidemien/novel-cov.html<br />
* https://www.bag.admin.ch/bag/it/home/krankheiten/ausbrueche-epidemien-pandemien/aktuelle-ausbrueche-epidemien/novel-cov.html<br />
* https://www.bag.admin.ch/bag/en/home/krankheiten/ausbrueche-epidemien-pandemien/aktuelle-ausbrueche-epidemien/novel-cov.html<br />
* https://bag-coronavirus.ch/<br />
* https://ofsp-coronavirus.ch/<br />
* https://ufsp-coronavirus.ch/<br />
* https://foph-coronavirus.ch/<br />
* https://www.bag.admin.ch/neues-coronavirus<br />
* https://www.bag.admin.ch/nouveau-coronavirus<br />
<br />
==== United States ====<br />
<br />
* https://coronavirus.gov/<br />
* https://www.cdc.gov/coronavirus/2019-nCoV/index.html<br />
* https://www.alabamapublichealth.gov/infectiousdiseases/2019-coronavirus.html<br />
* http://coronavirus.alaska.gov/<br />
* https://www.healthy.arkansas.gov/programs-services/topics/novel-coronavirus<br />
* http://cdph.ca.gov/covid19/<br />
* https://covid19.ca.gov/<br />
* https://www.colorado.gov/pacific/cdphe/2019-novel-coronavirus/<br />
* https://covid19.colorado.gov/<br />
* https://portal.ct.gov/coronavirus<br />
* https://coronavirus.dc.gov/<br />
* https://www.dhss.delaware.gov/dhss/dph/epi/2019novelcoronavirus.html<br />
* https://coronavirus.delaware.gov/<br />
* https://floridahealthcovid19.gov/<br />
* https://dph.georgia.gov/novelcoronavirus/<br />
* https://hawaiicovid19.com/<br />
* https://coronavirus.idaho.gov/<br />
* http://www.dph.illinois.gov/topics-services/diseases-and-conditions/diseases-a-z-list/coronavirus<br />
* http://coronavirus.illinois.gov<br />
* https://coronavirus.in.gov | note = redirected from https://www.in.gov/coronavirus/<br />
* https://idph.iowa.gov/Emerging-Health-Issues/Novel-Coronavirus<br />
* https://www.coronavirus.kdheks.gov | note = redirected from http://www.kdheks.gov/coronavirus/<br />
* https://kycovid19.ky.gov/<br />
* http://www.ldh.la.gov/Coronavirus/<br />
* https://www.maine.gov/governor/mills/covid-19<br />
* https://www.maine.gov/dhhs/mecdc/infectious-disease/epi/airborne/coronavirus.shtml<br />
* https://coronavirus.maine.gov<br />
* https://coronavirus.maryland.gov/<br />
* https://www.mass.gov/resource/information-on-the-outbreak-of-coronavirus-disease-2019-covid-19<br />
* https://covid19.memphistn.gov<br />
* https://www.michigan.gov/coronavirus/<br />
* https://www.health.state.mn.us/diseases/coronavirus/situation.html<br />
* https://msdh.ms.gov/msdhsite/_static/14,0,420.html<br />
* https://health.mo.gov/living/healthcondiseases/communicable/novel-coronavirus/<br />
* https://covid19.mt.gov/<br />
* http://dhhs.ne.gov/Pages/Coronavirus.aspx<br />
* http://dpbh.nv.gov/coronavirus/<br />
* https://www.nh.gov/covid19/<br />
* https://www.nj.gov/health/cd/topics/covid2019_dashboard.shtml<br />
* https://covid19.nj.gov<br />
* https://cv.nmhealth.org/<br />
* https://coronavirus.health.ny.gov/<br />
* https://www.ncdhhs.gov/divisions/public-health/coronavirus-disease-2019-covid-19-response-north-carolina<br />
* https://www.health.nd.gov/diseases-conditions/coronavirus<br />
* https://coronavirus.ohio.gov/<br />
* https://coronavirus.health.ok.gov/<br />
* https://govstatus.egov.com/OR-OHA-COVID-19<br />
* https://www.health.pa.gov/topics/disease/Pages/Coronavirus.aspx<br />
* https://www.scdhec.gov/covid19/<br />
* https://doh.sd.gov/news/Coronavirus.aspx<br />
* https://www.tn.gov/governor/covid-19.html<br />
* https://www.dshs.texas.gov/coronavirus/<br />
* https://coronavirus.utah.gov/<br />
* https://www.healthvermont.gov/covid/<br />
* http://www.vdh.virginia.gov/coronavirus/<br />
* https://www.doh.wa.gov/Emergencies/Coronavirus<br />
* https://coronavirus.wa.gov<br />
* https://dhhr.wv.gov/COVID-19<br />
* https://www.dhs.wisconsin.gov/covid-19/<br />
* https://covid19.wyo.gov/<br />
<br />
==== Thailand ====<br />
<br />
* https://ddc.moph.go.th/viralpneumonia/<br />
* https://ddc.moph.go.th/viralpneumonia/eng/ | note = English version<br />
* https://covid19.moph.go.th<br />
* https://stopcovid.anamai.moph.go.th/<br />
* http://www.moicovid.com/ | note = Ministry of Interior<br />
* http://www.bangkok.go.th/covid19/<br />
* http://bkkcovid19.bangkok.go.th/covid/frontend/web/<br />
* http://www.moicovid.com/map.html | note = all provinces' links<br />
;Provinces' Sites/Announcements<br />
* http://amnatcharoen.go.th/index.php/covid-19<br />
* http://www.angthong.go.th/covid19/<br />
* http://www.buriram.go.th/covid-19/<br />
* http://www.chachoengsao.go.th/covidccs/<br />
* http://www.chainat.go.th/covid-19/covid.htm<br />
* http://www.chaiyaphum.go.th/page_other/stopCovid-19cyp.php<br />
* https://sites.google.com/view/cphpublishcovid19 | note = Chaiyaphum<br />
* https://covid.chanthaburi.go.th/frontpage<br />
* https://cmcovid19.com/ | note = Chiang Mai<br />
* http://covid19.chiangrai.net/<br />
* http://123.242.164.5/Web/Covid-19/index.asp | note = Kamphaeng Phet<br />
* http://123.242.164.5/Web/Covid-19/linkMoi.asp<br />
* http://kanchanaburi.go.th/au/covidkan.html<br />
* http://www.khonkaen.go.th/khonkaen6/COVID19/<br />
* https://khonkaenstopcovid.com/<br />
* http://123.242.168.130/krabicovid/frontpage<br />
* http://www.lampang.go.th/covid19/<br />
* http://www.lampangceo.com/lampangceo/covid19/<br />
* http://www.lamphun.go.th/th/advertise/249/%E0%B8%84%E0%B8%93%E0%B8%B0%E0%B8%81%E0%B8%A3%E0%B8%A3%E0%B8%A1%E0%B8%81%E0%B8%B2%E0%B8%A3%E0%B9%82%E0%B8%A3%E0%B8%84%E0%B8%95%E0%B8%B4%E0%B8%94%E0%B8%95%E0%B9%88%E0%B8%AD%E0%B8%88%E0%B8%B1%E0%B8%87%E0%B8%AB%E0%B8%A7%E0%B8%B1%E0%B8%94%E0%B8%A5%E0%B8%B3%E0%B8%9E%E0%B8%B9%E0%B8%99-covid-19<br />
* http://www.lopburi.go.th/covid19/<br />
* http://www.mahasarakham.go.th/mkweb/610/3625-covid-19<br />
* http://www.mukdahan.go.th/covid.php<br />
* https://covid.nakhonphanom.go.th/frontpage<br />
* http://nakhonratchasima.go.th/covid-19/<br />
* https://www.nsn.moph.go.th/index.php/covid19/ | note = Nakhon Sawan<br />
* https://sites.google.com/view/nswcovid19/home | note = Nakhon Sawan<br />
* http://www.nakhonsithammarat.go.th/web_52/nstcovid19.php<br />
* http://www.nongbualamphu.go.th/NEXT/index.php/covid-19<br />
* http://www.nongkhai.go.th/covid/<br />
* http://nonthaburi.go.th/category/covid19<br />
* http://www.pathumthani.go.th/new_web/covid/<br />
* http://www.pattani2018.pattani.go.th/news_covid<br />
* https://covid.pattani.go.th/frontpage<br />
* https://covid.phatthalung.go.th/frontpage<br />
* http://www.phayao.go.th/covid/<br />
* http://www.phetchaburi.go.th/covid19/<br />
* http://www.phetchabun.go.th/covid19.php<br />
* http://203.157.213.6/covid/dist/index.php | note = Phetchabun<br />
* http://www.phichit.go.th/phichit/index.php/covid-annouce<br />
* http://www.phichit.go.th/phichit/covid19<br />
* http://phitsanulok.go.th/COVID19/<br />
* http://phrae.go.th/covid/covid.php<br />
* https://www.phuket.go.th/webpk/contents.php?str=covid-19<br />
* http://www.prachinburi.go.th/kamsung-covid19.htm<br />
* http://www.prachinburi.go.th/covid19.htm<br />
* http://www.ranong.go.th/covid19/covid19.htm<br />
* http://www.ratchaburi.go.th/rbcovid19/covid19.htm<br />
* https://sites.google.com/view/roiet-covid-19/<br />
* http://www.sakaeo.go.th/covid19/<br />
* http://www.samutsongkhram.go.th/covid/<br />
* http://www.samutsongkhram.go.th/V2013/index.php/covid<br />
* https://covid.satun.go.th/frontpage<br />
* http://www.singburi.go.th/covid19/<br />
* http://www.sisaket.go.th/covid19/<br />
* http://www.sukhothai.go.th/covid.html<br />
* http://www.suphanburi.go.th/suphan/covid19/<br />
* http://123.242.172.6/covid19_surat/<br />
* http://surin.go.th/covid19/<br />
* http://www.surin.go.th/index.php/%E0%B8%94%E0%B8%B2%E0%B8%A7%E0%B8%99%E0%B9%8C%E0%B9%82%E0%B8%AB%E0%B8%A5%E0%B8%94/category/14-%E0%B8%AB%E0%B8%99%E0%B8%B1%E0%B8%87%E0%B8%AA%E0%B8%B7%E0%B8%AD-%E0%B8%82%E0%B9%89%E0%B8%AD%E0%B8%AA%E0%B8%B1%E0%B9%88%E0%B8%87%E0%B8%81%E0%B8%B2%E0%B8%A3-covid-19.html<br />
* https://covid.takpho.go.th/<br />
* http://www.trang.go.th/covid/<br />
* http://www.trat.go.th/admin/index.php?view=covid<br />
* http://trat.go.th/covid19/<br />
* http://www.uthaithani.go.th/covid-19/covid-19.html<br />
* http://www.uttaradit.go.th/covid19/<br />
* http://www.yala.go.th/covid<br />
<br />
==== Other ====<br />
<br />
* https://thl.fi/en/web/infectious-diseases/what-s-new/coronavirus-covid-19-latest-updates<br />
* https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public | note = Gov.uk Guidance page (Updated multiple times a day)<br />
* https://www.rivm.nl/coronavirus/covid-19 | note = corona information from Rijksinstituut voor Volksgezondheid en Milieu (Updated multiple times a day)<br />
* https://coronadashboard.rijksoverheid.nl/<br />
* https://covid19.min-saude.pt/<br />
* https://shendetesia.gov.al/koronavirusi-i-ri-dhe-masat-ndaj-tij/<br />
* https://www.argentina.gob.ar/salud/coronavirus-COVID-19<br />
* https://www.health.gov.au/news/health-alerts/novel-coronavirus-2019-ncov-health-alert<br />
* https://www.saude.gov.br/saude-de-a-z/coronavirus<br />
* https://coronavirus.saude.gov.br/<br />
* https://covid19.lanix.org/<br />
* https://canada.ca/en/public-health/services/diseases/2019-novel-coronavirus-infection/<br />
* https://www.minsal.cl/nuevo-coronavirus-2019-ncov/casos-confirmados-en-chile-covid-19/<br />
* https://www.ins.gov.co/Noticias/Paginas/Coronavirus.aspx<br />
* http://koronavirus.hr/<br />
* https://onemocneni-aktualne.mzcr.cz/covid-19<br />
* https://politi.dk/coronavirus-i-danmark/<br />
* https://www.salud.gob.ec/coronavirus-covid-19/<br />
* https://thl.fi/en/web/infectious-diseases/what-s-new/coronavirus-covid-19-latest-updates/<br />
* https://interaktiv.morgenpost.de/corona-virus-karte-infektionen-deutschland-weltweit/<br />
* https://www.ghanahealthservice.org/covid19/<br />
* https://covid19honduras.org/<br />
* https://covid.is/<br />
* https://www.gov.ie/en/news/7e0924-latest-updates-on-covid-19-coronavirus/<br />
* https://govextra.gov.il/ministry-of-health/corona/<br />
* http://www.salute.gov.it/nuovocoronavirus<br />
* https://corona.e.gov.kw/<br />
* https://gouvernement.lu/fr/dossiers.gouv_msan+fr+dossiers+2020+corona-virus.html<br />
* http://www.moh.gov.my/index.php/pages/view/2019-ncov-wuhan/<br />
* https://covid19.health.gov.mv/<br />
* https://covid19malta.info/<br />
* http://www.covid19.mu/<br />
* https://www.health.govt.nz/our-work/diseases-and-conditions/covid-19-novel-coronavirus<br />
* http://zdravstvo.gov.mk/korona-virus/<br />
* http://covid.gov.pk/<br />
* https://www.mspbs.gov.py/covid-19.php<br />
* https://www.doh.gov.ph/2019-nCoV/<br />
* https://www.gov.pl/web/koronawirus/<br />
* https://www.moph.gov.qa/english/Pages/Coronavirus2019.aspx<br />
* https://covid19.rs/<br />
* https://sgwuhan.xose.net/<br />
* https://www.moh.gov.sg/covid-19/<br />
* http://www.korona.gov.sk/<br />
* https://www.gov.si/teme/koronavirus/<br />
* https://www.nijz.si/sl/pojav-novega-koronavirusa-2019-ncov/<br />
* https://sacoronavirus.co.za/<br />
* http://ncov.mohw.go.kr/<br />
* https://www.folkhalsomyndigheten.se/smittskydd-beredskap/utbrott/aktuella-utbrott/covid-19/<br />
* https://www.1177.se/sjukdomar--besvar/lungor-och-luftvagar/inflammation-och-infektion-ilungor-och-luftror/covid-19-coronavirus/<br />
* https://www.svt.se/datajournalistik/har-sprider-sig-coronaviruset/<br />
* https://www.svt.se/datajournalistik/corona-i-intensivvarden/<br />
* https://covid-19.tn/<br />
* https://hsgm.saglik.gov.tr/tr/covid19/<br />
* https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public<br />
* https://gehrcovidtriage.akidolabs.com/<br />
* https://www.gub.uy/ministerio-salud-publica/coronavirus/<br />
* https://ncov.moh.gov.vn/<br />
* https://www.covid19india.org/<br />
* https://www.mygov.in/covid-19/<br />
* https://lab24.ilsole24ore.com/coronavirus/<br />
* https://covid19.govt.nz/<br />
* https://www.gov.za/Coronavirus/<br />
* https://coronavirus.al/<br />
* https://www.govern.ad/coronavirus<br />
* https://www.sozialministerium.at/Informationen-zum-Coronavirus.html<br />
* https://koronavirusinfo.az/<br />
* https://www.corona.gov.bd/<br />
* https://epistat.wiv-isp.be/Covid/<br />
* https://www.mh.government.bg/bg/informaciya-za-grazhdani/potvrdeni-sluchai-na-koronavirus-na-teritoriyata-na-r-blgariya/<br />
* https://www.canada.ca/en/public-health/services/diseases/coronavirus-disease-covid-19.html<br />
* https://covid19.cv/<br />
* https://www.ministeriodesalud.go.cr/index.php/centro-de-prensa/noticias/741-noticias-2020/1532-lineamientos-nacionales-para-la-vigilancia-de-la-infeccion-por-coronavirus-2019-ncov<br />
* https://www.ssi.dk/aktuelt/sygdomsudbrud/coronavirus/covid-19-i-danmark-epidemiologisk-overvaagningsrapport<br />
* https://covid19.gob.sv/<br />
* https://www.terviseamet.ee/en/covid19<br />
* https://www.santepubliquefrance.fr/maladies-et-traumatismes/maladies-et-infections-respiratoires/infection-a-coronavirus/articles/infection-au-nouveau-coronavirus-sars-cov-2-covid-19-france-et-monde<br />
* https://covid19.gov.gr/covid19-live-analytics/<br />
* https://lab.imedd.org/covid19/<br />
* http://geochoros.survey.ntua.gr/coronavirus/<br />
* https://covid19.gov.gg/<br />
* https://covid.hi.is/<br />
* https://www3.nhk.or.jp/news/special/coronavirus/<br />
* https://www.gov.je/health/coronavirus/Pages/index.aspx<br />
* https://corona.moh.gov.jo/<br />
* https://www.coronavirus2020.kz/<br />
* https://kosova.health/<br />
* http://www.vm.gov.lv/en/ministry/novel_coronavirus_covid19_advice_for_the_public1/<br />
* https://spkc.gov.lv/en/covid-19<br />
* http://covid19.health.gov.mw/<br />
* https://ukkdosm.github.io/covid-19/<br />
* https://deputyprimeminister.gov.mt/en/health-promotion/Pages/Novel-coronavirus.aspx<br />
* https://coronavirus.gob.mx/<br />
* https://ansp.md/index.php/category/actualizarea-situatiei-privind-coronavirus/<br />
* https://www.amicusmongolia.com/coronavirus-mongolia-update.html<br />
* https://www.coronainfocg.me/<br />
* http://www.covidmaroc.ma/<br />
* https://covid19.mohp.gov.np/<br />
* http://covid19.ncdc.gov.ng/<br />
* https://koronavirus.gov.mk/<br />
* https://covid19.moh.gov.om/<br />
* http://corona.ps/<br />
* http://www.covid19.gov.ph/<br />
* https://advice.lk/coronavirus/<br />
* https://covid-19.sr/<br />
* http://minzdrav.gospmr.org/covid-19/<br />
* https://covid19.saglik.gov.tr/<br />
* https://covid19.tubitak.gov.tr/<br />
* https://corona.cbddo.gov.tr/<br />
* https://covid19.ncema.gov.ae/<br />
* https://coronavirus.uz/<br />
* https://verificovid.mx/<br />
* https://coronavirusrd.gob.do/<br />
* http://corona.gov.bd<br />
* http://corona.moh.gov.jo<br />
* http://coronaboard.com<br />
* http://coronavirus.uz<br />
* http://coronavirusvenezuela.info<br />
* http://covid.hi.is<br />
* http://covid19.cipalgerie.com<br />
* http://covid19.govt.nz<br />
* http://covid19.interieur.gov.ma<br />
* http://covid19.rs<br />
* http://covid19.sabah.digital<br />
* http://covid19.sante.gov.dz<br />
* http://covid19.sarawak.com.my<br />
* http://covidata.2m.ma<br />
* http://covidcanada.ca<br />
* http://covidmaroc.ma<br />
* http://italy.coronamapper.com<br />
* http://koronastop.lrv.lt<br />
* http://mapanticorona.map.ma<br />
* http://marocovid.com<br />
* https://anti-corona.kz<br />
* https://corona-sunsets.jp<br />
* https://corona.fo<br />
* https://corona.gov.bd<br />
* https://corona.ministryinfo.gov.lb<br />
* https://corona.ps<br />
* https://coronaboard.com<br />
* https://coronaboard.kr<br />
* https://coronamap.co.za<br />
* https://coronatracker.com<br />
* https://coronavirus-oswegocounty.hub.arcgis.com<br />
* https://coronavirus.1point3acres.com<br />
* https://coronavirus.bg<br />
* https://coronavirus.data.gov.uk<br />
* https://coronavirus.marinhhs.org<br />
* https://coronavirus.nd.edu<br />
* https://coronavirus.ne<br />
* https://coronavirus.nt.gov.au<br />
* https://coronavirus.tas.gov.au<br />
* https://coronavirus.ucsd.edu<br />
* https://coronavirus.ucsf.edu<br />
* https://coronavirusecuador.com<br />
* https://covid-19-cz.chcepe.now.sh<br />
* https://covid-19.ba<br />
* https://covid-19.wileam.com<br />
* https://covid-form.service.gov.au<br />
* https://covid.kg<br />
* https://covid.saude.gov.br<br />
* https://covid19-map.cdcmoh.gov.kh<br />
* https://covid19-phwstatement.nhs.wales<br />
* https://covid19.assam.gov.in<br />
* https://covid19.data.gov.rs<br />
* https://covid19.geo-spatial.org<br />
* https://covid19.gouv.tg<br />
* https://covid19.gov.im<br />
* https://covid19.gunnisoncounty.org<br />
* https://covid19.healthdata.org<br />
* https://covid19.ins.gov.mz<br />
* https://covid19.ly<br />
* https://covid19.minsa.gob.pe<br />
* https://covid19.sabah.digital<br />
* https://covid19.thrive.health<br />
* https://covid19.who.int<br />
* https://covid19bilgi.saglik.gov.tr<br />
* https://covid19estamoson.gov.pt<br />
* https://covid19ph.com<br />
* https://covid19stats.alberta.ca<br />
* https://covidassessment.org<br />
* https://dashboard.covid19.data.gouv.fr<br />
* https://gujcovid19.gujarat.gov.in<br />
* https://koronastop.lrv.lt<br />
* https://koronavirus.mzcr.cz<br />
* https://koronavirususrpskoj.com<br />
* https://ncov.dxy.cn<br />
* https://ncov.vncdc.gov.vn<br />
* https://ncovtracker.doh.gov.ph<br />
* https://opendatasus.saude.gov.br/dataset/painel-da-covid-19<br />
* https://ri-department-of-health-covid-19-data-rihealth.hub.arcgis.com<br />
* https://stopcorona.tn.gov.in<br />
* https://stopcoronatn.in<br />
* https://swiss.coronamapper.com<br />
* https://www.arubacovid19.org<br />
* https://www.beatcovid19.ai<br />
* https://www.coronavirus.bg<br />
* https://www.coronavirus.cchealth.org<br />
* https://www.coronavirus.gov.hk<br />
* https://www.covid-19.sa.gov.au<br />
* https://www.covid19.act.gov.au<br />
* https://www.covid19.qld.gov.au<br />
* https://www.covid19math.net<br />
* https://www.pacificcountycovid19.com<br />
* https://covid19faq.ru/<br />
<br />
=== Maps ===<br />
[[File:Thevirustracker.jpg|thumb|right|300px|[https://thevirustracker.com/ thevirustracker.com]]]<br />
* https://www.youtube.com/watch?v=qgylp3Td1Bw<br />
* https://medgic.co/virus/<br />
* https://corona.arrangy.com/<br />
* https://thevirustracker.com/<br />
* http://coronamapper.com/<br />
* https://www.arcgis.com/apps/opsdashboard/index.html#/f94c3c90da5b4e9f9a0b19484dd4bb14 | note = Public Health England tracking site (Updated 9AM GMT daily)<br />
* https://covidtracker.5lab.co/en | note = COVID-19 News Tracker – Location-based news about COVID-19 in Thailand<br />
* https://osp.maps.arcgis.com/apps/MapSeries/index.html?appid=79255eaa219140dfa65c01ae95ed143b | note = ofical map for lithuania<br />
* https://coronamap.it/<br />
* https://www.bing.com/covid<br />
* https://www.healthmap.org/covid-19/<br />
* https://covid-19-risk.github.io/map/<br />
* http://ccsl.ufpa.br/covid-19/<br />
* https://koronavirus.gov.hu/terkepek/fertozottek<br />
* https://kijijiyeetu.ushahidi.io/views/map | note = COVID19 Village Actions In Kenya / COVID-19 Actions in Transforming Villages<br />
* https://ushahidi.covid-19.ke/views/map<br />
* https://pbwatch.net/COVID19/<br />
* https://ddcportal.ddc.moph.go.th/portal/apps/opsdashboard/index.html#/20f3466e075e45e5946aa87c96e8ad65<br />
* https://stopcovid.anamai.moph.go.th/map<br />
* https://asteroidcollision.herokuapp.com/coronavirus-location-map<br />
<br />
== Archives and dedicated sites ==<br />
[[File:CoronaTracker.png|thumb|right|300px|[https://www.coronatracker.com/ CoronaTracker] tracking news.]]<br />
<br />
* https://www.covid19-archive.com/<br />
* https://github.com/2019ncovmemory/nCovMemory | note = Memory of 2020 nCoV: Media Coverage, Non-fiction Writings, and Individual Narratives<br />
* https://github.com/jiayiliujiayi/2020nCov_individual_archives | note = 2020nCov individual archives. Every individual matters. Every individual has a role to play<br />
* https://2019-ncov.jp/<br />
* https://covid19-chronicle.com/<br />
* https://www.wuhancrisis.com/<br />
* https://2019-ncov.sogiecn.com/<br />
* https://www.coronatracker.com/<br />
* https://transfer.notkiska.pw/4JCSb/coronatracker.com-news-articles | note = News articles listed on coronatracker.com (2020-03-02)<br />
* https://transfer.notkiska.pw/CDpS1/coronatracker.com-news-articles-list | note = JSON responses from coronatracker.com listing those news articles (2020-03-02)<br />
* https://transfer.notkiska.pw/vEFBM/coronatracker.com-news-articles-20200312T2215Z-minus-20200302T1545Z | note = News articles listed on coronatracker.com (2020-03-12, duplicates from the previous list removed)<br />
* https://transfer.notkiska.pw/OFSTL/coronatracker.com-news-articles-20200312T2215Z-minus-20200302T1545Z-operation-not-permitted-errors | note = URLs from this list which failed with "Operation not permitted" due to the sites' broken/insecure SSL configuration ([https://github.com/ArchiveTeam/ArchiveBot/pull/428 ArchiveBot PR #428])<br />
* https://transfer.notkiska.pw/lKdyS/coronatracker.com-news-articles-list-20200312T2215Z | note = Corresponding JSON responses (2020-03-12)<br />
* https://transfer.notkiska.pw/9zbgu/coronatracker.com-news-articles-20200519T1905Z-minus-20200312T2215Z | note = News articles listed on coronatracker.com (2020-05-19, duplicates from the previous list removed)<br />
* https://transfer.notkiska.pw/pb9AR/coronatracker.com-news-articles-list-20200519T1905Z | note = Corresponding JSON responses (2020-05-19)<br />
* https://transfer.notkiska.pw/nexEt/coronatracker.com-news-articles-20200616T1555Z-minus-20200519T1905Z | note = News articles listed on coronatracker.com (2020-06-16, duplicates from previous lists removed)<br />
* https://transfer.notkiska.pw/c0tqU/coronatracker.com-news-articles-list-20200616T1555Z | note = Corresponding JSON responses (2020-06-16)<br />
* https://covid19info.live/<br />
* https://covid-19.wtf/<br />
* https://2019ncov.ga/<br />
* https://www.info-coronavirus.be/<br />
* https://www.worldometers.info/coronavirus/<br />
* https://coronainfo.xyz/<br />
* https://corona-scanner.com/<br />
* https://staythefuckhome.com/<br />
* https://transfer.notkiska.pw/lTyNA/Corona_News.txt | note = Misc news articles<br />
* https://transfer.notkiska.pw/hxSbO/Corona_News2.txt | note = Misc news articles<br />
* https://transfer.notkiska.pw/hxSbO/Corona_News3.txt | note = Misc news articles<br />
* https://coronavirus.jhu.edu/<br />
* https://systems.jhu.edu/research/public-health/ncov/<br />
* https://livecorona.co.kr/<br />
* https://coronavirus.zone/<br />
* https://www.covid19italia.info/<br />
* https://www.covid19italia.help/<br />
* https://coronatracker.samabox.com/<br />
* https://lispczz.github.io/pneumonia/<br />
* https://coronavirus.john-coene.com/<br />
* https://corona-stats.online/<br />
* https://coronavirus-19-api.herokuapp.com/<br />
* https://weileizeng.github.io/Open-Source-COVID-19/<br />
* https://covid19.locale.ai/<br />
* https://the2019ncov.com/<br />
* https://developer.here.com/coronavirus/<br />
* https://pomber.github.io/covid19/timeseries.json<br />
* https://covid19.health/<br />
* https://covid19.khant.dev/<br />
* https://covid19.workpointnews.com/ | note = Thai language<br />
* https://transfer.notkiska.pw/E2Ngb/Corona_News4.txt | note = Misc news articles<br />
* https://coronavirus-monitor.ru/<br />
* https://covid19.th-stat.com/en<br />
* https://cov19.xyz<br />
* https://covidtracking.com/<br />
* https://coronavirus.app/<br />
* https://coronavirusinfections.org/<br />
* https://thewuhanvirus.com/<br />
* https://coronavirus.site/<br />
* https://wuflu.live/<br />
* https://www.outbreak.my/<br />
* https://www.epidemictracker.com/2019-Novel-Coronavirus-2019-nCoV<br />
* https://covid19japan.com/<br />
* https://coronavirus.visualdatahq.com/<br />
* https://go.gov.sg/covid-19-dashboard<br />
* https://shiny.john-coene.com/coronavirus<br />
* https://corona.rade.ir/<br />
* https://talksub.com/covid19<br />
* https://veille-coronavirus.fr/<br />
* https://alessiodl.github.io/COVID19Dashboard/dist/index.html<br />
* https://coronaviruslive.it/<br />
* https://stayinghome.club/<br />
* https://korona.ws/<br />
* https://www.coronainusa.com/<br />
* https://covid19esp.herokuapp.com/<br />
* https://italy.coronavirusinfections.org/<br />
* https://covid-api.com/<br />
* https://www.covidstats.com/<br />
* https://covidabruzzo.it/<br />
* https://corona-tracker-2020.netlify.com/<br />
* https://souryvath.github.io/ng-covid-19/<br />
* https://covid-19.kapook.com/ | note = Thai language<br />
* https://www.covid19.onl/<br />
* https://transfer.notkiska.pw/vMJWa/Corona_News5.txt | note = Misc news articles<br />
* https://www.corona-data.ch/<br />
* https://covid.observer/<br />
* https://covid9trump.com/<br />
* https://thepandemicwatch.com/<br />
* https://transfer.notkiska.pw/TMiHB/Corona_News6.txt | note = Misc news articles<br />
* https://moronavirus.site/<br />
* https://gocovid.issara.in.th/<br />
* https://covid19.voicetv.co.th/<br />
* https://coronavirus-global.com/<br />
* https://coronavirus-updates.live/<br />
* http://coronanederland.info/<br />
* https://kawalcovid19.id/<br />
* https://transfer.notkiska.pw/T6zFt/Corona_News7.txt | note = Misc news articles<br />
* https://transfer.notkiska.pw/CIvTn/Corona_News8.txt | note = Misc news articles<br />
* https://www.writingawrongcovid19.com/ | note = Site trying to help people out of work due to COVID-19 find jobs<br />
* https://covidmutualaid.org/<br />
* https://covid-19.alibabacloud.com/<br />
* https://community.wuhan2020.org.cn/<br />
* https://covid19dashboards.com/<br />
* https://th.kku.ac.th/covid-19kku/<br />
* https://th.kku.ac.th/covid19/<br />
* https://covid19.thaipbs.or.th/<br />
* http://www.covid-19.ke/<br />
* https://thaifightcovid19.com/<br />
* https://services.oas.psu.ac.th/COVID-19/<br />
* https://asteroidcollision.herokuapp.com/<br />
* https://coronavirus.jhu.edu/us-map<br />
<br />
=== Facebook ===<br />
<br />
* https://www.facebook.com/facebookmedia/solutions/coronavirus-resources<br />
* https://www.facebook.com/WHO/<br />
* https://apps.crowdtangle.com/public-hub/covid19<br />
* https://help.crowdtangle.com/en/articles/3791020-covid-19-live-display-hub<br />
* https://www.facebook.com/CovidAidUK/<br />
* https://www.facebook.com/verificovid<br />
* https://www.facebook.com/Coronavirusgob<br />
* https://www.facebook.com/informationcovid19/ | note = Thai language<br />
* https://www.facebook.com/KKUCovid19info<br />
* https://www.facebook.com/ThaiCovidCenter/<br />
* https://www.facebook.com/thaimoph/<br />
* https://www.facebook.com/KawalCOVID19<br />
<br />
=== GitHub ===<br />
[[File:Coronavirus GitHub.png|thumb|right|300px|GitHub repos regarding coronavirus.]]<br />
* https://github.com/topics/coronavirus<br />
* https://github.com/topics/covid-19<br />
* https://github.com/topics/2019-ncov<br />
* https://github.com/search?p=1&q=coronavirus&type=Topics<br />
* https://transfer.notkiska.pw/1P13N/github-coronavirus-1k.txt<br />
* https://github.com/noud/mouth-mask/<br />
* https://github.com/soroushchehresa/awesome-coronavirus<br />
* https://github.com/wuhan2020<br />
* https://github.com/github/covid19-dashboard<br />
* https://github.com/CovidShield<br />
* https://github.com/corona-warn-app<br />
* https://github.com/immuni-app<br />
* https://github.com/nhsx/antibody-web<br />
* https://github.com/nhsx/covid-chest-imaging-database<br />
* https://github.com/nhsx/COVID-19-app-Documentation-BETA<br />
* https://github.com/nhsx/COVID-19-app-iOS-BETA<br />
* https://github.com/nhsx/COVID-19-app-Android-BETA<br />
<br />
=== Google Drive ===<br />
<br />
* https://drive.google.com/drive/folders/1PcTEcMtjdLzak7C_ty6e-5pHM_LHJu9J<br />
* https://drive.google.com/drive/folders/1GRXNybjmwtyGCQ3VL7G8tOP4glt0hFTB<br />
* https://drive.google.com/drive/folders/1DmaEWGBaEu5XzwvZZXSbbR__V01BmhuV<br />
* https://drive.google.com/drive/folders/1_LldmKYcjntwuSAejkOxG47EiElvg8Xq<br />
* https://drive.google.com/drive/folders/1F5Rc7jnsyHe12kuT4fc8S7VBU-5z-KON<br />
* https://drive.google.com/drive/folders/1fJ8n2hSGu-LEiOibVLDnICzgZMDsytB1<br />
* https://drive.google.com/drive/folders/12Byw5mwoxgWZnhdR6sggXdAg2s-Ajcr3<br />
* https://drive.google.com/drive/folders/1RTF5N9kHSxfH7viwSKRicziS6ytgjLGw<br />
* https://drive.google.com/drive/folders/1Ix4nIXCC5HjVNKotZ0DSXrka1KHHHFOJ<br />
* https://drive.google.com/drive/folders/1ulmV_nTPAvQ4pf8d1NG5qfB3JYNvhR_t | note = Sing Buri , Thailand<br />
* https://drive.google.com/drive/folders/1XVQWYbkMEEqgYFN4Tddaw3AyFUx-r1bQ | note = Krabi, Thailand<br />
<br />
=== Instagram ===<br />
<br />
==== Accounts ====<br />
<br />
* https://www.instagram.com/CovidArtMuseum/<br />
* https://www.instagram.com/verificovid/<br />
* https://www.instagram.com/coronavirusgob/<br />
* https://www.instagram.com/covidmemorial/<br />
* https://www.instagram.com/nolacovid19mutualaid/<br />
* https://www.instagram.com/kawalcovid19.id/<br />
<br />
==== Hashtags ====<br />
* https://www.instagram.com/explore/tags/6feetapart/<br />
* https://www.instagram.com/explore/tags/30dayartquarantine/<br />
* https://www.instagram.com/explore/tags/2020quarantine/<br />
* https://www.instagram.com/explore/tags/airhugs/<br />
* https://www.instagram.com/explore/tags/artagainstcorona/<br />
* https://www.instagram.com/explore/tags/artduringcovid19/<br />
* https://www.instagram.com/explore/tags/artduringquarantine/<br />
* https://www.instagram.com/explore/tags/artinisolation/<br />
* https://www.instagram.com/explore/tags/artinlockdown/<br />
* https://www.instagram.com/explore/tags/artinthetimeofcorona/<br />
* https://www.instagram.com/explore/tags/artintimesofcorona/<br />
* https://www.instagram.com/explore/tags/artistinlockdown/<br />
* https://www.instagram.com/explore/tags/artistinquarantine/<br />
* https://www.instagram.com/explore/tags/artistsinquarantine/<br />
* https://www.instagram.com/explore/tags/artquarantine/<br />
* https://www.instagram.com/explore/tags/beatcovid19/<br />
* https://www.instagram.com/explore/tags/cironavirus/<br />
* https://www.instagram.com/explore/tags/coivd19art/ <!-- mispelling --><br />
* https://www.instagram.com/explore/tags/coivd19/ <!-- mispelling --><br />
* https://www.instagram.com/explore/tags/communalvirus/<br />
* https://www.instagram.com/explore/tags/coronaalert/<br />
* https://www.instagram.com/explore/tags/coronaapocalypse/<br />
* https://www.instagram.com/explore/tags/coronaartclub/<br />
* https://www.instagram.com/explore/tags/coronaart/<br />
* https://www.instagram.com/explore/tags/coronaartmuseum/<br />
* https://www.instagram.com/explore/tags/coronacation2020/<br />
* https://www.instagram.com/explore/tags/coronacreation/<br />
* https://www.instagram.com/explore/tags/coronacreations/<br />
* https://www.instagram.com/explore/tags/coronacreatives/<br />
* https://www.instagram.com/explore/tags/coronacreativity/<br />
* https://www.instagram.com/explore/tags/coronacrisis/<br />
* https://www.instagram.com/explore/tags/coronadiaries/<br />
* https://www.instagram.com/explore/tags/coronadrawing/<br />
* https://www.instagram.com/explore/tags/coronageddon/<br />
* https://www.instagram.com/explore/tags/coronahelp/<br />
* https://www.instagram.com/explore/tags/coronaillustration/<br />
* https://www.instagram.com/explore/tags/coronaindia/<br />
* https://www.instagram.com/explore/tags/coronakindness/<br />
* https://www.instagram.com/explore/tags/coronapatient/<br />
* https://www.instagram.com/explore/tags/coronapositive/<br />
* https://www.instagram.com/explore/tags/coronarelief/<br />
* https://www.instagram.com/explore/tags/coronascare/<br />
* https://www.instagram.com/explore/tags/coronasketch/<br />
* https://www.instagram.com/explore/tags/coronatesting/<br />
* https://www.instagram.com/explore/tags/coronathoughts/<br />
* https://www.instagram.com/explore/tags/coronavirusfear/<br />
* https://www.instagram.com/explore/tags/coronavirushumor/<br />
* https://www.instagram.com/explore/tags/coronaviruslockdown/<br />
* https://www.instagram.com/explore/tags/coronavirusscare/<br />
* https://www.instagram.com/explore/tags/coronavirustime/<br />
* https://www.instagram.com/explore/tags/coronav%C3%ADrussucks/<br />
* https://www.instagram.com/explore/tags/coronawarriors/<br />
* https://www.instagram.com/explore/tags/coronawarriorsindia/<br />
* https://www.instagram.com/explore/tags/coronaworld/<br />
* https://www.instagram.com/explore/tags/couplesinquarantine/<br />
* https://www.instagram.com/explore/tags/covid19artchallenge/<br />
* https://www.instagram.com/explore/tags/covid19art/<br />
* https://www.instagram.com/explore/tags/covid19art/<br />
* https://www.instagram.com/explore/tags/covid19artwork/<br />
* https://www.instagram.com/explore/tags/covid19crisis/<br />
* https://www.instagram.com/explore/tags/covid19deaths/<br />
* https://www.instagram.com/explore/tags/covid19humor/<br />
* https://www.instagram.com/explore/tags/covid19lockdown/<br />
* https://www.instagram.com/explore/tags/covid19memes/<br />
* https://www.instagram.com/explore/tags/covid19scare/<br />
* https://www.instagram.com/explore/tags/covid19sketch/<br />
* https://www.instagram.com/explore/tags/covid19time/<br />
* https://www.instagram.com/explore/tags/covid19video/<br />
* https://www.instagram.com/explore/tags/covidartchallenge/<br />
* https://www.instagram.com/explore/tags/covidartchallenge/<br />
* https://www.instagram.com/explore/tags/covidartmuseum/<br />
* https://www.instagram.com/explore/tags/covidchronicles/<br />
* https://www.instagram.com/explore/tags/covidcomedy/<br />
* https://www.instagram.com/explore/tags/covidcrazy/<br />
* https://www.instagram.com/explore/tags/covidcrisis/<br />
* https://www.instagram.com/explore/tags/coviddiaries/<br />
* https://www.instagram.com/explore/tags/coviddiary/<br />
* https://www.instagram.com/explore/tags/covidfear/<br />
* https://www.instagram.com/explore/tags/covidgames/<br />
* https://www.instagram.com/explore/tags/covidhumor/<br />
* https://www.instagram.com/explore/tags/covidlife/<br />
* https://www.instagram.com/explore/tags/covidlockdown/<br />
* https://www.instagram.com/explore/tags/covidlove/<br />
* https://www.instagram.com/explore/tags/covidmadness/<br />
* https://www.instagram.com/explore/tags/covidmemes/<br />
* https://www.instagram.com/explore/tags/COVIDmemorial/<br />
* https://www.instagram.com/explore/tags/covidnews/<br />
* https://www.instagram.com/explore/tags/covidphotodiaries/<br />
* https://www.instagram.com/explore/tags/covidscare/<br />
* https://www.instagram.com/explore/tags/covidsucks/<br />
* https://www.instagram.com/explore/tags/covidtime/<br />
* https://www.instagram.com/explore/tags/cov%C4%B1d19sucks/<br />
* https://www.instagram.com/explore/tags/createdontcontaminate/<br />
* https://www.instagram.com/explore/tags/creativeisolation/<br />
* https://www.instagram.com/explore/tags/creativequarantine/<br />
* https://www.instagram.com/explore/tags/defeatcovid19/<br />
* https://www.instagram.com/explore/tags/dontspreadgerms/<br />
* https://www.instagram.com/explore/tags/donttouchyourface/<br />
* https://www.instagram.com/explore/tags/endlockdown/<br />
* https://www.instagram.com/explore/tags/extendthelockdown/<br />
* https://www.instagram.com/explore/tags/fakevirus/<br />
* https://www.instagram.com/explore/tags/fcovid19/<br />
* https://www.instagram.com/explore/tags/fightagainstcorona/<br />
* https://www.instagram.com/explore/tags/fightthevirusproject/<br />
* https://www.instagram.com/explore/tags/flatteningthecurve/<br />
* https://www.instagram.com/explore/tags/flattenthecurve%E2%9A%A0%EF%B8%8F/<br />
* https://www.instagram.com/explore/tags/fuckcoronavirus/<br />
* https://www.instagram.com/explore/tags/fuckcovid19/<br />
* https://www.instagram.com/explore/tags/fuckcovid19%F0%9F%96%95/<br />
* https://www.instagram.com/explore/tags/fuckcovid/<br />
* https://www.instagram.com/explore/tags/fucklockdown/<br />
* https://www.instagram.com/explore/tags/fuckoffcoronavirus/<br />
* https://www.instagram.com/explore/tags/fuckoffcovid/<br />
* https://www.instagram.com/explore/tags/fuckthecovid19/<br />
* https://www.instagram.com/explore/tags/fuckthisvirus/<br />
* https://www.instagram.com/explore/tags/fuckyoucoronavirus/<br />
* https://www.instagram.com/explore/tags/fuckyoucovid19/<br />
* https://www.instagram.com/explore/tags/fuckyoucovid/<br />
* https://www.instagram.com/explore/tags/fuckyouvirus/<br />
* https://www.instagram.com/explore/tags/fucovid19/<br />
* https://www.instagram.com/explore/tags/goawaycorona/<br />
* https://www.instagram.com/explore/tags/ihatecoronavirus/<br />
* https://www.instagram.com/explore/tags/ihatecovid19/<br />
* https://www.instagram.com/explore/tags/indialockdown/<br />
* https://www.instagram.com/explore/tags/inisolation/<br />
* https://www.instagram.com/explore/tags/isolateandcreate/<br />
* https://www.instagram.com/explore/tags/isolatedartchallenge/<br />
* https://www.instagram.com/explore/tags/isolationart/<br />
* https://www.instagram.com/explore/tags/isolationartschool/<br />
* https://www.instagram.com/explore/tags/isolationchronicles/<br />
* https://www.instagram.com/explore/tags/isolationcreativity/<br />
* https://www.instagram.com/explore/tags/isolationdiaries/<br />
* https://www.instagram.com/explore/tags/isolationdiary/<br />
* https://www.instagram.com/explore/tags/isolationideas/<br />
* https://www.instagram.com/explore/tags/isolationinspiration/<br />
* https://www.instagram.com/explore/tags/isolationnation/<br />
* https://www.instagram.com/explore/tags/isolationpainting/<br />
* https://www.instagram.com/explore/tags/isolationphotography/<br />
* https://www.instagram.com/explore/tags/isolationstation/<br />
* https://www.instagram.com/explore/tags/isquarantineoveryet/<br />
* https://www.instagram.com/explore/tags/killcovid19/<br />
* https://www.instagram.com/explore/tags/letsfightcovid19together/<br />
* https://www.instagram.com/explore/tags/lifeduringcorona/<br />
* https://www.instagram.com/explore/tags/lifeduringcovid19/<br />
* https://www.instagram.com/explore/tags/lifeinisolation/<br />
* https://www.instagram.com/explore/tags/lifeinlockdown/<br />
* https://www.instagram.com/explore/tags/lifeunderlockdown/<br />
* https://www.instagram.com/explore/tags/lockdown2/<br />
* https://www.instagram.com/explore/tags/lockdownart/<br />
* https://www.instagram.com/explore/tags/lockdowncoronavirus/<br />
* https://www.instagram.com/explore/tags/lockdowncovid19/<br />
* https://www.instagram.com/explore/tags/lockdowndrawingchallenge/<br />
* https://www.instagram.com/explore/tags/lockdowndrawing/<br />
* https://www.instagram.com/explore/tags/lockdownextension/<br />
* https://www.instagram.com/explore/tags/lockdownextention/<br />
* https://www.instagram.com/explore/tags/lockdownfun/<br />
* https://www.instagram.com/explore/tags/lockdownliving/<br />
* https://www.instagram.com/explore/tags/lockdownnz/<br />
* https://www.instagram.com/explore/tags/lockdownsessions/<br />
* https://www.instagram.com/explore/tags/lockdownstories/<br />
* https://www.instagram.com/explore/tags/lockdownvibes/<br />
* https://www.instagram.com/explore/tags/lockdownwithoutplan/<br />
* https://www.instagram.com/explore/tags/maintaindistance/<br />
* https://www.instagram.com/explore/tags/maintainsocialdistance/<br />
* https://www.instagram.com/explore/tags/massisolation/<br />
* https://www.instagram.com/explore/tags/newzealandlockdown/<br />
* https://www.instagram.com/explore/tags/nottodaycorona/<br />
* https://www.instagram.com/explore/tags/nzlockdown2020/<br />
* https://www.instagram.com/explore/tags/nzlockdown/<br />
* https://www.instagram.com/explore/tags/onlockdown/<br />
* https://www.instagram.com/explore/tags/overquarantine/<br />
* https://www.instagram.com/explore/tags/pandemicart/<br />
* https://www.instagram.com/explore/tags/pandemichumor/<br />
* https://www.instagram.com/explore/tags/pandemiclife/<br />
* https://www.instagram.com/explore/tags/quarantaineart/<br />
* https://www.instagram.com/explore/tags/quarantineadventures/<br />
* https://www.instagram.com/explore/tags/quarantineart2020/<br />
* https://www.instagram.com/explore/tags/quarantineartclub/<br />
* https://www.instagram.com/explore/tags/quarantineartfest/<br />
* https://www.instagram.com/explore/tags/quarantineart/<br />
* https://www.instagram.com/explore/tags/quarantineartist/<br />
* https://www.instagram.com/explore/tags/quarantineartists/<br />
* https://www.instagram.com/explore/tags/quarantinecreative/<br />
* https://www.instagram.com/explore/tags/quarantinedaysofsketching/<br />
* https://www.instagram.com/explore/tags/quarantinedaywhatever/<br />
* https://www.instagram.com/explore/tags/quarantinediary/<br />
* https://www.instagram.com/explore/tags/quarantinedrawing/<br />
* https://www.instagram.com/explore/tags/quarantinehumor/<br />
* https://www.instagram.com/explore/tags/quarantineindia/<br />
* https://www.instagram.com/explore/tags/quarantinereading/<br />
* https://www.instagram.com/explore/tags/quarantinereads/<br />
* https://www.instagram.com/explore/tags/quarantinesketch/<br />
* https://www.instagram.com/explore/tags/quarantinetimepass/<br />
* https://www.instagram.com/explore/tags/quarentineart/<br />
* https://www.instagram.com/explore/tags/quarentinereads/<br />
* https://www.instagram.com/explore/tags/rona2020/<br />
* https://www.instagram.com/explore/tags/sanitizeeverything/<br />
* https://www.instagram.com/explore/tags/scamdemic/<br />
* https://www.instagram.com/explore/tags/screwyoucoronavirus/<br />
* https://www.instagram.com/explore/tags/screwyoucovid19/<br />
* https://www.instagram.com/explore/tags/selfisolationactivities/<br />
* https://www.instagram.com/explore/tags/selfisolationart/<br />
* https://www.instagram.com/explore/tags/selfisolationideas/<br />
* https://www.instagram.com/explore/tags/shelfisolation/<br />
* https://www.instagram.com/explore/tags/shelterinplace2020/<br />
* https://www.instagram.com/explore/tags/shelterinplacecalifornia/<br />
* https://www.instagram.com/explore/tags/shelterinplacesanfrancisco/<br />
* https://www.instagram.com/explore/tags/sociadistancing/<br />
* https://www.instagram.com/explore/tags/socialdistancingart/<br />
* https://www.instagram.com/explore/tags/socialdistancingatitsfinest/<br />
* https://www.instagram.com/explore/tags/socialdistancingsaveslives/<br />
* https://www.instagram.com/explore/tags/socialdistancingsucks/<br />
* https://www.instagram.com/explore/tags/standagainstcorona/<br />
* https://www.instagram.com/explore/tags/stay6feetaway/<br />
* https://www.instagram.com/explore/tags/stayhomeanddraw/<br />
* https://www.instagram.com/explore/tags/stayhomeartchallenge/<br />
* https://www.instagram.com/explore/tags/stayhomeart/<br />
* https://www.instagram.com/explore/tags/stayhomeclub/<br />
* https://www.instagram.com/explore/tags/stayhomeifyouaresick/<br />
* https://www.instagram.com/explore/tags/stayhomeindia/<br />
* https://www.instagram.com/explore/tags/stayhomemakeart/<br />
* https://www.instagram.com/explore/tags/stayhomenz/<br />
* https://www.instagram.com/explore/tags/stayhomeprotectthenhssavelives/<br />
* https://www.instagram.com/explore/tags/stayhomesavelives%E2%9D%A4%EF%B8%8F/<br />
* https://www.instagram.com/explore/tags/stayinsavelives/<br />
* https://www.instagram.com/explore/tags/stillsocialdistancing/<br />
* https://www.instagram.com/explore/tags/stopthespreadofcovid19/<br />
* https://www.instagram.com/explore/tags/stuckinthehouse/<br />
* https://www.instagram.com/explore/tags/stupidvirus/<br />
* https://www.instagram.com/explore/tags/suckitcovid/<br />
* https://www.instagram.com/explore/tags/supportlockdown/<br />
* https://www.instagram.com/explore/tags/survivingcovid19/<br />
* https://www.instagram.com/explore/tags/survivingquarantine/<br />
* https://www.instagram.com/explore/tags/thankscorona/<br />
* https://www.instagram.com/explore/tags/thatquarantinelife/<br />
* https://www.instagram.com/explore/tags/thisishowwequarantine/<br />
* https://www.instagram.com/explore/tags/toiletpaperart/<br />
* https://www.instagram.com/explore/tags/uklockdown/<br />
* https://www.instagram.com/explore/tags/virusart/<br />
* https://www.instagram.com/explore/tags/virusmemes/<br />
* https://www.instagram.com/explore/tags/washyourfuckinghands/<br />
* https://www.instagram.com/explore/tags/wearmask%F0%9F%98%B7/<br />
* https://www.instagram.com/explore/tags/worldfightcorona/<br />
<br />
=== Reddit ===<br />
<br />
==== Global ====<br />
<br />
* https://old.reddit.com/r/Coronavirus/<br />
* http://logs.mod.rcoronavirus.org/ | note = Moderation logs for /r/Coronavirus<br />
* https://old.reddit.com/r/The_Coronavirus/<br />
* https://old.reddit.com/r/China_Flu/<br />
* https://old.reddit.com/r/nCoV/<br />
* https://old.reddit.com/r/COVAnonymous/<br />
* https://old.reddit.com/r/CovHappened/<br />
* https://old.reddit.com/r/COVID__19/<br />
* https://old.reddit.com/r/COVID19/<br />
* http://logs.mod.rcoronavirus.org/?subreddit=COVID19 | note = Moderation logs for /r/COVID19<br />
* https://old.reddit.com/r/Covid2019/<br />
<br />
==== By place ====<br />
<br />
* https://old.reddit.com/r/CanadaCoronavirus/<br />
* https://old.reddit.com/r/China_Flu_Uncensored/<br />
* https://old.reddit.com/r/coronabr/<br />
* https://old.reddit.com/r/CoronaNC/<br />
* https://old.reddit.com/r/CoronaNL/<br />
* https://old.reddit.com/r/CoronaVirus_2019_nCoV/<br />
* https://old.reddit.com/r/CoronavirusAB/<br />
* https://old.reddit.com/r/CoronavirusAlabama/<br />
* https://old.reddit.com/r/CoronavirusAtlanta/<br />
* https://old.reddit.com/r/CoronavirusAustralia/<br />
* https://old.reddit.com/r/CoronavirusCA/<br />
* https://old.reddit.com/r/CoronavirusCanada/<br />
* https://old.reddit.com/r/CoronavirusColorado/<br />
* https://old.reddit.com/r/CoronavirusDownunder/<br />
* https://old.reddit.com/r/coronavirusflorida/<br />
* https://old.reddit.com/r/CoronavirusFOS/<br />
* https://old.reddit.com/r/CoronavirusFrance/<br />
* https://old.reddit.com/r/CoronavirusGA/<br />
* https://old.reddit.com/r/CoronavirusGermany/<br />
* https://old.reddit.com/r/CoronavirusIA/<br />
* https://old.reddit.com/r/CoronavirusIllinois/<br />
* https://old.reddit.com/r/CoronaVirusInfo/<br />
* https://old.reddit.com/r/Coronavirus_Ireland/<br />
* https://old.reddit.com/r/CoronaVirus_ITALIA/<br />
* https://old.reddit.com/r/CoronavirusKansas/<br />
* https://old.reddit.com/r/CoronaVirusLA/<br />
* https://old.reddit.com/r/Coronaviruslouisiana/<br />
* https://old.reddit.com/r/CoronavirusMaine/<br />
* https://old.reddit.com/r/CoronavirusMemes/<br />
* https://old.reddit.com/r/CoronavirusMichigan/<br />
* https://old.reddit.com/r/CoronavirusMidwest/<br />
* https://old.reddit.com/r/CoronavirusMN/<br />
* https://old.reddit.com/r/CoronavirusNE/<br />
* https://old.reddit.com/r/coronavirusnewmexico/<br />
* https://old.reddit.com/r/CoronavirusNewYork/<br />
* https://old.reddit.com/r/CoronavirusNorway/<br />
* https://old.reddit.com/r/Coronavirus_NZ/<br />
* https://old.reddit.com/r/CoronavirusOklahoma/<br />
* https://old.reddit.com/r/CoronaVirusPA/<br />
* https://old.reddit.com/r/Coronavirus_PH/<br />
* https://old.reddit.com/r/CoronavirusPT/<br />
* https://old.reddit.com/r/CoronavirusRecession/<br />
* https://old.reddit.com/r/coronavirusSC/<br />
* https://old.reddit.com/r/CoronavirusSCOTLAND/<br />
* https://old.reddit.com/r/CoronavirusSouth/<br />
* https://old.reddit.com/r/CoronaVirusSouthEast/<br />
* https://old.reddit.com/r/CoronavirusTN/<br />
* https://old.reddit.com/r/CoronaVirusTX/<br />
* https://old.reddit.com/r/CoronavirusUK/<br />
* https://old.reddit.com/r/CoronavirusUS/<br />
* https://old.reddit.com/r/CoronavirusUT/<br />
* https://old.reddit.com/r/CoronavirusWA/<br />
* https://old.reddit.com/r/CoronavirusWest/<br />
* https://old.reddit.com/r/COVID19chicago/<br />
* https://old.reddit.com/r/Covid19_Ohio/<br />
* https://old.reddit.com/r/FloridaCoronavirus/<br />
* https://old.reddit.com/r/NorthCarolinaCOVID/<br />
* https://old.reddit.com/r/nycCoronavirus/<br />
* https://old.reddit.com/r/UKCoronavirus/<br />
<br />
==== Related ====<br />
<br />
* https://old.reddit.com/r/cvmemes/ | note = Turned Private Apparently<br />
* https://old.reddit.com/r/DeniedCovidTesting/<br />
* https://old.reddit.com/r/Moronavirus/<br />
* https://old.reddit.com/r/Covid19_economics/<br />
* https://old.reddit.com/r/COVID19_support/<br />
* https://old.reddit.com/r/CovIdiots/<br />
* https://old.reddit.com/r/CovidMapping/<br />
* https://old.reddit.com/r/CoronaBumpers/<br />
* https://old.reddit.com/r/medicine/<br />
* https://old.reddit.com/r/worldnews/<br />
* https://old.reddit.com/r/epidemic/<br />
* https://old.reddit.com/r/LockdownSkepticism/<br />
* https://old.reddit.com/r/pandemicpreps/<br />
* https://old.reddit.com/r/preppers/<br />
<br />
=== Telegram ===<br />
<br />
* https://t.me/CoronaVirus<br />
* https://t.me/coronavirush24<br />
* https://t.me/coronavirusinfo<br />
* https://t.me/CoronavirusNewsIta<br />
* https://t.me/covid19<br />
* https://t.me/COVID19Up<br />
* https://t.me/COVIDnews<br />
* https://t.me/n_cov_2019<br />
* https://t.me/nCoV2019<br />
* https://t.me/wuhancensored<br />
* https://t.me/WuhanCoV<br />
<br />
* https://t.me/MINSAPCuba<br />
* https://t.me/StopCoVge<br />
* https://t.me/Corona_Infokanal_BMG<br />
* https://t.me/HKFIGHTCOVID19<br />
* https://t.me/MyGovCoronaNewsdesk<br />
* https://t.me/MinisteroSalute<br />
* https://t.me/MOHreport<br />
* https://t.me/coronavirus2020_kz<br />
* https://t.me/RshKRCOV<br />
* https://t.me/cprckkm<br />
<br />
=== Twitter ===<br />
<br />
==== Accounts ====<br />
[[File:Covid-Africa.jpg|thumb|right|300px|[https://twitter.com/NCoVAfrica @NCoVAfrica] tracking coronavirus in Africa.]]<br />
* https://twitter.com/2019nCoVwatcher<br />
* https://twitter.com/Corona_NL<br />
* https://twitter.com/CoronaTurkey<br />
* https://twitter.com/CoronaVid19<br />
* https://twitter.com/coronaviruscare<br />
* https://twitter.com/Coronavirus_es<br />
* https://twitter.com/CoronavirusNews<br />
* https://twitter.com/covid19indiaorg<br />
* https://twitter.com/COVID19Info<br />
* https://twitter.com/Covid19Thailand<br />
* https://twitter.com/COVID19Tracking<br />
* https://twitter.com/COVID19Update<br />
* https://twitter.com/COVID2019action<br />
* https://twitter.com/COVID2019tests<br />
* https://twitter.com/covidtrackerth<br />
* https://twitter.com/DataCoronavirus<br />
* https://twitter.com/KawalCOVID19<br />
* https://twitter.com/NCoVAfrica<br />
* https://twitter.com/PandemicCovid20<br />
* https://twitter.com/PneumoniaWuhan<br />
* https://twitter.com/SEACoronavirus<br />
* https://twitter.com/Seattle2019nCov<br />
* https://twitter.com/V2019N<br />
* https://twitter.com/VirologyToday<br />
* https://twitter.com/covidmx<br />
* https://twitter.com/ReporteCOVID19<br />
* https://twitter.com/COVID_19RD<br />
* https://twitter.com/AIRE_Covid19<br />
* https://twitter.com/COVIDNewsByMIB<br />
* https://twitter.com/UtahCoronavirus<br />
* https://twitter.com/OmanVSCovid19<br />
* https://twitter.com/MantralayaRoom<br />
* https://twitter.com/COVID19centre<br />
* https://twitter.com/DIPR_COVID19<br />
* https://twitter.com/covid19oyo_eoc<br />
<br />
==== Hashtags ====<br />
<br />
{{div col|5}}<br />
* #コロナウイルス<br />
* #코로나바이러스<br />
* #โควิด<br />
* #โคโรนา<br />
* #โคโรน่า<br />
* #ไวรัสโคโรนา<br />
* #โคโรนาไวรัส<br />
* #ไวรัสโคโรน่า<br />
* #โคโรน่าไวรัส<br />
* #ไวรัสอู่ฮั่น<br />
* #ไวรัสปอดอักเสบ<br />
* #โควิดเราต้องรอด<br />
* #อยู่บ้านหยุดเชื้อเพื่อชาติ<br />
* #โควิด19<br />
* #โควิท19<br />
* #โควิด_19<br />
* #โควิดー19<br />
* #โควิด19เราต้องรอด<br />
* #โควิค19<br />
* #ฝ่าวิกฤตโควิด19<br />
* #코로나바이러스감염증19<br />
* #2019nCoV<br />
* #21daysLockdown<br />
* #alamaison<br />
* #BailOutPeopleNotCorporations<br />
* #Belgique<br />
* #BelgiumLockdown<br />
* #bleibdaheim<br />
* #boycottcostco<br />
* #Canadacloseborder<br />
* #CDCstopTheCOVERUP<br />
* #CerradMadrid<br />
* #cerrarmadrid<br />
* #cerrarmadridya<br />
* #ChinaBurialPits<br />
* #Chinaliedpeopledied<br />
* #ChinaVirus<br />
* #ChineseVirus<br />
* #ChineseWuhanVirus<br />
* #CongressPassUBI<br />
* #CoronaAlert<br />
* #CoronaApp<br />
* #CoronaCrisis<br />
* #coronadebat<br />
* #coronadeutschland<br />
* #Coronafighters<br />
* #coronahulp<br />
* #Coronaindia<br />
* #Coronaindiaupdates<br />
* #CoronaInPakistan<br />
* #CoronaIreland<br />
* #Coronakrise<br />
* #Coronalul<br />
* #coronanederland<br />
* #coronanl<br />
* #CoronaOutbreak<br />
* #CoronaOutbreakinIndia<br />
* #coronaPakistan<br />
* #CoronaPandemie<br />
* #coronapocalypse<br />
* #CoronaStopKaroNa<br />
* #Coronasverige<br />
* #coronausa<br />
* #coronavirus<br />
* #CoronavirusArgentina<br />
* #coronavirusaustralia<br />
* #CoronaVirusChallenge<br />
* #CoronavirusChina<br />
* #CoronaVirusDE<br />
* #CoronaVirusDebatte<br />
* #CORONAVIRUSENFRANCE<br />
* #CoronavirusEnUruguay<br />
* #CoronavirusESP<br />
* #CoronavirusEspana<br />
* #Coronavirusflorida<br />
* #coronavirusfr<br />
* #Coronavirusgermany<br />
* #coronavirusindia<br />
* #CoronaVirusIndonesia<br />
* #coronavirusinKenya<br />
* #CoronavirusInSA<br />
* #CoronavirusInSouthAfrica<br />
* #CoronaVirusItalia<br />
* #coronaviruskenya<br />
* #CoronavirusKorea<br />
* #CoronavirusLiar<br />
* #CoronavirusLockdown<br />
* #CoronavirusMadrid<br />
* #coronavirusnederland<br />
* #coronavirusnetherlands<br />
* #CoronavirusNewYork<br />
* #Coronavirusnl<br />
* #Coronavirusnyc<br />
* #coronavirusnz<br />
* #CoronavirusOutbreak<br />
* #CoronaVirusPakistan<br />
* #CoronavirusPandemic <br />
* #CoronaVirusSA<br />
* #CoronaVirusSverige<br />
* #coronavirussweden<br />
* #Coronavirustruth<br />
* #CoronaVirusUpdate<br />
* #CoronaVirusUpdates<br />
* #CoronavirusUSA<br />
* #coronvirusuk<br />
* #CoronaWillEndSoon<br />
* #covid<br />
* #Covid_19<br />
* #COVID19<br />
* #ศูนย์ข้อมูลCOVID19<br />
* #COVIDー19<br />
* #COVID19argentina<br />
* #COVID19au<br />
* #covid19australia<br />
* #COVID19BE<br />
* #COVID19Belgium<br />
* #covid_19DE<br />
* #COVID19deutschland<br />
* #covid19ESP<br />
* #COVID19España<br />
* #Covid_19fr<br />
* #COVID19france<br />
* #COVID19greece<br />
* #Covid19India<br />
* #Covid19InSA<br />
* #COVID19ireland<br />
* #covid_19italia<br />
* #COVID19italia<br />
* #covid_19Ke<br />
* #COVID19KE<br />
* #COVID19NIGERIA<br />
* #COVID19NL<br />
* #Covid_19nz<br />
* #COVID19nz<br />
* #Covid19Out<br />
* #COVID19Pakistan<br />
* #COVID19PH<br />
* #Covid19SA<br />
* #COVID19SK<br />
* #COVID19spain<br />
* #COVID19sverige<br />
* #COVID19UG<br />
* #covid19UK<br />
* #COVID_19uk<br />
* #covid19Ukraine <br />
* #COVID2019<br />
* #COVID2019NL<br />
* #Covid2019TR<br />
* #COVIDActNow<br />
* #CurfewInIndia<br />
* #DoNotOpenCalifornia<br />
* #dudukrumah<br />
* #DudukRumahDiamDiam<br />
* #együttsikerül<br />
* #EmergencyUBI<br />
* #EUROPETRAVELBAN<br />
* #ExtendTheLockdown<br />
* #FakePandemic<br />
* #FakeVirus<br />
* #FloridaMorons<br />
* #FilmYourHospital<br />
* #FireFauci<br />
* #FlattenTheCurve<br />
* #gebarentolk<br />
* #hamsteraars<br />
* #hamsteren<br />
* #Hamsterkaeufe<br />
* #ikblijfthuis<br />
* #IndiaFightsBackCorona<br />
* #IndiaFightsCorona<br />
* #IndiaFightsCoronavirus<br />
* #InsideForThePeople<br />
* #Italycorona<br />
* #ItalyCoronavirus<br />
* #italyofafrica<br />
* #IWillStayAtHome<br />
* #JantaCurfew<br />
* #JantaCurfewChallenge<br />
* #KeepCalmStayHome<br />
* #Klopapier<br />
* #Klopapiergate<br />
* #Kontaktverbot<br />
* #LGBTQuarantine<br />
* #lockdown<br />
* #lockdown2020<br />
* #Lockdown21<br />
* #lockdowneffect<br />
* #LockdownEnd<br />
* #LockdownGhana<br />
* #LockDownGhanaNow<br />
* #LockdownHolland<br />
* #lockdownitalia<br />
* #LockDownKenya<br />
* #LockdownLifeLessons<br />
* #lockdownnl<br />
* #LockdownNow<br />
* #lockdownparty<br />
* #lockdownextension<br />
* #LombardiaChiusa<br />
* #MalaysiaBebasCovid19<br />
* #maradjotthon<br />
* #menoumespiti<br />
* #MichiganTerrorists<br />
* #mumbailockdown<br />
* #MusaadahCOVID19<br />
* #MyQuarantineInSixWords<br />
* #MySocialDistancingOutfit<br />
* #ncov2019<br />
* #NotDying4WallStreet<br />
* #opencalifornianow<br />
* #Pakistancorona<br />
* #Pakistancoronavirus<br />
* #PakistanFightsCorona<br />
* #PakistanLockdown<br />
* #PakistanUnitedAgainstCorona<br />
* #PakistanVsCorona<br />
* #panicbuying<br />
* #persconferentie<br />
* #PresidentPineSol<br />
* #ProtectFauci<br />
* #Quarantine<br />
* #QuarantineAndChill<br />
* #QuarantineLife<br />
* #ReopenAmerica<br />
* #RIPAmerica<br />
* #RIPCapitalism<br />
* #rivm<br />
* #SaluteCoronaFighters<br />
* #samentegencorona<br />
* #SARSCoV2<br />
* #SignsYoureACOVIDIOT<br />
* #SindhSelfQuarantine<br />
* #SocialDistancing<br />
* #SocialDistancingPickUpLines<br />
* #SouthAfricaLockdown<br />
* #StayAtHome<br />
* #StayAtHomeChallenge<br />
* #StayAtHomeGh<br />
* #stayathomeNigerians<br />
* #StayAtHomeOrder<br />
* #StayAtHomeSaveLives<br />
* #StayHomeChallenge<br />
* #StayHomeIndia<br />
* #StayHomeSaveLives<br />
* #StayIndoors<br />
* #stayingsafewithbuzz<br />
* #staysafemzansi<br />
* #StaySafeStayHome<br />
* #Stimuluscheck<br />
* #stimuluspayment<br />
* #STOPcorona<br />
* #supportCostco<br />
* #TestingForCovid19<br />
* #thuiswerken<br />
* #TogetherAtHome<br />
* #toiletpapercrisis <br />
* #tousalamaison<br />
* #TravelBan<br />
* #trumpandemic<br />
* #TrumpBurialPits<br />
* #TrumpCoronavirusTestFailure<br />
* #TrumpDeathToll81K<br />
* #TrumpHasNoPlan<br />
* #TrumpLiesAboutCoronavirus<br />
* #TrumpMeltdown<br />
* #TrumpVirus<br />
* #TrumpVirus2020<br />
* #TrumpVirusCoverup<br />
* #TrumpVirusTestingFailure<br />
* #UkweliUsemwe<br />
* #vigyázzunkegymásra<br />
* #VirusCorona<br />
* #WarAgainstVirus<br />
* #WashYourHands<br />
* #wcpapier<br />
* #WearYourMask<br />
* #WeStandWithDrTedros<br />
* #westayathome<br />
* #WeStayHome<br />
* #WhenCoronaVirusIsOver<br />
* #WHOBurialPits<br />
* #wirbleibenzuhause<br />
* #workingfromhomelife<br />
* #WuhanVirus<br />
* #zeiklozevrijdagavond<br />
* #ZoneRosse<br />
* فيروسكورونا# <br />
* كورونا_الجديد#<br />
* #Κορονοΐός<br />
* #коронавирус<br />
* #कोरोनावायरस <br />
* #ਕੋਰੋਨਾਵਾਇਰਸ<br />
* #পুষ্পমুকুটভাইরাস <br />
* #冠状病毒<br />
* #武汉肺炎<br />
{{div col end}}<br />
<br />
A large list of hashtags aggregated from tweets containing "coronavirus": https://files.pushshift.io/coronavirus_hashtags.txt. More info: https://twitter.com/jasonbaumgartne/status/1240705182473781249.<br />
<br />
==== Searches ====<br />
<br />
Some examples, incomplete list.<br />
<br />
<pre><br />
twitter-search coronavirus%20min_retweets:1000<br />
twitter-search coronavirus%20italy%20min_retweets:10<br />
twitter-search coronavirus%20italia%20min_retweets:10<br />
twitter-search coronavirus%20spain%20min_retweets:10<br />
twitter-search coronavirus%20espana%20min_retweets:10<br />
twitter-search coronavirus%20france%20min_retweets:10<br />
twitter-search coronavirus%20korea%20min_retweets:10<br />
twitter-search coronavirus%20iran%20min_retweets:10<br />
twitter-search coronavirus%20japan%20min_retweets:10<br />
twitter-search coronavirus%20singapore%20min_retweets:10<br />
twitter-search coronavirus%20germany%20min_retweets:10<br />
twitter-search coronavirus%20kuwait%20min_retweets:10<br />
twitter-search coronavirus%20thailand%20min_retweets:10<br />
twitter-search coronavirus%20taiwan%20min_retweets:10<br />
twitter-search coronavirus%20bahrain%20min_retweets:10<br />
twitter-search coronavirus%20australia%20min_retweets:10<br />
twitter-search coronavirus%20malaysia%20min_retweets:10<br />
twitter-search coronavirus%20uk%20min_retweets:10<br />
twitter-search coronavirus%20uae%20min_retweets:10<br />
twitter-search coronavirus%20canada%20min_retweets:10<br />
<br />
twitter-search coronavirus%20usa%20min_retweets:10<br />
twitter-search coronavirus%20california%20min_retweets:10<br />
twitter-search coronavirus%20oregon%20min_retweets:10<br />
twitter-search coronavirus%20washington%20min_retweets:10<br />
<br />
twitter-search wuhan%20min_retweets:100<br />
twitter-search coronavirus%20racism%20min_retweets:10<br />
twitter-search coronavirus%20cruise%20min_retweets:10<br />
twitter-search coronavirus%20diamond%20min_retweets:10<br />
twitter-search coronavirus%20breaking%20min_retweets:10<br />
twitter-search coronavirus%20hoax%20min_retweets:10<br />
twitter-search coronavirus%20fake%20min_retweets:10<br />
twitter-search coronavirus%20conspiracy%20min_retweets:10<br />
twitter-search coronavirus%20panic%20min_retweets:10<br />
twitter-search coronavirus%20cdc%20min_retweets:10<br />
twitter-search coronavirus%20hoax%20min_retweets:10<br />
twitter-search chinese%20virus%20min_retweets:10<br />
twitter-search persconferentie%20corona%20min_retweets:10<br />
<br />
twitter-search #CoronaVirusPakistan%20min_retweets:10<br />
twitter-search #SaluteCoronaFighters%20min_retweets:10<br />
twitter-search #ChinaVirus%20min_retweets:10<br />
twitter-search #IndiaFightsBackCorona%20min_retweets:5<br />
twitter-search #Covid19India%20min_retweets:5<br />
twitter-search #COVID19ireland%20min_retweets:2<br />
twitter-search #COVID19PH%20min_retweets:2<br />
twitter-search #COVID19España%20min_retweets:2<br />
twitter-search #COVID19spain%20min_retweets:1<br />
twitter-search #CoronavirusArgentina%20min_retweets:5<br />
twitter-search #CoronavirusESP%20min_retweets:5<br />
twitter-search #COVID19argentina%20min_retweets:2<br />
twitter-search #COVID19greece%20min_retweets:2<br />
twitter-search #Κορονοΐός%20min_retweets:2<br />
twitter-search #CoronavirusEnUruguay%20min_retweets:1<br />
twitter-search #covid19UK%20min_retweets:5<br />
twitter-search #WashYourHands%20min_retweets:5<br />
twitter-search #cerrarmadridya%20min_retweets:5<br />
twitter-search #CurfewInIndia%20min_retweets:2<br />
twitter-search #StayHomeIndia%20min_retweets:2<br />
twitter-search #21daysLockdown%20min_retweets:10<br />
twitter-search #Coronavirustruth%20min_retweets:5<br />
twitter-search #CoronavirusLockdown%20min_retweets:2<br />
twitter-search #IWillStayAtHome%20min_retweets:5<br />
twitter-search #LockDownKenya%20min_retweets:5<br />
twitter-search JantaCurfewChallenge%20min_retweets:10<br />
twitter-search IndiaFightsCoronavirus%20min_retweets:10<br />
twitter-search #Italycorona%20min_retweets:20<br />
twitter-search #StayIndoors%20min_retweets:10<br />
twitter-search #Coronaindia%20min_retweets:10<br />
twitter-search #ItalyCoronavirus%20min_retweets:10<br />
twitter-search #COVID19au%20min_retweets:10<br />
twitter-search #DudukRumahDiamDiam%20min_retweets:10<br />
twitter-search #WarAgainstVirus%20min_retweets:2<br />
twitter-search #dudukrumah%20min_retweets:10<br />
twitter-search #KeepCalmStayHome%20min_retweets:5<br />
twitter-search #workingfromhomelife%20min_retweets:5<br />
twitter-search KingofVentilators<br />
twitter-search Another%204.4<br />
</pre><br />
<br />
=== YouTube ===<br />
[[File:Coronavirus real time.jpg|thumb|right|300px|[https://www.youtube.com/watch?v=qgylp3Td1Bw 2019-nCoV Live World Map] on February 29th ([https://archive.org/search.php?query=subject%3A%22coronavirus-roylab-stats%22&sort=-publicdate archive]).]]<br />
<br />
* https://www.youtube.com/channel/UCkwrn9A_LotBoma4Kvq3VyQ/videos<br />
* https://www.youtube.com/channel/UCGcNNBwIUq6lErlVM7EVYXQ/videos<br />
* https://www.youtube.com/channel/UC2sm79fCrGVIlKRGpHRRYrQ/videos<br />
* https://www.youtube.com/channel/UCSp7px6h4DSblPALwibiZrQ/videos<br />
* https://www.youtube.com/channel/UC3s-6d71jbiKzZf5dgVjpRA/videos<br />
* https://www.youtube.com/channel/UCTn4F9k-r7G_GzSJJWFpbcA/videos<br />
* https://www.youtube.com/channel/UCNtnuZ7HB-PbxCkcegDdRuQ/videos<br />
* https://www.youtube.com/channel/UCzcI3iC8y4vD9nNeeLL4iCQ/videos<br />
* https://www.youtube.com/channel/UCFh0EsubhM-VEDKwO14VaWA/videos<br />
* https://www.youtube.com/channel/UC3JumqRep0ABzxWpShndZrg/videos<br />
<br />
== Datasets ==<br />
<br />
* https://github.com/CSSEGISandData/COVID-19<br />
* https://weileizeng.github.io/OpenSourceWuhan/<br />
* http://open-source-covid-19.weileizeng.com/<br />
* https://github.com/Academic-nCoV/2019-nCoV/wiki<br />
* https://github.com/openZH/covid_19/ | note = Switzerland, by an initiative of the canton of Zürich<br />
* https://www.kaggle.com/sudalairajkumar/novel-corona-virus-2019-dataset<br />
* https://about.lens.org/covid-19/<br />
* https://figshare.com/articles/CORD-19-policy_dataset/12055860/2<br />
* https://renkulab.io/projects/covid-19/covid-19-public-data<br />
* https://data.go.th/en/dataset/covid19<br />
* https://data.go.th/en/dataset/covid-19-daily<br />
<br />
== Search engines and directories ==<br />
<br />
* https://cord19.vespa.ai/<br />
* https://coronavirustechhandbook.com/<br />
* https://www.coronaviruscheatsheet.org/<br />
* https://github.com/soroushchehresa/awesome-coronavirus<br />
* http://open-source-covid-19.weileizeng.com/<br />
<br />
== Quarantined municipalities ==<br />
<br />
=== China ===<br />
[[File:Wuhan-gov.jpg|thumb|right|300px|Wuhan government site.]]<br />
* https://en.wikipedia.org/wiki/Template:2020_coronavirus_quarantines<br />
* http://www.wuhan.gov.cn/<br />
* http://english.wh.gov.cn/<br />
* http://www.whmuseum.com.cn/<br />
* http://www.hg.gov.cn/<br />
<br />
=== Italy ===<br />
<br />
* https://en.wikipedia.org/wiki/2020_coronavirus_outbreak_in_Italy#Reactions<br />
* http://www.comune.bertonico.lo.it/<br />
* http://www.comune.casalpusterlengo.lo.it/<br />
* http://www.comune.castelgerundo.lo.it/<br />
* http://www.comune.castiglionedadda.lo.it/<br />
* http://www.comune.codogno.lo.it/<br />
* http://www.comune.fombio.lo.it/<br />
<br />
== Postponed or cancelled events ==<br />
<br />
* [[Coronavirus/Postponed or cancelled events]]<br />
<br />
== Affected companies ==<br />
* [[Coronavirus/Affected companies]]<br />
<br />
== Notable deaths ==<br />
See [[Coronavirus/Notable deaths]]<br />
<br />
== Repatriation ==<br />
* https://bijzonderebijstandbuitenland.nl/ | note = website whit information for dutch citizens in foreign countries to be repatriated<br />
* https://urm.lt/urm-informacija-keliaujantiems<br />
* http://keliauk.urm.lt/lt/pranesimai<br />
* https://urm.lt/default/lt/urm-informacija-keliaujantiems/covid19-duk-keliaujantiems<br />
<br />
== Miscellaneous ==<br />
<br />
* https://www.shincheonji.kr/ | note = Church involved in spreading the virus in Korea<br />
* https://www.facebook.com/scjchurch/<br />
* https://www.instagram.com/scjchurch/<br />
* https://twitter.com/scjchurch<br />
* https://www.youtube.com/user/ShincheonjiChurch<br />
* https://en.shincheonji.kr/<br />
* https://www.facebook.com/enscjchurch/<br />
* https://www.instagram.com/scjchurch_en/<br />
* https://twitter.com/scjchurch_en<br />
* https://gabgoh.github.io/COVID/index.html<br />
* https://penn-chime.phl.io/<br />
* https://www.thementalhealthcomedian.com/<br />
* https://www.facebook.com/frankkingcomedian<br />
* https://www.facebook.com/theMentalHealthComedian/<br />
* https://twitter.com/themhcomedian<br />
* https://www.youtube.com/user/frankking2<br />
* https://brakofcorona.nl/ | note = joke site<br />
* http://tp-fuckwits.xyz/ | note = joke site<br />
* https://reichtmeinklopapier.de/ | note = joke site<br />
* https://howmuchtoiletpaper.com/ | note = joke site<br />
* https://diymask.site/<br />
* https://smartairfilters.com/en/blog/best-materials-make-diy-face-mask-virus/<br />
* https://smartairfilters.com/en/blog/diy-homemade-mask-protect-virus-coronavirus/<br />
* https://www.deaconess.com/How-to-make-a-Face-Mask<br />
* https://www.mask-match.com/<br />
* http://jlacovid19.org/ | note = U.S. jail reform, COVID-19 response<br />
* https://doneereenmondkapje.nl/ | note = a dutch campain to collect ppe equipment<br />
* https://covid19.rajavithi.go.th | note = Risk assessment form before hospital visit for COVID-19 infection<br />
* http://rajavithi.emergencymed.net/corona/en_index.html<br />
* https://www.antifakenewscenter.com/tag/covid-19/ | note = Thai language<br />
* https://www.xn--12cl1ck0bl6hdu9iyb9bp.com/ | note = Registration for 5,000-baht gov. aid for Thai people affected by covid crisis ("Rao Mai Ting Kan" website)<br />
* https://www.xn--12caj8ddlle3f8b9a4fbe7a8r2a9fi.com/<br />
* https://www.conquercovidtogether.com/<br />
* https://1daysooner.org/ | note = Campaign for faster human challenge trials of vaccine candidates<br />
* https://twitter.com/1daysooner<br />
* https://www.zeitpunkt.ch/ | note = Swiss news outlet spreading conspiracy theories<br />
* https://www.facebook.com/ZeitpunktMagazin/<br />
* https://scientificrussia.ru/covid/<br />
<br />
== Frontpages ==<br />
<br />
* https://transfer.notkiska.pw/6rYxe/cities-top-1000.txt<br />
* https://transfer.notkiska.pw/wqwos/cities-100000.txt<br />
* https://transfer.notkiska.pw/YxQKe/cinema-websites-7000.txt<br />
* https://transfer.notkiska.pw/13DTld/restaurants-websites-2000.txt<br />
* https://transfer.notkiska.pw/aVG4c/museums-top-1000.txt<br />
* https://transfer.notkiska.pw/SjN0e/world-13000-universities.txt<br />
* https://transfer.notkiska.pw/PTUBR/newspapers-top-100.txt<br />
* https://transfer.notkiska.pw/qORue/newspapers-top-500.txt<br />
* https://transfer.notkiska.pw/5HnU0/newspapers-top-1000.txt<br />
* https://transfer.notkiska.pw/scnOs/newspapers-top-5000.txt<br />
* https://transfer.notkiska.pw/pOZvW/twitter-top-10000.txt<br />
* https://transfer.notkiska.pw/OCm6I/archiveteam-wiki-coronavirus-20200327.txt<br />
* https://transfer.notkiska.pw/sRVEQ/archiveteam-wiki-coronavirus-20200329.txt<br />
* https://transfer.notkiska.pw/tOdUi/archiveteam-wiki-coronavirus-20200330.txt<br />
* https://transfer.notkiska.pw/AACqN/archiveteam-wiki-coronavirus-20200401.txt<br />
* https://transfer.notkiska.pw/3rmEZ/archiveteam-wiki-coronavirus-20200409.txt<br />
* https://transfer.notkiska.pw/ThgAD/archiveteam-wiki-coronavirus-20200410.txt<br />
* https://transfer.notkiska.pw/XmRJz/archiveteam-wiki-coronavirus-20200411.txt<br />
* https://transfer.notkiska.pw/t5KkU/archiveteam-wiki-coronavirus-20200413.txt<br />
* https://transfer.notkiska.pw/zCfZu/archiveteam-wiki-coronavirus-20200415.txt<br />
* https://transfer.notkiska.pw/u7RVP/archiveteam-wiki-coronavirus-20200416.txt<br />
* https://transfer.notkiska.pw/ExgsD/archiveteam-wiki-coronavirus-20200418.txt<br />
<br />
== Academic publications ==<br />
[[File:Nature-coronavirus.jpg|thumb|right|300px|[https://www.nature.com/collections/hajgidghjb/ Nature coronavirus] papers collection.]]<br />
* https://www.cdc.gov/coronavirus/2019-ncov/publications.html<br />
* https://www.nejm.org/coronavirus<br />
* https://jamanetwork.com/journals/jama/pages/coronavirus-alert/<br />
* https://www.thelancet.com/coronavirus<br />
* https://www.cell.com/2019-nCOV<br />
* https://www.bmj.com/coronavirus/<br />
* https://www.elsevier.com/connect/coronavirus-information-center/<br />
* https://academic.oup.com/journals/pages/coronavirus/<br />
* https://www.nature.com/collections/hajgidghjb/<br />
* https://novel-coronavirus.onlinelibrary.wiley.com/<br />
* https://www.cambridge.org/core/browse-subjects/medicine/coronavirus-free-access-collection/<br />
* http://connect.medrxiv.org/relate/content/181/<br />
<br />
== Transport ==<br />
[[File:Flightradar-europe-20200411.jpg|thumb|right|300px|[https://www.flightradar24.com/ Flightradar] on April 11th.]]<br />
* https://www.flightradar24.com/<br />
* https://www.marinetraffic.com/<br />
<br />
== Exchange points ==<br />
[[File:Milan Internet Exchange 2019-2020.png|thumb|right|300px|[https://www.mix-it.net/statistiche/ Milan Internet Exchange], 2019-2020.]]<br />
Internet traffic statistics<br />
<br />
* https://en.wikipedia.org/wiki/List_of_Internet_exchange_points<br />
* https://en.wikipedia.org/wiki/List_of_Internet_exchange_points_by_size<br />
* https://www.mix-it.net/statistiche/ | note = Milan Internet Exchange (MIX)<br />
* https://www.namex.it/statistics/ | note = Nautilus Mediterranean Exchange Point (NaMeX)<br />
* https://ix.br/agregado/ | note = Brazil Internet Exchange<br />
* https://www.bcix.de/bcix/traffic/ | note = Berlin Commercial Internet Exchange (BCIX)<br />
* https://www.ams-ix.net/ams/documentation/total-stats | note = Amsterdam Internet Exchange (AMS-IX)<br />
* https://www.msk-ix.ru/en/traffic/ | note = Moscow Internet Exchange (MSK-IX)<br />
* https://www.mumbai-ix.net/en/graph | note = Mumbai Internet Exchange<br />
* https://www.franceix.net/en/technical/traffic-statistics/ | note = France Internet Exchange<br />
* https://ixp.rheintal-ix.net/statistics/ixp | note = Rheintal Internet Exchange<br />
* https://www.netnod.se/ix-stats/sums/All.html | note = Netnod Internet Exchange in Sweden<br />
* https://www.jpnap.net/ | note = Japan Network Access Point<br />
* http://mrtg.nixi.in/mrtg.html | note = National Internet Exchange of India<br />
* https://www.lonap.net/mrtg/lonap-total.html | note = London Network Access Point<br />
* https://www.sgix.sg/services/traffic-statistics/ | note = Singapore Internet Exchange<br />
<br />
== Hacking ==<br />
<br />
* https://www.hackthecrisis.se/<br />
* https://www.codevscovid19.org/<br />
* https://wirvsvirushackathon.org/<br />
* https://covid-global-hackathon.devpost.com/<br />
* https://hackquarantine.com/<br />
* https://www.hackcov19.com/<br />
* https://www.hackthecrisis.be/<br />
<br />
== Political turmoil ==<br />
<br />
=== Brazil ===<br />
<br />
* https://www.reuters.com/article/us-brazil-politics/brazil-justice-minister-quits-accuses-bolsonaro-of-meddling-in-police-idUSKCN2261KW<br />
<br />
=== Hungary ===<br />
<br />
* https://www.theguardian.com/world/2020/mar/23/hungary-to-consider-bill-that-would-allow-orban-to-rule-by-decree<br />
* https://en.mszp.hu/article/joint_statement_of_the_opposition_we_trust_hungarian_people_and_hungary_but_we_do_not_trust_the_government_of_orban<br />
* #NoQuarantineForDemocracy<br />
* #StopOrbán<br />
<br />
== Memorials ==<br />
<br />
* https://www.covidmemorial.online/<br />
<br />
== See also ==<br />
<br />
* [[List of disasters]]</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=ArchiveTeam_Warrior&diff=42422ArchiveTeam Warrior2019-12-09T15:07:21Z<p>Jrwr: </p>
<hr />
<div>==What is the Archive Team Warrior?==<br />
<br />
[[Image:Archive_team.png|100px|left]]<br />
[[Image:Warrior-vm-screenshot.png||256px|right]]<br />
[[Image:Warrior-web-screenshot.png|256px|right]]<br />
[[File:Archiveteam_warrior_infrastructure.png|thumb|right|256px|[[Dev/Infrastructure|Warrior infastructure]]]]<br />
<br />
The Archive Team Warrior is a virtual archiving appliance. You can run it to help with the ArchiveTeam archiving efforts. It will download sites and upload them to our archive — and it’s really easy to do!<br />
<br />
The warrior is a virtual machine, so there is no risk to your computer. The warrior will only use your bandwidth and some of your disk space. It will get tasks from and report progress to the [[Tracker]].<br />
<br />
== Basic usage ==<br />
<br />
The warrior runs on Windows, macOS, and Linux using a virtual machine. You'll need:<br />
<br />
* [https://warriorhq.archiveteam.org/downloads/warrior3/ Warrior Appliance] (300MB) - Download mirrors: [https://www.syping.de/archiveteam/ #1 (de)] [https://archive.org/details/archiveteam-warrior-v3-20171013 #2 (IA)]<br />
Plus one of the virtualization applications below to run it:<br />
* [https://hub.docker.com/r/archiveteam/warrior-dockerfile/ Docker Image] (recommended for anyone who has used docker in the past)<br />
* [https://www.virtualbox.org/ VirtualBox] (recommended to [[#Beta version|use the beta version of the warrior]]) <br />
* [https://www.vmware.com/products/player/ VMware workstation/player] (free-gratis for personal use)<br />
* [[#Alternative virtual machines|See below for alternative virtual machines]]<br />
<br />
=== Quick start instructions for VirtualBox ===<br />
<br />
# Download the appliance from the link above.<br />
# Launch VirtualBox<br />
# In VirtualBox, click File > Import Appliance and open the file.<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit http://localhost:8001/<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
=== Start instructions for VMWare Player ===<br />
<br />
# Download the appliance from the link above<br />
# Launch VMWare Player<br />
# In Player on the right, click "Open Virtual Machine", open the file and import the virtual machine.<br />
# (Optional) Select the virtual machine and click "Edit virtual machine settings".<br />
#* Select Network Adapter and set it to "Bridged: Connected directly to the physical network"<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit the address that is shown on the bottom (e.g. http://192.168.0.100:8001/)<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
<br />
__TOC__<br />
<br />
== Beta version ==<br />
<br />
Help us test the new version of the appliance available at https://warriorhq.archiveteam.org/downloads/warrior3/. Report any issues or feedback on [[IRC|#warrior on EFnet]].<br />
<br />
This version includes updated internal components that allow us to run newer and improved software. Specifically, it runs the warrior code within a Docker container.<br />
<br />
== Alternative virtual machines ==<br />
<br />
Thanks to user-effort, there are alternatives:<br />
<br />
* [https://www.docker.io/ Docker] (Linux)<br />
** [https://hub.docker.com/r/archiveteam/warrior-dockerfile/ official dockerfile] ([https://github.com/ArchiveTeam/warrior-dockerfile repository])<br />
** [https://hub.docker.com/r/infrequent/at-as-dockerfile modified dockerfile - for manual script execution]<br />
<br />
* [https://www.microsoft.com/en-us/server-cloud/solutions/virtualization.aspx Hyper-V] (Windows 8 Professional)<br />
** ([http://jonimoose.net/2013/archiveteam-warrior-on-hyper-v/ Hyper-V virtual machine])<br />
<br />
Please note that these alternatives are not in widespread use by our warriors, so we may not be able to help with either issues or advanced usage.<br />
<br />
== Warrior FAQ ==<br />
<br />
=== Why a virtual machine in the first place? ===<br />
<br />
The virtual machine is a quick, safe, and easy way for newcomers to help us out. It offers many features:<br />
<br />
* Graphical interface<br />
* Automatically selects which project is important to run<br />
* Self-updating software infrastructure<br />
* Allows for unattended use<br />
* In case of software faults, your machine is not ruined<br />
* Restarts itself in case of runaway programs<br />
* Runs on Windows, Mac, and Linux painlessly<br />
* Ensures consistency in the archived data regardless of your machine's quirks<br />
<br />
If you have suggestions for improving this system, please talk to us as described below.<br />
<br />
=== Can I use whatever internet access for the warrior? ===<br />
<br />
No. We need "clean" connections. Please ensure the following:<br />
<br />
* No OpenDNS. No ISP DNS that redirects to a search page. Use non-captive DNS servers.<br />
* No ISP connections that inject advertisements into web pages.<br />
* No proxies. Proxies can return bad data. The original HTTP headers and IP address are needed for the WARC file.<br />
* No content-filtering firewalls.<br />
* No censorship. If you believe your country implements censorship, do not run a warrior. <br />
* No Tor. The server may return an error page instead of content if they ban exit nodes.<br />
* No free cafe wifi. Archiving your cafe's wifi service agreement repeatedly is not helpful.<br />
* No VPNs. Data integrity is a very high priority for the Archive Team so use of VPNs with the official crawler is discouraged.<br />
* We prefer connections from many public IP addresses if possible. (For example, if your apartment building uses a single IP address, we don't want your apartment banned.)<br />
<br />
=== I turned my warrior VM appliance off. Will those tasks be lost? ===<br />
<br />
If you've killed your warrior VM instance, then the work your warrior did has been lost. However, the tasks will be returned to the pool after a period of time, and other warriors may claim them. If you want, you can alert the admins via [[IRC]] of what's happened and they can clear the claims your username may have made. but this isn't very important on most projects.<br />
<br />
=== I closed my browser or tab with the warrior's web interface. Will those tasks be lost? ===<br />
<br />
No. The web browser interface just provides a user interface to the warrior. As long as the VM is not stopped, it will continue normally.<br />
<br />
=== I need to disconnect my internet / reboot my PC. How can I do this without losing work? ===<br />
<br />
If you pause/suspend the warrior instance, most projects will allow resuming of work in progress when you unsuspend the warrior instance.<br />
<br />
If you decide to use the suspend feature, please note that if you keep it suspended for too long (more than a few hours), the administrators will assume that the item is lost and re-queue it. Using the suspend feature so that you can reboot your computer is perfectly fine.<br />
<br />
=== How much disk space will the warrior use? ===<br />
<br />
Short answer: it depends on the project. (But never more than 60GB.)<br />
<br />
Long answer: because each project defines items differently, sizes may vary. A single task may be a small file or a whole subsection of a website. The virtual machine is configured by default to use an absolute maximum of 60GB. Any unused virtual machine disk space is not used on the host computer. You may run the virtual machine on less than 60GB if you like to live dangerously. We're downloading the internet, after all!<br />
<br />
=== How can I log in to the virtual machine? ===<br />
<br />
Unless you know what you are doing, you should not need to do this. But, if you want to, the username is <code>root</code> and the password is <code>archiveteam</code>. Once logged in as root, you can execute <code>sudo -u warrior -i</code> to log in as the warrior user. <br />
<br />
Press ALT+F3 to switch to virtual console number 3. Use ALT+Left or ALT+Right to switch between virtual consoles. There are 6 virtual consoles in total. Consoles 1 and 2 are reserved for the warrior.<br />
<br />
=== How can I run multiple virtual machines at the same time? ===<br />
<br />
You'll need to adjust the networking settings.<br />
<br />
In VirtualBox, select a virtual machine and open up Settings → Network → Adapter 1 → Port Forwarding. You need to adjust the host port. For example, set your table to TCP | 127.0.0.1 | 8123 | | 8001. This maps port 8123 on the host machine (your computer) to port 8001 on the virtual machine (the warrior), and you can then access the warrior's web interface from port 8123 in your browser.<br />
<br />
Each VM you want to access should have a different host port. Do not use port numbers below 1024 unless you know what you are doing.<br />
<br />
VMWare installations should be using bridged networking. However, if you want, you can switch to NAT (under Settings → Hardware → Virtual Network Adapter) and click Edit to set up port forwarding. On Linux, you can also use lines like <code>8123 = 192.168.0.100:8001</code> in the <code>[incomingtcp]</code> section of nat.conf. (Make sure the VM IP is correct!)<br />
<br />
=== How can I run the virtual machine headlessly (without leaving a window open)? ===<br />
<br />
From the VirtualBox GUI, after opening the VM, click Machine > Detach GUI. You can then close the VirtualBox Manager window.<br />
<br />
For the VirtualBox CLI, use this command:<br />
<br />
<pre>vboxmanage startvm archiveteam-warrior-2 --type headless</pre><br />
<br />
Shut down the VM with:<br />
<br />
<pre>vboxmanage controlvm archiveteam-warrior-2 acpipowerbutton</pre><br />
<br />
Substituting <code>suspend</code> or <code>resume</code> for <code>acpipowerbutton</code> suspends or resumes the VM. For more information, consult [http://www.virtualbox.org/manual/ch08.html#vboxmanage-startvm the VirtualBox manual (Chapter 8, Sections 12 and 13)].<br />
<br />
For the VMWare CLI, use this command:<br />
<br />
<pre>vmrun start <path to vmx file> nogui</pre><br />
<br />
Shut down with:<br />
<br />
<pre>vmrun stop <path to vmx file> soft</pre><br />
<br />
Substituting <code>suspend</code> for <code>stop</code> suspends the VM. Resume with <code>start</code> again. For more information, including the paths to VMX files on different operating systems, consult [http://www.vmware.com/pdf/vix180_vmrun_command.pdf Using vmrun to Control Virtual Machines] (PDF), pages 10 and 11.<br />
<br />
=== How can I set up the virtual machine as a system service (so that it starts up on boot and shuts down automatically)? ===<br />
<br />
If you are using VirtualBox and running a Linux distribution that uses the systemd init system (like most recent releases), you can follow the short instructions on [http://www.ericerfanian.com/automatically-starting-virtualbox-vms-on-archlinux-using-systemd/ this page]. (The page title specifies Arch Linux, but this will work for other distros as long as they run systemd.)<br />
<br />
=== How can I set up the virtual machine with directly-bridged networking instead of NAT? ===<br />
<br />
On VirtualBox, use these commands:<br />
<br />
<pre>vboxmanage modifyvm archiveteam-warrior-2 --nic1 bridged<br />
vboxmanage modifyvm archiveteam-warrior-2 --bridgeadapter1 eth0</pre><br />
<br />
We presume you want to bind to <code>eth0</code>. Adjust as required. :)<br />
<br />
VMWare installations should already be using bridged networking.<br />
<br />
=== How can I run the warrior without a virtual machine? (The VM has too much overhead for a VPS!) ===<br />
<br />
One option is running a Docker container (see [[#Alternative_virtual_machines|above]]). Docker is based on LXC, and the overhead is far less than running a full VM. If you plan on running the [https://github.com/ArchiveTeam/warrior-dockerfile warrior-dockerfile], make sure to publish the port to allow access to the web interface:<br />
<br />
<pre>docker run -d -p 8001:8001 archiveteam/warrior-dockerfile</pre><br />
<br />
This creates a direct port mapping. For host port 38001 to container port 8001, use <code>38001:8001</code>. Adjust as required. :P<br />
<br />
(Multiple projects can be also run in isolated environments (containers) for rapid deployment using [https://hub.docker.com/r/infrequent/at-as-dockerfile at-as-dockerfile].)<br />
<br />
Another alternative is '''running the project manually.''' If you are managing a VPS, it's likely you are comfortable with some Linux stuff. Consult the project wiki page or the source code repository readme file.<br />
<br />
=== How can I run tons of warriors easily? ===<br />
<br />
We assume you've checked with the current ArchiveTeam project what concurrency and resources are needed or useful!<br />
<br />
Whether your have your own virtual cluster or you're renting someone else's (aka a "[https://fsfe.org/activities/nocloud/ cloud]"), you probably need some [[wikipedia:Category:Orchestration_software|orchestration software]].<br />
<br />
ArchiveTeam volunteers have successfully used a variety of hosting providers and tools (including free trials on AWS and GCE), often just by building their own flavour of virtual server and then repeating it with simple [https://cloudinit.readthedocs.io/ cloud-init] scripts (to install and launch docker as above) or whatever tool the hosting provides. If you desire full automation, the [https://gitlab.com/diggan/archiveteam-infra archiveteam-infra repository by diggan] helps with [[wikipedia:Terraform (software)|Terraform]] on [[wikipedia:DigitalOcean|DigitalOcean]].<br />
<br />
Some custom monitoring scripts also exist, for instance [https://github.com/general-programming/gp-archiveteam-bs/blob/master/tumblr/watcher.py watcher.py].<br />
<br />
=== I'm looking at the leaderboard. What's that icon beside the username? ===<br />
<br />
That's just the warrior logo: [[File:Archive_team.png|42px]] (click on the image for a larger version). It means that that person is using the warrior. Those without the icon are running the scripts manually.<br />
<br />
[[Image:Archiveteam-warrior-sticker.png|256px|right]]<br />
<br />
=== What's that guy doing in the logo? ===<br />
<br />
The place is on fire! But don't worry, he safely escaped with the rescued data in his arms.<br />
<br />
=== That’s awesome – can I slap this logo on my laptop to show my Internet-preservation pride? ===<br />
<br />
[http://www.redbubble.com/people/ajhajh/works/12857655-archive-team-warrior-stickers?p=sticker You sure can!] The ArchiveTeam Warrior laptop sticker can start conversations about archiving, if you’re into that.<br />
<br />
=== I'd like to help write code or I want to tweak the scripts to run to my liking. Where can I find more info? Where is the source code and repository? ===<br />
<br />
Check out the [[Dev]] documentation for details on the infrastructure and details of the source code layout.<br />
<br />
=== I still have a question! ===<br />
<br />
Check out the [[Frequently Asked Questions|general FAQ page]]. Talk to us on [[IRC]]. Use [irc://irc.efnet.org/warrior #warrior] for specific warrior questions or [irc://irc.efnet.org/archiveteam #archiveteam] for general questions.<br />
<br />
== Troubleshooting ==<br />
<br />
=== I'm getting errors when I try to launch the VM. ===<br />
<br />
If you are receiving <code>Breakpoint has been reached (0x80000003)</code>, <code>A critical error has occurred while running the virtual machine and the machine execution has been stopped.</code>, or VT-X errors, you probably do not have virtualization enabled, either because it is turned off in your computer's BIOS or your CPU does not support it.<br />
<br />
You can check CPU support on Linux with <code>cat /proc/cpuinfo | grep "(vmx|svm)" | uniq</code>. If there is a line of output starting with "flags", your processor supports virtualization; if there is no output, it does not. You can check whether virtualization is enabled in the BIOS using the <code>rdmsr</code> utility in your distro's <code>msr-tools</code> package.<br />
<br />
You can check support and BIOS status on Windows using [https://www.microsoft.com/en-us/download/details.aspx?id=592 Microsoft's Hardware-Assisted Virtualization Detection Tool] or [http://openlibsys.org/index-ja.html VirtualChecker].<br />
<br />
To enable virtualization on a CPU with support, reboot the computer and enter the BIOS. The virtualization setting is usually under something like 'CPU configuration' or 'advanced settings'.<br />
<br />
=== I just imported the ova image and the warrior is stuck on "Preparing the data partition". ===<br />
<br />
This issue has cropped up before, and we do not know what causes it. We recommend you delete the warrior image and import the ova again. Testing shows that such a reimport works in the majority of cases.<br />
<br />
=== I can't connect to localhost. ===<br />
<br />
The application is configured to set up port forwarding to the guest machine, and you should be able to access the interface through your web browser at port 8001. If this does not happen, and isn't resolved by rebooting the warrior (using the ACPI power signals, not suspend/save state and resume), you may need to double-check your machine's network settings (as described [[#How_can_I_run_multiple_virtual_machines_at_the_same_time.3F|above]]).<br />
<br />
=== The warrior can't connect to the internet. ===<br />
<br />
It's possible that the virtual machine has picked up the address of the local DNS cache on your computer, which the virtual machine does not have access to. <br />
<br />
If you experience this on VirtualBox, see [http://askubuntu.com/questions/204953/virtualbox-dns-stopped-working-on-upgrade-to-12-10 this question and answer]. Additionally, check to see if "Cable Connected" is unchecked in the advanced settings of the virtual adapter, under the network tab in the virtual machine's settings. Check it if it's unchecked, then save your settings.<br />
<br />
=== I see a message that no item was received. ===<br />
<br />
This means that there is no work available. This can happen for several reasons:<br />
<br />
* The project has just finished and someone is inspecting the work done. If a problem is discovered, items may be re-queued and more work will become available.<br />
* You have checked out/claimed too many items. Reduce your concurrency and let others do some of the work too.<br />
* In a rare case, you have been banned by a tracker administrator because there was a problem with your work: you were requesting too much, you were tampering with the scripts, a malfunction has occurred, or your internet connection is "unclean" (see [[#Can_I_use_whatever_internet_access_for_the_warrior.3F|above]]).<br />
<br />
=== I see a message about rate limiting. ===<br />
<br />
Don't worry. Keep in mind that although downloading the internet for fun and digital preservation are the primary goals of all Archive Team activities, serious stress on the target's server may occur. The rate limit is imposed by a [[Tracker#People|tracker administrator]] and should not be subverted.<br />
<br />
(In other words, we don't want to DDoS the servers.)<br />
<br />
If you like, you can switch to another [[Warrior projects|project]] with less load.<br />
<br />
=== I see a message about code being out of date. ===<br />
<br />
Don't worry. There is a new update ready. You do not need to do anything about this; the warrior will update its code every hour. If you are impatient, please reboot the warrior and it will download the latest code and resume work.<br />
<br />
=== I'm running the scripts manually and I see a message about code being out of date. ===<br />
<br />
This happens when a bug in the scripts is discovered. Bugs are unavoidable, especially when the server is out of our control.<br />
<br />
Try the <code>--auto-update</code> option available in Seesaw version 0.8. However, please be aware that you are now executing code automatically. Be sure to run the scripts in a separate user account for safety.<br />
<br />
=== I see messages about rsync errors. ===<br />
<br />
Uh-oh! Something is not right. Please notify us immediately in the appropriate [[IRC]] channel.<br />
<br />
=== I told the warrior to shut down from the interface, but nothing has changed. ===<br />
<br />
The warrior will attempt to finish the current running tasks before shutting down. If you need to shut down right away, go ahead. Your progress will be lost, but the jobs will eventually cycle out to another user.<br />
<br />
=== The warrior is eating all my bandwidth! ===<br />
<br />
On VirtualBox (relatively recent versions), use this command:<br />
<br />
<pre>vboxmanage bandwidthctl archiveteam-warrior-3 add limit --type network --limit 3m</pre><br />
<br />
This will limit the warrior to 3Mb/s. (Limit units are <code>k</code> for kilobit, <code>m</code> for megabit, <code>g</code> for gigabit, <code>K</code> for kilobyte, <code>M</code> for megabyte, and <code>G</code> for gigabyte.) Adjust as required. :)<br />
<br />
In the latest version of VirtualBox on Windows, the syntax appears to have changed. The correct command now seems to be:<br />
<br />
<pre>VBoxManage bandwidthctl archiveteam-warrior-3 add netlimit --type network --limit 3</pre><br />
<br />
For more information, consult [http://www.virtualbox.org/manual/ch06.html#network_bandwidth_limit the VirtualBox manual (Chapter 6, Section 9)].<br />
<br />
On VMWare (versions 9 and above), select a virtual machine and open Settings → Hardware → Virtual Network Adapter → Advanced. You can set a bandwidth limit here.<br />
<br />
=== The warrior is using up disk space, even though it's not running a project! ===<br />
<br />
Virtual machine disk images do not behave like a regular file. There are several ways to safely reclaim space:<br />
<br />
* Delete the second disk and put back an empty disk. The warrior should reformat the second disk.<br />
* Delete the entire warrior application and re-import it.<br />
* Use the [http://intgat.tigress.co.uk/rmy/uml/index.html zerofree] program and then clone the disk image. Reattach the cloned disk image.<br />
<br />
=== The item I'm working on is downloading thousands of URLs and it's taking hours. ===<br />
<br />
Please notify us in the appropriate [[IRC]] channel. You may need to reboot the warrior.<br />
<br />
=== Why is the default project not working? / Why is a manual project not in the warrior yet? ===<br />
<br />
Sorry. Sometimes the administrators are too busy...<br />
<br />
=== Why are there no projects? ===<br />
<br />
We finished the ones we were working on! If there are no projects showing, you can [[Dev|help us write one]]. No projects does ''not'' mean there is nothing left to archive!<br />
<br />
=== The instructions to run the software/scripts are awful and they are difficult to set up. ===<br />
<br />
Well, excuuuuse me, princess!<br />
<br />
We're not a professional support team so help us help you help us all. See above for [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|bug reports]], [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|suggestions]], or [[#I.27d_like_to_help_write_code._Where_can_I_find_more_info.3F|code contributions]].<br />
<br />
=== Where can I file a bug, suggestion, or a feature request? ===<br />
<br />
If the issue is related to the warrior's web interface or the library that grab scripts are using, see [https://github.com/ArchiveTeam/seesaw-kit/issues seesaw-kit issues]. Other issues should be filed into their own [[Dev/Source_Code|repositories]].<br />
<br />
== Projects ==<br />
<br />
See [[Warrior projects]].<br />
<br />
== Are you a coder? ==<br />
<br />
Like the warrior? Interested in how it works under the hood? Got software skills? '''[[Dev|Help us improve it!]]'''<br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=ArchiveTeam_Warrior&diff=42421ArchiveTeam Warrior2019-12-09T15:06:28Z<p>Jrwr: Wikitext is hard</p>
<hr />
<div>==What is the Archive Team Warrior?==<br />
<br />
[[Image:Archive_team.png|100px|left]]<br />
[[Image:Warrior-vm-screenshot.png||256px|right]]<br />
[[Image:Warrior-web-screenshot.png|256px|right]]<br />
[[File:Archiveteam_warrior_infrastructure.png|thumb|right|256px|[[Dev/Infrastructure|Warrior infastructure]]]]<br />
<br />
The Archive Team Warrior is a virtual archiving appliance. You can run it to help with the ArchiveTeam archiving efforts. It will download sites and upload them to our archive — and it’s really easy to do!<br />
<br />
The warrior is a virtual machine, so there is no risk to your computer. The warrior will only use your bandwidth and some of your disk space. It will get tasks from and report progress to the [[Tracker]].<br />
<br />
== Basic usage ==<br />
<br />
The warrior runs on Windows, macOS, and Linux using a virtual machine. You'll need:<br />
<br />
* [https://warriorhq.archiveteam.org/downloads/warrior3/ Warrior Appliance] (300MB) - Download mirrors: [https://www.syping.de/archiveteam/ #1 (de)] [https://archive.org/details/archiveteam-warrior-v3-20171013 #2 (IA)]<br />
Plus one of the virtualization applications below to run it:<br />
* [https://hub.docker.com/r/archiveteam/warrior-dockerfile/ Docker Image]<br />
* [https://www.virtualbox.org/ VirtualBox] (recommended to [[#Beta version|use the beta version of the warrior]]) <br />
* [https://www.vmware.com/products/player/ VMware workstation/player] (free-gratis for personal use)<br />
* [[#Alternative virtual machines|See below for alternative virtual machines]]<br />
<br />
=== Quick start instructions for VirtualBox ===<br />
<br />
# Download the appliance from the link above.<br />
# Launch VirtualBox<br />
# In VirtualBox, click File > Import Appliance and open the file.<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit http://localhost:8001/<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
=== Start instructions for VMWare Player ===<br />
<br />
# Download the appliance from the link above<br />
# Launch VMWare Player<br />
# In Player on the right, click "Open Virtual Machine", open the file and import the virtual machine.<br />
# (Optional) Select the virtual machine and click "Edit virtual machine settings".<br />
#* Select Network Adapter and set it to "Bridged: Connected directly to the physical network"<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit the address that is shown on the bottom (e.g. http://192.168.0.100:8001/)<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
<br />
__TOC__<br />
<br />
== Beta version ==<br />
<br />
Help us test the new version of the appliance available at https://warriorhq.archiveteam.org/downloads/warrior3/. Report any issues or feedback on [[IRC|#warrior on EFnet]].<br />
<br />
This version includes updated internal components that allow us to run newer and improved software. Specifically, it runs the warrior code within a Docker container.<br />
<br />
== Alternative virtual machines ==<br />
<br />
Thanks to user-effort, there are alternatives:<br />
<br />
* [https://www.docker.io/ Docker] (Linux)<br />
** [https://hub.docker.com/r/archiveteam/warrior-dockerfile/ official dockerfile] ([https://github.com/ArchiveTeam/warrior-dockerfile repository])<br />
** [https://hub.docker.com/r/infrequent/at-as-dockerfile modified dockerfile - for manual script execution]<br />
<br />
* [https://www.microsoft.com/en-us/server-cloud/solutions/virtualization.aspx Hyper-V] (Windows 8 Professional)<br />
** ([http://jonimoose.net/2013/archiveteam-warrior-on-hyper-v/ Hyper-V virtual machine])<br />
<br />
Please note that these alternatives are not in widespread use by our warriors, so we may not be able to help with either issues or advanced usage.<br />
<br />
== Warrior FAQ ==<br />
<br />
=== Why a virtual machine in the first place? ===<br />
<br />
The virtual machine is a quick, safe, and easy way for newcomers to help us out. It offers many features:<br />
<br />
* Graphical interface<br />
* Automatically selects which project is important to run<br />
* Self-updating software infrastructure<br />
* Allows for unattended use<br />
* In case of software faults, your machine is not ruined<br />
* Restarts itself in case of runaway programs<br />
* Runs on Windows, Mac, and Linux painlessly<br />
* Ensures consistency in the archived data regardless of your machine's quirks<br />
<br />
If you have suggestions for improving this system, please talk to us as described below.<br />
<br />
=== Can I use whatever internet access for the warrior? ===<br />
<br />
No. We need "clean" connections. Please ensure the following:<br />
<br />
* No OpenDNS. No ISP DNS that redirects to a search page. Use non-captive DNS servers.<br />
* No ISP connections that inject advertisements into web pages.<br />
* No proxies. Proxies can return bad data. The original HTTP headers and IP address are needed for the WARC file.<br />
* No content-filtering firewalls.<br />
* No censorship. If you believe your country implements censorship, do not run a warrior. <br />
* No Tor. The server may return an error page instead of content if they ban exit nodes.<br />
* No free cafe wifi. Archiving your cafe's wifi service agreement repeatedly is not helpful.<br />
* No VPNs. Data integrity is a very high priority for the Archive Team so use of VPNs with the official crawler is discouraged.<br />
* We prefer connections from many public IP addresses if possible. (For example, if your apartment building uses a single IP address, we don't want your apartment banned.)<br />
<br />
=== I turned my warrior VM appliance off. Will those tasks be lost? ===<br />
<br />
If you've killed your warrior VM instance, then the work your warrior did has been lost. However, the tasks will be returned to the pool after a period of time, and other warriors may claim them. If you want, you can alert the admins via [[IRC]] of what's happened and they can clear the claims your username may have made. but this isn't very important on most projects.<br />
<br />
=== I closed my browser or tab with the warrior's web interface. Will those tasks be lost? ===<br />
<br />
No. The web browser interface just provides a user interface to the warrior. As long as the VM is not stopped, it will continue normally.<br />
<br />
=== I need to disconnect my internet / reboot my PC. How can I do this without losing work? ===<br />
<br />
If you pause/suspend the warrior instance, most projects will allow resuming of work in progress when you unsuspend the warrior instance.<br />
<br />
If you decide to use the suspend feature, please note that if you keep it suspended for too long (more than a few hours), the administrators will assume that the item is lost and re-queue it. Using the suspend feature so that you can reboot your computer is perfectly fine.<br />
<br />
=== How much disk space will the warrior use? ===<br />
<br />
Short answer: it depends on the project. (But never more than 60GB.)<br />
<br />
Long answer: because each project defines items differently, sizes may vary. A single task may be a small file or a whole subsection of a website. The virtual machine is configured by default to use an absolute maximum of 60GB. Any unused virtual machine disk space is not used on the host computer. You may run the virtual machine on less than 60GB if you like to live dangerously. We're downloading the internet, after all!<br />
<br />
=== How can I log in to the virtual machine? ===<br />
<br />
Unless you know what you are doing, you should not need to do this. But, if you want to, the username is <code>root</code> and the password is <code>archiveteam</code>. Once logged in as root, you can execute <code>sudo -u warrior -i</code> to log in as the warrior user. <br />
<br />
Press ALT+F3 to switch to virtual console number 3. Use ALT+Left or ALT+Right to switch between virtual consoles. There are 6 virtual consoles in total. Consoles 1 and 2 are reserved for the warrior.<br />
<br />
=== How can I run multiple virtual machines at the same time? ===<br />
<br />
You'll need to adjust the networking settings.<br />
<br />
In VirtualBox, select a virtual machine and open up Settings → Network → Adapter 1 → Port Forwarding. You need to adjust the host port. For example, set your table to TCP | 127.0.0.1 | 8123 | | 8001. This maps port 8123 on the host machine (your computer) to port 8001 on the virtual machine (the warrior), and you can then access the warrior's web interface from port 8123 in your browser.<br />
<br />
Each VM you want to access should have a different host port. Do not use port numbers below 1024 unless you know what you are doing.<br />
<br />
VMWare installations should be using bridged networking. However, if you want, you can switch to NAT (under Settings → Hardware → Virtual Network Adapter) and click Edit to set up port forwarding. On Linux, you can also use lines like <code>8123 = 192.168.0.100:8001</code> in the <code>[incomingtcp]</code> section of nat.conf. (Make sure the VM IP is correct!)<br />
<br />
=== How can I run the virtual machine headlessly (without leaving a window open)? ===<br />
<br />
From the VirtualBox GUI, after opening the VM, click Machine > Detach GUI. You can then close the VirtualBox Manager window.<br />
<br />
For the VirtualBox CLI, use this command:<br />
<br />
<pre>vboxmanage startvm archiveteam-warrior-2 --type headless</pre><br />
<br />
Shut down the VM with:<br />
<br />
<pre>vboxmanage controlvm archiveteam-warrior-2 acpipowerbutton</pre><br />
<br />
Substituting <code>suspend</code> or <code>resume</code> for <code>acpipowerbutton</code> suspends or resumes the VM. For more information, consult [http://www.virtualbox.org/manual/ch08.html#vboxmanage-startvm the VirtualBox manual (Chapter 8, Sections 12 and 13)].<br />
<br />
For the VMWare CLI, use this command:<br />
<br />
<pre>vmrun start <path to vmx file> nogui</pre><br />
<br />
Shut down with:<br />
<br />
<pre>vmrun stop <path to vmx file> soft</pre><br />
<br />
Substituting <code>suspend</code> for <code>stop</code> suspends the VM. Resume with <code>start</code> again. For more information, including the paths to VMX files on different operating systems, consult [http://www.vmware.com/pdf/vix180_vmrun_command.pdf Using vmrun to Control Virtual Machines] (PDF), pages 10 and 11.<br />
<br />
=== How can I set up the virtual machine as a system service (so that it starts up on boot and shuts down automatically)? ===<br />
<br />
If you are using VirtualBox and running a Linux distribution that uses the systemd init system (like most recent releases), you can follow the short instructions on [http://www.ericerfanian.com/automatically-starting-virtualbox-vms-on-archlinux-using-systemd/ this page]. (The page title specifies Arch Linux, but this will work for other distros as long as they run systemd.)<br />
<br />
=== How can I set up the virtual machine with directly-bridged networking instead of NAT? ===<br />
<br />
On VirtualBox, use these commands:<br />
<br />
<pre>vboxmanage modifyvm archiveteam-warrior-2 --nic1 bridged<br />
vboxmanage modifyvm archiveteam-warrior-2 --bridgeadapter1 eth0</pre><br />
<br />
We presume you want to bind to <code>eth0</code>. Adjust as required. :)<br />
<br />
VMWare installations should already be using bridged networking.<br />
<br />
=== How can I run the warrior without a virtual machine? (The VM has too much overhead for a VPS!) ===<br />
<br />
One option is running a Docker container (see [[#Alternative_virtual_machines|above]]). Docker is based on LXC, and the overhead is far less than running a full VM. If you plan on running the [https://github.com/ArchiveTeam/warrior-dockerfile warrior-dockerfile], make sure to publish the port to allow access to the web interface:<br />
<br />
<pre>docker run -d -p 8001:8001 archiveteam/warrior-dockerfile</pre><br />
<br />
This creates a direct port mapping. For host port 38001 to container port 8001, use <code>38001:8001</code>. Adjust as required. :P<br />
<br />
(Multiple projects can be also run in isolated environments (containers) for rapid deployment using [https://hub.docker.com/r/infrequent/at-as-dockerfile at-as-dockerfile].)<br />
<br />
Another alternative is '''running the project manually.''' If you are managing a VPS, it's likely you are comfortable with some Linux stuff. Consult the project wiki page or the source code repository readme file.<br />
<br />
=== How can I run tons of warriors easily? ===<br />
<br />
We assume you've checked with the current ArchiveTeam project what concurrency and resources are needed or useful!<br />
<br />
Whether your have your own virtual cluster or you're renting someone else's (aka a "[https://fsfe.org/activities/nocloud/ cloud]"), you probably need some [[wikipedia:Category:Orchestration_software|orchestration software]].<br />
<br />
ArchiveTeam volunteers have successfully used a variety of hosting providers and tools (including free trials on AWS and GCE), often just by building their own flavour of virtual server and then repeating it with simple [https://cloudinit.readthedocs.io/ cloud-init] scripts (to install and launch docker as above) or whatever tool the hosting provides. If you desire full automation, the [https://gitlab.com/diggan/archiveteam-infra archiveteam-infra repository by diggan] helps with [[wikipedia:Terraform (software)|Terraform]] on [[wikipedia:DigitalOcean|DigitalOcean]].<br />
<br />
Some custom monitoring scripts also exist, for instance [https://github.com/general-programming/gp-archiveteam-bs/blob/master/tumblr/watcher.py watcher.py].<br />
<br />
=== I'm looking at the leaderboard. What's that icon beside the username? ===<br />
<br />
That's just the warrior logo: [[File:Archive_team.png|42px]] (click on the image for a larger version). It means that that person is using the warrior. Those without the icon are running the scripts manually.<br />
<br />
[[Image:Archiveteam-warrior-sticker.png|256px|right]]<br />
<br />
=== What's that guy doing in the logo? ===<br />
<br />
The place is on fire! But don't worry, he safely escaped with the rescued data in his arms.<br />
<br />
=== That’s awesome – can I slap this logo on my laptop to show my Internet-preservation pride? ===<br />
<br />
[http://www.redbubble.com/people/ajhajh/works/12857655-archive-team-warrior-stickers?p=sticker You sure can!] The ArchiveTeam Warrior laptop sticker can start conversations about archiving, if you’re into that.<br />
<br />
=== I'd like to help write code or I want to tweak the scripts to run to my liking. Where can I find more info? Where is the source code and repository? ===<br />
<br />
Check out the [[Dev]] documentation for details on the infrastructure and details of the source code layout.<br />
<br />
=== I still have a question! ===<br />
<br />
Check out the [[Frequently Asked Questions|general FAQ page]]. Talk to us on [[IRC]]. Use [irc://irc.efnet.org/warrior #warrior] for specific warrior questions or [irc://irc.efnet.org/archiveteam #archiveteam] for general questions.<br />
<br />
== Troubleshooting ==<br />
<br />
=== I'm getting errors when I try to launch the VM. ===<br />
<br />
If you are receiving <code>Breakpoint has been reached (0x80000003)</code>, <code>A critical error has occurred while running the virtual machine and the machine execution has been stopped.</code>, or VT-X errors, you probably do not have virtualization enabled, either because it is turned off in your computer's BIOS or your CPU does not support it.<br />
<br />
You can check CPU support on Linux with <code>cat /proc/cpuinfo | grep "(vmx|svm)" | uniq</code>. If there is a line of output starting with "flags", your processor supports virtualization; if there is no output, it does not. You can check whether virtualization is enabled in the BIOS using the <code>rdmsr</code> utility in your distro's <code>msr-tools</code> package.<br />
<br />
You can check support and BIOS status on Windows using [https://www.microsoft.com/en-us/download/details.aspx?id=592 Microsoft's Hardware-Assisted Virtualization Detection Tool] or [http://openlibsys.org/index-ja.html VirtualChecker].<br />
<br />
To enable virtualization on a CPU with support, reboot the computer and enter the BIOS. The virtualization setting is usually under something like 'CPU configuration' or 'advanced settings'.<br />
<br />
=== I just imported the ova image and the warrior is stuck on "Preparing the data partition". ===<br />
<br />
This issue has cropped up before, and we do not know what causes it. We recommend you delete the warrior image and import the ova again. Testing shows that such a reimport works in the majority of cases.<br />
<br />
=== I can't connect to localhost. ===<br />
<br />
The application is configured to set up port forwarding to the guest machine, and you should be able to access the interface through your web browser at port 8001. If this does not happen, and isn't resolved by rebooting the warrior (using the ACPI power signals, not suspend/save state and resume), you may need to double-check your machine's network settings (as described [[#How_can_I_run_multiple_virtual_machines_at_the_same_time.3F|above]]).<br />
<br />
=== The warrior can't connect to the internet. ===<br />
<br />
It's possible that the virtual machine has picked up the address of the local DNS cache on your computer, which the virtual machine does not have access to. <br />
<br />
If you experience this on VirtualBox, see [http://askubuntu.com/questions/204953/virtualbox-dns-stopped-working-on-upgrade-to-12-10 this question and answer]. Additionally, check to see if "Cable Connected" is unchecked in the advanced settings of the virtual adapter, under the network tab in the virtual machine's settings. Check it if it's unchecked, then save your settings.<br />
<br />
=== I see a message that no item was received. ===<br />
<br />
This means that there is no work available. This can happen for several reasons:<br />
<br />
* The project has just finished and someone is inspecting the work done. If a problem is discovered, items may be re-queued and more work will become available.<br />
* You have checked out/claimed too many items. Reduce your concurrency and let others do some of the work too.<br />
* In a rare case, you have been banned by a tracker administrator because there was a problem with your work: you were requesting too much, you were tampering with the scripts, a malfunction has occurred, or your internet connection is "unclean" (see [[#Can_I_use_whatever_internet_access_for_the_warrior.3F|above]]).<br />
<br />
=== I see a message about rate limiting. ===<br />
<br />
Don't worry. Keep in mind that although downloading the internet for fun and digital preservation are the primary goals of all Archive Team activities, serious stress on the target's server may occur. The rate limit is imposed by a [[Tracker#People|tracker administrator]] and should not be subverted.<br />
<br />
(In other words, we don't want to DDoS the servers.)<br />
<br />
If you like, you can switch to another [[Warrior projects|project]] with less load.<br />
<br />
=== I see a message about code being out of date. ===<br />
<br />
Don't worry. There is a new update ready. You do not need to do anything about this; the warrior will update its code every hour. If you are impatient, please reboot the warrior and it will download the latest code and resume work.<br />
<br />
=== I'm running the scripts manually and I see a message about code being out of date. ===<br />
<br />
This happens when a bug in the scripts is discovered. Bugs are unavoidable, especially when the server is out of our control.<br />
<br />
Try the <code>--auto-update</code> option available in Seesaw version 0.8. However, please be aware that you are now executing code automatically. Be sure to run the scripts in a separate user account for safety.<br />
<br />
=== I see messages about rsync errors. ===<br />
<br />
Uh-oh! Something is not right. Please notify us immediately in the appropriate [[IRC]] channel.<br />
<br />
=== I told the warrior to shut down from the interface, but nothing has changed. ===<br />
<br />
The warrior will attempt to finish the current running tasks before shutting down. If you need to shut down right away, go ahead. Your progress will be lost, but the jobs will eventually cycle out to another user.<br />
<br />
=== The warrior is eating all my bandwidth! ===<br />
<br />
On VirtualBox (relatively recent versions), use this command:<br />
<br />
<pre>vboxmanage bandwidthctl archiveteam-warrior-3 add limit --type network --limit 3m</pre><br />
<br />
This will limit the warrior to 3Mb/s. (Limit units are <code>k</code> for kilobit, <code>m</code> for megabit, <code>g</code> for gigabit, <code>K</code> for kilobyte, <code>M</code> for megabyte, and <code>G</code> for gigabyte.) Adjust as required. :)<br />
<br />
In the latest version of VirtualBox on Windows, the syntax appears to have changed. The correct command now seems to be:<br />
<br />
<pre>VBoxManage bandwidthctl archiveteam-warrior-3 add netlimit --type network --limit 3</pre><br />
<br />
For more information, consult [http://www.virtualbox.org/manual/ch06.html#network_bandwidth_limit the VirtualBox manual (Chapter 6, Section 9)].<br />
<br />
On VMWare (versions 9 and above), select a virtual machine and open Settings → Hardware → Virtual Network Adapter → Advanced. You can set a bandwidth limit here.<br />
<br />
=== The warrior is using up disk space, even though it's not running a project! ===<br />
<br />
Virtual machine disk images do not behave like a regular file. There are several ways to safely reclaim space:<br />
<br />
* Delete the second disk and put back an empty disk. The warrior should reformat the second disk.<br />
* Delete the entire warrior application and re-import it.<br />
* Use the [http://intgat.tigress.co.uk/rmy/uml/index.html zerofree] program and then clone the disk image. Reattach the cloned disk image.<br />
<br />
=== The item I'm working on is downloading thousands of URLs and it's taking hours. ===<br />
<br />
Please notify us in the appropriate [[IRC]] channel. You may need to reboot the warrior.<br />
<br />
=== Why is the default project not working? / Why is a manual project not in the warrior yet? ===<br />
<br />
Sorry. Sometimes the administrators are too busy...<br />
<br />
=== Why are there no projects? ===<br />
<br />
We finished the ones we were working on! If there are no projects showing, you can [[Dev|help us write one]]. No projects does ''not'' mean there is nothing left to archive!<br />
<br />
=== The instructions to run the software/scripts are awful and they are difficult to set up. ===<br />
<br />
Well, excuuuuse me, princess!<br />
<br />
We're not a professional support team so help us help you help us all. See above for [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|bug reports]], [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|suggestions]], or [[#I.27d_like_to_help_write_code._Where_can_I_find_more_info.3F|code contributions]].<br />
<br />
=== Where can I file a bug, suggestion, or a feature request? ===<br />
<br />
If the issue is related to the warrior's web interface or the library that grab scripts are using, see [https://github.com/ArchiveTeam/seesaw-kit/issues seesaw-kit issues]. Other issues should be filed into their own [[Dev/Source_Code|repositories]].<br />
<br />
== Projects ==<br />
<br />
See [[Warrior projects]].<br />
<br />
== Are you a coder? ==<br />
<br />
Like the warrior? Interested in how it works under the hood? Got software skills? '''[[Dev|Help us improve it!]]'''<br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=ArchiveTeam_Warrior&diff=42420ArchiveTeam Warrior2019-12-09T15:06:04Z<p>Jrwr: Adding Docker Image to the main sections</p>
<hr />
<div>==What is the Archive Team Warrior?==<br />
<br />
[[Image:Archive_team.png|100px|left]]<br />
[[Image:Warrior-vm-screenshot.png||256px|right]]<br />
[[Image:Warrior-web-screenshot.png|256px|right]]<br />
[[File:Archiveteam_warrior_infrastructure.png|thumb|right|256px|[[Dev/Infrastructure|Warrior infastructure]]]]<br />
<br />
The Archive Team Warrior is a virtual archiving appliance. You can run it to help with the ArchiveTeam archiving efforts. It will download sites and upload them to our archive — and it’s really easy to do!<br />
<br />
The warrior is a virtual machine, so there is no risk to your computer. The warrior will only use your bandwidth and some of your disk space. It will get tasks from and report progress to the [[Tracker]].<br />
<br />
== Basic usage ==<br />
<br />
The warrior runs on Windows, macOS, and Linux using a virtual machine. You'll need:<br />
<br />
* [https://warriorhq.archiveteam.org/downloads/warrior3/ Warrior Appliance] (300MB) - Download mirrors: [https://www.syping.de/archiveteam/ #1 (de)] [https://archive.org/details/archiveteam-warrior-v3-20171013 #2 (IA)]<br />
Plus one of the virtualization applications below to run it:<br />
* [Docker Image https://hub.docker.com/r/archiveteam/warrior-dockerfile/]<br />
* [https://www.virtualbox.org/ VirtualBox] (recommended to [[#Beta version|use the beta version of the warrior]]) <br />
* [https://www.vmware.com/products/player/ VMware workstation/player] (free-gratis for personal use)<br />
* [[#Alternative virtual machines|See below for alternative virtual machines]]<br />
<br />
=== Quick start instructions for VirtualBox ===<br />
<br />
# Download the appliance from the link above.<br />
# Launch VirtualBox<br />
# In VirtualBox, click File > Import Appliance and open the file.<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit http://localhost:8001/<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
=== Start instructions for VMWare Player ===<br />
<br />
# Download the appliance from the link above<br />
# Launch VMWare Player<br />
# In Player on the right, click "Open Virtual Machine", open the file and import the virtual machine.<br />
# (Optional) Select the virtual machine and click "Edit virtual machine settings".<br />
#* Select Network Adapter and set it to "Bridged: Connected directly to the physical network"<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit the address that is shown on the bottom (e.g. http://192.168.0.100:8001/)<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
<br />
__TOC__<br />
<br />
== Beta version ==<br />
<br />
Help us test the new version of the appliance available at https://warriorhq.archiveteam.org/downloads/warrior3/. Report any issues or feedback on [[IRC|#warrior on EFnet]].<br />
<br />
This version includes updated internal components that allow us to run newer and improved software. Specifically, it runs the warrior code within a Docker container.<br />
<br />
== Alternative virtual machines ==<br />
<br />
Thanks to user-effort, there are alternatives:<br />
<br />
* [https://www.docker.io/ Docker] (Linux)<br />
** [https://hub.docker.com/r/archiveteam/warrior-dockerfile/ official dockerfile] ([https://github.com/ArchiveTeam/warrior-dockerfile repository])<br />
** [https://hub.docker.com/r/infrequent/at-as-dockerfile modified dockerfile - for manual script execution]<br />
<br />
* [https://www.microsoft.com/en-us/server-cloud/solutions/virtualization.aspx Hyper-V] (Windows 8 Professional)<br />
** ([http://jonimoose.net/2013/archiveteam-warrior-on-hyper-v/ Hyper-V virtual machine])<br />
<br />
Please note that these alternatives are not in widespread use by our warriors, so we may not be able to help with either issues or advanced usage.<br />
<br />
== Warrior FAQ ==<br />
<br />
=== Why a virtual machine in the first place? ===<br />
<br />
The virtual machine is a quick, safe, and easy way for newcomers to help us out. It offers many features:<br />
<br />
* Graphical interface<br />
* Automatically selects which project is important to run<br />
* Self-updating software infrastructure<br />
* Allows for unattended use<br />
* In case of software faults, your machine is not ruined<br />
* Restarts itself in case of runaway programs<br />
* Runs on Windows, Mac, and Linux painlessly<br />
* Ensures consistency in the archived data regardless of your machine's quirks<br />
<br />
If you have suggestions for improving this system, please talk to us as described below.<br />
<br />
=== Can I use whatever internet access for the warrior? ===<br />
<br />
No. We need "clean" connections. Please ensure the following:<br />
<br />
* No OpenDNS. No ISP DNS that redirects to a search page. Use non-captive DNS servers.<br />
* No ISP connections that inject advertisements into web pages.<br />
* No proxies. Proxies can return bad data. The original HTTP headers and IP address are needed for the WARC file.<br />
* No content-filtering firewalls.<br />
* No censorship. If you believe your country implements censorship, do not run a warrior. <br />
* No Tor. The server may return an error page instead of content if they ban exit nodes.<br />
* No free cafe wifi. Archiving your cafe's wifi service agreement repeatedly is not helpful.<br />
* No VPNs. Data integrity is a very high priority for the Archive Team so use of VPNs with the official crawler is discouraged.<br />
* We prefer connections from many public IP addresses if possible. (For example, if your apartment building uses a single IP address, we don't want your apartment banned.)<br />
<br />
=== I turned my warrior VM appliance off. Will those tasks be lost? ===<br />
<br />
If you've killed your warrior VM instance, then the work your warrior did has been lost. However, the tasks will be returned to the pool after a period of time, and other warriors may claim them. If you want, you can alert the admins via [[IRC]] of what's happened and they can clear the claims your username may have made. but this isn't very important on most projects.<br />
<br />
=== I closed my browser or tab with the warrior's web interface. Will those tasks be lost? ===<br />
<br />
No. The web browser interface just provides a user interface to the warrior. As long as the VM is not stopped, it will continue normally.<br />
<br />
=== I need to disconnect my internet / reboot my PC. How can I do this without losing work? ===<br />
<br />
If you pause/suspend the warrior instance, most projects will allow resuming of work in progress when you unsuspend the warrior instance.<br />
<br />
If you decide to use the suspend feature, please note that if you keep it suspended for too long (more than a few hours), the administrators will assume that the item is lost and re-queue it. Using the suspend feature so that you can reboot your computer is perfectly fine.<br />
<br />
=== How much disk space will the warrior use? ===<br />
<br />
Short answer: it depends on the project. (But never more than 60GB.)<br />
<br />
Long answer: because each project defines items differently, sizes may vary. A single task may be a small file or a whole subsection of a website. The virtual machine is configured by default to use an absolute maximum of 60GB. Any unused virtual machine disk space is not used on the host computer. You may run the virtual machine on less than 60GB if you like to live dangerously. We're downloading the internet, after all!<br />
<br />
=== How can I log in to the virtual machine? ===<br />
<br />
Unless you know what you are doing, you should not need to do this. But, if you want to, the username is <code>root</code> and the password is <code>archiveteam</code>. Once logged in as root, you can execute <code>sudo -u warrior -i</code> to log in as the warrior user. <br />
<br />
Press ALT+F3 to switch to virtual console number 3. Use ALT+Left or ALT+Right to switch between virtual consoles. There are 6 virtual consoles in total. Consoles 1 and 2 are reserved for the warrior.<br />
<br />
=== How can I run multiple virtual machines at the same time? ===<br />
<br />
You'll need to adjust the networking settings.<br />
<br />
In VirtualBox, select a virtual machine and open up Settings → Network → Adapter 1 → Port Forwarding. You need to adjust the host port. For example, set your table to TCP | 127.0.0.1 | 8123 | | 8001. This maps port 8123 on the host machine (your computer) to port 8001 on the virtual machine (the warrior), and you can then access the warrior's web interface from port 8123 in your browser.<br />
<br />
Each VM you want to access should have a different host port. Do not use port numbers below 1024 unless you know what you are doing.<br />
<br />
VMWare installations should be using bridged networking. However, if you want, you can switch to NAT (under Settings → Hardware → Virtual Network Adapter) and click Edit to set up port forwarding. On Linux, you can also use lines like <code>8123 = 192.168.0.100:8001</code> in the <code>[incomingtcp]</code> section of nat.conf. (Make sure the VM IP is correct!)<br />
<br />
=== How can I run the virtual machine headlessly (without leaving a window open)? ===<br />
<br />
From the VirtualBox GUI, after opening the VM, click Machine > Detach GUI. You can then close the VirtualBox Manager window.<br />
<br />
For the VirtualBox CLI, use this command:<br />
<br />
<pre>vboxmanage startvm archiveteam-warrior-2 --type headless</pre><br />
<br />
Shut down the VM with:<br />
<br />
<pre>vboxmanage controlvm archiveteam-warrior-2 acpipowerbutton</pre><br />
<br />
Substituting <code>suspend</code> or <code>resume</code> for <code>acpipowerbutton</code> suspends or resumes the VM. For more information, consult [http://www.virtualbox.org/manual/ch08.html#vboxmanage-startvm the VirtualBox manual (Chapter 8, Sections 12 and 13)].<br />
<br />
For the VMWare CLI, use this command:<br />
<br />
<pre>vmrun start <path to vmx file> nogui</pre><br />
<br />
Shut down with:<br />
<br />
<pre>vmrun stop <path to vmx file> soft</pre><br />
<br />
Substituting <code>suspend</code> for <code>stop</code> suspends the VM. Resume with <code>start</code> again. For more information, including the paths to VMX files on different operating systems, consult [http://www.vmware.com/pdf/vix180_vmrun_command.pdf Using vmrun to Control Virtual Machines] (PDF), pages 10 and 11.<br />
<br />
=== How can I set up the virtual machine as a system service (so that it starts up on boot and shuts down automatically)? ===<br />
<br />
If you are using VirtualBox and running a Linux distribution that uses the systemd init system (like most recent releases), you can follow the short instructions on [http://www.ericerfanian.com/automatically-starting-virtualbox-vms-on-archlinux-using-systemd/ this page]. (The page title specifies Arch Linux, but this will work for other distros as long as they run systemd.)<br />
<br />
=== How can I set up the virtual machine with directly-bridged networking instead of NAT? ===<br />
<br />
On VirtualBox, use these commands:<br />
<br />
<pre>vboxmanage modifyvm archiveteam-warrior-2 --nic1 bridged<br />
vboxmanage modifyvm archiveteam-warrior-2 --bridgeadapter1 eth0</pre><br />
<br />
We presume you want to bind to <code>eth0</code>. Adjust as required. :)<br />
<br />
VMWare installations should already be using bridged networking.<br />
<br />
=== How can I run the warrior without a virtual machine? (The VM has too much overhead for a VPS!) ===<br />
<br />
One option is running a Docker container (see [[#Alternative_virtual_machines|above]]). Docker is based on LXC, and the overhead is far less than running a full VM. If you plan on running the [https://github.com/ArchiveTeam/warrior-dockerfile warrior-dockerfile], make sure to publish the port to allow access to the web interface:<br />
<br />
<pre>docker run -d -p 8001:8001 archiveteam/warrior-dockerfile</pre><br />
<br />
This creates a direct port mapping. For host port 38001 to container port 8001, use <code>38001:8001</code>. Adjust as required. :P<br />
<br />
(Multiple projects can be also run in isolated environments (containers) for rapid deployment using [https://hub.docker.com/r/infrequent/at-as-dockerfile at-as-dockerfile].)<br />
<br />
Another alternative is '''running the project manually.''' If you are managing a VPS, it's likely you are comfortable with some Linux stuff. Consult the project wiki page or the source code repository readme file.<br />
<br />
=== How can I run tons of warriors easily? ===<br />
<br />
We assume you've checked with the current ArchiveTeam project what concurrency and resources are needed or useful!<br />
<br />
Whether your have your own virtual cluster or you're renting someone else's (aka a "[https://fsfe.org/activities/nocloud/ cloud]"), you probably need some [[wikipedia:Category:Orchestration_software|orchestration software]].<br />
<br />
ArchiveTeam volunteers have successfully used a variety of hosting providers and tools (including free trials on AWS and GCE), often just by building their own flavour of virtual server and then repeating it with simple [https://cloudinit.readthedocs.io/ cloud-init] scripts (to install and launch docker as above) or whatever tool the hosting provides. If you desire full automation, the [https://gitlab.com/diggan/archiveteam-infra archiveteam-infra repository by diggan] helps with [[wikipedia:Terraform (software)|Terraform]] on [[wikipedia:DigitalOcean|DigitalOcean]].<br />
<br />
Some custom monitoring scripts also exist, for instance [https://github.com/general-programming/gp-archiveteam-bs/blob/master/tumblr/watcher.py watcher.py].<br />
<br />
=== I'm looking at the leaderboard. What's that icon beside the username? ===<br />
<br />
That's just the warrior logo: [[File:Archive_team.png|42px]] (click on the image for a larger version). It means that that person is using the warrior. Those without the icon are running the scripts manually.<br />
<br />
[[Image:Archiveteam-warrior-sticker.png|256px|right]]<br />
<br />
=== What's that guy doing in the logo? ===<br />
<br />
The place is on fire! But don't worry, he safely escaped with the rescued data in his arms.<br />
<br />
=== That’s awesome – can I slap this logo on my laptop to show my Internet-preservation pride? ===<br />
<br />
[http://www.redbubble.com/people/ajhajh/works/12857655-archive-team-warrior-stickers?p=sticker You sure can!] The ArchiveTeam Warrior laptop sticker can start conversations about archiving, if you’re into that.<br />
<br />
=== I'd like to help write code or I want to tweak the scripts to run to my liking. Where can I find more info? Where is the source code and repository? ===<br />
<br />
Check out the [[Dev]] documentation for details on the infrastructure and details of the source code layout.<br />
<br />
=== I still have a question! ===<br />
<br />
Check out the [[Frequently Asked Questions|general FAQ page]]. Talk to us on [[IRC]]. Use [irc://irc.efnet.org/warrior #warrior] for specific warrior questions or [irc://irc.efnet.org/archiveteam #archiveteam] for general questions.<br />
<br />
== Troubleshooting ==<br />
<br />
=== I'm getting errors when I try to launch the VM. ===<br />
<br />
If you are receiving <code>Breakpoint has been reached (0x80000003)</code>, <code>A critical error has occurred while running the virtual machine and the machine execution has been stopped.</code>, or VT-X errors, you probably do not have virtualization enabled, either because it is turned off in your computer's BIOS or your CPU does not support it.<br />
<br />
You can check CPU support on Linux with <code>cat /proc/cpuinfo | grep "(vmx|svm)" | uniq</code>. If there is a line of output starting with "flags", your processor supports virtualization; if there is no output, it does not. You can check whether virtualization is enabled in the BIOS using the <code>rdmsr</code> utility in your distro's <code>msr-tools</code> package.<br />
<br />
You can check support and BIOS status on Windows using [https://www.microsoft.com/en-us/download/details.aspx?id=592 Microsoft's Hardware-Assisted Virtualization Detection Tool] or [http://openlibsys.org/index-ja.html VirtualChecker].<br />
<br />
To enable virtualization on a CPU with support, reboot the computer and enter the BIOS. The virtualization setting is usually under something like 'CPU configuration' or 'advanced settings'.<br />
<br />
=== I just imported the ova image and the warrior is stuck on "Preparing the data partition". ===<br />
<br />
This issue has cropped up before, and we do not know what causes it. We recommend you delete the warrior image and import the ova again. Testing shows that such a reimport works in the majority of cases.<br />
<br />
=== I can't connect to localhost. ===<br />
<br />
The application is configured to set up port forwarding to the guest machine, and you should be able to access the interface through your web browser at port 8001. If this does not happen, and isn't resolved by rebooting the warrior (using the ACPI power signals, not suspend/save state and resume), you may need to double-check your machine's network settings (as described [[#How_can_I_run_multiple_virtual_machines_at_the_same_time.3F|above]]).<br />
<br />
=== The warrior can't connect to the internet. ===<br />
<br />
It's possible that the virtual machine has picked up the address of the local DNS cache on your computer, which the virtual machine does not have access to. <br />
<br />
If you experience this on VirtualBox, see [http://askubuntu.com/questions/204953/virtualbox-dns-stopped-working-on-upgrade-to-12-10 this question and answer]. Additionally, check to see if "Cable Connected" is unchecked in the advanced settings of the virtual adapter, under the network tab in the virtual machine's settings. Check it if it's unchecked, then save your settings.<br />
<br />
=== I see a message that no item was received. ===<br />
<br />
This means that there is no work available. This can happen for several reasons:<br />
<br />
* The project has just finished and someone is inspecting the work done. If a problem is discovered, items may be re-queued and more work will become available.<br />
* You have checked out/claimed too many items. Reduce your concurrency and let others do some of the work too.<br />
* In a rare case, you have been banned by a tracker administrator because there was a problem with your work: you were requesting too much, you were tampering with the scripts, a malfunction has occurred, or your internet connection is "unclean" (see [[#Can_I_use_whatever_internet_access_for_the_warrior.3F|above]]).<br />
<br />
=== I see a message about rate limiting. ===<br />
<br />
Don't worry. Keep in mind that although downloading the internet for fun and digital preservation are the primary goals of all Archive Team activities, serious stress on the target's server may occur. The rate limit is imposed by a [[Tracker#People|tracker administrator]] and should not be subverted.<br />
<br />
(In other words, we don't want to DDoS the servers.)<br />
<br />
If you like, you can switch to another [[Warrior projects|project]] with less load.<br />
<br />
=== I see a message about code being out of date. ===<br />
<br />
Don't worry. There is a new update ready. You do not need to do anything about this; the warrior will update its code every hour. If you are impatient, please reboot the warrior and it will download the latest code and resume work.<br />
<br />
=== I'm running the scripts manually and I see a message about code being out of date. ===<br />
<br />
This happens when a bug in the scripts is discovered. Bugs are unavoidable, especially when the server is out of our control.<br />
<br />
Try the <code>--auto-update</code> option available in Seesaw version 0.8. However, please be aware that you are now executing code automatically. Be sure to run the scripts in a separate user account for safety.<br />
<br />
=== I see messages about rsync errors. ===<br />
<br />
Uh-oh! Something is not right. Please notify us immediately in the appropriate [[IRC]] channel.<br />
<br />
=== I told the warrior to shut down from the interface, but nothing has changed. ===<br />
<br />
The warrior will attempt to finish the current running tasks before shutting down. If you need to shut down right away, go ahead. Your progress will be lost, but the jobs will eventually cycle out to another user.<br />
<br />
=== The warrior is eating all my bandwidth! ===<br />
<br />
On VirtualBox (relatively recent versions), use this command:<br />
<br />
<pre>vboxmanage bandwidthctl archiveteam-warrior-3 add limit --type network --limit 3m</pre><br />
<br />
This will limit the warrior to 3Mb/s. (Limit units are <code>k</code> for kilobit, <code>m</code> for megabit, <code>g</code> for gigabit, <code>K</code> for kilobyte, <code>M</code> for megabyte, and <code>G</code> for gigabyte.) Adjust as required. :)<br />
<br />
In the latest version of VirtualBox on Windows, the syntax appears to have changed. The correct command now seems to be:<br />
<br />
<pre>VBoxManage bandwidthctl archiveteam-warrior-3 add netlimit --type network --limit 3</pre><br />
<br />
For more information, consult [http://www.virtualbox.org/manual/ch06.html#network_bandwidth_limit the VirtualBox manual (Chapter 6, Section 9)].<br />
<br />
On VMWare (versions 9 and above), select a virtual machine and open Settings → Hardware → Virtual Network Adapter → Advanced. You can set a bandwidth limit here.<br />
<br />
=== The warrior is using up disk space, even though it's not running a project! ===<br />
<br />
Virtual machine disk images do not behave like a regular file. There are several ways to safely reclaim space:<br />
<br />
* Delete the second disk and put back an empty disk. The warrior should reformat the second disk.<br />
* Delete the entire warrior application and re-import it.<br />
* Use the [http://intgat.tigress.co.uk/rmy/uml/index.html zerofree] program and then clone the disk image. Reattach the cloned disk image.<br />
<br />
=== The item I'm working on is downloading thousands of URLs and it's taking hours. ===<br />
<br />
Please notify us in the appropriate [[IRC]] channel. You may need to reboot the warrior.<br />
<br />
=== Why is the default project not working? / Why is a manual project not in the warrior yet? ===<br />
<br />
Sorry. Sometimes the administrators are too busy...<br />
<br />
=== Why are there no projects? ===<br />
<br />
We finished the ones we were working on! If there are no projects showing, you can [[Dev|help us write one]]. No projects does ''not'' mean there is nothing left to archive!<br />
<br />
=== The instructions to run the software/scripts are awful and they are difficult to set up. ===<br />
<br />
Well, excuuuuse me, princess!<br />
<br />
We're not a professional support team so help us help you help us all. See above for [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|bug reports]], [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|suggestions]], or [[#I.27d_like_to_help_write_code._Where_can_I_find_more_info.3F|code contributions]].<br />
<br />
=== Where can I file a bug, suggestion, or a feature request? ===<br />
<br />
If the issue is related to the warrior's web interface or the library that grab scripts are using, see [https://github.com/ArchiveTeam/seesaw-kit/issues seesaw-kit issues]. Other issues should be filed into their own [[Dev/Source_Code|repositories]].<br />
<br />
== Projects ==<br />
<br />
See [[Warrior projects]].<br />
<br />
== Are you a coder? ==<br />
<br />
Like the warrior? Interested in how it works under the hood? Got software skills? '''[[Dev|Help us improve it!]]'''<br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=File:The_Artist_Union-logo-20190626.PNG&diff=40883File:The Artist Union-logo-20190626.PNG2019-06-26T15:40:11Z<p>Jrwr: </p>
<hr />
<div></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=The_Artist_Union&diff=40882The Artist Union2019-06-26T15:12:43Z<p>Jrwr: </p>
<hr />
<div>{{Infobox project<br />
| title = The Artist Union<br />
| image = The_Artist_Union-20190626.PNG<br />
| description = <br />
| URL = https://theartistunion.com/<br />
| project_status = {{online}}<br />
| source = <br />
| archiving_status = {{upcoming}}<br />
| irc =<br />
}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=File:The_Artist_Union-20190626.PNG&diff=40881File:The Artist Union-20190626.PNG2019-06-26T15:12:16Z<p>Jrwr: </p>
<hr />
<div></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=The_Artist_Union&diff=40880The Artist Union2019-06-26T15:11:13Z<p>Jrwr: Created page with "{{Infobox project | title = The Artist Union | image = | description = | URL = https://theartistunion.com/ | project_status = {{online}} | source = | archiving_status = {{u..."</p>
<hr />
<div>{{Infobox project<br />
| title = The Artist Union<br />
| image = <br />
| description = <br />
| URL = https://theartistunion.com/<br />
| project_status = {{online}}<br />
| source = <br />
| archiving_status = {{upcoming}}<br />
| irc =<br />
}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Current_Projects&diff=40879Current Projects2019-06-26T15:08:50Z<p>Jrwr: /* Proposed projects */</p>
<hr />
<div>__NOTOC__<br />
== Archive Team recruiting ==<br />
* [[Dev|Want to code for Archive Team? Here's a starting point.]]<br />
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br><br />
* What's on: [http://tracker.archiveteam.org/ online tracker].<br><br />
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].--><br />
<br />
== Warrior-based projects ==<br />
{{:CurrentWarriorProject}}<br />
<br />
<!-- Urgent projects --><br />
<!-- Long-term projects --><br />
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.<br />
<br />
=== Scripts only ===<br />
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more news sites. '''IRC Channel {{IRC|newsgrabber}}'''.<br />
<br />
== Manual projects ==<br />
* [[Make Magazine]]: "EVERYTHING RELATED TO MAKE MAGAZINE. GET IT ALL. START IMMEDIATELY." ([[User:Jscott|SketchCow]], 2019-06-04) '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.<br />
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.<br />
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.<br />
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.<br />
<br />
== Active Projects Not Yet Ingesting ==<br />
<!-- Top priority: could disappear anytime now --><br />
<!-- Shutting down, definite deadline given --><br />
* [[Sketch]]: Sony doesn't seem to like their user's sketches. Shutting down 2019-09-30. '''IRC Channel {{IRC|SketchedOut}}'''.<br />
<!-- Other --><br />
* [[Reddit]]: Banning communities that generate bad PR for Reddit Inc. '''IRC Channel {{IRC|shreddit}}'''.<br />
<br />
== Proposed projects ==<br />
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). --><br />
<!-- Shutting down, vague deadline given --><br />
<!-- Shutting down, no deadline given --><br />
<!-- Archiving the archives --><br />
<!-- Misc. projects (unmaintained sites, distrust in owners) --><br />
* [[The Artist Union]]: Staff have gone dark for some time, this site is in danger of being lost to time.<br />
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.<br />
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums}}'''.<br />
* [[GitHub]]: Embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|getgit}}'''.<br />
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. '''IRC Channel {{IRC|imgone}}'''.<br />
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.<br />
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.<br />
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.<br />
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.<br />
<br />
== Recently finished projects ==<br />
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people --><br />
* [[Facepunch Forums]]: Contained ~33 million posts and shut down on 2019-06-12. '''IRC Channel {{IRC|faceplant}}'''.<br />
* [[YTMND]]: Shut down on 2019-05-12. Content and database were donated to Archive Team. '''IRC Channel TBD'''.<br />
* [[Google+]]: Google finally realised they failed. Shut down on 2019-04-02. Archive Team's largest grab to date with just short of 1.4 PiB ''(1424 TiB)'' saved. '''IRC Channel {{IRC|googleminus}}'''.<br />
* [[GeoCities Japan]]: It's GeoCities all over again... The Japanese version shut down on 2019-04-01. '''IRC Channel {{IRC|notagain}}'''.<br />
<br />
== Hiatus / Missed the Mark ==<br />
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr}}'''.<br />
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. '''IRC Channel {{IRC|tumbledown}}'''.<br />
* [[Textream]]: [[Yahoo!]] Japan has killed yet another platform... Large Japanese discussion forum went partially down in early 2019-01 (?). '''IRC Channel {{IRC|textreamer}}'''.<br />
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.<br />
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.<br />
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam}}'''.<br />
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.<br />
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).<br />
* [[The Escapist]]: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. '''IRC Channel TBD'''.<br />
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.<br />
<br />
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]] - New Official Discord Server: https://discord.gg/JDD5DKa</small></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Main_Page&diff=40878Main Page2019-06-26T13:31:44Z<p>Jrwr: Updated wording.</p>
<hr />
<div>__NOTOC__<br />
<center><br />
<!-- [[Image:Jasonappeal.png|center|link=Introduction]]--><br />
<table style="width:100%;border-spacing:8px;margin:12px 0px 0px 0px"><br />
<tr><td style="width:60%;border:1px solid #FFB9B9;background-color:#FFFFF0;vertical-align:top;color:#000"><br />
<table class="thumb" width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#FFFFF0;"><br />
<tr><td><br />
<td style="color:#000;text-align:left;vertical-align:top"><br />
<br />
=== HISTORY IS OUR FUTURE ===<br />
[[Image:Archiveteam.jpg|right|200px]]<br />
''And we've been trashing our history''<br />
<br />
Archive Team is a loose collective of rogue archivists, programmers, writers and loudmouths dedicated to saving our digital heritage. Since 2009 this variant force of nature has caught wind of shutdowns, shutoffs, mergers, and plain old deletions - and done our best to save the history before it's lost forever. Along the way, we've gotten attention, resistance, [[In_The_Media|press and discussion]], but most importantly, we've gotten the message out: '''IT DOESN'T HAVE TO BE THIS WAY'''.<br />
<br />
This website is intended to be an offloading point and information depot for a number of archiving projects, all related to saving websites or data that is in danger of being lost. Besides serving as a hub for team-based pulling down and mirroring of data, this site will provide advice on managing your own data and rescuing it from the brink of destruction.<br />
<!-- featured article ends --><br />
<br />
===Currently Active Projects (Get Involved Here!) ===<br />
{{:Current_Projects}}<br />
<br />
</td></tr><br />
</table><br />
<td style="width:40%;border:1px solid #cedff2;background-color:#f5faff;vertical-align:top"><br />
<table width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#f5faff"><br />
<tr><td><br />
[[Image:Archivetime.png]]<br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">What is What</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<!-- links starts --><br />
* [[Who We Are]] and how you can join our cause!<br />
<br />
* [[Deathwatch]] is where we keep track of sites that are sickly, dying or dead.<br />
<br />
* [[Fire Drill]] is where we keep track of sites that seem fine but a lot depends on them.<br />
<br />
* [[Projects]] is a comprehensive list of AT endeavors.<br />
<br />
* [[Philosophy]] describes the ideas underpinning our work.<br />
<br />
<!-- links ends --><br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Some Starting Points</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<br />
* [[Introduction|The Introduction]] is an overview of basic archiving methods.<br />
<br />
* [[Why Back Up?]] Because they don't care about you.<br />
<br />
* [[Facebook|Back Up your Facebook Data]] Learn how to liberate your personal data from Facebook.<br />
<br />
* [[Software]] will assist you in regaining control of your data by providing tools for information backup, archiving and distribution. <br />
<br />
* [[Formats]] will familiarize you with the various data formats, and how to ensure your files will be readable in the future.<br />
<br />
* [[Storage Media]] is about where to get it, what to get, and how to use it.<br />
<br />
* [[Recommended Reading]] links to others sites for further information.<br />
<br />
* [[Frequently Asked Questions]] is where we answer common questions.<br />
<br />
* [https://discord.gg/Crc6jNv Archive Team Discord server] is a great place to get help.<br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Quote of the Moment</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<tr><td style="margin:20;background-color:#000000;font-size:200%;font-weight:bold;border:1px solid #a3b0bf;text-align:center;color:#fff;" ><br />
"[Yahoo!] found the way to destroy <br />
the most massive amount of history<br />
in the shortest amount of time <br />
with absolutely no recourse"<br />
</td></tr><br />
<tr><td style="text-align:right"><br />
[http://www.time.com/time/business/article/0,8599,1936645,00.html Internet Atrocity! GeoCities' Demise Erases Web History] <br />
<br>By Dan Fletcher, TIME Magazine, Monday, Nov. 09, 2009<br />
</td></tr><br />
<tr><td><br />
<br />
=== In The Media ===<br />
{{:Main Page/In The Media}}<br />
<td></tr><br />
</table><br />
</td></tr><br />
</table><br />
'''Archive Team is in no way affiliated with the fine folks at [http://www.archive.org ARCHIVE.ORG]'''<br />
'''Archive Team can always be reached by e-mail at [mailto:archiveteam@archiveteam.org archiveteam@archiveteam.org] or by [[IRC]] at the {{IRC|archiveteam}} channel on EFnet.'''</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=INTERNETARCHIVE.BAK&diff=40877INTERNETARCHIVE.BAK2019-06-26T12:56:12Z<p>Jrwr: /* CONCERNS */</p>
<hr />
<div>[[Image:Ohreally.gif|right|frame|Backing up the Internet Archive]]<br />
The wonder of the [[Internet Archive]]'s petabytes of stored data is that they're a world treasure, providing access to a mass of information and stored culture, gathered from decades of history (in some case, centuries), and available in a (relatively) easy-to-find fashion. And as media and popular websites begin to cover the Archive's mission in earnest, the audience is growing notably. <br />
<br />
In each wave of interest, questions come forward out of the accolades: <br />
<br />
* Why is the Internet Archive only in one (actually, limited) physical space? <br />
* What is the disaster recovery plan? <br />
* What steps are being taken to ensure integrity and access?<br />
<br />
Some of the answers are essays in themselves, but regarding the protection of the Internet Archive's storehouses of data, a project has been launched to add some real-world information to the theoretical consideration of data protection.<br />
<br />
The '''INTERNETARCHIVE.BAK project''' (also known as '''IA.BAK''' or '''IABAK''') is a combined experiment and research project to back up the Internet Archive's data stores, utilizing zero infrastructure of the Archive itself (save for bandwidth used in download) and, along the way, gain real-world knowledge of what issues and considerations are involved with such a project. Started in April 2015, the project already has dozens of contributors and partners, and has resulted in a fairly robust environment backing up terabytes of the Archive in multiple locations around the world. <br />
<br />
''To see the current status of the project's data storage and to learn how you can contribute disk space and bandwidth, click [http://iabak.archiveteam.org here]''.<br />
<br />
== THE PHILOSOPHY ==<br />
<br />
The project's main goals include:<br />
<br />
* Maintaining multiple, verified, geographically-disparate copies of Internet Archive data<br />
* No use of Internet Archive infrastructure, that is, machines or drives (bandwidth just for download)<br />
* Keep at least 3 external copies in three different physical locations from the Archive.<br />
* Conduct bi-weekly verification that the data is secure in the external locations.<br />
* Expire or remove data that has not been verified after 30 days, replacing it with functional space.<br />
<br />
The project's secondary goals include:<br />
<br />
* Add ease of use to the end-user clients so the maximum amount of drive space contributors can participate.<br />
* Offer optional peer-to-peer data provision for both the main site's items and to speed synchronization.<br />
* Issue useful conclusions as to how the project is conducted.<br />
* Ultimately provide encrypted versions of some data so that internal/system data can be backed up too.<br />
<br />
The project rests on several assumptions:<br />
<br />
* Given an opportunity and good feedback, there are petabytes of volunteer disk space available<br />
* The Internet Archive will gain more awareness by the general public by this project<br />
* A non-homogenous environment for the data makes the data that much stronger and disaster-resistant<br />
* The project is an educational workshop as well as a good-faith effort, providing hard answers to theoretical questions.<br />
<br />
== WHAT WE HAVE LEARNED SO FAR (ABOUT THE DATA) ==<br />
<br />
To understand what might be involved in backing up a large set of data, information about that dataset needed to be researched.<br />
<br />
The project, known as the ''[[Internet_Archive_Census|Internet Archive Census]]'' resulted in some solid numbers, as well as a set of facts that helped nail down the scope of the project. They include:<br />
<br />
* The Internet Archive has roughly 21 petabytes of unique data at this juncture. (It grows daily.)<br />
* Some is not available for direct download by the general public, so IA.BAK is not addressing it (yet).<br />
* Some data is, by its nature, more "critical" or "important" than others. Unique acquired data versus, say, universally available datasets or mirrors of prominent and accessible-from-many-locations music videos.<br />
* A lot of the data — the vast, vast majority — is extremely static, and meant to live forever.<br />
* A lot of the files are "derives", and marked as such - files that were derived from other files.<br />
* The Internet Archive reserves the right to delete uploaded content.<br />
<br />
The census classified the total store of public-accessible, unique data as very roughly 14 petabytes. Of that data, there is some level of redundancy and there are collections that might be called "crown jewels" or treasures (the Prelinger Archives, the Bali Culture collection, collections of scanned books from partner libraries) while others are more "nice to have" (universally accessible podcasts or video blogs, multiple revisions of the same website backup).<br />
<br />
== WHAT WE HAVE DONE SO FAR (ABOUT THE IMPLEMENTATION) ==<br />
<br />
[[Image:gitannex.png|right]]<br />
<br />
There is now a channel, '''#internetarchive.bak''', on EFNet, for discussion about the project as well as bot-driven updates about code changes and new contributors. It is occasionally very active and mostly quiet in between new issues being handled. It is not required to use as a contributor of disk space, but is an excellent resource for questions.<br />
<br />
After multiple discussions, the back-end for this phase of this project is using the [http://git-annex.branchable.com/ git-annex] suite of tools. Reasons include the maturity of the project and the willing contribution of time by the git-annex code designer and maintainer, Joey Hess (also a co-founder of Archive Team). ''Other possible software suites are listed at the end of this Wiki entry and might play a part in future revisions of the project.''<br />
<br />
To read the git-annex overview and proposal, read here: '''[[INTERNETARCHIVE.BAK/git-annex_implementation]]'''<br />
<br />
To read the git-annex implementation documentation, read it here: '''[https://git-annex.branchable.com/design/iabackup/ https://git-annex.branchable.com/design/iabackup/]'''<br />
<br />
== CHOOSING WHICH DATA AT THE ARCHIVE TO BACK UP USING IA.BAK ==<br />
<br />
As space is relatively limited to provide to IA.BAK, the project has had a second task line of choosing which public-facing data at the Internet Archive to push into IA.BAK. Generally, the group is looking for:<br />
<br />
* Data unique enough that it is predominantly at the Internet Archive<br />
* Data that does not flood the capacity of the project, i.e. hundreds of Terabytes<br />
* Data that does not generally limit which countries can host it<br />
* Data that is generally smaller in size, yet still unique<br />
<br />
There is now a page to nominate sets of data at the Internet Archive that should be added to future shards:<br />
<br />
* [[INTERNETARCHIVE.BAK/nominations]]<br />
<br />
The project status page has methods for seeing what collections are now in the project, although it lacks simple search (yet).<br />
<br />
== KEEPING TRACK OF THE DOWNLOAD AND BACKUP PROGRESS ==<br />
[[File:iabakpage.png|300px|right]]<br />
<br />
The IA.BAK project has a [http://iabak.archiveteam.org/ page] that provides graphical overview of the progress of the project. Updated frequently, it shows total amount of space backed up, the status (red to green) of amount of backups of a given set of data, and timelines of how data is being acquired from the original sources. It also includes maps to show the geographical disparity of the clients, as well as how the clients are performing.<br />
<br />
It is a continual challenge, and an ongoing one, to make navigation of these pages intuitive and informative. As the dataset grows in size and complexity, major changes to the layout of the pages will continue.<br />
<br />
As with everything else, the infrastructure to maintain this page is completely separate from Internet Archive machines and resources.<br />
<br />
== CONCERNS ==<br />
<br />
Since the beginning, there have been a number of concerns voiced about the project, and while most can't be glibly dismissed, it is good to at least acknowledge them (as they tend to take the first minutes of a conversation about the project).<br />
<br />
* '''Bad Actors''' will always be a continued concern, as person or persons determined to prevent the backing up of data could execute endless actions to slow down, corrupt, or ruin their contributions of space.<br />
<br />
* '''The Great Restore''' is the time when data from IA.BAK must return to its home to handle a physical or software-based failure of the Internet Archive's data stores. (This could be anything from an earthquake, fibre line cut, or to the dropping of an EMP). A restoring would definitely involve the leasing of a large amount of upload bandwidth and some amount of physical transfer.<br />
<br />
== See Also and Additional Information ==<br />
<br />
Alternate proposed software suites for this project besides git-annex:<br />
<br />
* [[INTERNETARCHIVE.BAK/torrents_implementation]]<br />
* [[INTERNETARCHIVE.BAK/ipfs_implementation]]<br />
<br />
* [[Valhalla]] - Valhalla was a discussion about the "ultimate home" for uploaded Archive Team data, be it the Internet Archive, elsewhere, or both. IA.BAK is an example of a potential shared home, although Archive Team projects have not generally been backed up using IA.BAK, yet.<br />
<br />
__NOTOC__<br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Main_Page&diff=40876Main Page2019-06-26T12:49:03Z<p>Jrwr: I mucked up the word "Archive"</p>
<hr />
<div>__NOTOC__<br />
<center><br />
<!-- [[Image:Jasonappeal.png|center|link=Introduction]]--><br />
<table style="width:100%;border-spacing:8px;margin:12px 0px 0px 0px"><br />
<tr><td style="width:60%;border:1px solid #FFB9B9;background-color:#FFFFF0;vertical-align:top;color:#000"><br />
<table class="thumb" width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#FFFFF0;"><br />
<tr><td><br />
<td style="color:#000;text-align:left;vertical-align:top"><br />
<br />
=== HISTORY IS OUR FUTURE ===<br />
[[Image:Archiveteam.jpg|right|200px]]<br />
''And we've been trashing our history''<br />
<br />
Archive Team is a loose collective of rogue archivists, programmers, writers and loudmouths dedicated to saving our digital heritage. Since 2009 this variant force of nature has caught wind of shutdowns, shutoffs, mergers, and plain old deletions - and done our best to save the history before it's lost forever. Along the way, we've gotten attention, resistance, [[In_The_Media|press and discussion]], but most importantly, we've gotten the message out: '''IT DOESN'T HAVE TO BE THIS WAY'''.<br />
<br />
This website is intended to be an offloading point and information depot for a number of archiving projects, all related to saving websites or data that is in danger of being lost. Besides serving as a hub for team-based pulling down and mirroring of data, this site will provide advice on managing your own data and rescuing it from the brink of destruction.<br />
<!-- featured article ends --><br />
<br />
===Currently Active Projects (Get Involved Here!) ===<br />
{{:Current_Projects}}<br />
<br />
</td></tr><br />
</table><br />
<td style="width:40%;border:1px solid #cedff2;background-color:#f5faff;vertical-align:top"><br />
<table width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#f5faff"><br />
<tr><td><br />
[[Image:Archivetime.png]]<br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">What is What</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<!-- links starts --><br />
* [[Who We Are]] and how you can join our cause!<br />
<br />
* [[Deathwatch]] is where we keep track of sites that are sickly, dying or dead.<br />
<br />
* [[Fire Drill]] is where we keep track of sites that seem fine but a lot depends on them.<br />
<br />
* [[Projects]] is a comprehensive list of AT endeavors.<br />
<br />
* [[Philosophy]] describes the ideas underpinning our work.<br />
<br />
<!-- links ends --><br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Some Starting Points</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<br />
* [[Introduction|The Introduction]] is an overview of basic archiving methods.<br />
<br />
* [[Why Back Up?]] Because they don't care about you.<br />
<br />
* [[Facebook|Back Up your Facebook Data]] Learn how to liberate your personal data from Facebook.<br />
<br />
* [[Software]] will assist you in regaining control of your data by providing tools for information backup, archiving and distribution. <br />
<br />
* [[Formats]] will familiarize you with the various data formats, and how to ensure your files will be readable in the future.<br />
<br />
* [[Storage Media]] is about where to get it, what to get, and how to use it.<br />
<br />
* [[Recommended Reading]] links to others sites for further information.<br />
<br />
* [[Frequently Asked Questions]] is where we answer common questions.<br />
<br />
* [https://discord.gg/JDD5DKa Archive Team Discord server] is a great place to get help.<br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Quote of the Moment</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<tr><td style="margin:20;background-color:#000000;font-size:200%;font-weight:bold;border:1px solid #a3b0bf;text-align:center;color:#fff;" ><br />
"[Yahoo!] found the way to destroy <br />
the most massive amount of history<br />
in the shortest amount of time <br />
with absolutely no recourse"<br />
</td></tr><br />
<tr><td style="text-align:right"><br />
[http://www.time.com/time/business/article/0,8599,1936645,00.html Internet Atrocity! GeoCities' Demise Erases Web History] <br />
<br>By Dan Fletcher, TIME Magazine, Monday, Nov. 09, 2009<br />
</td></tr><br />
<tr><td><br />
<br />
=== In The Media ===<br />
{{:Main Page/In The Media}}<br />
<td></tr><br />
</table><br />
</td></tr><br />
</table><br />
'''Archive Team is in no way affiliated with the fine folks at [http://www.archive.org ARCHIVE.ORG]'''<br />
'''Archive Team can always be reached by e-mail at [mailto:archiveteam@archiveteam.org archiveteam@archiveteam.org] or by [[IRC]] at the {{IRC|archiveteam}} channel on EFnet.'''</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Main_Page&diff=40875Main Page2019-06-26T12:48:00Z<p>Jrwr: Fixed Spelling of familiarize</p>
<hr />
<div>__NOTOC__<br />
<center><br />
<!-- [[Image:Jasonappeal.png|center|link=Introduction]]--><br />
<table style="width:100%;border-spacing:8px;margin:12px 0px 0px 0px"><br />
<tr><td style="width:60%;border:1px solid #FFB9B9;background-color:#FFFFF0;vertical-align:top;color:#000"><br />
<table class="thumb" width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#FFFFF0;"><br />
<tr><td><br />
<td style="color:#000;text-align:left;vertical-align:top"><br />
<br />
=== HISTORY IS OUR FUTURE ===<br />
[[Image:Archiveteam.jpg|right|200px]]<br />
''And we've been trashing our history''<br />
<br />
Archive Team is a loose collective of rogue archivists, programmers, writers and loudmouths dedicated to saving our digital heritage. Since 2009 this variant force of nature has caught wind of shutdowns, shutoffs, mergers, and plain old deletions - and done our best to save the history before it's lost forever. Along the way, we've gotten attention, resistance, [[In_The_Media|press and discussion]], but most importantly, we've gotten the message out: '''IT DOESN'T HAVE TO BE THIS WAY'''.<br />
<br />
This website is intended to be an offloading point and information depot for a number of archiving projects, all related to saving websites or data that is in danger of being lost. Besides serving as a hub for team-based pulling down and mirroring of data, this site will provide advice on managing your own data and rescuing it from the brink of destruction.<br />
<!-- featured article ends --><br />
<br />
===Currently Active Projects (Get Involved Here!) ===<br />
{{:Current_Projects}}<br />
<br />
</td></tr><br />
</table><br />
<td style="width:40%;border:1px solid #cedff2;background-color:#f5faff;vertical-align:top"><br />
<table width="100%" cellpadding="2" cellspacing="5" style="vertical-align:top;background-color:#f5faff"><br />
<tr><td><br />
[[Image:Archivetime.png]]<br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">What is What</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<!-- links starts --><br />
* [[Who We Are]] and how you can join our cause!<br />
<br />
* [[Deathwatch]] is where we keep track of sites that are sickly, dying or dead.<br />
<br />
* [[Fire Drill]] is where we keep track of sites that seem fine but a lot depends on them.<br />
<br />
* [[Projects]] is a comprehensive list of AT endeavors.<br />
<br />
* [[Philosophy]] describes the ideas underpinning our work.<br />
<br />
<!-- links ends --><br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Some Starting Points</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<br />
* [[Introduction|The Introduction]] is an overview of basic archiving methods.<br />
<br />
* [[Why Back Up?]] Because they don't care about you.<br />
<br />
* [[Facebook|Back Up your Facebook Data]] Learn how to liberate your personal data from Facebook.<br />
<br />
* [[Software]] will assist you in regaining control of your data by providing tools for information backup, archiving and distribution. <br />
<br />
* [[Formats]] will familiarize you with the various data formats, and how to ensure your files will be readable in the future.<br />
<br />
* [[Storage Media]] is about where to get it, what to get, and how to use it.<br />
<br />
* [[Recommended Reading]] links to others sites for further information.<br />
<br />
* [[Frequently Asked Questions]] is where we answer common questions.<br />
<br />
* [https://discord.gg/JDD5DKa|Archive Team Discord server] is a great place to get help.<br />
</td></tr><br />
<tr><th><br />
<h2 style="margin:0;background:#cedff2;font-size:120%;font-weight:bold;border:1px solid #a3b0bf;text-align:left;color:#000;padding:0.2em 0.4em;">Quote of the Moment</h2><br />
</th></tr><br />
<tr><td style="color:#000"><br />
<tr><td style="margin:20;background-color:#000000;font-size:200%;font-weight:bold;border:1px solid #a3b0bf;text-align:center;color:#fff;" ><br />
"[Yahoo!] found the way to destroy <br />
the most massive amount of history<br />
in the shortest amount of time <br />
with absolutely no recourse"<br />
</td></tr><br />
<tr><td style="text-align:right"><br />
[http://www.time.com/time/business/article/0,8599,1936645,00.html Internet Atrocity! GeoCities' Demise Erases Web History] <br />
<br>By Dan Fletcher, TIME Magazine, Monday, Nov. 09, 2009<br />
</td></tr><br />
<tr><td><br />
<br />
=== In The Media ===<br />
{{:Main Page/In The Media}}<br />
<td></tr><br />
</table><br />
</td></tr><br />
</table><br />
'''Archive Team is in no way affiliated with the fine folks at [http://www.archive.org ARCHIVE.ORG]'''<br />
'''Archive Team can always be reached by e-mail at [mailto:archiveteam@archiveteam.org archiveteam@archiveteam.org] or by [[IRC]] at the {{IRC|archiveteam}} channel on EFnet.'''</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Current_Projects&diff=40874Current Projects2019-06-26T12:44:02Z<p>Jrwr: </p>
<hr />
<div>__NOTOC__<br />
== Archive Team recruiting ==<br />
* [[Dev|Want to code for Archive Team? Here's a starting point.]]<br />
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br><br />
* What's on: [http://tracker.archiveteam.org/ online tracker].<br><br />
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].--><br />
<br />
== Warrior-based projects ==<br />
{{:CurrentWarriorProject}}<br />
<br />
<!-- Urgent projects --><br />
<!-- Long-term projects --><br />
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.<br />
<br />
=== Scripts only ===<br />
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more news sites. '''IRC Channel {{IRC|newsgrabber}}'''.<br />
<br />
== Manual projects ==<br />
* [[Make Magazine]]: "EVERYTHING RELATED TO MAKE MAGAZINE. GET IT ALL. START IMMEDIATELY." ([[User:Jscott|SketchCow]], 2019-06-04) '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.<br />
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.<br />
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.<br />
* [[WikiTeam]]: Saving wikis dumps (XML). And their external links for the Wayback Machine (WARC) as well as exporting MediaWiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.<br />
<br />
== Active Projects Not Yet Ingesting ==<br />
<!-- Top priority: could disappear anytime now --><br />
<!-- Shutting down, definite deadline given --><br />
* [[Sketch]]: Sony doesn't seem to like their user's sketches. Shutting down 2019-09-30. '''IRC Channel {{IRC|SketchedOut}}'''.<br />
<!-- Other --><br />
* [[Reddit]]: Banning communities that generate bad PR for Reddit Inc. '''IRC Channel {{IRC|shreddit}}'''.<br />
<br />
== Proposed projects ==<br />
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). --><br />
<!-- Shutting down, vague deadline given --><br />
<!-- Shutting down, no deadline given --><br />
<!-- Archiving the archives --><br />
<!-- Misc. projects (unmaintained sites, distrust in owners) --><br />
* [[Angelfire]]: Angelfire is a web hosting service that contains big chunks of early WWW history and has no proper backup. '''IRC Channel {{IRC|angelonfire}}'''.<br />
* [[JamiiForums]]: the Tanzanian government would like this gone. '''IRC Channel {{IRC|jammedforums}}'''.<br />
* [[GitHub]]: Embraced-uh, I mean, bought by Microsoft. '''IRC Channel {{IRC|getgit}}'''.<br />
* [[Imgur]]: Image hoster decided that using it for hosting images is not permitted. '''IRC Channel {{IRC|imgone}}'''.<br />
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.<br />
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.<br />
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.<br />
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.<br />
<br />
== Recently finished projects ==<br />
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people --><br />
* [[Facepunch Forums]]: Contained ~33 million posts and shut down on 2019-06-12. '''IRC Channel {{IRC|faceplant}}'''.<br />
* [[YTMND]]: Shut down on 2019-05-12. Content and database were donated to Archive Team. '''IRC Channel TBD'''.<br />
* [[Google+]]: Google finally realised they failed. Shut down on 2019-04-02. Archive Team's largest grab to date with just short of 1.4 PiB ''(1424 TiB)'' saved. '''IRC Channel {{IRC|googleminus}}'''.<br />
* [[GeoCities Japan]]: It's GeoCities all over again... The Japanese version shut down on 2019-04-01. '''IRC Channel {{IRC|notagain}}'''.<br />
<br />
== Hiatus / Missed the Mark ==<br />
* [[Flickr]]: <s>[[Yahoo!]]</s> SmugMug decided to kill it after finding Yahoo!'s plans to do so before they were bought by Verizon. '''IRC Channel {{IRC|flickrfckr}}'''.<br />
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired and Verizon declared war on NSFW blogs. '''IRC Channel {{IRC|tumbledown}}'''.<br />
* [[Textream]]: [[Yahoo!]] Japan has killed yet another platform... Large Japanese discussion forum went partially down in early 2019-01 (?). '''IRC Channel {{IRC|textreamer}}'''.<br />
* [[Google News Archive]]: Let's store all newspapers at Google, WCGW? '''IRC Channel {{IRC|papersplease}}'''.<br />
* [[Quizlet]]: Flashcards and other learning tools '''IRC Channel {{IRC|quizletusin}}'''.<br />
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam}}'''.<br />
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''. THIS PROJECT IS ON HIATUS AND WILL BE RETURNED TO AS AUDIT2018.<br />
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07).<br />
* [[The Escapist]]: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. '''IRC Channel TBD'''.<br />
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.<br />
<br />
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]] - New Official Discord Server: https://discord.gg/JDD5DKa</small></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=ArchiveTeam_Warrior&diff=30293ArchiveTeam Warrior2018-01-30T20:59:24Z<p>Jrwr: </p>
<hr />
<div>==What is the Archive Team Warrior?==<br />
<br />
[[Image:Archive_team.png|100px|left]]<br />
[[Image:Warrior-vm-screenshot.png||256px|right]]<br />
[[Image:Warrior-web-screenshot.png|256px|right]]<br />
<br />
The Archive Team Warrior is a virtual archiving appliance. You can run it to help with the ArchiveTeam archiving efforts. It will download sites and upload them to our archive — and it’s really easy to do!<br />
<br />
The warrior is a virtual machine, so there is no risk to your computer. The warrior will only use your bandwidth and some of your disk space. It will get tasks from and report progress to the [[Tracker]].<br />
<br />
== Basic usage ==<br />
<br />
The warrior runs on Windows, OS X and Linux using a virtual machine. You'll need one of:<br />
<br />
* [https://www.virtualbox.org/ VirtualBox] (recommended to [[#Beta version|use the beta version of the warrior]]) <br />
* [https://www.vmware.com/products/player/ VMware workstation/player] (free-gratis for personal use)<br />
* [[#Alternative virtual machines|See below for alternative virtual machines]]<br />
<br />
=== Quick start instructions for VirtualBox ===<br />
<br />
# Download the [https://warriorhq.archiveteam.org/downloads/warrior3/ appliance] (300MB).<br />
# Launch VirtualBox<br />
# In VirtualBox, click File > Import Appliance and open the file.<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit http://localhost:8001/<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
=== Start instructions for VMWare Player ===<br />
<br />
# Download the [https://warriorhq.archiveteam.org/downloads/warrior3/ appliance] (300MB).<br />
# Launch VMWare Player<br />
# In Player on the right, click "Open Virtual Machine", open the file and import the virtual machine.<br />
# Select the virtual machine and click "Edit virtual machine settings".<br />
#* Select "Hard Disk 2 (IDE)" > "Advanced..." and change it to "IDE 1:0"<br />
#* Select Network Adapter and set it to "Bridged: Connected directly to the physical network"<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit the address that is shown on the bottom (e.g. http://192.168.0.100:8001/)<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
<br />
__TOC__<br />
<br />
== Beta version ==<br />
<br />
Help us test the new version of the appliance available at https://warriorhq.archiveteam.org/downloads/warrior3/. Report any issues or feedback on [[IRC|#warrior on EFnet]].<br />
<br />
This version includes updated internal components that allow us to run newer and improved software. Specifically, it runs the warrior code within a Docker container.<br />
<br />
== Alternative virtual machines ==<br />
<br />
Thanks to user-effort, there are alternatives:<br />
<br />
* [https://www.docker.io/ Docker] (Linux)<br />
** ([https://archive.org/download/Warrior100G/Warrior-100G.ova Virtual Machine Appliance to auto load the docker version]) - Proposed Update to the current virtual machine.<br />
** ([https://github.com/ArchiveTeam/warrior-dockerfile modified dockerfile])<br />
** ([https://hub.docker.com/r/infrequent/at-as-dockerfile modified dockerfile - for manual script execution])<br />
<br />
* [https://www.microsoft.com/en-us/server-cloud/solutions/virtualization.aspx Hyper-V] (Windows 8 Professional)<br />
** ([http://jonimoose.net/2013/archiveteam-warrior-on-hyper-v/ Hyper-V virtual machine])<br />
<br />
Please note that these alternatives are not in widespread use by our warriors, so we may not be able to help with either issues or advanced usage.<br />
<br />
== Warrior FAQ ==<br />
<br />
=== Why a virtual machine in the first place? ===<br />
<br />
The virtual machine is a quick, safe, and easy way for newcomers to help us out. It offers many features:<br />
<br />
* Graphical interface<br />
* Automatically selects which project is important to run<br />
* Self-updating software infrastructure<br />
* Allows for unattended use<br />
* In case of software faults, your machine is not ruined<br />
* Restarts itself in case of runaway programs<br />
* Runs on Windows, Mac, and Linux painlessly<br />
* Ensures consistency in the archived data regardless of your machine's quirks<br />
<br />
If you have suggestions for improving this system, please talk to us as described below.<br />
<br />
=== Can I use whatever internet access for the warrior? ===<br />
<br />
No. We need "clean" connections. Please ensure the following:<br />
<br />
* No OpenDNS. No ISP DNS that redirects to a search page. Use non-captive DNS servers.<br />
* No ISP connections that inject advertisements into web pages.<br />
* No proxies. Proxies can return bad data. The original HTTP headers and IP address are needed for the WARC file.<br />
* No content-filtering firewalls.<br />
* No censorship. If you believe your country implements censorship, do not run a warrior. <br />
* No Tor. The server may return an error page instead of content if they ban exit nodes.<br />
* No free cafe wifi. Archiving your cafe's wifi service agreement repeatedly is not helpful.<br />
* We prefer connections from many public IP addresses if possible. (For example, if your apartment building uses a single IP address, we don't want your apartment banned.)<br />
<br />
=== I turned my warrior VM appliance off. Will those tasks be lost? ===<br />
<br />
If you've killed your warrior VM instance, then the work your warrior did has been lost. However, the tasks will be returned to the pool after a period of time, and other warriors may claim them. If you want, you can alert the admins via [[IRC]] of what's happened and they can clear the claims your username may have made. but this isn't very important on most projects.<br />
<br />
=== I closed my browser or tab with the warrior's web interface. Will those tasks be lost? ===<br />
<br />
No. The web browser interface just provides a user interface to the warrior. As long as the VM is not stopped, it will continue normally.<br />
<br />
=== I need to disconnect my internet / reboot my PC. How can I do this without losing work? ===<br />
<br />
If you pause/suspend the warrior instance, most projects will allow resuming of work in progress when you unsuspend the warrior instance.<br />
<br />
If you decide to use the suspend feature, please note that if you keep it suspended for too long (more than a few hours), the administrators will assume that the item is lost and re-queue it. Using the suspend feature so that you can reboot your computer is perfectly fine.<br />
<br />
=== How much disk space will the warrior use? ===<br />
<br />
Short answer: it depends on the project. (But never more than 60GB.)<br />
<br />
Long answer: because each project defines items differently, sizes may vary. A single task may be a small file or a whole subsection of a website. The virtual machine is configured by default to use an absolute maximum of 60GB. Any unused virtual machine disk space is not used on the host computer. You may run the virtual machine on less than 60GB if you like to live dangerously. We're downloading the internet, after all!<br />
<br />
=== How can I log in to the virtual machine? ===<br />
<br />
Unless you know what you are doing, you should not need to do this. But, if you want to, the username is <code>root</code> and the password is <code>archiveteam</code>. Once logged in as root, you can execute <code>sudo -u warrior -i</code> to log in as the warrior user. <br />
<br />
Press ALT+F3 to switch to virtual console number 3. Use ALT+Left or ALT+Right to switch between virtual consoles. There are 6 virtual consoles in total. Consoles 1 and 2 are reserved for the warrior.<br />
<br />
=== How can I run multiple virtual machines at the same time? ===<br />
<br />
You'll need to adjust the networking settings.<br />
<br />
In VirtualBox, select a virtual machine and open up Settings → Network → Adapter 1 → Port Forwarding. You need to adjust the host port. For example, set your table to TCP | 127.0.0.1 | 8123 | | 8001. This maps port 8123 on the host machine (your computer) to port 8001 on the virtual machine (the warrior), and you can then access the warrior's web interface from port 8123 in your browser.<br />
<br />
Each VM you want to access should have a different host port. Do not use port numbers below 1024 unless you know what you are doing.<br />
<br />
VMWare installations should be using bridged networking. However, if you want, you can switch to NAT (under Settings → Hardware → Virtual Network Adapter) and click Edit to set up port forwarding. On Linux, you can also use lines like <code>8123 = 192.168.0.100:8001</code> in the <code>[incomingtcp]</code> section of nat.conf. (Make sure the VM IP is correct!)<br />
<br />
=== How can I run the virtual machine headlessly (without leaving a window open)? ===<br />
<br />
On VirtualBox, use this command:<br />
<br />
<pre>vboxmanage startvm archiveteam-warrior-2 --type headless</pre><br />
<br />
Shut down the VM with:<br />
<br />
<pre>vboxmanage controlvm archiveteam-warrior-2 acpipowerbutton</pre><br />
<br />
Substituting <code>suspend</code> or <code>resume</code> for <code>acpipowerbutton</code> suspends or resumes the VM. For more information, consult [http://www.virtualbox.org/manual/ch08.html#vboxmanage-startvm the VirtualBox manual (Chapter 8, Sections 12 and 13)].<br />
<br />
On VMWare, use this command:<br />
<br />
<pre>vmrun start <path to vmx file> nogui</pre><br />
<br />
Shut down with:<br />
<br />
<pre>vmrun stop <path to vmx file> soft</pre><br />
<br />
Substituting <code>suspend</code> for <code>stop</code> suspends the VM. Resume with <code>start</code> again. For more information, including the paths to VMX files on different operating systems, consult [http://www.vmware.com/pdf/vix180_vmrun_command.pdf Using vmrun to Control Virtual Machines] (PDF), pages 10 and 11.<br />
<br />
=== How can I set up the virtual machine as a system service (so that it starts up on boot and shuts down automatically)? ===<br />
<br />
If you are using VirtualBox and running a Linux distribution that uses the systemd init system (like most recent releases), you can follow the short instructions on [http://www.ericerfanian.com/automatically-starting-virtualbox-vms-on-archlinux-using-systemd/ this page]. (The page title specifies Arch Linux, but this will work for other distros as long as they run systemd.)<br />
<br />
=== How can I set up the virtual machine with directly-bridged networking instead of NAT? ===<br />
<br />
On VirtualBox, use these commands:<br />
<br />
<pre>vboxmanage modifyvm archiveteam-warrior-2 --nic1 bridged<br />
vboxmanage modifyvm archiveteam-warrior-2 --bridgeadapter1 eth0</pre><br />
<br />
We presume you want to bind to <code>eth0</code>. Adjust as required. :)<br />
<br />
VMWare installations should already be using bridged networking.<br />
<br />
=== How can I run the warrior without a virtual machine? (The VM has too much overhead for a VPS!) ===<br />
<br />
One option is running a Docker container (see [[#Alternative_virtual_machines|above]]). Docker is based on LXC, and the overhead is far less than running a full VM. If you plan on running the [https://github.com/ArchiveTeam/warrior-dockerfile warrior-dockerfile], make sure to publish the port to allow access to the web interface:<br />
<br />
<pre>docker run -d -p 8001:8001 archiveteam/warrior-dockerfile</pre><br />
<br />
This creates a direct port mapping. For host port 38001 to container port 8001, use <code>38001:8001</code>. Adjust as required. :P<br />
<br />
(Multiple projects can be also run in isolated environments (containers) for rapid deployment using [https://hub.docker.com/r/infrequent/at-as-dockerfile at-as-dockerfile].)<br />
<br />
Another alternative is '''running the project manually.''' If you are managing a VPS, it's likely you are comfortable with some Linux stuff. Consult the project wiki page or the source code repository readme file.<br />
<br />
=== Why is the default project not working? / Why is a manual project not in the warrior yet? ===<br />
<br />
Sorry. Sometimes the administrators are too busy...<br />
<br />
=== Why are there no projects? ===<br />
<br />
We finished the ones we were working on! If there are no projects showing, you can [[Dev|help us write one]]. No projects does ''not'' mean there is nothing left to archive!<br />
<br />
=== I'm looking at the leaderboard. What's that icon beside the username? ===<br />
<br />
That's just the warrior logo: [[File:Archive_team.png|42px]] (click on the image for a larger version). It means that that person is using the warrior. Those without the icon are running the scripts manually.<br />
<br />
[[Image:Archiveteam-warrior-sticker.png|256px|right]]<br />
<br />
=== What's that guy doing in the logo? ===<br />
<br />
The place is on fire! But don't worry, he safely escaped with the rescued data in his arms.<br />
<br />
=== That’s awesome – can I slap this logo on my laptop to show my Internet-preservation pride? ===<br />
<br />
[http://www.redbubble.com/people/ajhajh/works/12857655-archive-team-warrior-stickers?p=sticker You sure can!] The ArchiveTeam Warrior laptop sticker can start conversations about archiving, if you’re into that.<br />
<br />
=== Where can I file a bug, suggestion, or a feature request? ===<br />
<br />
If the issue is related to the warrior's web interface or the library that grab scripts are using, see [https://github.com/ArchiveTeam/seesaw-kit/issues seesaw-kit issues]. Other issues should be filed into their own [[Dev/Source_Code|repositories]].<br />
<br />
=== I'd like to help write code. Where can I find more info? ===<br />
<br />
Check out the [[Dev]] documentation for details on the infrastructure and details of the source code layout.<br />
<br />
=== I still have a question! ===<br />
<br />
Check out the [[Frequently Asked Questions|general FAQ page]]. Talk to us on [[IRC]]. Use [irc://irc.efnet.org/warrior #warrior] for specific warrior questions or [irc://irc.efnet.org/archiveteam #archiveteam] for general questions.<br />
<br />
== Troubleshooting ==<br />
<br />
=== I'm getting errors when I try to launch the VM. ===<br />
<br />
If you are receiving <code>Breakpoint has been reached (0x80000003)</code>, <code>A critical error has occurred while running the virtual machine and the machine execution has been stopped.</code>, or VT-X errors, you probably do not have virtualization enabled, either because it is turned off in your computer's BIOS or your CPU does not support it.<br />
<br />
You can check CPU support on Linux with <code>cat /proc/cpuinfo | grep "(vmx|svm)" | uniq</code>. If there is a line of output starting with "flags", your processor supports virtualization; if there is no output, it does not. You can check whether virtualization is enabled in the BIOS using the <code>rdmsr</code> utility in your distro's <code>msr-tools</code> package.<br />
<br />
You can check support and BIOS status on Windows using [https://www.microsoft.com/en-us/download/details.aspx?id=592 Microsoft's Hardware-Assisted Virtualization Detection Tool] or [http://openlibsys.org/index-ja.html VirtualChecker].<br />
<br />
To enable virtualization on a CPU with support, reboot the computer and enter the BIOS. The virtualization setting is usually under something like 'CPU configuration' or 'advanced settings'.<br />
<br />
=== I just imported the ova image and the warrior is stuck on "Preparing the data partition". ===<br />
<br />
This issue has cropped up before, and we do not know what causes it. We recommend you delete the warrior image and import the ova again. Testing shows that such a reimport works in the majority of cases.<br />
<br />
=== I can't connect to localhost. ===<br />
<br />
The application is configured to set up port forwarding to the guest machine, and you should be able to access the interface through your web browser at port 8001. If this does not happen, and isn't resolved by rebooting the warrior (using the ACPI power signals, not suspend/save state and resume), you may need to double-check your machine's network settings (as described [[#How_can_I_run_multiple_virtual_machines_at_the_same_time.3F|above]]).<br />
<br />
=== The warrior can't connect to the internet. ===<br />
<br />
It's possible that the virtual machine has picked up the address of the local DNS cache on your computer, which the virtual machine does not have access to. <br />
<br />
If you experience this on VirtualBox, see [http://askubuntu.com/questions/204953/virtualbox-dns-stopped-working-on-upgrade-to-12-10 this question and answer].<br />
<br />
=== I see a message that no item was received. ===<br />
<br />
This means that there is no work available. This can happen for several reasons:<br />
<br />
* The project has just finished and someone is inspecting the work done. If a problem is discovered, items may be re-queued and more work will become available.<br />
* You have checked out/claimed too many items. Reduce your concurrency and let others do some of the work too.<br />
* In a rare case, you have been banned by a tracker administrator because there was a problem with your work: you were requesting too much, you were tampering with the scripts, a malfunction has occurred, or your internet connection is "unclean" (see [[#Can_I_use_whatever_internet_access_for_the_warrior.3F|above]]).<br />
<br />
=== I see a message about rate limiting. ===<br />
<br />
Don't worry. Keep in mind that although downloading the internet for fun and digital preservation are the primary goals of all Archive Team activities, serious stress on the target's server may occur. The rate limit is imposed by a [[Tracker#People|tracker administrator]] and should not be subverted.<br />
<br />
(In other words, we don't want to DDoS the servers.)<br />
<br />
If you like, you can switch to another [[Warrior projects|project]] with less load.<br />
<br />
=== I see a message about code being out of date. ===<br />
<br />
Don't worry. There is a new update ready. You do not need to do anything about this; the warrior will update its code every hour. If you are impatient, please reboot the warrior and it will download the latest code and resume work.<br />
<br />
=== I'm running the scripts manually and I see a message about code being out of date. ===<br />
<br />
This happens when a bug in the scripts is discovered. Bugs are unavoidable, especially when the server is out of our control.<br />
<br />
Try the <code>--auto-update</code> option available in Seesaw version 0.8. However, please be aware that you are now executing code automatically. Be sure to run the scripts in a separate user account for safety.<br />
<br />
=== I see messages about rsync errors. ===<br />
<br />
Uh-oh! Something is not right. Please notify us immediately in the appropriate [[IRC]] channel.<br />
<br />
=== I told the warrior to shut down from the interface, but nothing has changed. ===<br />
<br />
The warrior will attempt to finish the current running tasks before shutting down. If you need to shut down right away, go ahead. Your progress will be lost, but the jobs will eventually cycle out to another user.<br />
<br />
=== The warrior is eating all my bandwidth! ===<br />
<br />
On VirtualBox (relatively recent versions), use this command:<br />
<br />
<pre>vboxmanage bandwidthctl archiveteam-warrior-2 add limit --type network --limit 3m</pre><br />
<br />
This will limit the warrior to 3Mb/s. (Limit units are <code>k</code> for kilobit, <code>m</code> for megabit, <code>g</code> for gigabit, <code>K</code> for kilobyte, <code>M</code> for megabyte, and <code>G</code> for gigabyte.) Adjust as required. :)<br />
<br />
In the latest version of VirtualBox on Windows, the syntax appears to have changed. The correct command now seems to be:<br />
<br />
<pre>VBoxManage bandwidthctl archiveteam-warrior-2 add netlimit --type network --limit 3</pre><br />
<br />
For more information, consult [http://www.virtualbox.org/manual/ch06.html#network_bandwidth_limit the VirtualBox manual (Chapter 6, Section 9)].<br />
<br />
On VMWare (versions 9 and above), select a virtual machine and open Settings → Hardware → Virtual Network Adapter → Advanced. You can set a bandwidth limit here.<br />
<br />
=== The warrior is using up disk space, even though it's not running a project! ===<br />
<br />
Virtual machine disk images do not behave like a regular file. There are several ways to safely reclaim space:<br />
<br />
* Delete the second disk and put back an empty disk. The warrior should reformat the second disk.<br />
* Delete the entire warrior application and re-import it.<br />
* Use the [http://intgat.tigress.co.uk/rmy/uml/index.html zerofree] program and then clone the disk image. Reattach the cloned disk image.<br />
<br />
=== The item I'm working on is downloading thousands of URLs and it's taking hours. ===<br />
<br />
Please notify us in the appropriate [[IRC]] channel. You may need to reboot the warrior.<br />
<br />
=== The instructions to run the software/scripts are awful and they are difficult to set up. ===<br />
<br />
Well, excuuuuse me, princess!<br />
<br />
We're not a professional support team so help us help you help us all. See above for [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|bug reports]], [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|suggestions]], or [[#I.27d_like_to_help_write_code._Where_can_I_find_more_info.3F|code contributions]].<br />
<br />
== Projects ==<br />
<br />
See [[Warrior projects]].<br />
<br />
== Are you a coder? ==<br />
<br />
Like the warrior? Interested in how it works under the hood? Got software skills? '''[[Dev|Help us improve it!]]'''<br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=ArchiveTeam_Warrior&diff=30258ArchiveTeam Warrior2018-01-05T16:07:36Z<p>Jrwr: </p>
<hr />
<div>==What is the Archive Team Warrior?==<br />
<br />
[[Image:Archive_team.png|100px|left]]<br />
[[Image:Warrior-vm-screenshot.png||256px|right]]<br />
[[Image:Warrior-web-screenshot.png|256px|right]]<br />
<br />
The Archive Team Warrior is a virtual archiving appliance. You can run it to help with the ArchiveTeam archiving efforts. It will download sites and upload them to our archive — and it’s really easy to do!<br />
<br />
The warrior is a virtual machine, so there is no risk to your computer. The warrior will only use your bandwidth and some of your disk space. It will get tasks from and report progress to the [[Tracker]].<br />
<br />
== Basic usage ==<br />
<br />
The warrior runs on Windows, OS X and Linux using a virtual machine. You'll need one of:<br />
<br />
* [https://www.virtualbox.org/ VirtualBox] (recommended to [[#Beta version|use the beta version of the warrior]]) <br />
* [https://www.vmware.com/products/player/ VMware workstation/player] (free-gratis for personal use)<br />
* [[#Alternative virtual machines|See below for alternative virtual machines]]<br />
<br />
=== Quick start instructions for VirtualBox ===<br />
<br />
# Download the [http://archive.org/download/archiveteam-warrior/archiveteam-warrior-v2-20121008.ova appliance] (174MB).<br />
# Launch VirtualBox<br />
# In VirtualBox, click File > Import Appliance and open the file.<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit http://localhost:8001/<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
=== Start instructions for VMWare Player ===<br />
<br />
# Download the [http://archive.org/download/archiveteam-warrior/archiveteam-warrior-v2-20121008.ova appliance] (174MB).<br />
# Launch VMWare Player<br />
# In Player on the right, click "Open Virtual Machine", open the file and import the virtual machine.<br />
# Select the virtual machine and click "Edit virtual machine settings".<br />
#* Select "Hard Disk 2 (IDE)" > "Advanced..." and change it to "IDE 1:0"<br />
#* Select Network Adapter and set it to "Bridged: Connected directly to the physical network"<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit the address that is shown on the bottom (e.g. http://192.168.0.100:8001/)<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
<br />
__TOC__<br />
<br />
== Beta version ==<br />
<br />
Help us test the new version of the appliance available at https://warriorhq.archiveteam.org/downloads/warrior3/. Report any issues or feedback on [[IRC|#warrior on EFnet]].<br />
<br />
This version includes updated internal components that allow us to run newer and improved software. Specifically, it runs the warrior code within a Docker container.<br />
<br />
== Alternative virtual machines ==<br />
<br />
Thanks to user-effort, there are alternatives:<br />
<br />
* [https://www.docker.io/ Docker] (Linux)<br />
** ([https://archive.org/download/Warrior100G/Warrior-100G.ova Virtual Machine Appliance to auto load the docker version]) - Proposed Update to the current virtual machine.<br />
** ([https://github.com/ArchiveTeam/warrior-dockerfile modified dockerfile])<br />
** ([https://hub.docker.com/r/infrequent/at-as-dockerfile modified dockerfile - for manual script execution])<br />
<br />
* [https://www.microsoft.com/en-us/server-cloud/solutions/virtualization.aspx Hyper-V] (Windows 8 Professional)<br />
** ([http://jonimoose.net/2013/archiveteam-warrior-on-hyper-v/ Hyper-V virtual machine])<br />
<br />
Please note that these alternatives are not in widespread use by our warriors, so we may not be able to help with either issues or advanced usage.<br />
<br />
== Warrior FAQ ==<br />
<br />
=== Why a virtual machine in the first place? ===<br />
<br />
The virtual machine is a quick, safe, and easy way for newcomers to help us out. It offers many features:<br />
<br />
* Graphical interface<br />
* Automatically selects which project is important to run<br />
* Self-updating software infrastructure<br />
* Allows for unattended use<br />
* In case of software faults, your machine is not ruined<br />
* Restarts itself in case of runaway programs<br />
* Runs on Windows, Mac, and Linux painlessly<br />
* Ensures consistency in the archived data regardless of your machine's quirks<br />
<br />
If you have suggestions for improving this system, please talk to us as described below.<br />
<br />
=== Can I use whatever internet access for the warrior? ===<br />
<br />
No. We need "clean" connections. Please ensure the following:<br />
<br />
* No OpenDNS. No ISP DNS that redirects to a search page. Use non-captive DNS servers.<br />
* No ISP connections that inject advertisements into web pages.<br />
* No proxies. Proxies can return bad data. The original HTTP headers and IP address are needed for the WARC file.<br />
* No content-filtering firewalls.<br />
* No censorship. If you believe your country implements censorship, do not run a warrior. <br />
* No Tor. The server may return an error page instead of content if they ban exit nodes.<br />
* No free cafe wifi. Archiving your cafe's wifi service agreement repeatedly is not helpful.<br />
* We prefer connections from many public IP addresses if possible. (For example, if your apartment building uses a single IP address, we don't want your apartment banned.)<br />
<br />
=== I turned my warrior VM appliance off. Will those tasks be lost? ===<br />
<br />
If you've killed your warrior VM instance, then the work your warrior did has been lost. However, the tasks will be returned to the pool after a period of time, and other warriors may claim them. If you want, you can alert the admins via [[IRC]] of what's happened and they can clear the claims your username may have made. but this isn't very important on most projects.<br />
<br />
=== I closed my browser or tab with the warrior's web interface. Will those tasks be lost? ===<br />
<br />
No. The web browser interface just provides a user interface to the warrior. As long as the VM is not stopped, it will continue normally.<br />
<br />
=== I need to disconnect my internet / reboot my PC. How can I do this without losing work? ===<br />
<br />
If you pause/suspend the warrior instance, most projects will allow resuming of work in progress when you unsuspend the warrior instance.<br />
<br />
If you decide to use the suspend feature, please note that if you keep it suspended for too long (more than a few hours), the administrators will assume that the item is lost and re-queue it. Using the suspend feature so that you can reboot your computer is perfectly fine.<br />
<br />
=== How much disk space will the warrior use? ===<br />
<br />
Short answer: it depends on the project. (But never more than 60GB.)<br />
<br />
Long answer: because each project defines items differently, sizes may vary. A single task may be a small file or a whole subsection of a website. The virtual machine is configured by default to use an absolute maximum of 60GB. Any unused virtual machine disk space is not used on the host computer. You may run the virtual machine on less than 60GB if you like to live dangerously. We're downloading the internet, after all!<br />
<br />
=== How can I log in to the virtual machine? ===<br />
<br />
Unless you know what you are doing, you should not need to do this. But, if you want to, the username is <code>root</code> and the password is <code>archiveteam</code>. Once logged in as root, you can execute <code>sudo -u warrior -i</code> to log in as the warrior user. <br />
<br />
Press ALT+F3 to switch to virtual console number 3. Use ALT+Left or ALT+Right to switch between virtual consoles. There are 6 virtual consoles in total. Consoles 1 and 2 are reserved for the warrior.<br />
<br />
=== How can I run multiple virtual machines at the same time? ===<br />
<br />
You'll need to adjust the networking settings.<br />
<br />
In VirtualBox, select a virtual machine and open up Settings → Network → Adapter 1 → Port Forwarding. You need to adjust the host port. For example, set your table to TCP | 127.0.0.1 | 8123 | | 8001. This maps port 8123 on the host machine (your computer) to port 8001 on the virtual machine (the warrior), and you can then access the warrior's web interface from port 8123 in your browser.<br />
<br />
Each VM you want to access should have a different host port. Do not use port numbers below 1024 unless you know what you are doing.<br />
<br />
VMWare installations should be using bridged networking. However, if you want, you can switch to NAT (under Settings → Hardware → Virtual Network Adapter) and click Edit to set up port forwarding. On Linux, you can also use lines like <code>8123 = 192.168.0.100:8001</code> in the <code>[incomingtcp]</code> section of nat.conf. (Make sure the VM IP is correct!)<br />
<br />
=== How can I run the virtual machine headlessly (without leaving a window open)? ===<br />
<br />
On VirtualBox, use this command:<br />
<br />
<pre>vboxmanage startvm archiveteam-warrior-2 --type headless</pre><br />
<br />
Shut down the VM with:<br />
<br />
<pre>vboxmanage controlvm archiveteam-warrior-2 acpipowerbutton</pre><br />
<br />
Substituting <code>suspend</code> or <code>resume</code> for <code>acpipowerbutton</code> suspends or resumes the VM. For more information, consult [http://www.virtualbox.org/manual/ch08.html#vboxmanage-startvm the VirtualBox manual (Chapter 8, Sections 12 and 13)].<br />
<br />
On VMWare, use this command:<br />
<br />
<pre>vmrun start <path to vmx file> nogui</pre><br />
<br />
Shut down with:<br />
<br />
<pre>vmrun stop <path to vmx file> soft</pre><br />
<br />
Substituting <code>suspend</code> for <code>stop</code> suspends the VM. Resume with <code>start</code> again. For more information, including the paths to VMX files on different operating systems, consult [http://www.vmware.com/pdf/vix180_vmrun_command.pdf Using vmrun to Control Virtual Machines] (PDF), pages 10 and 11.<br />
<br />
=== How can I set up the virtual machine as a system service (so that it starts up on boot and shuts down automatically)? ===<br />
<br />
If you are using VirtualBox and running a Linux distribution that uses the systemd init system (like most recent releases), you can follow the short instructions on [http://www.ericerfanian.com/automatically-starting-virtualbox-vms-on-archlinux-using-systemd/ this page]. (The page title specifies Arch Linux, but this will work for other distros as long as they run systemd.)<br />
<br />
=== How can I set up the virtual machine with directly-bridged networking instead of NAT? ===<br />
<br />
On VirtualBox, use these commands:<br />
<br />
<pre>vboxmanage modifyvm archiveteam-warrior-2 --nic1 bridged<br />
vboxmanage modifyvm archiveteam-warrior-2 --bridgeadapter1 eth0</pre><br />
<br />
We presume you want to bind to <code>eth0</code>. Adjust as required. :)<br />
<br />
VMWare installations should already be using bridged networking.<br />
<br />
=== How can I run the warrior without a virtual machine? (The VM has too much overhead for a VPS!) ===<br />
<br />
One option is running a Docker container (see [[#Alternative_virtual_machines|above]]). Docker is based on LXC, and the overhead is far less than running a full VM. If you plan on running the [https://github.com/ArchiveTeam/warrior-dockerfile warrior-dockerfile], make sure to publish the port to allow access to the web interface:<br />
<br />
<pre>docker run -d -p 8001:8001 archiveteam/warrior-dockerfile</pre><br />
<br />
This creates a direct port mapping. For host port 38001 to container port 8001, use <code>38001:8001</code>. Adjust as required. :P<br />
<br />
(Multiple projects can be also run in isolated environments (containers) for rapid deployment using [https://hub.docker.com/r/infrequent/at-as-dockerfile at-as-dockerfile].)<br />
<br />
Another alternative is '''running the project manually.''' If you are managing a VPS, it's likely you are comfortable with some Linux stuff. Consult the project wiki page or the source code repository readme file.<br />
<br />
=== Why is the default project not working? / Why is a manual project not in the warrior yet? ===<br />
<br />
Sorry. Sometimes the administrators are too busy...<br />
<br />
=== Why are there no projects? ===<br />
<br />
We finished the ones we were working on! If there are no projects showing, you can [[Dev|help us write one]]. No projects does ''not'' mean there is nothing left to archive!<br />
<br />
=== I'm looking at the leaderboard. What's that icon beside the username? ===<br />
<br />
That's just the warrior logo: [[File:Archive_team.png|42px]] (click on the image for a larger version). It means that that person is using the warrior. Those without the icon are running the scripts manually.<br />
<br />
[[Image:Archiveteam-warrior-sticker.png|256px|right]]<br />
<br />
=== What's that guy doing in the logo? ===<br />
<br />
The place is on fire! But don't worry, he safely escaped with the rescued data in his arms.<br />
<br />
=== That’s awesome – can I slap this logo on my laptop to show my Internet-preservation pride? ===<br />
<br />
[http://www.redbubble.com/people/ajhajh/works/12857655-archive-team-warrior-stickers?p=sticker You sure can!] The ArchiveTeam Warrior laptop sticker can start conversations about archiving, if you’re into that.<br />
<br />
=== Where can I file a bug, suggestion, or a feature request? ===<br />
<br />
If the issue is related to the warrior's web interface or the library that grab scripts are using, see [https://github.com/ArchiveTeam/seesaw-kit/issues seesaw-kit issues]. Other issues should be filed into their own [[Dev/Source_Code|repositories]].<br />
<br />
=== I'd like to help write code. Where can I find more info? ===<br />
<br />
Check out the [[Dev]] documentation for details on the infrastructure and details of the source code layout.<br />
<br />
=== I still have a question! ===<br />
<br />
Check out the [[Frequently Asked Questions|general FAQ page]]. Talk to us on [[IRC]]. Use [irc://irc.efnet.org/warrior #warrior] for specific warrior questions or [irc://irc.efnet.org/archiveteam #archiveteam] for general questions.<br />
<br />
== Troubleshooting ==<br />
<br />
=== I'm getting errors when I try to launch the VM. ===<br />
<br />
If you are receiving <code>Breakpoint has been reached (0x80000003)</code>, <code>A critical error has occurred while running the virtual machine and the machine execution has been stopped.</code>, or VT-X errors, you probably do not have virtualization enabled, either because it is turned off in your computer's BIOS or your CPU does not support it.<br />
<br />
You can check CPU support on Linux with <code>cat /proc/cpuinfo | grep "(vmx|svm)" | uniq</code>. If there is a line of output starting with "flags", your processor supports virtualization; if there is no output, it does not. You can check whether virtualization is enabled in the BIOS using the <code>rdmsr</code> utility in your distro's <code>msr-tools</code> package.<br />
<br />
You can check support and BIOS status on Windows using [https://www.microsoft.com/en-us/download/details.aspx?id=592 Microsoft's Hardware-Assisted Virtualization Detection Tool] or [http://openlibsys.org/index-ja.html VirtualChecker].<br />
<br />
To enable virtualization on a CPU with support, reboot the computer and enter the BIOS. The virtualization setting is usually under something like 'CPU configuration' or 'advanced settings'.<br />
<br />
=== I just imported the ova image and the warrior is stuck on "Preparing the data partition". ===<br />
<br />
This issue has cropped up before, and we do not know what causes it. We recommend you delete the warrior image and import the ova again. Testing shows that such a reimport works in the majority of cases.<br />
<br />
=== I can't connect to localhost. ===<br />
<br />
The application is configured to set up port forwarding to the guest machine, and you should be able to access the interface through your web browser at port 8001. If this does not happen, and isn't resolved by rebooting the warrior (using the ACPI power signals, not suspend/save state and resume), you may need to double-check your machine's network settings (as described [[#How_can_I_run_multiple_virtual_machines_at_the_same_time.3F|above]]).<br />
<br />
=== The warrior can't connect to the internet. ===<br />
<br />
It's possible that the virtual machine has picked up the address of the local DNS cache on your computer, which the virtual machine does not have access to. <br />
<br />
If you experience this on VirtualBox, see [http://askubuntu.com/questions/204953/virtualbox-dns-stopped-working-on-upgrade-to-12-10 this question and answer].<br />
<br />
=== I see a message that no item was received. ===<br />
<br />
This means that there is no work available. This can happen for several reasons:<br />
<br />
* The project has just finished and someone is inspecting the work done. If a problem is discovered, items may be re-queued and more work will become available.<br />
* You have checked out/claimed too many items. Reduce your concurrency and let others do some of the work too.<br />
* In a rare case, you have been banned by a tracker administrator because there was a problem with your work: you were requesting too much, you were tampering with the scripts, a malfunction has occurred, or your internet connection is "unclean" (see [[#Can_I_use_whatever_internet_access_for_the_warrior.3F|above]]).<br />
<br />
=== I see a message about rate limiting. ===<br />
<br />
Don't worry. Keep in mind that although downloading the internet for fun and digital preservation are the primary goals of all Archive Team activities, serious stress on the target's server may occur. The rate limit is imposed by a [[Tracker#People|tracker administrator]] and should not be subverted.<br />
<br />
(In other words, we don't want to DDoS the servers.)<br />
<br />
If you like, you can switch to another [[Warrior projects|project]] with less load.<br />
<br />
=== I see a message about code being out of date. ===<br />
<br />
Don't worry. There is a new update ready. You do not need to do anything about this; the warrior will update its code every hour. If you are impatient, please reboot the warrior and it will download the latest code and resume work.<br />
<br />
=== I'm running the scripts manually and I see a message about code being out of date. ===<br />
<br />
This happens when a bug in the scripts is discovered. Bugs are unavoidable, especially when the server is out of our control.<br />
<br />
Try the <code>--auto-update</code> option available in Seesaw version 0.8. However, please be aware that you are now executing code automatically. Be sure to run the scripts in a separate user account for safety.<br />
<br />
=== I see messages about rsync errors. ===<br />
<br />
Uh-oh! Something is not right. Please notify us immediately in the appropriate [[IRC]] channel.<br />
<br />
=== I told the warrior to shut down from the interface, but nothing has changed. ===<br />
<br />
The warrior will attempt to finish the current running tasks before shutting down. If you need to shut down right away, go ahead. Your progress will be lost, but the jobs will eventually cycle out to another user.<br />
<br />
=== The warrior is eating all my bandwidth! ===<br />
<br />
On VirtualBox (relatively recent versions), use this command:<br />
<br />
<pre>vboxmanage bandwidthctl archiveteam-warrior-2 add limit --type network --limit 3m</pre><br />
<br />
This will limit the warrior to 3Mb/s. (Limit units are <code>k</code> for kilobit, <code>m</code> for megabit, <code>g</code> for gigabit, <code>K</code> for kilobyte, <code>M</code> for megabyte, and <code>G</code> for gigabyte.) Adjust as required. :)<br />
<br />
In the latest version of VirtualBox on Windows, the syntax appears to have changed. The correct command now seems to be:<br />
<br />
<pre>VBoxManage bandwidthctl archiveteam-warrior-2 add netlimit --type network --limit 3</pre><br />
<br />
For more information, consult [http://www.virtualbox.org/manual/ch06.html#network_bandwidth_limit the VirtualBox manual (Chapter 6, Section 9)].<br />
<br />
On VMWare (versions 9 and above), select a virtual machine and open Settings → Hardware → Virtual Network Adapter → Advanced. You can set a bandwidth limit here.<br />
<br />
=== The warrior is using up disk space, even though it's not running a project! ===<br />
<br />
Virtual machine disk images do not behave like a regular file. There are several ways to safely reclaim space:<br />
<br />
* Delete the second disk and put back an empty disk. The warrior should reformat the second disk.<br />
* Delete the entire warrior application and re-import it.<br />
* Use the [http://intgat.tigress.co.uk/rmy/uml/index.html zerofree] program and then clone the disk image. Reattach the cloned disk image.<br />
<br />
=== The item I'm working on is downloading thousands of URLs and it's taking hours. ===<br />
<br />
Please notify us in the appropriate [[IRC]] channel. You may need to reboot the warrior.<br />
<br />
=== The instructions to run the software/scripts are awful and they are difficult to set up. ===<br />
<br />
Well, excuuuuse me, princess!<br />
<br />
We're not a professional support team so help us help you help us all. See above for [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|bug reports]], [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|suggestions]], or [[#I.27d_like_to_help_write_code._Where_can_I_find_more_info.3F|code contributions]].<br />
<br />
== Projects ==<br />
<br />
See [[Warrior projects]].<br />
<br />
== Are you a coder? ==<br />
<br />
Like the warrior? Interested in how it works under the hood? Got software skills? '''[[Dev|Help us improve it!]]'''<br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=User:Jrwr&diff=30234User:Jrwr2017-12-26T01:22:12Z<p>Jrwr: </p>
<hr />
<div><br />
== Fixer of wikis and caller of the black magic ==<br />
Here is what I did<br />
<br />
PHP is located in ~/.local/bin/php-cgi<br />
I used a .htaccess to register a new cgi handler its in ~/www<br />
<br />
SSL is handled in ~/letsencrypt there is a shellscript in there talking to the cpanel to install new SSL certs, I used acme.sh for most of that.<br />
<br />
For anyone coming in behind me.... I'm sorry<br />
<br />
[[File:H97A49856.jpg]]</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=User:Jrwr&diff=30233User:Jrwr2017-12-26T01:22:04Z<p>Jrwr: </p>
<hr />
<div><br />
== Fixer of wikis and caller of the black magic ==<br />
Here is what I did<br />
<br />
PHP is located in ~/.local/bin/php-cgi<br />
I used a .htaccess to register a new cgi handler its in ~/www<br />
<br />
SSL is handled in ~/letsencrypt there is a shellscript in there talking to the cpanel to install new SSL certs, I used acme.sh for most of that.<br />
<br />
For anyone coming in behind me.... I'm sorry<br />
<br />
[File:H97A49856.jpg]</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=File:H97A49856.jpg&diff=30232File:H97A49856.jpg2017-12-26T01:21:37Z<p>Jrwr: </p>
<hr />
<div></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=User:Jrwr&diff=30231User:Jrwr2017-12-26T01:20:31Z<p>Jrwr: /* Fixer of wikis and caller of the black magic */</p>
<hr />
<div><br />
== Fixer of wikis and caller of the black magic ==<br />
Here is what I did<br />
<br />
PHP is located in ~/.local/bin/php-cgi<br />
I used a .htaccess to register a new cgi handler its in ~/www<br />
<br />
SSL is handled in ~/letsencrypt there is a shellscript in there talking to the cpanel to install new SSL certs, I used acme.sh for most of that.</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=User:Jrwr&diff=30211User:Jrwr2017-12-21T10:53:54Z<p>Jrwr: Replaced content with " == Fixer of wikis and caller of the black magic =="</p>
<hr />
<div><br />
== Fixer of wikis and caller of the black magic ==</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Deathwatch&diff=30210Deathwatch2017-12-21T10:29:32Z<p>Jrwr: </p>
<hr />
<div>The '''Deathwatch''' or '''Watchlist''' is a central indicator of websites and networks that are shutting down and serves as an indicator of what happened to particular sites that shut down quickly.<br />
<br />
New sites should be added in chronological order, newest death date first. Forward-looking death dates should be added to the first list only. Sites large enough to warrant additional information will receive a dedicated page, linked from here and on [[:Category:Closing projects]].<br />
<br />
(The content of the Getting Things Done table, merged with the In Progress table, can now be found on [[Small projects]].)<br />
<br />
== Pre-emptive Alarmbells (Likely To Die) ==<br />
<br />
=== Sunset Happy ===<br />
<br />
* Archive Team officially proclaims '''[[Yahoo!]]''' the least trustable host and its arch-enemy. Prove us different, Yahooligans. Or... don't. Expect anything in [[wikipedia:List_of_mergers_and_acquisitions_by_Yahoo!]] and [[wikipedia:List_of_Yahoo!-owned_sites_and_services]] to shutdown (if it already hasn't).<br />
**Please follow the feeds! {{url|https://twitter.com/YahooVictims}} & {{url|http://www.google.com/alerts/feeds/03733117766037168292/11115209096644139952}}<br />
<br />
* [[Nokia]] has recently been shutting down services at an alarmingly fast rate. Back up your data, Nokia users!<br />
<br />
* [[AOL]] has decided to follow in Yahoo's footsteps by mass-closing websites at an alarmingly fast rate. Be careful not to leave any important data with them!<br />
<br />
=== Just When You Least Expect It ===<br />
<br />
Archive Team keeps a list of '''[[Fire_Drill|"healthy sites"]]''' that could be fine today and not so hot tomorrow. We focus on ways to back your personal data off these sites so you don't put yourself at unnecessary risk.<br />
<br />
=== Other endangered species and misc ideas ===<br />
<br />
* [https://www.youtube.com/channel/UCl2mFZoRqjw_ELax4Yisf6w Louis Rossmann's Youtube channel]. He released a video on June 30th with strong hints his channel and business were being shutdown because of reasons he was not able to state. <br />
** He runs/ran a business repairing Apple Macbook motherboards and making videos on how to do these repairs, business advice and related philosophy. <br />
** These repairs are considered "unauthorized" by Apple and could the driving force behind the shutdown. <br />
** There are approximately 700 educational videos on his channel that should be archived, please see the [[YouTube]] page on how to archive YouTube videos. <br />
** His business websites could also be at risk https://www.rossmanngroup.com/ & https://mailin.repair/ & https://www.rossmanngroup.com/boards/<br />
* [[Miiverse]] (Nintendo's social Network which has a client in the 3DS and WiiU consoles, but is also mostly completely accessible over https://miiverse.nintendo.net/ ) was first rumored that it might be suspended in the future in January: http://venturebeat.com/2017/01/13/nintendo-switch-wont-have-miiverse-or-streetpass/ . Made a bit more urgent as a recent system update to the Wii U [https://twitter.com/ShinyQuagsire/status/887123601056350209 contained a message about the service ending]<sup>[http://archive.is/j23xF archive.is]</sup>. Nintendo has since confirmed that the service will end on November 8, 2017: https://miiverse.nintendo.net/posts/AYMHAAADAAADV44YslslXw <sup>[http://archive.is/QpsEz archive.is]</sup><br />
* BitTorrent DHT - indexed by various projects who tend to get shut down sooner or later:<br />
** BTDB [https://btdb.to] - has had domain seized in the past, uses gmail for DMCA notices [http://btdb.to/about], no other contact info<br />
** BTDigg [https://btdig.com/] - has had multiple domains seized in the past and died before. Twitter and Facebook is inactive. Contact page doesn't work, but allegedly uses email form<br />
** Torrent Project [https://torrentproject.se/] - maybe dead, see [[Deathwatch#2017]] for more information<br />
** iTorrents.org [https://itorrents.org] - torrent cache, run by the operator of limetorrents.cc (see whois for contact information)<br />
* We have even more small tidbits of information at [[Deathwatch/Misc]].<br />
<br />
== Pining for the Fjords (Dying) ==<br />
<br />
Websites (notable or ones with user-generated content) that are definitively shutting down. No speculation please! Sites that appear troubled should go on [[Fire Drill]].<br />
<br />
=== 2018 ===<br />
*The Polish free webhosting service Republika WWW[republika.pl] is shutting down either on March 1, 2018 (according to [https://mailing.onet.pl/02431610498540524545 emails sent out to users]) or on January 1, 2018 (according to [http://ankietarepublika.pl/ this page] with an online survey.) <br />
<br />
=== 2017 ===<br />
*[[Vidme]][https://medium.com/vidme/goodbye-for-now-120b40becafa] - video sharing platform is closing on December 15. "Existing videos will be playable and exportable from your video manager until December 15th at noon PT, at which point they will be permanently deleted from the Vidme servers."<br />
*CompuServe Forums[http://member.compuserve.com/forum_center/] - closing December 15 [https://www.fastcompany.com/40495831/compuserves-forums-which-still-exist-are-finally-shutting-down]<br />
*[[Xoom]]: websites frozen, will only serve static files. Probably preparing for closure.<br />
*Torrent Project [https://torrentproject.se] - displays an error 403 page, but the server is still active and serving the .onion domain [http://x4torrentjjjjuxy.onion/]. Can be contacted via email (see https://web.archive.org/web/20170705071813/https://torrentproject.se/feedback). Has valuable metadata they've collected about torrents such as mediainfo, and also has a very large database (103m) of them.<br />
* Twitter translation center forums [https://translate.twitter.com/forum/] - closing November 30, only forum accounts created prior to November 1 will work<br />
<br />
=== 2016 ===<br />
* Date unknown: http://gamingpolo.com/ has many non-working pages and downloads<br />
* Date unknown: Pirate Bay image hosting site "Bayimg" returns after it shutdown in the raid. However, staff announced that the site would only be up for a week. <ref>{{url|https://torrentfreak.com/pirate-bays-image-hosting-site-bayimg-returns-for-a-bit-160425/}}</ref> <br />
* December 31: [[ex.ua]] was like what.cd, except the data is hosted on the site and is at risk of being deleted.<br />
* June 27: Music News Nashville is ceasing publication. "All of our archives will remain online for at least one more year." <ref>{{url|http://www.musicnewsnashville.com/}}</ref><br />
* March 21: Futanariobsession, a niche porn site that has been running since 2009/09/01, is closing its doors. <ref>{{url|http://futanariobsession.com/site-news/}}</ref><br />
* January 1: AutoHotKey's older, IPBoards based forum has been made read-only, in favor of their new forums. Users were migrated but forum posts were not. <ref>{{url|https://autohotkey.com/board/topic/149716-ip-boards-decommission/}}</ref><ref>{{url|http://ahkscript.org/foundation/history.html}}</ref><br />
* lots of older [[nin.com]] sub-domains (e.g. remix.nin.com, forum.nin.com) are dying; DNS has already been repointed but the old hosts are still on at the time of writing[http://www.echoingthesound.org/community/threads/4298-New-nin-com-website?p=328754#post328754]<br />
<br />
=== 2015 ===<br />
<br />
* Date Unknown: [[Picasa]] content will increasingly be killed as [[wikipedia:Google Photos|Google Photos]] was launched on 2015-05-28 and will need users.<br />
* Date Unknown: AOL apparently has plans to kill a bunch of sites, including with [[Joystiq]], [[MyDaily]], and [[ParentDish]].<ref>{{url|http://recode.net/2015/01/26/aol-likely-to-shutter-gaming-site-joystiq-in-larger-content-cleanup/}}</ref><br />
* Date Unknown: Bad Juju Games has filed for bankruptcy, which might mean an end to [[Desura]] and [[Indie Royale]], which hosts a large amount of games not hosted anywhere else (some of which is free), as well as forums and various user-generated content. <ref>{{url|http://www.rockpapershotgun.com/2015/06/05/desura-bankruptcy-bad-juju-games/}}</ref><br />
<br />
== Dead as a Doornail ==<br />
=== 2017 ===<br />
* June 30: [[Eroshare]], a pornographic sharing service, shut down. All those [[Reddit]] links, useless...<br />
* June 23: {{url|https://www.imzy.com/|Imzy}}, a discussion community website, shut down.<br />
* March 17: [https://loadaverage.org/ LoadAverage], a GNU social instance (Twitter clone) shut down<ref>{{url|https://wiki.loadaverage.org/news/bye_guys}}</ref><br />
* March 10: Version 2 of {{url|http://deadhorseinterchangeable.freeforums.org/|Dead Horse Interchangeable}}, a forum for mocking online personalities, was shut down by FreeForums.org for violating their terms of service. The userbase migrated to ProBoards ({{url|http://dhi.freeforums.net/}}), and then to a self-hosted domain two weeks later ({{url|http://deadhorseinterchange.net/}}), but countless posts from version 2 have been lost.<br />
* March 3: Disney Infinity shut down all community services<ref>{{url|https://infinity.disney.com/closing}}</ref><br />
* January 31: J:COM NET closes down webhosting service WebSpace <ref>{{url|http://notices.jcom.co.jp/notice/10073.html}}</ref><br />
<br />
=== 2016 ===<br />
* Date unknown: http://www.mytvshows.org/ gets turned off.<br />
* Date unknown: According to akz, self-identified in #archivebot as a moderator of the site, [[Captain Luffy Forums]] will be closing when the hosting expires, as the owner has chosen not to renew it. It finally did so sometime after August 10th.<br />
* December 27: [[kepfeltoltes.hu]], one of the most popular Hungarian image sharing services, ceased operations.<br />
* November 17: {{url|http://What.cd/|What.cd}} suddenly shuts down. One of, if not, the largest BitTorrent Music Trackers on the internet. [http://i.imgur.com/qb3po3C.png "Due to some recent events, What.CD is shutting down. We are not likely to return any time soon in our current form. All site and user data has been destroyed. So long, and thanks for all the fish."]<br />
* November 10: [[Nifty]] ends web-hosting service. A number has migrated to LaCoocan.<ref>{{url|http://homepage.nifty.com/information/2016/01/}}</ref><br />
* October 31: Vessel shuts down after it is acquired by Verizon. <ref>{{url|https://www.vessel.com/blog}}</ref><br />
* October 31: [[Twitterfeed]] shut its doors on October 31st, 2016. They recommend [[Buffer]] (https://buffer.com) or [[Dlvr.it]].<br />
* October 25: Bioware is shut down their forums. They were made read-only on August 26, and taken down entirely on October 25.<ref>{{url|http://blog.bioware.com/2016/07/29/concerning-our-forums/}}</ref><br />
* October 23: Allmyvideos.net removed all videos and shut down their website for Good. They claimed that this is because their site is no longer profitable enough to run and maintain the website.<br />
* September: Questhub.io is a public social todolist/quests service. The author announced that it will be closed soon.<ref>{{url|https://questhub.io/realm/meta/quest/57b23a65330ed0bb37000041}}</ref> He is willing to dump the database. The code in open on {{url|https://github.com/berekuk/questhub/}}.<br />
* September 30: {{url|http://www.lokalisten.de/}} will shut down.<ref>{{url|https://www.deutsche-startups.de/2016/09/03/lokalisten-ende-soziales-netzwerk-wird-abgeschaltet/}}</ref><br />
* August 31: Sunrise Calendar will shut down to make way for Outlook. Blame [[Microsoft]].<ref>{{url|http://blog.sunrise.am/post/144196642739/its-almost-time-to-say-goodbye}}</ref><br />
* August 5: Yahoo has announced that is discontinuing support for all legacy versions of Yahoo messenger and on August 5th the servers will be shut down for good. <ref>{{url|http://gadgets.ndtv.com/apps/news/old-yahoo-messenger-app-to-shut-down-on-august-5-848476}}</ref><br />
* July 31: {{url|http://kagi.com/|Kagi.com}}, shareware and other software payment processor that started in 1994, shut down with no notice, claiming: "For the past ten years Kagi has been struggling to recover from financial losses due to a supplier fraud situation. We have reduced the debt but the recovery has failed and forced us to close."<br />
* July 27: [[Portalgraphics.net]] has closed the portal to the "PGN Community", home to over 90000 unique user-submitted images<ref>{{url|http://www.portalgraphics.net/pg/guide/en_news20160520.html}}</ref><br />
* July 20: Kickasstorrents has been seized and the tor domain is offline as well. Fortunately, Proxies exist that have some of the data cached, but it's only a matter of time before the cache gets deleted or the proxies stop working. <ref>{{url|https://torrentfreak.com/feds-seize-kickasstorrents-domains-charge-owner-160720/}}</ref><br />
* July 19: [[Webmonkey]] now redirects to wired.com after having been abandoned for three years.<br />
* June 1: [[Arto]], the first Danish social site, is shut down (800.000 users about 2-3 TB data estimated).<br />
* June 1: http://www.blog.dk/ Danish blog site (subproject of Arto).<br />
* May 13: Beatport "will be shutting down the Streaming service and mobile app, Beatport News, the Video livestreaming platform, and the Events section."<ref>{{url|https://blog.beatport.com/en/an-update-on-beatport-services/}}</ref><br />
* May 1: Copy.com and CudaDrive are shut down.<ref>{{url|https://community.barracudanetworks.com/forum/index.php?/topic/27488-copy-and-cudadrive-services-will-be-discontinued/}}</ref><ref>{{url|https://blog.barracuda.com/2016/02/01/message-from-gm-of-storage/}}</ref><br />
* March 15: Barnes & Noble's Nook App Store, Nook Video, and the UK Nook Store are shut down.<ref>{{url|http://the-digital-reader.com/2016/03/03/bn-is-shutting-down-its-second-greatest-digital-blunder-on-15-march/}}</ref><br />
* February 9: Gametrailers officially closed, though the site is still up.<br />
* February 1: [[notepad.cc]] by Jacob Bijani (Tumblr creative director until 2013) ([http://0bin.net/paste/HHGBysvFQ732TBSy#uNpZlqUYH0C9S-BM/id/GMaXnQi5CFdl9WJM9ZNpplp urlteam results])More than 900 urls.<br />
* January 31: resume.io "Crazy-simple online resumes." by Jacob Bijani (Tumblr creative director till 2013)<br />
* January 25: [[Google Code]] is shut down.<ref>{{url|http://google-opensource.blogspot.ca/2015/03/farewell-to-google-code.html}}</ref><br />
* January 21: Google Maps Coordinate is shut down.<br />
* January 15: Oyster (book service) closed its shell.<ref>{{url|https://www.oysterbooks.com/boh7IeY7}}</ref><ref>{{url|http://blog.oysterbooks.com/post/122942822025/o}}</ref> The public-facing side was [http://archive.fart.website/archivebot/viewer/?q=oysterbooks saved] with [[ArchiveBot]] on 2015-10-04.<br />
<br />
===2015===<br />
* December 31: [http://www.guildportal.com/ GuildPortal]<br />
* October 29: Wizards of the Coast (Magic the Gathering, Dungeons & Dragons etc.) shut down its community forums.<ref>{{url|http://magic.wizards.com/en/articles/archive/news/wizards-coast-community-forums-be-shut-down-2015-09-16}}</ref><br />
* September 30: Club Nintendo shut down worldwide.<br />
* September 30: [[Yahoo Pipes]] gets clogged up.<ref>{{url|http://pipes.yqlblog.net/post/120705592639/pipes-end-of-life-announcement}}</ref><br />
* September 10: Sony discontinues PlayStation Mobile<ref>{{url|http://community.us.playstation.com/t5/PlayStation-Mobile-Support/INFO-Update-on-PlayStation-Mobile-PSM/td-p/45023971}}</ref>.<br />
* August or September: [[cyberpunkreview.com]]: 80s science fiction fansite and community's domain no longer resolves.<br />
* August 27: [[Blip.tv]] is gone in a blip.<br />
* <s>August 25: [[Blingee]] dies and deletes 9 years of user content</s>.<br />
* July 31: Google Moderator disappears (goes read-only on June 30).<ref>{{url|https://docs.google.com/document/u/0/d/1sPmkuVqoHKue7SlL3tSLrDsyufB8owMeR8AHx4LG8FA/pub}}</ref><br />
* July 24: Surfersparadise closes down most of its websites and content, including the Miss Surfersparadise illustration contest, after making an announcement just 11 days prior. <ref>{{url|http://news.surpara.com/2015/07/35772}}</ref><br />
* July 30: emoj.li, emoji-based social network was set up as a joke but they are shutting it down seriously.<ref>{{url|http://emoj.li}}</ref><br />
* July 10: SoundTracking sunsetted.<ref>{{url|http://www.rhapsody.com/soundtracking}}</ref><br />
* July 6: XFire social profiles are burnt up.<ref>{{url|http://www.reddit.com/r/Games/comments/39a41v/xfire_social_profiles_shutdown_save_your/}}</ref><br />
* June 30: Freebase shuts down.<br />
* June 13: Hungarian image hosting service [[keptarad.hu]] goes down with nearly 80,000 (or, according to inner source, 1.6 million) pictures, one week after it was scheduled to.<br />
* June 9: [[Pomf.se]] staff decided to go down with 1.6 million files (and thousands of pastes). Fortunately, they contacted ArchiveTeam and let them get a copy. <br />
* May 31: [[Gitorious]] is no longer glorious after acquired by GitLab<ref>{{url|https://about.gitlab.com/2015/03/03/gitlab-acquires-gitorious/}}</ref><br />
* May 30: [[Foodily]] recipes vanished in space void.<br />
* May 17: Codehaus.org got kicked out of the hosting market.<br />
* April 30: Hiveminder shut down (user data could be requested by email until May 8th.)<br />
* April 30: [[Google Helpouts]] shut down.<br />
* April 30: [[Grooveshark]] shut down due to years of copyright issues.<ref>{{url|https://recode.net/2015/04/30/grooveshark-the-free-music-service-that-used-to-scare-the-big-labels-gives-up/}}</ref><br />
* April 17: Yahoo's [[URLTeam|URL shortener]] y.ahoo.it drops its YQL<!-- (sic; Yahoo Query Language) --> table.<br />
* April 10: [[FriendFeed]] shut down, one day later than it was scheduled to.<br />
* April 9: [[Yahoo]] Transliteration got shut down for "focus" reasons. <ref>{{url|http://transliteration.yahoo.com/}}</ref><br />
* April 10: '''[[FriendFeed]]''' ({{url|1=http://friendfeed.com/}}) got unfriended by Facebook.<br />
* March 31: [[Trovebox]] got looted.<ref>{{url|https://trovebox.com/shutdown/}}</ref><br />
* March 31: [[RapidShare]] shut down.<br />
* March 19: PlaceMyPast.com got lost in history<ref>{{url|http://genealogysstar.blogspot.com/ncr/2015/03/demise-of-place-my-past-announced.html}}</ref>.<br />
* March 18: Animetake.com, Gogoanime.com, etc. is no-go and takes its anime offline<ref>{{url|https://twitter.com/AnimeTake/status/578322431749828608}}</ref><ref>{{url|1=https://answers.yahoo.com/question/index?qid=20150321231148AALtZBj}}</ref>.<br />
* March 15: twiigs.com did its last poll (server stayed up for about a month afterwards.)<br />
* March 15: [[Google Business Sitebuilder]] became a business sitebreaker.<ref>{{url|https://support.google.com/businesssitebuilder/answer/6098405}}</ref><br />
* March 15: {{url|1=http://www.cloudon.com|2=CloudOn}} was cloud-offed after getting acquired by [[Dropbox]].<br />
* March 12: [[Ovi Store]] is replaced by Opera Mobile Store.<br />
* March 12: [[Roon]] (roon.io) met its doom. The site was supposed to have shut down on Dec. 31, 2014.<br />
* March 8: DrivePop.com popped their drives.<ref>{{url|https://www.reddit.com/r/sysadmin/comments/2wm3ri/apparently_lifetime_subscription_8_months/}}</ref><br />
* March 7: Target Ticket expired.<br />
* March 5: Mail.in.com sent its last mail.<br />
* March 4: ToonTube (by Launchpad Toys) shut down. No site access, login only.<ref>{{url|https://toontube.launchpadtoys.com/login}}</ref><br />
* March 3: [[Internet Centrum]] deletes its phpcities.<br />
* February: CrimeLibrary.com was killed by truTV.<ref>{{url|https://twitter.com/CrimeLibrary/status/570021102791094273}}</ref><br />
* February 28: Web hosting service Page ON shuts down, taking several websites with it.<ref>{{url|http://page-on.ocn.ne.jp/close.html}}</ref><br />
* February 26: Apple crashes [[TestFlight]].<br />
* February 23: [[Odysee]] shuts down.<br />
* February 16: Google Talk is shut up.<br />
* February 15: Wizards of the Coast will shut down its LISTSERV mailing lists<ref>{{url|http://greyhawkery.blogspot.ca/2015/01/wotc-closing-down-listserv.html}}</ref>.<br />
* February 13: [[MediaCrush]] got crushed.<br />
* February 11: Spot.us has lost us<ref>{{url|http://www.knightdigitalmediacenter.org/blogs/agahran/2015/02/spotus-ends-insights-community-news-crowdfunding}}</ref>.<br />
* February 7: Cricket Wireless will discontinue Muve Music.<br />
* February 3: [[The Unofficial Apple Weblog]] is officially dead<ref>{{url|http://www.engadget.com/2015/02/03/so-long-and-thanks-for-all-the-fish/}}</ref>.<br />
* February 1: Molto melts away.<br />
* February 1: Samsung ChatON goes quiet.<br />
* February 1: [[Inkblazers]] will be Inkerasers<ref>{{url|http://www.inkblazers.com/blogs/Inkblazers-Shutdown/detail-page/10226}}</ref>. <br />
* January or February: {{url|1=http://www.nakido.com/|2=Nakido}}, a file sharing site, resolves a domain parking page.<br />
* January: [[AOL Autos]] is shut down.<br />
* January: Image hosting site Majhost quietly disappeared. Curiously, as of 2017, its whois registration is still renewed regularly. Its LEGO-related counterpart, Brickshelf, remains active.<br />
* January 31: Transformers Universe collapses<ref>{{url|https://www.transformersuniverse.com/en/news/2014/12/important-tu-announcement-161214}}</ref>.<br />
* January 26: [[Brace.io]] has been acquired by Squarespace<ref>{{url|http://blog.brace.io/2015/01/26/goodbye/}}</ref>. (Shutdown originally planned on 19th.)<br />
* January 15: eFreeGuestbooks couldn't compete with social media<ref>{{url|http://www.efreeguestbooks.com/mg/multi.pl?122505}}</ref><br />
* January 15: HP shut down webOS cloud services.<br />
* January 15: Nokia Chat became Nokia's latest victim.<br />
* January 15: HumanIPO publishes its last story.<br />
* January 15: [[vStreamers]] goes offline.<br />
* January 12: DreamBook is burned by DreamHost<ref>{{url|http://www.dreambook.com/}}</ref>.<br />
* January 12: [[Nokia Memories]] is forgotten<ref>{{url|1=http://www.nokia.com/ca-en/support/faq/?action=singleTopic&topic=FA144076}}</ref>.<br />
* January 12: Gnome (Gnome Platform, formerly Interclick) and Right Media Exchange (Right Media Inc) is shutdown by Yahoo!.<ref>{{url|http://www.businessinsider.com/yahoo-shuts-down-right-media-exchange-2015-1}}</ref><ref>{{url|http://adexchanger.com/online-advertising/yahoo-retires-genome-and-right-media-brands-simplifies-around-yahoo-ad-exchange/}}</ref><ref><nowiki>http://yahoo.tumblr.com/post/72591025021/introducing-the-new-yahoo-advertising</nowiki> ([https://archive.is/eGAIq archive.today] copy) (direct link blocked by wiki spamfilter)</ref><br />
* January 2: Leelah Alcorn's Tumblr blog and other online presence is removed<ref>[[wikipedia:Death_of_Leelah_Alcorn]]</ref>.<br />
* January 2: [[Nokia Trailers]], which was supposed to shut down on December 31, 2014, shut down.<br />
* January 1: everfree.net wasn't forever.<br />
* January 1: [[tvtag]] was untagged.<br />
<br />
===2014===<br />
<br />
* December 31: Yahoo! Classic Games shut down.<br />
* December 31: nRelate closed.<br />
* December 31: Samsung Video Hub and WatchON shut down.<br />
* December 31: Virginia Tech Filebox shut down.<ref>{{url|http://computing.vt.edu/kb/entry/3997}}</ref><br />
* December 27: [[Yahoo! Directory]] shut down 5 days early.<ref>{{url|http://searchengineland.com/yahoo-directory-closes-211784}}</ref><br />
* December 24: Slide Bureau closed down.<br />
* December 23: Magneto shut down.<br />
* December 22: Yahoo! Profiles was—Who are you again?.<br />
* December 21: Yahoo! sunsetted Maktoob forums.<br />
* December 20: Toontown Infinite, a fan-made Toontown Online revival, shut down.<ref>{{url|https://www.reddit.com/r/Toontown/comments/2pwgfj/tti_closing/}}</ref><br />
* December 18: Everest.com and its app died from altitude sickness<ref>{{url|http://techcrunch.com/2014/12/18/everest-the-peter-thiel-backed-app-for-achieving-your-dreams-shuts-down/}}</ref><br />
* December 17: thatguywiththeglasses.com got replaced by channelawesome.com.<br />
* December 16: [[Google News]] shut down in Spain.<ref>{{url|1=http://googlepolicyeurope.blogspot.ca/2014/12/an-update-on-google-news-in-spain.html?m=1}}</ref><br />
* December 15: [[Viddy]] and [[Epic]], video sharing services acquired by Fullscreen, shut down.<br />
* December 15: [[Relay.im]], bought by Kik, shut down.<br />
* December 12: BigPond Music shut down.<br />
* December 12: {{url|1=http://allgame.com|2=Allgame.com}} ran out of quarters. It was saved with ArchiveBot [https://archive.org/details/archiveteam_archivebot_go_20141119080001 here] (and available in the Wayback Machine).<br />
* December 10: [[ZipList]] got zipped up.<br />
* December 9: '''[[The Pirate Bay]]''' was raided. ''(Back online February 1, 2015.)''<br />
* December 5: Nokia Sync was discontinued.<br />
* December 2: Verizon shut down SugarString.<br />
* November: <s>OpenBitTorrent is mysteriously no longer tracking</s><ref>{{url|https://torrentfreak.com/worlds-largest-bittorrent-tracker-goes-down-141205/}}</ref>. (Back online by Jan 6, 2015) <ref>{{url|http://torrentfreak.com/top-torrent-trackers-return-online-150106/}}</ref><br />
* November: [[Jux]] went down before their official shutdown date, November 30, 2014.<br />
* November 30: Tree Puncher (Minecraft server host) got chopped down.<br />
* November 1: [[Easel]] shut down.<br />
* November 1: [[Qwiki]] slowed down.<br />
* October 30: [[Listn]] was shut down by Beatport.<br />
* October 24: Haivl.com, Vietnam's 9gag equivalent, shut down by the government authorities.<br />
* October 11: [[OhLife]] became NoLife.<br />
* October 1: '''[[Quizilla]]''' fizzled away. <br />
* September 30: '''[[Verizon Personal Web Space]]''' shut down.<br />
* September 30: '''[[Orkut]]''' got kut, [[Google]] thankfully left a public archive.<br />
* September 30: [[Yahoo! Education]] dropped out.<br />
* September 30: Petition Online shut down.<br />
* September 30: The [[National Atlas]] died.<ref>{{url|http://www.nationalatlas.gov/status.html}}</ref><br />
* September 25: <s>[[TwitPic]] shuts down.</s><ref>{{url|http://blog.twitpic.com/2014/09/twitpic-is-shutting-down/}}</ref><br />
* September 17: [[TuneWiki]] (not a wiki)<br />
* August: Hungarian microblogging service [[mommo.hu|Mommo]] disappeared.<br />
* August: [[Blogter.hu]] died after long illness.<br />
* August 31: [[Svpply]] and Want by Svpply were shut down.<br />
* August 31: The [[Yahoo! Contributor Network]] is destroyed by [[Yahoo!]].<br />
* August 15: '''[[Heello]]''' said goooodbye.<br />
* August 10: '''[[Fotopedia]]''' leaves a photo finish.<br />
* August 5: '''[[Justin.tv]]''' shuts down completely.<br />
* August 1: '''[[Yahoo! Voices]]''', formerly Associated Content, is shut up by [[Yahoo!]].<br />
* July/August: Potential massive Quebec newspaper shutdown around August 2, 74 newspapers were bought by {{url|1=http://blog.fagstein.com/2014/05/28/competition-bureau-quebecor-tc-newspapers/|2=Transcontinental}}.<br />
* July 31: [[Shortmail]] shut down.<br />
* July 31: [[Snapdisk]] got snapped.<br />
* July 31: [[Yahoo! Shine]] went dark.<br />
* July 31: Pinterest acquires Icebergs.com<ref>{{url|http://www.iol.co.za/scitech/technology/business/pinterest-buys-startup-icebergs-1.1728612}}</ref><br />
* July 3: {{url|1=http://www.thegridto.com|2=The Grid}} (magazine in Toronto) printed its last issue on July 3rd 2014 and the website disappeared some time after.<br />
* June 30: Hungarian [[iWiW]] social network closes; data not available from this date at all.<br />
* June 30: [[Me2Day]], a [[Twitter]]-like social network, kicks the bucket.<br />
* June 15: '''[[Rawporter]]''' enters "into an exclusive business partnership", deletes user photos and videos (which we rescue.)<br />
* June 1: '''[[Ubuntu One]]''' shuts down, gives its users until July 31 to grab their data.<br />
* May 20: Nintendo shut down [[Nintendo Wi-Fi Connection]] (except for the Wii and DSi Shop Channels).<br />
* May 6: [[Userscripts.org]] mysteriously vanished. {{url|http://userscripts-mirror.org}} popped up not long after.<br />
* April: {{url|http://jderef.com/}} is served a takedown notice by Oracle.<br />
* April 30: [[qik]].com shut down.<br />
* April 18: [[Twitter Music]] shuts down.<br />
* April 15: Beats shuts down [[MOG]].<br />
* April 14: [[CGHub]] quietly closes down. {{url|https://www.facebook.com/264398057068394/photos/a.265401656968034.1073741828.264398057068394/265401163634750/}}<br />
* April 7: [[Vizify]].com was acquired by [[Yahoo!]]. Bios were deleted on April 7, 2014. (Users could opt-in to extend date to September 4, 2014.)<br />
* March: [[Kephost.hu]] stepped off with half a million pictures.<br />
* March 31: [[IntoNow]], a [[Yahoo!]] acquisition, will ceased to function.<br />
* March 31: '''[[Mochi Media]]''' realizes Flash is dead and the game is over.<br />
* March 28: [[Readmill]], a social e-reader thing, is closing its doors on July 1, 2013. They have quite a few user pages documenting who read what, who says what and what people think of books.<br />
* March 19: <s>[[Full Disclosure]] ({{url|http://seclists.org/fulldisclosure/}}) is a security/hacker mailing list that was {{url|1=http://seclists.org/fulldisclosure/2014/Mar/332|2=suddenly suspended}}.</s><br />
* March 17: [[doo]] shut down.<br />
* March 11: [[Intel AppUp]] shut down.<br />
* March 3: '''[[My Opera]]''' closes its member profiles.<br />
* February: [[Videogum]] is shutting down.<ref>{{url|http://www.videogum.com/800151/hey-guys-we-have-to-talk-to-you-about-something/letter-from-the-editor/}}</ref><br />
* February 28: [[Outbox]] shuts down to rebuild itself.<ref>{{url|http://blog.outboxmail.com/post/74086768959/outbox-is-shutting-down-a-note-of-gratitude}}</ref><br />
* February 21: [[Yahoo!]] crashed [[Cloud Party]].<br />
* February 14: [[Gatsby]], not sure whether to file this here or under "Dead as a Doornail". {{url|1=http://gatsby.im/|=2The site's frontpage}} says that it's dead, but it's unclear whether hosted content is still available. Awaiting {{url|1=https://vpsboard.com/topic/3475-gatsbyim-discontinued/#entry52574|2=a response}} as to what happened to the data.<br />
* February 7: Schemer.com shut down by Google. (Time of death: 2014-02-08 00:13:52,184 EST.)<br />
* January 21: DrawQuest and '''[[Canv.as|Canvas]]''' shuts down. moot writes his {{url|1=http://chrishateswriting.com/post/74083032842/today-my-startup-failed|2=shut down notice.}}<br />
* ??? '''[[dl.tv]]''' {{url|http://dl.tv}} There is no new tech podcast on here for over a year. Good idea to start backing up all podcast on this site. Same for Crankygeeks. {{url|http://www.crankygeeks.com/}}<br />
<br />
===2013===<br />
<br />
* December 26: [[Wretch]] and [[Yahoo! Blog]] is closed by Yahoo!.<br />
* December 21: {{url|1=http://clanbase.org|2=ClanBase}} is no more. The company that bought the website in 2004, Global Gaming League, decided to "move on" after basically running the website into the ground.<br />
* December 20: [[WinAmp]], home of the Winamp media player, shuts down.<br />
* December 18: [[Warhammer|Warhammer Online: Age of Reckoning]] closes.<br />
* December 15: [[Everpix]], a photo-sharing service, shuts down. {{url|https://github.com/everpix/Everpix-Intelligence}} was saved, the rest lost.<ref>{{url|http://www.everpix.com/}}</ref><ref>{{url|http://www.theverge.com/2013/11/5/5039216/everpix-life-and-death-inside-the-worlds-best-photo-startup}}</ref> <br />
* December 12: [[Hyves]] closes its social network, but it's now got games!<br />
* November 18 (and back through 2012): Disney nuked a bunch of online games: Pixie Hollow Online, Cars Online, Pirates of the Caribbean Online, Toontown Online. The futures of the large fan forums and an extremely completist wiki are doubtful. {{url|http://fairies.disney.com/pixie-hollow-faq}} {{url|http://www.vmkforums.com/}} {{url|http://www.carsonlineforums.com/}} {{url|http://www.piratesonlineforums.com/}} {{url|http://www.pixiehollowforums.com/}} {{url|http://www.disneysonlineworlds.com/index.php/Main_Page}} The Pixie Hollow fan forum specifically announced that they will not be archived, and the Cars Online forum seems to have a similar warning, while the other forums for the shut down games will apparently be migrated into this: {{url|http://www.mmocentralforums.com/}}<br />
* November 11: [[Bre.ad]] is dead.<br />
* November 7: [[Dopplr]] drops out from the web.<br />
* November 1: [[Zapd]] deletes its user data from the website.<br />
* November 1: [[iGoogle]] shuts down.<br />
* November: [[BerliOS]] is barely alive.<br />
* November: [[Bitmit]], a Bitcoin marketplace, shut down.<br />
* November: Going to call this one before it even starts, friends: '''{{url|1=https://www.legacylocker.com/|2=Legacy Locker}}''' promises lifetime control of your data and return of your data to loved ones for just $300 for "lifetime", or $30/year. Archive Team says to just say '''No'''.<ref>{{url|http://www.washingtonpost.com/wp-dyn/content/article/2009/03/10/AR2009031001211.html}}</ref><br />
* October 31: Nintendo shut down {{url|1=http://www.fullscreenmario.com|2=Full Screen Mario}}. It's {{url|1=https://github.com/Diogenesthecynic/FullScreenMario|2=GitHub repository}} should be archived in case it goes down.<br />
* October 21: [[isoHunt]] was always going to shut down after an MPAA settlement. However, it did so earlier than expected to prevent archival efforts, claiming that 95% of torrents were available elsewhere. No mention of the metadata though.<br />
* October 11: RomBay shut down, now redirects to {{url|http://www.theoldcomputer.com}}<ref>{{url|https://twitter.com/rombay_com/status/388768860284788736}}</ref><br />
* September 30: [[OMGPOP]] shut down, and now redirects to Zynga's main site. There was a {{url|https://www.facebook.com/SaveOMGPOP|petition}} to stop it from closing, which did not gain much traction.<br />
* September 30: [[MSN TV]], aka WebTV, no longer accessible.<br />
* September 1st: Thebox.bz, a TV torrents tracker/site, shuts down.<ref>{{url|https://torrentfreak.com/major-tv-torrent-site-thebox-bz-calls-it-quits-130829/}}</ref><br />
* September: [[Freeblog.hu]] closes without notifying their users. Unknown number of blogs lost.<br />
* August-September: {{url|http://fileden.com/}}, a file hosting website, suddenly shuts down, giving their users little to no warning.<br />
* August 31: [[Rockmelt]] shuts down after being acquired by [[Yahoo!]].<br />
* August 21: [[Amplicate]] vanishes, leaves behind 502 Bad Gateway errors.<br />
* August 20: [[Catch]] closes its doors.<br />
* August 19: {{url|http://wowcoolfactsaboutgaming.com|Wow! Cool Facts About Gaming}} shuts down, thankfully leaves everything up.<br />
* August 9: [[Google Latitude]] shut down.<br />
* August 5: [[Astrid]] is shut down after being acquired by [[Yahoo!]].<br />
* July 31: All third party downloads disappear from [[Yahoo! Downloads]].<br />
* July 25: [[Yahoo! Stars India]] is shut down.<br />
* July 24: [[Snapjoy]], acquired by Dropbox in December 2012, is shut down.<br />
* July 19: [[Google]] shuts down Alfred.<br />
* July 9: [[Yahoo! Neighbors]] shuts down a day after it was supposed to.<br />
* July 8: AltaVista, one of the oldest search engines, shuts down.<br />
* July 1: FoxyTunes and Yahoo! RSS Alerts disappear from the web.<br />
* June 30: [[Yahoo!]] demolishes Yahoo! WebPlayer.<br />
* June 28: [[Yahoo!]] shuts down Axis, Browser Plus and Citizen Sports.<br />
* June 28: Nintendo shuts down all of its WiiConnect24 services, except for the Mii Channel, Wii Shop Channel, Mario Kart Wii Channel, and the Wii Speak Channel.<br />
* June 4: '''Adrenaline Vault''', a video game review site, has this posted on their Facebook profile: "Over the past weekend hackers hit the site with a DoS attack. Everything had been wiped and with no backups, everything was lost. It has been decided that Avault will remain closed. Rest in Peace, Avault."<br />
* June: '''{{url|1=http://ompldr.org/|2=Omploader}}''', an anonymous file upload site, has announced that they are about $2500 in the hole on hosting costs, and that there is possibility of their shutting down if donations do not improve. It stands to reason that there are some files among their database that are worth saving. An attempt to contact the administrator for more information and to be given a dump of the site was made, and he responded saying he'd be happy to rsync a copy of the data after some legal issues have been settled.<br />
* April 30: '''[[Posterous]]''', a blogging and life streaming platform, shut down its "Posterous Spaces" to focus on Twitter.<br />
* April 30: '''Circalit''' decides in March that {{url|1=http://circalit.createsend4.com/t/ViewEmail/r/26E73577D4220DBD/4433C195741969884AB3169DA1FD82E9|2=deleting is easier than migrating}} its prose-writing users.<br />
* April 20: '''Microsoft Collection Book''', a site dedicated to collecting information about Windows betas, shuts down due to a C&D from Microsoft. It reopened on May 5 as '''The Collection Book'''.<br />
* March 31: '''Zug.com''', a comedy website running since 1995 closed down, and replaced all its pages with a goodbye image.<br />
* March 29: {{url|http://wrathofheroes.warhammeronline.com/}} Play 4 Free Warhammer Online: Wrath of Heroes (WOH) shut down<br />
* March 25: [[Epinions]] locked out its users.<br />
* March 24: '''{{url|1=http://hub.opensolaris.org/bin/view/Main/|2=The OpenSolaris Hub}}''' and '''all sites under opensolaris.org''', including the site hosting the OpenSolaris source code, were decommissioned by Oracle. OpenSolaris was an open source computer operating system based on Solaris and originally created by Sun Microsystems. After the acquisition of Sun Microsystems in 2010, Oracle decided to discontinue open development of the core software, and replaced the OpenSolaris distribution model with the proprietary Solaris Express.<br />
* February 28: '''{{url|1=http://www.stickam.com|2=Stickam}}''', a major video chat service, shut down. Users were emailed and given the ability to download any recorded videos for 3 weeks in advance of the closing date.<br />
* February 21st: '''{{url|1=http://1up.com|2=1up.com}}''', {{url|1=http://www.ugo.com/|2=ugo.com}}, and {{url|1=http://www.gamespy.com/|2=gamespy.com}} all run out of lives.<br />
* February: [[Regretsy]] shuts down.<br />
* January 31: [[Do.com]] shuts down.<br />
* January: {{url|http://go.to}}, an [[URLTeam|URL shortener]], has all of its domains on sale on Sedo. No official word just yet, though.<br />
<br />
===2012===<br />
<br />
* December: {{url|1=http://pic2.piczo.com/go/home|2=Piczo}}, a social network for teens, has announced that it's shutting down.<br />
* October 29: '''{{url|1=http://gamecorner.pl|2=Gamecorner.pl}}''', a Polish video game news portal, was closed in May, and later wiped entirely on October 29. The articles have been retained at the publisher's other video game portal, Polygamia.pl, but the article comments and the forums are gone (It also had user blogs, but they seemed to have been erased much earlier.)<br />
* September 26: {{url|1=http://cia.vc|2=CIA.vc}}, a central distributor of FOSS commit messages to IRC channels, got its database deleted by its web host. There were no backups. It had been running for a decade (although it had changed maintainership a year before).<br />
* August 17: '''Ponibooru''', a famous My Little Pony-related imageboard, {{url|1=http://www.equestriadaily.com/2012/06/ponibooru-shuts-down.html|2=shut down}} by August 17. All of the images themselves (but not the comments) were available to download via torrents, though it is unknown if the torrents are still available. Currently the most popular/upvoted images are available via another imageboard, Derpibooru, but their copy is incomplete.<br />
* August: [[Parodius Networking]], which hosts numerous web sites related to classic video game platforms, died<br />
* July 30: '''{{url|1=http://kasabi.com|2=Kasabi}}''', a data publishing platform created by {{url|1=http://talis.com|2=Talis}} was {{url|1=http://blog.kasabi.com/2012/07/09/shutting-down-kasabi/|2=announced}} to be closing on July 30, 2012. While the service has only been around for ~2 years it represents a unique look at services for Linked Data, and contains a variety of datasets. Kasabi has a {{url|1=http://blog.kasabi.com/2012/07/16/archive-of-datasets/|2=blog post}} that announces the availability of datasets contained in Kasabi to ease archiving.<br />
* July 26: [[noob.hu]] doesn't accept more images. Uploaded pictures still there long after, though.<br />
* July 1: The Polish social network '''[[wikipedia:Grono.net]]''' has disappeared, replaced by a file hosting service '''grono.net.pl''' on July 1, 2012. Most content from the old site was supposed to be migrated, but, according to a message on the main page, technical difficulties have delayed the migration by one or two weeks. It's getting increasingly late...<br />
* June 30: '''Apple''' '''[[MobileMe]]''', '''[[MobileMe#iDisk | iDisk]]''', '''[[MobileMe#web.me.com / iWeb | iWeb]]''', and included services. This major website and these services will shut down in {{url|1=http://support.apple.com/kb/HT4597|2=2012}}, simply because web hosting is boring and they want to focus on the exciting "iCloud". <ref>{{url|http://www.apple.com/mobileme/transition.html}}</ref><ref>{{url|http://support.apple.com/kb/HT4597}}</ref><br />
* April 30: Google Wave shut down on April 30th.<br />
* April: '''{{url|1=http://blog.convore.com/post/17951919109/convore-shutting-down-april-1st|2=convore.com}}''' shut down in April 2012. The site hosted IRC conversations, and involved a lot of JavaScript.<br />
* February: Hungarian free hosting provider {{url|1=http://eplanet.hu|2=Eplanet}} stops free service as of February 2012; unknown number of pages disappeared and probably deleted.<br />
* January 19: The popular file hosting service '''Megaupload''' has been shut down in January 2012; with it, '''Megavideo''' too is gone. It was mainly used for copyright infringement, but lots of perfectly regular files were hosted on it.<br />
<br />
==== Because we know better ====<br />
* [[Fileplanet]] <ref>{{url|http://www.fileplanet.com/}}</ref>. Already fully archived.<br />
<br />
===2011===<br />
<br />
* End of 2011: '''{{url|1=http://ghost.cc/|2=Ghost Cloud Computing}}''' became a ghost of itself <ref>{{url|http://ghost.cc/home/SignUp.jsp}}</ref>.<br />
<br />
* Late October/November: '''{{url|1=http://itdied.com/|2=It Died}}''' by Glenn Fleishman. a site dedicated to indicating sites that have died, itself died. (Keep the {{url|1=http://itdied.com/atom.xml|2=RSS Feed}} around in case that changes, though).<br />
<br />
* September/October: The closure of '''Google Buzz''' was announced in October. Luckily Google released a tool to download your content from it called [[Google Takeout]]: {{url|https://www.google.com/takeout/}} Besides Buzz, Google shut down many of its other minor services, such as Aardvark, Sidewiki, and others: {{url|http://googleblog.blogspot.com/2011/09/fall-spring-clean.html}}<br />
<br />
* August/September: '''[[Google Labs]]''' closed. <ref>{{url|1=http://www.pcmag.com/article2/0,2817,2388881,00.asp#fbid=7kZ39-1XQUH}}</ref> and many great/experimental one of a kind tools vanished. Among many others "google sets" that had been around since a long time, "City Tours" some includeing user generated content and the exciting "google squared" <ref>{{url|http://4.bp.blogspot.com/_ZaGO7GjCqAI/SibWbewOy5I/AAAAAAAAQBM/8lb7UA6AWPY/s640/google-squared-species.png}}</ref> that was an approach to pass more artificial intelligence to the user than conventional searchengines (compareable to wolframalpha) but seemingly based on a bigger/vast pool of data just like standard google searchresults). Since there is hardly any obvious rationale(?) for closeing down "Google Labs" it pictures google as being either less supportive or even hostile to new inoventions and less responsible with usergenerated content or more secretive about their ongoing projects than one might thought before or than Google might was before indeed. 1 Jan 2011 [[User:Whatsgoingonwithgoogle|Whatsgoingonwithgoogle]] 18:06, 17 October 2011 (UTC)<br />
<br />
* June 3: '''[[Forums.starwars.com]]''': {{url|1=http://www.starwars.com|2=StarWars.Com}} {{url|1=http://forums.starwars.com/ann.jspa?annID=3|2=announced}} the closure of their {{url|1=http://forums.starwars.com|2=forums}} on June 3, 2011. (Forum will lock on 29 April 2011) {{url|1=http://theforce.net/latestnews/story/StarWarscom_Forums_Shutting_Down_In_June_137497.asp|2=tf.n report}}<br />
<br />
* June 1: '''[[Prodigy Pages]]''' shut down on June 1,2011.<br />
<br />
* May 31: '''{{url|1=http://www.myphotoalbum.com/|2=MyPhotoAlbum.com}}''' closed on May 3, 2011 and deleted everything on May 31, 2011. Users who heard about the closure were given the options of either transferring their photos and videos over to dotPhoto.com or purchasing a DVD with their content for $15.00.<br />
<br />
* May 24: [[Yahoo]]! has {{url|1=http://techcrunch.com/2011/02/24/yahoo-to-shut-down-mybloglog-on-may-24/|2=announced}} that '''[[MyBlogLog]]''' will be closed on 24 May 2011. '''UPDATE:''' Yup.<br />
<br />
* April 16: '''[[Encyclopedia Dramatica]]''' shutdown on 16. April 2011 without warning. Ongoing reconstruction Efforts. A lot of Images and Articles are probably lost. (The replacement OhInternet is a very strongly sanitized Version of ED.) <s>ED is claiming that they are in danger of shutting down. Despite the controversial nature of many articles hosted on the wiki, this would be a big loss of historical records.</s><br /><font color="red">A lot of the Images and Pages are still missing. Help appreciated.</font><br />
<br />
* March: '''{{url|1=http://team.gaia.com/blog/2010/3/important-gaia-announcement|2=Gaia Community}}''' shut down at the end of March.<br />
<br />
* March 31: '''[[Yahoo! Video]]''' shut down on March 31st, 2011 and was reborn as a video portal.<br />
<br />
* March 16: '''Microsoft''' closed '''Windows Live Spaces''' on March 16, 2011. Spaces owners had the option to migrate their blogs to '''WordPress''' or to make copies. As of January 4, 2011, they could no longer edit their existing Spaces.<ref>{{url|http://explore.live.com/windows-live-spaces-help-center}}</ref><br />
<br />
* February 22: The [[Insurgency Wiki]] is a wiki with a community that created multiple guides and raids for Anonymous, in a similar manner to [[Encyclopedia Dramatica]]. It's status has always been unclear, with many mirrors coming and going. But as of Feb. 22, 2012, the last mirror, Partyvan.info, looks like it has some damning database error. Just in case, the Bibliotheca Anonoma has made a full backup, including all available images available.<br />
<br />
* February/June: The IRC logging service {{url|1=http://irseek.com|2='''IRSeeK'''.com}} shut down. Back in 2007, it had [https://web.archive.org/web/20080204010231/http://www.irseek.com/blog/?p=3 controversially] used un-labeled bots to archive (and publish) logs of IRC channels without notification or permission.<br />
<br />
* January 17: '''The Sims Carnival''': <ref>{{url|http://www.simscarnival.com/games/CarnivalMonkey/35068/The-Sims-Carnival-Says-Goodbye}}</ref><br />
<br />
* January 1: '''[[ProHosting]]''' {{url|http://free.prohosting.com}} closed hosted sites on 1 Jan 2011<br />
<br />
* January: The wiki hosting site '''wik.is''', hosted by MindTouch, shut down on the first week of January 2011; the explanation being that "in order to continue to support the growing needs of our MindTouch Express users, we are offering MindTouch Cloud", which "opens up additional features and functionality that are not available in Wik.is.". The only way you'd know all that is if you receive a warning e-mail from MindTouch. They offer to keep your site running by "upgrading to our paid Cloud version by {{url|1=http://campaigns.mindtouch.com/Wik.isDecomissioningMigrationInterest.html|2=filling out this short form.}}"<br />
<br />
===2010===<br />
* December 17: The '''{{url|1=http://www.symbian.org/|2=Symbian Foundation}}''' will shut down its websites, Twitter account, Facebook page, bug trackers and remove access to its source code on 17 Dec 2010<ref>{{url|http://www.engadget.com/2010/11/27/symbian-foundation-axing-websites-on-december-17th-source-repos/}}</ref><ref>{{url|http://developer.symbian.org/wiki/Symbian_Foundation_web_sites_to_shut_down}}</ref>.<br />
* December: '''{{url|1=http://machinima.com|2=Machinima.com}}''' was reworked in December 2010, and by "reworked" we mean massacred. Most notably, the forums were deleted, as well as tons of older articles. <br />
* November: '''{{url|1=http://www.brightfuse.net|2=BrightFuse}}''' was a small social network started as a side venture by CareerBuilder.com in August 2009. It was quietly shutdown November 2010 without much fanfare. At its height it has 100k users.<br />
* October 31: '''isweb lite''', the Japanese GeoCities, shut down on October 31. Thousands of personal homepages of artists and illustrators were deleted forever. A tiny sample of the pages deleted: <ref>{{url|http://togetter.com/li/64058}}</ref> '''isweb''' itself (paid hosting!) will shut down in May 2012. <ref>{{url|http://portal.faq.rakuten.co.jp/app/answers/detail/a_id/15387/}}</ref><br />
* September/October: '''{{url|1=http://closing.vox.com/|2=Vox}}''' shut down at the end of September 2010.<br />
* Mid-2010: '''[[JuniorNet]]''', a subscription based online portal for children, was quietly shut down nearly a decade after it dot-bombed and was acquired by former employees.<br />
* May 31: {{url|http://www.cgillust.com/|cgillust.com}} essentially closes down its galleries, and members are migrated to [[Portalgraphics.net]]<br />
* April/May: '''{{url|1=http://www.kidradd.com|2=Kid Radd}}''' was a notable and quite popular webcomic which vanished when AT&T discontinued their Worldnet service. Thankfully, an archive is available, e.g. {{url|1=http://tangent128.name/depot/kid_radd.zip|2=here}}.<br />
* March 31: '''[[Extra.hu]]''', largest free hosting Hungarian hosting provider goes paid-only; deletes unknown number of free sites on 31 March 2010.<br />
* March 1: '''{{url|1=http://storytlr.com/|2=Storytlr}}''', a lifestreaming site, stopped hosting March 1st 2010.<br />
* March: '''{{url|1=http://platinum.ac|2=Platinum}}''', once a popular Finnish web site associated with electronic dance music, clubbing/raving, and the other related things was closed in March after been running for years. All the content posted to the forums of the site was, however, obtained and made available by {{url|1=http://klubitus.org|2=Klubitus}}, another related portal popular in Finland.<br />
<br />
===2009===<br />
<br />
* December 6: '''favrd''', a website that aggregated favorite tweets from twitter, abruptly shut down on December 6, 2009 with absolutely no warning, killing off thousands of highlighted entries added by group-consensus over significant months. As a reward for their efforts, founder Dean Allen wrote this helpful message: ''"Alas, stars on Twitter have become mere take-out menus hung on the doors of other restaurants. There are still lots of clever and funny things to read every day, but finding these is no longer a challenge â you already follow your sources. Sites like this one now serve mainly as fuel for emotional up-fuckedness in the guise of a game. Just an idea: next time you see something you like, write the person who made it a note telling them so. Even better, explain why. Take care!"'' Advice to people who want to work with Dean Allen's projects in the future: don't.<br />
* November: '''here.is''' seems to permanently off-line. It ceased to re-direct email for some time ago and as per 11-23-09 it doesn't redirect even URLs any longer.<br />
[[Image:Encarta.jpg|right|300px|Discontinuedpedia]] <br />
* October 31: '''Microsoft Encarta''', the online encyclopedia with a 15+ year history, is being shut down. The US version will shut down on October 31, 2009 and the Japanese version on December 31, 2009. <ref>{{url|http://www.reuters.com/article/CMPTRS/idUSLV28230720090331}}</ref><br />
* October 26: '''[[GeoCities]]''': Shock! Repeat Offender '''[[Yahoo]]''' announced that it would close GeoCities "later this year...We'll send you more details this summer." <ref>{{url|http://help.yahoo.com/l/us/yahoo/geocities/geocities-05.html}}</ref>. The plug was pulled on October 26th 2009. See the [[Geocities]] project page for more details.<br />
* August 31: '''Microsoft's SoapBox''' has announced it is getting off said soapbox on August 31, 2009. <ref>{{url|http://arstechnica.com/microsoft/news/2009/07/soapbox-microsofts-youtube-dies-on-august-31-2009.ars}}</ref>. <br />
* August 30ish: '''ArchNacho's & TortillaGodzilla's Quality ROMs''', a site that hosted ROMs for NES, SNES, and Genesis games, which has announced its effective death back in January 2006, is now finally completely inaccessible, both on its original domain {{url|http://www.qualityroms.com}}, and on the site that the domain masked {{url|http://home.no.net/qualrom/}}. The Wayback Machine contains a mirror of the site up through August 30, 2007, which is after all updates to the site ceased. All ROMs hosted on QualityRoms are included in the mirror and can be downloaded from there.<br />
* August 24: '''Microsoft's Popfly''' <ref>{{url|http://popflyteam.spaces.live.com/blog/cns!51018025071FD37F!336.entry}}</ref> pops off into nowhere on August 24, 2009.<br />
* July 13: '''Yahoo! 360''' announces <ref>{{url|1=http://blog.360.yahoo.com/blog-1qCkw2Ehaak.hdNZkEAzDrpa4Q--?cq=1}}</ref> that they are closing up shop on July 13, 2009. Of course, you can still register an account but that's the first thing you're told.<br />
* June 25: '''Imeem''', a site for sharing music and convincing yourself that what you're hearing is good, {{url|1=http://blog.imeem.com/2009/06/25/simplifying-imeem/|2=announced}} on June 25, 2009 that they were "simplifying" things and deleting all user-generated photos and videos uploaded by users. They gave everyone '''five days''' to get their photos off, and then extended it to ''twenty days'' from the ensuing hue and cry. The uploaded videos had no way to extract them back.<br />
* June 15: '''{{url|1=http://www.jumpcut.com|2=Jumpcut.com}}''' became the latest example of Yahoo!'s awesome respect for history and data, announcing the closure of the video hosting and editing site, for June 15, 2009. A software utility has been released to allow you to download the movies from Jumpcut. Otherwise, you are not in great shape - Yahoo says you can move your videos to Flickr, but Flickr cuts off at 90 seconds. A lot of homemade video is going to disappear.<br />
* May 31: '''Rejaw''', a microblogging platform, has announced that it will be shutting down on May 31 2009 <ref>{{url|http://rejaw.com/rejaw/shout/OOfs2wUaLql}}</ref>. It's gone.<br />
* May 21: '''MSN QnA Beta''' closed on May 21 <ref>{{url|http://liveqna.spaces.live.com/blog/cns!2933A3E375F68349!2244.entry}}</ref><br />
* April 20: '''{{url|1=http://www.coghead.com|2=Coghead}}''', " a web-based service for building and hosting custom online database applications and a software as a platform 'utility computing' company", announced it had closed up on February 20, 2009, and that the site would go down permanently on April 20, 2009. <ref>{{url|1=http://blogs.zdnet.com/collaboration/?p=349}}</ref>. It did.<br />
* April 17: '''{{url|1=http://furl.net/|2=Furl}}''' was a social bookmarking service that had been around since 2004. It was acquired by Diigo (announced on March 9), allowed people to opt into transferring their bookmarks to Diigo, and shut down on April 17.<ref>blog.diigo.com/2009/03/16/welcome-furl-users/ (link blocked by spam filter)</ref><ref>{{url|1=http://www.techcrunch.com/2009/03/09/diigo-buys-web-page-clipping-service-furl-away-from-looksmart/|2=Techcrunch post}}</ref><br />
[[Image:HP upline goes offline.jpg|right|300px|Did we say upline? We meant offline.]]<br />
* March 31: It doesn't get more ironic than this: '''{{url|1=https://www.upline.com/|2=Upline}}''', a HP-owned online backup service, is being shut down.<ref>{{url|1=http://news.cnet.com/8301-17939_109-10173136-2.html?part=rss&subj=news&tag=2547-1_3-0-5}}</ref> ''They almost immediately turned off the backup process,'' and then announced all your restorable data would go offline on March 31, roughly 30 days after announcement. Surprise!<br />
* March 31: Google acquired '''{{url|1=http://etherpad.com|2=Etherpad}}''' on 4th December, 2009 and immediately {{url|1=http://etherpad.com/ep/blog/posts/google-acquires-appjet|2=announced}} a March 2010 content deletion date. After community pressure, Google has decided to {{url|1=http://etherpad.com/ep/blog/posts/etherpad-back-online-until-open-sourced|2=open source the Etherpad codebase}}, keeping the service alive until then. The site closed down shortly after. Fortunately there are now are [http://www.google.com/search?q=etherpad+alternatives numerous] [http://www.google.com/search?q=etherpad+clone alternatives].<br />
* March 30: '''[[Yahoo_Briefcase|Yahoo Briefcase]]''', a positively ancient site run by Yahoo that provided you with 25 free megabytes of storage space for your junk, sent a mail to what were likely years-old contact addresses to tell them they had a little more than a month to get their files out, March 30, 2009. After that, the files would be deleted. What, Yahoo doesn't have a spare memory stick to store what must be the amount of files in this service for the next year?<br />
* March 25: '''Yahoo! Farechase''', an airline fare aggregation and searching site, was shut down on March 25, 2009. It had previously been its own company, founded in 1999, and purchased by Yahoo! in 2004. <ref>{{url|http://news.cnet.com/Yahoo-buys-travel-company/2100-1032_3-5300561.html}}</ref><br />
* March 20: '''{{url|http://www.spiralfrog.com|Spiralfrog}}''', "a FREE service that lets you download over 3 million songs and videos, legally and safely", pulled up stakes in the night and completely shut down on March 20, 2009. <ref>{{url|http://arstechnica.com/web/news/2009/03/ad-based-music-service-spiralfrog-croaks.ars}}</ref> Things looked so promising in 2006: <ref>{{url|http://arstechnica.com/old/content/2006/08/7611.ars}}</ref> Oh, and sadly, all your music you downloaded from them will stop working within 30 days or less. <ref>{{url|http://arstechnica.com/old/content/2007/09/spiralfrog-debuts-with-free-ad-supported-music-downloads.ars}}</ref><br />
* March 17: '''{{url|http://seattlepi.nwsource.com/|The Seattle Post-Intelligencer}}''' was {{url|1=http://seattlepi.nwsource.com/business/395463_newspapersale10.html|2=put up for sale}}, but found no buyer, and the print edition stopped on March 17th 2009 after 146 years. <ref>{{url|http://www.thenewstribune.com/news/columnists/zeeck/story/591181.html}}</ref> Initially, reports indicated it would shut down the website as well as the paper, but a plan was apparently in place to run a "skeleton crew" on an internet-only site, which continues to operate.<br />
* March 11: '''{{url|1=http://www.videosift.com|2=Videosift}}''' had a combination database and backup failure, losing: "All votes, ever. All member usernames who registered later than around 12 months ago. All member rankings. Your member profile info (e.g., bio, favorite sift, etc.), if any. All activity that happened on the site yesterday, March 11." This is unlikely to kill the site, but an awful lot of data was lost.<br />
* March 6: '''{{url|1=http://www.scoopt.com/|2=Scoopt}}''', a "citizen journalism" site run by Getty images to allow the uploading of images by citizen journalists and the chance to be licensed to news organizations, announced they would no longer take any new imagery after February 6, 2009, and will shut down completely on March 6, 2009. Some content uploaders "may" be contacted about being absorbed into the main Getty site.<br />
[[Image:20090227.jpg|right|300px]]<br />
* Sometime between [https://web.archive.org/web/20090228114022/http://music.download.com/ February 28th] and [https://web.archive.org/web/20090323020108/http://music.download.com/ March 23d]: '''{{url|1=http://music.download.com/|2=music.download.com}}''' was redirected to Last.fm. The free music it offered does not seem to have been transferred, however (the band Ancient Teknologi had several tracks available on music.download.com, but only one available on Last.fm). As of 28 February, it claimed to have 111.052 MP3s.<br />
* February 28: '''[[Lycos Europe]]''' shut down their '''Tripod''' hosting service on February 28, 2009. <ref>{{url|http://www.washingtonpost.com/wp-dyn/content/article/2009/01/18/AR2009011800224.html}}</ref> <ref>{{url|http://www.paidcontent.co.uk/entry/419-lycos-europe-killing-tripod-customers-warned-to-back-up/}}</ref> Note that Lycos Europe are distinct from Lycos.com. '''[[Lycos Europe]]''' is also shuttering the social networking site '''Jubii''' as of February 15, 2009. <ref>{{url|http://www.techcrunch.com/2009/01/18/lycos-kills-jubii-while-theyre-at-it/}}</ref> A Danish version of the site will remain open for the time being.<br />
* February 27: '''The {{url|1=http://www.rockymountainnews.com/|2=Rocky Mountain News}}''' has shut down as of February 27, 2009. <ref>{{url|http://www.rockymountainnews.com/news/2009/feb/26/rocky-mountain-news-closes-friday-final-edition/}}</ref> We're watching to see what happens with the website (and the material, and the newspaper itself). With a 150-year history, there's a lot of backstory, and how this chronicler of history will end up, so too will many others. There is an excellent documentary about the last days of the Rocky Mountain News {{url|http://www.vimeo.com/3390739|here}}.<br />
* February 23: '''Windows Live''' shut down the '''MSN Groups''' on February 23. They extended their original date from February 21st to give Group owners the weekend to prepare. <ref>{{url|1=http://windowslivewire.spaces.live.com/Blog/cns!2F7EB29B42641D59!34861.entry?sa=503427140}}</ref><br />
* January 31: '''{{url|http://ma.gnolia.com/|ma.gnolia.com}}''' had a catastrophic disk corruption/failure on January 31, 2009. From the message on the main site: ''"As I evaluate recovery options, I can't provide a certain timeline or prognosis as to to when or to what degree Ma.gnolia or your bookmarks will return; only that this process will take days, not hours."'' Ma.gnolia had an excellent export feature... hope you used it and did the backups they didn't!<br />
* January 28: '''{{url|1=http://dominomag.com/|2=Domino Magazine}}''', a style/interior design magazine, announced that they were shutting down on January 28, 2009. {{url|1=http://mydecofile.dominomag.com/|2=My Deco File}}, one of the site's heavily used social bookmarking features (somewhat like delicious for images) will remain up for a few weeks to allow users to save their stuff.<br />
* January 28: '''{{url|1=http://culture11.com/home|2=Culture11}}''' ran out of money.<ref>{{url|http://www.patrolmag.com/scanner/1263/culture11-is-over}}</ref><br />
* January 27: '''Yahoo Pets''' was shut down and redirected with absolutely no notice around January 27, 2009. <ref>{{url|http://blog.dogster.com/2009/01/28/yahoo-quietly-shutters-yahoo-pets-grin/}}</ref><br />
* January 17: '''[[totse]].com''' {{url|1=http://www.totse.com/|2=closed its doors}} on January 17, 2009. As of Jan 20th, a mirror {{url|1=http://totse.danladds.com/|2=exists}}, alongside a {{url|1=http://totse.danladds.com/text/|2=repository of the totse text files}}.<br />
* January 15: '''[[Ficlets]].com''' (owned by AOL) has announced they are closing on January 15, 2009. <ref>{{url|http://www.peopleconnectionblog.com/2008/12/02/ficlets-will-be-shut-down-permanently/}}</ref><br />
* January 15: '''[[Circavie]].com''' (owned by AOL) has announced they are closing on January 15, 2009. <ref>{{url|http://www.peopleconnectionblog.com/2008/12/03/circavie-will-be-shut-down-permanently/}}</ref><br />
* January 14: '''Several Google services''' have shut down. <ref>{{url|http://www.readwriteweb.com/archives/google_giveth_and_it_taketh_away.php}}</ref> Most importantly, Google Video stopped accepting new uploads (to avoid competition with Google-owned YouTube), and Google Catalog Search was erased.<br />
* January 11: '''[[Co.mments]].com''' closed down on January 11, 2009.<br />
* January 9: '''[[AOL_Pictures|AOL Pictures]]''' said so long on January 9, 2009. To their credit, you can still yank your stuff into other photo services until June 2009. (At least, according to their goodbye letter.)<br />
* January 6: '''Electronic Gaming Monthly''' has recently shut its doors. <ref>{{url|http://multiplayerblog.mtv.com/2009/01/06/egm-closed-ziff-lays-off-30/}}</ref><br />
<br />
===2008===<br />
<br />
* {{url|http://blogs.zdnet.com/BTL/?p=11227|Overview of 2008 Technology News from zdnet}}<br />
<br />
''Biggest Botched Shutdowns of 2008''<br />
<br />
* October 31: '''{{url|1=http://www.peopleconnectionblog.com/2008/11/06/hometown-has-been-shutdown|2=AOL Hometown}}''' (owned by AOL) was officially killed on October 31, 2008. {{url|1=http://ascii.textfiles.com/archives/1617|2=Jason wrote about it.}}<br />
[[Image:Stayclassyaol.png|thumb|right|470px|The full extent of warning AOL gave about shutting down Hometown.]]<br />
* October 27: '''Digitalrailroad.net''', a photo hosting site, gave their users a 24-hour eviction notice on October 27, 2008. They shut down 10 hours after the 24-hour notice. <ref>{{url|http://news.cnet.com/8301-17939_109-10078042-2.html}}</ref><br />
<br />
''Other deaths of 2008''<br />
<br />
* December 31: '''{{url|1=http://pingmag.jp/|2=Pingmag}}''', the magazine from Tokyo about "Designing and Making things," simultaneously rang in the new year and checked out of existence on December 31, 2008.<br />
* December 31: '''{{url|1=http://www.lively.com/goodbye.html|2=Lively}}''', a 3D Avatar space experiment, was killed in a really crappy way by Google on December 31, 2008.<br />
* December 27:'''{{url|1=http://blog.mixwit.com/|2=Mixwit}}''' said goodbye on December 27, 2008. <ref>{{url|http://news.cnet.com/8301-17939_109-10126057-2.html}}</ref><br />
* December 23: '''{{url|http://www.castlecops.com/|Castle Cops}}''' put away their badges on December 23, 2008. <ref>{{url|http://www.idf50.co.uk/clubhouse/computer-room/15996-castle-cops-closed-down.html}}</ref><br />
* December 19(?): '''[[Google Research Datasets]]''', shut down on December 19(?), 2008. <ref>{{url|http://blog.wired.com/wiredscience/2008/12/googlescienceda.html}}</ref><br />
[[Image:Final image 01.png|400px|right|thumb|The last person at Yahoo! Kickstart turning off the lights.]]<br />
* December 18: '''Yahoo! Kickstart''', a social network for college students revealed in 2007 <ref>{{url|http://mashable.com/2007/08/30/yahoo-kickstart/}}</ref> got expelled on about December 18, 2008. <ref>{{url|http://www.techpluto.com/yahoo-kickstart-shutdown/}}</ref><br />
* December 16: '''Flip.com''', a social network for teenage girls, shut down on December 16, 2008. Users were advised to print out their digital scrapbooks as backups. <ref>{{url|http://news.cnet.com/8301-1023_3-10112021-93.html}}</ref><br />
* December 15: '''{{url|http://pownce.com/|Pownce}}''' was closed on December 15, 2008.<br />
* December 8: '''{{url|http://getsatisfaction.com/iwantsandy/topics/a_fork_in_the_road_an_important_announcement_about_i_want_sandy|I Want Sandy}}''' was shut down on December 8, 2008. A lot of people complained about this one, while others thanked the site for shutting down and wished the founder well! <br />
* December 3: '''{{url|1=http://live.yahoo.com/|2=Yahoo Live!}}''' died on December 3, 2008. <ref>{{url|http://news.cnet.com/8301-13515_3-10081486-26.html}}</ref><br />
* October 31: '''{{url|1=http://ourworld.cs.com/sfrederick2/index.htm?f=fs|2=Compuserve OurWorld}}''' slipped into history on October 31, 2008.<br />
* October 29: '''{{url|1=http://blogrush.com|2=BlogRush.com}}''' failed to provide bloggers with the traffic they so desperately desired, and the creator admitted on October 29, 2008 that his 4AM idea may not have been so brilliant. <ref>{{url|http://mashable.com/2008/10/29/blogrush-shutdown/}}</ref><br />
* September 29: '''ScribbleWiki''' wikis go offline. Apparently {{url|1=http://wikiindex.org/ScribbleWiki|2=their servers crashed}} and they didn't have a backup.<br />
* September 28: '''Yahoo! Mash''', a social networking site, became mush on September 28, 2009, after 30 days warning. <ref>{{url|http://mashable.com/2008/08/28/yahoo-mash-has-been-quashed/}}</ref> <br />
* September 26: '''Uber.com''' was a social blog site that died. <ref>{{url|http://news.cnet.com/8301-13577_3-10052301-36.html}}</ref><br />
** Not too be confused with the ridesharing service of the same name, which now owns the domain name uber.com.<br />
* September 18: '''{{url|1=http://wallop.com/|2=Wallop}}''', Microsoft's attempt at starting a social network, died on September 18, 2008. All that remains is a few Facebook apps. <ref>{{url|http://news.cnet.com/8301-13577_3-10041856-36.html}}</ref> <ref>{{url|http://www.techcrunch.com/2008/09/15/wallop-takes-a-leap-into-the-deadpool/}}</ref><br />
* May 21: '''Virtual Magic Kingdom''' {{url|1=http://www.intercot.com/discussion/showthread.php?t=130548|2=closed its gates}} on May 21, 2008. <ref>{{url|http://www.virtualworldsnews.com/2008/04/disneys-virtual.html}}</ref> The amount of broken hearts and anguish over this move was amazing, and a warning sign to any family-oriented site that encourages families to join up.<br />
** Some of the more anguished fans have gotten together in various forms to recreate VMK, including {{url|1=http://game.myvmk.com/|2=MyVMK}}, {{url|1=http://www.vmkrevisited.com/|2=VMKRevisted}} (a memorial site), and {{url|1=http://www.openvmk.com/|2=OpenVMK}} (although OpenVMK shutdown due to {{url|1=https://docs.google.com/document/d/1qTdpgcLUd-Hg6-FZzkVEju4x1aMlhbMNX6snlUNgnOM/|2=internal squabbles}}.)<br />
* February 14: '''[[wikipedia:Think_Secret]]''' was killed by Apple and shut down on February 14, 2008. <ref>{{url|http://blog.wired.com/business/2007/12/apple-and-think.html}}</ref><br />
* July 31: '''Social.fm''' couldn't stand up to Last.fm, and died. <ref>{{url|http://news.cnet.com/8301-13577_3-10005554-36.html}}</ref><br />
* May 15: '''Brijit.com''', a news aggregation site, closed on May 15, 2008. It might be closed for good. <ref>{{url|http://news.cnet.com/8301-13577_3-9945059-36.html}}</ref><br />
* February: '''Yahoo! Design''', a showcase of designing and information aesthetics related to the Yahoo! properties, got revised into oblivion in February, 2008 as part of a 1,000 employee layoff. <ref>{{url|http://infosthetics.com/archives/2008/02/rip_yahoo_design_closed_down.html}}</ref><br />
<br />
===2007===<br />
<br />
* October 31: '''Yahoo! Podcasts''', a Podcast searching site founded in October 2005 <ref>{{url|http://www.ysearchblog.com/2005/10/09/listen-to-the-internet-with-yahoo-podcasts/}}</ref>, was closed with no explanation on October 31, 2007. <ref>{{url|http://searchengineland.com/yahoo-podcasts-to-close-the-sorry-state-of-podcast-search-12288}}</ref><br />
* October 23: '''{{url|1=http://oink.cd/|2=OiNK's Pink Palace}}''' Music Bittorrent tracker site with huge user community which cared greatly about digital content and music. Would have been a great resource for the industry to research. Shutdown October 23, 2007. <ref>{{url|http://www.wired.com/entertainment/music/news/2007/10/oink}}</ref><br />
* September 20: '''Yahoo! Photos''', a photo sharing service by Yahoo!. Tools: [http://smart-techie.com/yahoo/ Download Hi Resolution Yahoo! Photos] by [http://smart-techie.com/web/ Rohit Sud], [http://kentbrewster.com/download-yahoo-photos/ Download Yahoo! Photos] by [[Kent Brewster]], and {{url|1=http://yandao.com/yahoograb/|2=Yahoo! Photos Grabber}} by {{url|1=http://yandao.com|2=Yandao.com}}<br />
* March 20: '''{{url|1=http://jam.bbc.co.uk/|2=BBC Jam}}''' was {{url|1=http://news.bbc.co.uk/2/hi/uk_news/education/6449619.stm|2=suspended}} March 20, 2007 and {{url|1=http://www.guardian.co.uk/media/2008/feb/28/bbc.digitalmedia|2=will not be coming back}}.<br />
<br />
===2006===<br />
<br />
===2005===<br />
<br />
* {{url|http://IUMA.COM}} (Internet Underground Music Archive), of Santa Cruz, California, the actual first website to offer free hosting of bands including MP3 files of music offered by the bands, was mostly archived by John Gilmore before going down. At least one IUMA founder now has a copy of that archive. This ~800GB collection has been [https://archive.org/details/iuma-archive uploaded to a collection on the Internet Archive.]<br />
<br />
===2004===<br />
<br />
===2003===<br />
<br />
* {{url|http://mp3.com}} went down. Much of it was archived by John Gilmore.<br />
* {{url|http://www.cyberworldcorp.com|Cyberworld International Corporation}}, which invented a way of producing simple 3D environments in the web years before the advent of WebGL, quietly disappears from the face of the web<br />
<br />
===2002===<br />
<br />
===2001===<br />
* '''SixDegrees.com''', a social network service website that lasted from 1997 to 2001<br />
* '''The Useless Pages''' (at [http://replay.web.archive.org/20000612123540/http://www.go2net.com/useless/index.html IA])<br />
<br />
== Eleventh Hour Reprieves and Reanimations ==<br />
<br />
* '''[[TwitPic]]''''s founder states it won't shut down and Twitter will take care of it. Not.<br />
* Video host '''[[Viddler]]''' announces in an {{url|1=http://mad.ly/5ae274?pact=20251445218&fe=1|2=e-mail newsletter}} that they're shutting down free accounts on March 11, 2014. But Archive Team kicked in and began to suck up the place until the owners told us to stop. Videos won't be permanently deleted.<br />
* '''[[4chan|Chanarchive.org]]''' - A site dedicated to saving select quality threads from 4chan, running since 2006 and containing 500GBs of important material. It has shut down entirely, as the owner was banned from PayPal and has no means of paying for the site in its current state. In a {{url|1=https://boards.4chan.org/q/res/264159|2=4chan thread}}, the owner explains that backups will be made available, but there is no guarantee of who, where, and for how long.<br />
* '''[[Berlios.de]]''' <s>will {{url|1=http://www.berlios.de/|2=shut down at end of 2011}}. The site hosts thousands of open source software projects (git, svn, bzr, mailing lists, bug tracking, etc.). {{url|1=http://developer.berlios.de/docman/display_doc.php?docid=2056&group_id=2|2=Instructions for exporting a project.}} Berlios is still open and they are now</s> {{url|1=http://joinup.ec.europa.eu/news/german-open-source-development-site-berlios-joins-sourceforge|2=partnered with sourceforge}} to keep things running.<br />
* '''[[Citizendium]]''''s finances {{url|1=http://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2010-11-08/News_and_notes|2=constantly cry for money}}. Running a MediaWiki site is cheap and Sanger is not homeless, hence it's expected to survive. [[WikiTeam]] archives it on a regular basis.<br />
* '''[[Delicious]]'''<ref>{{url|http://www.delicious.com}}</ref> will be {{url|1=http://daringfireball.net/linked/2010/12/16/delicious.php|2=shutting down soon}}. The whole team was let go yesterday - 15 December 2010. {{url|1=http://tech.slashdot.org/story/10/12/16/2220225/Yahoo-To-Close-Delicious|2=Slashdot link}}. Delicious was acquired from Yahoo! in early 2011 by AVOS however all the prior content is gone.<br />
* '''Cli.gs''', another URL shortening service, announced closure: "On Sunday, 25 Oct 2009 at 12:00:00 GMT, the service will stop accepting new short URLs and will stop logging analytics."<ref>{{url|http://blog.cli.gs/news/cligs-shutting-down}}</ref> In December 2009, it was announced that the "social bookmarking" site Mister Wong has acquired cli.gs and are keeping it running.<ref>{{url|http://blog.cli.gs/news/mister-wong-acquires-cligs}}</ref> All aboard the [[TinyURL]] project. <br />
* '''{{url|1=https://duck.co/topic/soft-launch-of-the-new-forum|2=Duck.co}}''', the official DuckDuckGo community forums, transitioned to their {{url|1=https://dukgo.com|2=own platform}} and moved all posts over from their old Zoho forum.<br />
* '''[[Earbits]]''' bites the dust on June 16, 2014, but comes back to life on June 19th, 2014. In between, we grabbed ~130GB of images and ~130k MP3s.<br />
*'''Filefront.com''' is closing up shop <ref>{{url|http://farewell.filefront.com/}}</ref>. The site will be suspended on March 30, 2009. 1.5 Million files and 48+ TB of space gone just like that. '''UPDATE''' As of April 2, 2009, it looks like there may have been an 11th hour reprieve for Filefront. According to a message reportedly from the original founders of the service <ref>{{url|http://welcome.filefront.com/}}</ref>, the site has been re-acquired by them in order to prevent its proposed shuttering.<br />
* '''[[Formspring]]''' (now called '''spring.me''') announced they'd be {{url|1=http://formspring.wordpress.com/2013/03/15/formspring-is-shutting-down/|2=shutting down}} on April the 15th. It was, however, was acquired by new management on May 8, 2013, and saved from being shut down.<br />
* '''[[GitHost]]''' announced they would be shutting down on April 30, 2015.<ref>{{url|https://githost.io/blog/posts/githost-shutting-down}}</ref> However, on April 26th, GitLab announced they had acquired GitHost and that user data would not be GitDeleted.<ref>{{url|https://githost.io/blog/posts/githost-gitlab}}</ref><ref>{{url|https://about.gitlab.com/2015/04/26/gitlab-acquires-githost/}}</ref><br />
* '''[[Google Video]]''' threatened to remove all hosted videos with two weeks' notice in April 2011. It backed down after criticism and an archive effort by the Archive Team.<br />
* '''Home of the Underdogs''' went under on Feb 9th<ref>{{url|http://flashofsteel.com/index.php/2009/02/13/rip-hotu/}}</ref>. There has been some passed along words by the site's owner, now working at an NGO, that an attempt to bring it back may happen. (She definitely has backups of the site.) A community-driven effort to revive the site is currently underway <ref>{{url|http://www.hotud.org}}</ref>. Backups were restored, and the remaining files (1,000+) collected from the community. As of Jan 4th 2010, HOTU is reporting that files are back online <ref>{{url|http://www.hotud.org/component/content/article/25133-files-online-and-import-done}}</ref><br />
* '''[[JPG Magazine]]''' announced it would shut down on January 5, 2009 <ref>{{url|http://jpgmag.com/blog/2009/01/jpg_magazine_says_goodbye.html}}</ref>, but the site lives {{url|1=http://jpgmag.com/blog/2009/02/an_exciting_future_for_jpg.html|2=lives on under new ownership}}. Feel free to download the {{url|http://thepiratebay.org/torrent/4624703/|torrent}}<br />
* <s>[[Jux]] announced that they would be shutting down on August 31, 2013. '''UPDATE''' On July 17, 2013, Jux announced that they would not shut down, apparently due to financial support from one of their members.</s><br />
* [[KeygenJukebox]], which shut down in 2014, has recently popped back up.<br />
* ({{url|http://kiwifarms.net/|Kiwi Farms}}, a notorious forum that mocks [http://www.urbandictionary.com/define.php?term=lolcow "lolcows"], was shut down on January 20, 2017 without a warning by its owner, but was restored three weeks later.<br />
* '''[[MobyGames]]''', the largest database of old game releases on the net, with huge amount of content found nowhere else. Was bought by [[GameFly]] in 2010 and received a new site design in September 2013, which made almost all contributors emigrate. Many site features have disappeared or became broken in the new design, and their large database of cover art and screenshots had problems loading. In December 2013, the site was bought by {{url|1=http://blueflamelabs.com/|2=Blue Flame Labs}}, who have restored the old site design and managed to draw back pretty much all the contributors. It seems that the site is going back to full health again. <br />
* '''[[WebCite]]''' &ndash; Has a habit of crying for money, threatening it will stop accepting submissions. Since October 2013, the Wayback Machine archives pages on demand, hence there's no reason to use a site like WebCite that declares self at risk. It's expected that they'll send their data to Internet Archive if they ever really have to shut down.<br />
* '''[[Word Count Journal]]''' ({{url|1=http://www.wordcountjournal.com/about}}) is shutting down on June 11, 2011 '''UPDATE''' The site is fully up and running. (checked on October 21, 2011) '''UPDATE2''': Non-functional, but the website is up with this notice "Word Count Journal is no longer being supported." (checked on January 26th, 2012)<br />
<br />
== Links ==<br />
<br />
=== Other Sites Remember the Dead ===<br />
<br />
* {{url|1=http://www.disobey.com/ghostsites/|2=Ghost Sites of the Web}} by Steve Baldwin. {{url|1=http://www.disobey.com/ghostsites/atom.xml|2=RSS Feed}}<br />
* {{url|1=http://www.techcrunch.com/tag/deadpool/|2=Techcrunch's Deadpool}} is an excellent archive of stories about site closings.<br />
* {{url|1=http://deletionpedia.dbatley.com/w/index.php?title=Main_Page|2=Deletionpedia}} saved the articles deleted from Wikipedia in 2008, and {{url|1=http://wikidumper.blogspot.com/|2=Wikidumper}} preserves a selection of them.<br />
<br />
=== Tragic ===<br />
<br />
* {{url|1=http://news.cnet.com/8301-13578_3-10029798-38.html|2="Russia Web site owner killed after arrest" - article at CNET News}}<br />
<br />
=== Humorous ===<br />
<br />
* {{url|1=http://www.nzherald.co.nz/lifestyle/news/article.cfm?c_id=6&objectid=10448650|2="Dating website's miscalculated publicity attempt" - article at New Zealand Herald}}<br />
<br />
== References ==<br />
<br />
<references/><br />
<br />
<br />
{{Navigation pager<br />
| previous = Who We Are<br />
| next = Fire Drill<br />
}}<br />
{{Navigation box}}<br />
<br />
[[Category:Archive Team]]</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Roblox&diff=30169Roblox2017-12-07T17:50:10Z<p>Jrwr: </p>
<hr />
<div>{{Infobox project<br />
| title = Roblox<br />
| logo = Roblox_logo_2017.png<br />
| image = Roblox_-_12-4-17.png<br />
| URL = https://www.roblox.com/<br />
| project_status = {{online}}<br />
| archiving_status = {{notsaved}}<br />
}}<br />
<br />
'''Roblox''' is a multiplayer building and games platform featuring Lua scripting, originally launched in 2006.<br />
<br />
== Forums ==<br />
=== July 2017: consolidation ===<br />
<br />
{{Infobox project<br />
| title = Roblox forums consolidation<br />
| logo = Roblox_logo_2017.png<br />
| image = Roblox_forums_screenshot.png<br />
| URL = {{url|1=https://forum.roblox.com/Forum/}}<br />
| project_status = {{specialcase}}<br />
| archiving_status = {{partiallysaved}}<br />
| source = https://github.com/ArchiveTeam/roblox-grab<br />
| tracker = https://tracker.archiveteam.org/roblox/<br />
| irc = robloxd<br />
}}<br />
<br />
On July 14th, the Roblox administrators [http://i.imgur.com/eYj25OG.png announced that its forums would be consolidated into 5 sections], and to save any content that wasn't in those boards:<br />
<br />
<blockquote><br />
<p>'''Forum Upgrade'''</p><br />
<br />
<p>Dear Robloxians,</p><br />
<br />
<p>As the community continues to grow and evolve, our vision is to create a positive and constructive environment where everyone is welcome to share their passion for Roblox. Moving forward, we will be introducing new improvements to the Roblox Forum to provide you with a more streamlined experience.</p><br />
<br />
<p>On July 27th, 2017, the existing forums will be rolled into the following categories. If you have posted content in any forum NOT listed below, please make a copy of it now.</p><br />
<br />
* <p>Roblox News & Discussion</p><br />
* <p>Clans & Guilds</p><br />
* <p>Let’s Make a Deal</p><br />
* <p>Game Design</p><br />
* <p>Scripts</p><br />
<br />
<p>We’re committed to providing players with a place where they can continue safely engaging in interesting discussions about playing and creating amazing experiences on Roblox. We believe these newly organized forum categories will help facilitate these kinds of friendly and collaborative conversations within the community.</p><br />
<br />
<p>As always, we appreciate your continued involvement on the forums. Thanks for being part of the Roblox community!</p><br />
</blockquote><br />
<br />
=== December 2017: shutdown ===<br />
<br />
<br />
{{Infobox project<br />
| title = Roblox forums shutdown<br />
| logo = Roblox_logo_2017.png<br />
| image = Roblox_forums_screenshot_201712.png<br />
| URL = {{url|1=https://forum.roblox.com/Forum/}}<br />
| project_status = {{closing}}<br />
| archiving_status = {{inpgress}}<br />
| source = https://github.com/ArchiveTeam/roblox-grab<br />
| tracker = https://tracker.archiveteam.org/roblox/<br />
| irc = robloxd<br />
}}<br />
<br />
On 4th of December, 2017, Roblox staff [https://forum.roblox.com/Forum/ShowPost.aspx?PostID=228429979 announced that the forums would be shut down a week later on the 11th of December]:<br />
<br />
<blockquote><br />
<p>'''Important Announcement Regarding Closure of Forum'''</p><br />
<br />
<p>Dear Robloxians,</p><br />
<br />
<p>As the community continues to grow and evolve, our vision is to create an environment where everyone is welcome to share their passion for Roblox. The current structure for our Forums does not allow us to maintain the high standards that we feel are so important for nurturing a constructive and positive environment.</p><br />
<br />
<p>After much consideration, we've made the decision to close these public forums. Please consider using these alternative communication methods:</p><br />
<br />
<p>There are groups that are available to serve as places for discussion and collaboration on any topic or interest. You can even create a new group for any topic that doesn't exist yet. You can search for a group here: https://www.roblox.com/groups/join or create new groups here: https://www.roblox.com/groups/create. You can also advertise your group to engage with others with your interests.</p><br />
<br />
<p>Our developer forums have read-only sections available where all users can read about important game development and platform announcements: https://devforum.roblox.com/</p><br />
<br />
<p>You can always catch-up on the latest news and features here at our blog: https://blog.roblox.com/</p><br />
<br />
<p>We’re committed to providing players with a place where they can continue safely engaging in interesting discussions about playing and creating amazing experiences on Roblox. This coming year, we'll be investigating options to re-build forums that better serve you, our community, and our goals in providing a safe and constructive environment. As of today, the Forums will be read-only. Please save any content that you might want to keep as these public forums will be closed on Monday, December 11, 2017.</p><br />
</blockquote><br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Current_Projects&diff=30168Current Projects2017-12-07T17:49:15Z<p>Jrwr: </p>
<hr />
<div>__NOTOC__<br />
== Archive Team recruiting ==<br />
* [[Dev|Want to code for Archive Team? Here's a starting point.]]<br />
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br><br />
* What's on: [http://tracker.archiveteam.org/ online tracker].<br><br />
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].--><br />
<br />
== Warrior based projects ==<br />
{{:CurrentWarriorProject}}<br />
<br />
* [[Roblox|Roblox Forums]]: Roblox is blowing up all of the forums on December 11th. We're going in for round two. '''IRC Channel {{IRC|robloxd}}'''.<br />
* [[Vidme]]: Newer products are better! So let's put the old one in the shredder on December 14th. '''IRC Channel {{IRC|vidmeh}}'''.<br />
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more newssites. '''IRC Channel {{IRC|newsgrabber}}'''.<br />
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.<br />
* [[WikiTeam]] ([[WARC]] format): Saving wikis and their external links for the Wayback Machine. '''IRC Channel {{IRC|wikiteam}}'''.<br />
<br />
=== Scripts only ===<br />
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
<br />
== [[ArchiveBot]] projects==<br />
* [[NCIX]] and [[DirectCanada]]: A saga of telltale signs of a demise by bankruptcy, including many closures and alarm bells rung by customers, vendors, and even YouTube hosts. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Raptr]]: AMD's cash went away, and now it's running out, closing on September 30th. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Sears Canada]]: Reinventing the bankruptcy process through early 2018. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Ars Technica UK]]: UK staff all laid off. [https://twitter.com/textfiles/status/936328601095626752 Jason asked us to.] '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[The Consumerist]]: Consumer Reports: "Having Lots of Loyal Readers is Greatly Overrated". '''IRC Channel {{IRC|archivebot}}'''.<br />
<br />
== Manual projects ==<br />
* [[AOL]]: Climbing into the decaying walled garden. '''IRC Channel {{IRC|aohell}}'''<br />
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''.<br />
* [[Froogle]]: Let's do a census of all of Google's products. '''IRC Channel {{IRC|froogle}}'''.<br />
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.<br />
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.<br />
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.<br />
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.<br />
* [[WikiTeam]] (XML dumps): Exporting Mediawiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.<br />
* [[Woohoo]]: Yahoo is untrustworthy, let's do a census of all their products. '''IRC Channel {{IRC|woohoo}}'''.<br />
<br />
== Upcoming projects ==<br />
<!-- Top priority: could disappear anytime now --><br />
* [[DNAinfo]] and Gothamist: Abruptly ceased operations and was briefly taken offline after a unionization occurred. '''IRC Channel {{IRC|archiveteam}}'''.<br />
<!-- Shutting down, definite deadline given --><br />
<!-- Shutting down, vague deadline given --><br />
<!-- Shutting down, no deadline given --><br />
<!-- Archiving the archives --><br />
<!-- Misc. projects (unmaintained sites, distrust in owners) --><br />
<br />
== Proposed projects ==<br />
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). --><br />
* [[NeoGAF]]: Currently undergoing [[reddit]]-like riots due to a sexual harassment scandal involving the site owner. '''IRC Channel {{IRC|neogaffe}}'''.<br />
* [[The Escapist]]: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. '''IRC Channel TBD'''.<br />
* [[DeviantART]]: Being [https://techcrunch.com/2017/02/23/website-builder-wix-acquires-art-community-deviantart-for-36m/ bought by Wix], users may be unhappy with "access to that work to use in their own site building" on Wix. '''IRC Channel {{IRC|devianttart}}.<br />
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.<br />
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.<br />
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired. '''IRC Channel {{IRC|stumblr}}'''.<br />
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.<br />
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07). <br />
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.<br />
<br />
== Recently finished ==<br />
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people --><br />
* [[Miiverse]]: Nintendo's Switching away from Miiverse on November 8th (UTC). '''IRC Channel {{IRC|miiworse}}'''.<br />
<br />
== Hiatus / Missed the Mark ==<br />
<br />
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. Project currently paused. '''IRC Channel {{IRC|archiveteam}}'''.<br />
* [[Flickr]]: [[Yahoo!]] decided to kill it, now Yahoo has been acquired. '''IRC Channel {{IRC|flickrfckr}}'''.<br />
<br />
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]]</small></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Current_Projects&diff=30012Current Projects2017-12-02T14:51:37Z<p>Jrwr: </p>
<hr />
<div>__NOTOC__<br />
== Archive Team recruiting ==<br />
* [[Dev|Want to code for Archive Team? Here's a starting point.]]<br />
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br><br />
* What's on: [http://tracker.archiveteam.org/ online tracker].<br><br />
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].--><br />
<br />
== Warrior based projects ==<br />
{{:CurrentWarriorProject}}<br />
<br />
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. '''IRC Channel {{IRC|archiveteam}}'''.<br />
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more newssites. '''IRC Channel {{IRC|newsgrabber}}'''.<br />
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.<br />
* [[WikiTeam]] ([[WARC]] format): Saving wikis and their external links for the Wayback Machine. '''IRC Channel {{IRC|wikiteam}}'''.<br />
<br />
=== Scripts only ===<br />
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
<br />
== [[ArchiveBot]] projects==<br />
* [[Ars Technica UK]]: UK staff all laid off. [https://twitter.com/textfiles/status/936328601095626752 Jason asked us to.] '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Raptr]]: AMD's cash went away, and now it's running out, closing on September 30th. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Sears Canada]]: Reinventing the bankruptcy process through early 2018. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[The Consumerist]]: Consumer Reports: "Having Lots of Loyal Readers is Greatly Overrated". '''IRC Channel {{IRC|archivebot}}'''.<br />
<br />
== Manual projects ==<br />
* [[AOL]]: Climbing into the decaying walled garden. '''IRC Channel {{IRC|aohell}}'''<br />
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''.<br />
* [[Froogle]]: Let's do a census of all of Google's products. '''IRC Channel {{IRC|froogle}}'''.<br />
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.<br />
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.<br />
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.<br />
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.<br />
* [[WikiTeam]] (XML dumps): Exporting Mediawiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.<br />
* [[Woohoo]]: Yahoo is untrustworthy, let's do a census of all their products. '''IRC Channel {{IRC|woohoo}}'''.<br />
<br />
== Upcoming projects ==<br />
<!-- Top priority: could disappear anytime now --><br />
* [[DNAinfo]] and Gothamist: Abruptly ceased operations and was briefly taken offline after a unionization occurred. '''IRC Channel {{IRC|archiveteam}}'''.<br />
<!-- Shutting down, definite deadline given --><br />
* [[Vidme]]: Newer products are better! So let's put the old one in the shredder on December 14th. '''IRC Channel {{IRC|vidmeh}}'''.<br />
<!-- Shutting down, vague deadline given --><br />
<!-- Shutting down, no deadline given --><br />
<!-- Archiving the archives --><br />
<!-- Misc. projects (unmaintained sites, distrust in owners) --><br />
<br />
== Proposed projects ==<br />
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). --><br />
* [[NeoGAF]]: Currently undergoing [[reddit]]-like riots due to a sexual harassment scandal involving the site owner. '''IRC Channel {{IRC|neogaffe}}'''.<br />
* [[The Escapist]]: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. '''IRC Channel TBD'''.<br />
* [[NCIX]] and [[DirectCanada]]: An investigation into recent telltale signs of a demise, including whole-province closures and alarm bells rung by customers, distributors, and even YouTube hosts. '''IRC Channel TBD'''.<br />
* [[DeviantART]]: Being [https://techcrunch.com/2017/02/23/website-builder-wix-acquires-art-community-deviantart-for-36m/ bought by Wix], users may be unhappy with "access to that work to use in their own site building" on Wix. '''IRC Channel {{IRC|devianttart}}.<br />
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.<br />
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.<br />
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired. '''IRC Channel {{IRC|stumblr}}'''.<br />
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.<br />
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07). <br />
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.<br />
<br />
== Recently finished ==<br />
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people --><br />
* [[Miiverse]]: Nintendo's Switching away from Miiverse on November 8th (UTC). '''IRC Channel {{IRC|miiworse}}'''.<br />
* [[Slingshot Esports]]: Announced a sudden shutdown with approximately 24 hours' notice. '''IRC Channel {{IRC|archivebot}}'''.<br />
<br />
== Hiatus / Missed the Mark ==<br />
<br />
* [[Yahoo! Answers]]: It's Yahoo. It's been acquired. More questions? '''IRC Channel {{IRC|noanswers}}'''.<br />
* [[Flickr]]: [[Yahoo!]] decided to kill it, now Yahoo has been acquired. '''IRC Channel {{IRC|flickrfckr}}'''.<br />
* [[Vine]]: [[Twitter]] killed the app and left an archive up, but videos likely won't last forever. Project currently on hiatus due to technical issues. '''IRC Channel {{IRC|vinewhine}}'''.<br />
* [[PDF 2016]]: We've been given a long list of PDF files. We'll get'em. '''IRC Channel {{IRC|pdflush}}.'''<br />
<br />
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]]</small></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Vidme&diff=30011Vidme2017-12-02T14:51:18Z<p>Jrwr: </p>
<hr />
<div>{{Infobox project<br />
| title = Vidme<br />
| logo = Vidme_logo.png<br />
| image = Vidme_-_12-1-17.png<br />
| URL = [http://vidme.com/ vid.me]<br />
| project_status = {{closing}}<br />
| archiving_status = {{nosavedyet}}<br />
| irc = vidmeh<br />
}}<br />
<br />
'''Vidme''' is a video hosting site similar to [[YouTube]] and [[Vimeo]]. It surged in popularity after YouTube started screwing over some of its content creators in the "Adpocalypse".<br />
<br />
== Shutdown ==<br />
On December 1st 2017, [https://medium.com/vidme/goodbye-for-now-120b40becafa Vidme's co-founder Warren Shaeffer announced that Vidme was going to be "suspended" at the middle of the month in favor of a newer product]. In reality, it reads like a shutdown instead since videos are being erased.<br />
<br />
<blockquote><br />
<p>'''{{url|1=https://medium.com/vidme/goodbye-for-now-120b40becafa|2=Goodbye for now}}'''</p><br />
<p>Vidme came a long way as an independent platform, but we couldn’t find a path to sustainability. We’re building something new.</p><br />
<br />
<p>After careful consideration, the Vidme team has arrived at the difficult decision to suspend the Vidme site and apps effective December 15th at noon PT. We’ll use this blog post to explain what this means for users, how we got here, and what’s next for us.</p><br />
<br />
<p>'''What this means for users'''</p><br />
<br />
<p><br />
* New sign-ups and uploads will be disabled effective today.<br />
* Existing videos will be playable and exportable from your video manager until December 15th at noon PT, at which point they will be permanently deleted from the Vidme servers.<br />
* All paid channel subscripitions will be suspended immediately, and subscriber-only videos will be exclusively accessible by their video owners.<br />
* Any outstanding earnings will be paid out upon verification within 60 days.<br />
* All Vidme paid subscriptions will cease as of today, and subscribers will no longer be billed.</p><br />
<br />
<p>Please see our [https://vidme.groovehq.com/knowledge_base/categories/vidme FAQ] for more details, and email us at [mailto:hello@vid.me hello@vid.me] with any questions.<ref>https://medium.com/vidme/goodbye-for-now-120b40becafa</ref></p><br />
</blockquote><br />
<br />
The rest of the Medium post goes into detail on why they started the site (hoping to break YouTube's monopoly on revenue sharing to creators), and the struggles they faced when trying to reach their goal.<br />
<br />
== Site Structure ==<br />
* Video's URLs are in this format: <pre>https://vid.me/<VIDEO_ID></pre><br />
* <VIDEO_ID> is a base-64 or base-62 encoded number.<br />
* It is possible to generate a list of URLs by incrementing the number. The size of <VIDEO_ID> is four or five characters for virtually all videos. This results in theoretically 64^5 = 1,073,741,824 possible <VIDEO_ID>'s.<br />
<br />
== References ==<br />
<br />
<references/><br />
<br />
{{Navigation box}}</div>Jrwrhttps://wiki.archiveteam.org/index.php?title=Current_Projects&diff=30010Current Projects2017-12-02T14:50:54Z<p>Jrwr: </p>
<hr />
<div>__NOTOC__<br />
== Archive Team recruiting ==<br />
* [[Dev|Want to code for Archive Team? Here's a starting point.]]<br />
* Help us: '''[[warrior|☞ Download and run your warrior ☜]]'''.<br><br />
* What's on: [http://tracker.archiveteam.org/ online tracker].<br><br />
<!--Combined project activity graphs [http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/project_items.html here].--><br />
<br />
== Warrior based projects ==<br />
{{:CurrentWarriorProject}}<br />
<br />
* [[yuku]]: Lately yuku is very unstable and hosting thousands of forums. '''IRC Channel {{IRC|archiveteam}}'''.<br />
* [[NewsGrabber]]: Saving all news articles. Help with server power or by finding more newssites. '''IRC Channel {{IRC|newsgrabber}}'''.<br />
* [[URLTeam]]: URL shorteners were a fucking awful idea. '''IRC Channel {{IRC|urlteam}}'''.<br />
* [[WikiTeam]] ([[WARC]] format): Saving wikis and their external links for the Wayback Machine. '''IRC Channel {{IRC|wikiteam}}'''.<br />
<br />
=== Scripts only ===<br />
* [[FTP]]: Download all the FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
<br />
== [[ArchiveBot]] projects==<br />
* [[Ars Technica UK]]: UK staff all laid off. [https://twitter.com/textfiles/status/936328601095626752 Jason asked us to.] '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Raptr]]: AMD's cash went away, and now it's running out, closing on September 30th. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Sears Canada]]: Reinventing the bankruptcy process through early 2018. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[The Consumerist]]: Consumer Reports: "Having Lots of Loyal Readers is Greatly Overrated". '''IRC Channel {{IRC|archivebot}}'''.<br />
<br />
== Manual projects ==<br />
* [[AOL]]: Climbing into the decaying walled garden. '''IRC Channel {{IRC|aohell}}'''<br />
* [[ArchiveBot]]: For those with lots of disk space, bandwidth and long-term commitment. '''IRC Channel {{IRC|archivebot}}'''.<br />
* [[Audit2014|Audit 2014]]: It's time to verify our shit. '''IRC Channel {{IRC|auditteam}}'''.<br />
* [[Froogle]]: Let's do a census of all of Google's products. '''IRC Channel {{IRC|froogle}}'''.<br />
* [[FTP]]: Help us find all FTP sites! '''IRC Channel {{IRC|effteepee}}'''.<br />
* [[INTERNETARCHIVE.BAK]]: Grab a slice of the big cake of [[Internet Archive|The Archive]]! '''IRC Channel {{IRC|internetarchive.bak}}'''.<br />
* [[ISP Hosting]]: Finding ISP web hosting services before the Grim Reaper finds them. '''IRC Channel {{IRC|webroasting}}'''.<br />
* [[Project Newsletter]]: Archiving e-newsletters, currently in development. '''IRC Channel {{IRC|projectnewsletter}}'''.<br />
* [[Valhalla]]: Where to store what even the [[Internet Archive]] doesn't have space for? '''IRC Channel {{IRC|huntinggrounds}}'''.<br />
* [[WikiTeam]] (XML dumps): Exporting Mediawiki databases. Permanent effort, [https://github.com/WikiTeam/wikiteam/wiki/Tutorial#I_have_no_shell_access_to_server everyone can help] (you choose the size of your downloads). '''IRC Channel {{IRC|wikiteam}}'''.<br />
* [[Woohoo]]: Yahoo is untrustworthy, let's do a census of all their products. '''IRC Channel {{IRC|woohoo}}'''.<br />
<br />
== Upcoming projects ==<br />
<!-- Top priority: could disappear anytime now --><br />
* [[DNAinfo]] and Gothamist: Abruptly ceased operations and was briefly taken offline after a unionization occurred. '''IRC Channel {{IRC|archiveteam}}'''.<br />
<!-- Shutting down, definite deadline given --><br />
* [[Vidme]]: Newer products are better! So let's put the old one in the shredder on December 14th. '''IRC Channel {{IRC|vidme}}'''.<br />
<!-- Shutting down, vague deadline given --><br />
<!-- Shutting down, no deadline given --><br />
<!-- Archiving the archives --><br />
<!-- Misc. projects (unmaintained sites, distrust in owners) --><br />
<br />
== Proposed projects ==<br />
<!-- Websites you would like to have archived. Please create a wikipage about the project with information about the website (shutting down? (when), why should it be archived, etc.). --><br />
* [[NeoGAF]]: Currently undergoing [[reddit]]-like riots due to a sexual harassment scandal involving the site owner. '''IRC Channel {{IRC|neogaffe}}'''.<br />
* [[The Escapist]]: Staff activity dwindling due to layoffs, remaining supporters are doing it for free. '''IRC Channel TBD'''.<br />
* [[NCIX]] and [[DirectCanada]]: An investigation into recent telltale signs of a demise, including whole-province closures and alarm bells rung by customers, distributors, and even YouTube hosts. '''IRC Channel TBD'''.<br />
* [[DeviantART]]: Being [https://techcrunch.com/2017/02/23/website-builder-wix-acquires-art-community-deviantart-for-36m/ bought by Wix], users may be unhappy with "access to that work to use in their own site building" on Wix. '''IRC Channel {{IRC|devianttart}}.<br />
* [[LiveJournal]]: Very old, widely regarded as in decline, and has a lot of important stuff buried in it. '''IRC Channel {{IRC|recordedjournal}}'''.<br />
* [[DevPort]]: This [http://developerportfolio.com/ portfolio SaaS provider] has [http://www.lowendtalk.com/discussion/65135/need-some-help-saas-provider-is-dead-but-my-site-is-still-up-how-should-i-grab-it reportedly] been having infrastructure issues, and removed their social media accounts. Possible impending shutdown.<br />
* [[Tumblr]]: [[Yahoo!]] considered killing it, now Yahoo has been acquired. '''IRC Channel {{IRC|stumblr}}'''.<br />
* [[Ownlog]]: Ownlog is losing popularity and support from its owners. '''IRC Channel {{IRC|pwnlog}}'''.<br />
* [[Google Groups]]: "Gone within a year" ([[User:Jscott|SketchCow]], 2016-06-07). <br />
* [[The Pirate Bay]]: Recently came back up, grabbing an archive for sanity's sake. '''IRC Channel {{IRC|yarharfiddlededee}}'''.<br />
<br />
== Recently finished ==<br />
<!-- put projects here that are still in the tracker but not yet deleted so it won't confuse people --><br />
* [[Miiverse]]: Nintendo's Switching away from Miiverse on November 8th (UTC). '''IRC Channel {{IRC|miiworse}}'''.<br />
* [[Slingshot Esports]]: Announced a sudden shutdown with approximately 24 hours' notice. '''IRC Channel {{IRC|archivebot}}'''.<br />
<br />
== Hiatus / Missed the Mark ==<br />
<br />
* [[Yahoo! Answers]]: It's Yahoo. It's been acquired. More questions? '''IRC Channel {{IRC|noanswers}}'''.<br />
* [[Flickr]]: [[Yahoo!]] decided to kill it, now Yahoo has been acquired. '''IRC Channel {{IRC|flickrfckr}}'''.<br />
* [[Vine]]: [[Twitter]] killed the app and left an archive up, but videos likely won't last forever. Project currently on hiatus due to technical issues. '''IRC Channel {{IRC|vinewhine}}'''.<br />
* [[PDF 2016]]: We've been given a long list of PDF files. We'll get'em. '''IRC Channel {{IRC|pdflush}}.'''<br />
<br />
<small>ArchiveTeam uses the EFnet IRC network – irc://irc.efnet.org – webchat: http://chat.efnet.org:9090 – [[IRC|More info]]</small></div>Jrwrhttps://wiki.archiveteam.org/index.php?title=ArchiveTeam_Warrior&diff=29575ArchiveTeam Warrior2017-07-22T20:41:19Z<p>Jrwr: /* Alternative virtual machines */</p>
<hr />
<div>==What is the Archive Team Warrior?==<br />
<br />
[[Image:Archive_team.png|100px|left]]<br />
[[Image:Warrior-vm-screenshot.png||256px|right]]<br />
[[Image:Warrior-web-screenshot.png|256px|right]]<br />
<br />
The Archive Team Warrior is a virtual archiving appliance. You can run it to help with the ArchiveTeam archiving efforts. It will download sites and upload them to our archive — and it’s really easy to do!<br />
<br />
The warrior is a virtual machine, so there is no risk to your computer. The warrior will only use your bandwidth and some of your disk space. It will get tasks from and report progress to the [[Tracker]].<br />
<br />
== Basic usage ==<br />
<br />
The warrior runs on Windows, OS X and Linux using a virtual machine. You'll need one of:<br />
<br />
* [https://www.virtualbox.org/ VirtualBox] (recommended)<br />
* [https://www.vmware.com/products/player/ VMware workstation/player] (free-gratis for personal use)<br />
* [[#Alternative virtual machines|See below for alternative virtual machines]]<br />
<br />
=== Quick start instructions for VirtualBox ===<br />
<br />
# Download the [http://archive.org/download/archiveteam-warrior/archiveteam-warrior-v2-20121008.ova appliance] (174MB).<br />
# Launch VirtualBox<br />
# In VirtualBox, click File > Import Appliance and open the file.<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit http://localhost:8001/<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
=== Start instructions for VMWare Player ===<br />
<br />
# Download the [http://archive.org/download/archiveteam-warrior/archiveteam-warrior-v2-20121008.ova appliance] (174MB).<br />
# Launch VMWare Player<br />
# In Player on the right, click "Open Virtual Machine", open the file and import the virtual machine.<br />
# Select the virtual machine and click "Edit virtual machine settings".<br />
#* Select "Hard Disk 2 (IDE)" > "Advanced..." and change it to "IDE 1:0"<br />
#* Select Network Adapter and set it to "Bridged: Connected directly to the physical network"<br />
# Start the virtual machine.<br />
#* It will fetch the latest updates and will eventually tell you to start your web browser.<br />
# Using your regular web browser, visit the address that is shown on the bottom (e.g. http://192.168.0.100:8001/)<br />
# On the left, click "Your settings".<br />
# Choose a username - we'll show your progress on the [[tracker|leaderboard]].<br />
# On the left, click "Available projects" tab and pick a project to work on.<br />
#* Even better: select "ArchiveTeam's Choice" to let your warrior work on the most urgent project.<br />
<br />
<br />
__TOC__<br />
<br />
== Alternative virtual machines ==<br />
<br />
Thanks to user-effort, there are alternatives:<br />
<br />
* [https://www.docker.io/ Docker] (Linux)<br />
** ([https://archive.org/download/Warrior100G/Warrior-100G.ova Virtual Machine Appliance to auto load the docker version]) - Proposed Update to the current virtual machine.<br />
** ([https://github.com/ArchiveTeam/warrior-dockerfile modified dockerfile])<br />
** ([https://hub.docker.com/r/infrequent/at-as-dockerfile modified dockerfile - for manual script execution])<br />
<br />
* [https://www.microsoft.com/en-us/server-cloud/solutions/virtualization.aspx Hyper-V] (Windows 8 Professional)<br />
** ([http://jonimoose.net/2013/archiveteam-warrior-on-hyper-v/ Hyper-V virtual machine])<br />
<br />
Please note that these alternatives are not in widespread use by our warriors, so we may not be able to help with either issues or advanced usage.<br />
<br />
== Warrior FAQ ==<br />
<br />
=== Why a virtual machine in the first place? ===<br />
<br />
The virtual machine is a quick, safe, and easy way for newcomers to help us out. It offers many features:<br />
<br />
* Graphical interface<br />
* Automatically selects which project is important to run<br />
* Self-updating software infrastructure<br />
* Allows for unattended use<br />
* In case of software faults, your machine is not ruined<br />
* Restarts itself in case of runaway programs<br />
* Runs on Windows, Mac, and Linux painlessly<br />
* Ensures consistency in the archived data regardless of your machine's quirks<br />
<br />
If you have suggestions for improving this system, please talk to us as described below.<br />
<br />
=== Can I use whatever internet access for the warrior? ===<br />
<br />
No. We need "clean" connections. Please ensure the following:<br />
<br />
* No OpenDNS. No ISP DNS that redirects to a search page. Use non-captive DNS servers.<br />
* No ISP connections that inject advertisements into web pages.<br />
* No proxies. Proxies can return bad data. The original HTTP headers and IP address are needed for the WARC file.<br />
* No content-filtering firewalls.<br />
* No censorship. If you believe your country implements censorship, do not run a warrior. <br />
* No Tor. The server may return an error page instead of content if they ban exit nodes.<br />
* No free cafe wifi. Archiving your cafe's wifi service agreement repeatedly is not helpful.<br />
* We prefer connections from many public IP addresses if possible. (For example, if your apartment building uses a single IP address, we don't want your apartment banned.)<br />
<br />
=== I turned my warrior VM appliance off. Will those tasks be lost? ===<br />
<br />
If you've killed your warrior VM instance, then the work your warrior did has been lost. However, the tasks will be returned to the pool after a period of time, and other warriors may claim them. If you want, you can alert the admins via [[IRC]] of what's happened and they can clear the claims your username may have made. but this isn't very important on most projects.<br />
<br />
=== I closed my browser or tab with the warrior's web interface. Will those tasks be lost? ===<br />
<br />
No. The web browser interface just provides a user interface to the warrior. As long as the VM is not stopped, it will continue normally.<br />
<br />
=== I need to disconnect my internet / reboot my PC. How can I do this without losing work? ===<br />
<br />
If you pause/suspend the warrior instance, most projects will allow resuming of work in progress when you unsuspend the warrior instance.<br />
<br />
If you decide to use the suspend feature, please note that if you keep it suspended for too long (more than a few hours), the administrators will assume that the item is lost and re-queue it. Using the suspend feature so that you can reboot your computer is perfectly fine.<br />
<br />
=== How much disk space will the warrior use? ===<br />
<br />
Short answer: it depends on the project. (But never more than 60GB.)<br />
<br />
Long answer: because each project defines items differently, sizes may vary. A single task may be a small file or a whole subsection of a website. The virtual machine is configured by default to use an absolute maximum of 60GB. Any unused virtual machine disk space is not used on the host computer. You may run the virtual machine on less than 60GB if you like to live dangerously. We're downloading the internet, after all!<br />
<br />
=== How can I log in to the virtual machine? ===<br />
<br />
Unless you know what you are doing, you should not need to do this. But, if you want to, the username is <code>root</code> and the password is <code>archiveteam</code>. Once logged in as root, you can execute <code>sudo -u warrior -i</code> to log in as the warrior user. <br />
<br />
Press ALT+F3 to switch to virtual console number 3. Use ALT+Left or ALT+Right to switch between virtual consoles. There are 6 virtual consoles in total. Consoles 1 and 2 are reserved for the warrior.<br />
<br />
=== How can I run multiple virtual machines at the same time? ===<br />
<br />
You'll need to adjust the networking settings.<br />
<br />
In VirtualBox, select a virtual machine and open up Settings → Network → Adapter 1 → Port Fowarding. You need to adjust the host port. For example, set your table to TCP | 127.0.0.1 | 8123 | | 8001. This maps port 8123 on the host machine (your computer) to port 8001 on the virtual machine (the warrior), and you can then access the warrior's web interface from port 8123 in your browser.<br />
<br />
Each VM you want to access should have a different host port. Do not use port numbers below 1024 unless you know what you are doing.<br />
<br />
VMWare installations should be using bridged networking. However, if you want, you can switch to NAT (under Settings → Hardware → Virtual Network Adapter) and click Edit to set up port forwarding. On Linux, you can also use lines like <code>8123 = 192.168.0.100:8001</code> in the <code>[incomingtcp]</code> section of nat.conf. (Make sure the VM IP is correct!)<br />
<br />
=== How can I run the virtual machine headlessly (without leaving a window open)? ===<br />
<br />
On VirtualBox, use this command:<br />
<br />
<pre>vboxmanage startvm archiveteam-warrior-2 --type headless</pre><br />
<br />
Shut down the VM with:<br />
<br />
<pre>vboxmanage controlvm archiveteam-warrior-2 acpipowerbutton</pre><br />
<br />
Substituting <code>suspend</code> or <code>resume</code> for <code>acpipowerbutton</code> suspends or resumes the VM. For more information, consult [http://www.virtualbox.org/manual/ch08.html#vboxmanage-startvm the VirtualBox manual (Chapter 8, Sections 12 and 13)].<br />
<br />
On VMWare, use this command:<br />
<br />
<pre>vmrun start <path to vmx file> nogui</pre><br />
<br />
Shut down with:<br />
<br />
<pre>vmrun stop <path to vmx file> soft</pre><br />
<br />
Substituting <code>suspend</code> for <code>stop</code> suspends the VM. Resume with <code>start</code> again. For more information, including the paths to VMX files on different operating systems, consult [http://www.vmware.com/pdf/vix180_vmrun_command.pdf Using vmrun to Control Virtual Machines] (PDF), pages 10 and 11.<br />
<br />
=== How can I set up the virtual machine as a system service (so that it starts up on boot and shuts down automatically)? ===<br />
<br />
If you are using VirtualBox and running a Linux distribution that uses the systemd init system (like most recent releases), you can follow the short instructions on [http://www.ericerfanian.com/automatically-starting-virtualbox-vms-on-archlinux-using-systemd/ this page]. (The page title specifies Arch Linux, but this will work for other distros as long as they run systemd.)<br />
<br />
=== How can I set up the virtual machine with directly-bridged networking instead of NAT? ===<br />
<br />
On VirtualBox, use these commands:<br />
<br />
<pre>vboxmanage modifyvm archiveteam-warrior-2 --nic1 bridged<br />
vboxmanage modifyvm archiveteam-warrior-2 --bridgeadapter1 eth0</pre><br />
<br />
We presume you want to bind to <code>eth0</code>. Adjust as required. :)<br />
<br />
VMWare installations should already be using bridged networking.<br />
<br />
=== How can I run the warrior without a virtual machine? (The VM has too much overhead for a VPS!) ===<br />
<br />
One option is running a Docker container (see [[#Alternative_virtual_machines|above]]). Docker is based on LXC, and the overhead is far less than running a full VM. If you plan on running the [https://github.com/ArchiveTeam/warrior-dockerfile warrior-dockerfile], make sure to publish the port to allow access to the web interface:<br />
<br />
<pre>docker run -d -p 8001:8001 archiveteam/warrior-dockerfile</pre><br />
<br />
This creates a direct port mapping. For host port 38001 to container port 8001, use <code>38001:8001</code>. Adjust as required. :P<br />
<br />
(Multiple projects can be also run in isolated environments (containers) for rapid deployment using [https://hub.docker.com/r/infrequent/at-as-dockerfile at-as-dockerfile].)<br />
<br />
Another alternative is '''running the project manually.''' If you are managing a VPS, it's likely you are comfortable with some Linux stuff. Consult the project wiki page or the source code repository readme file.<br />
<br />
=== Why is the default project not working? / Why is a manual project not in the warrior yet? ===<br />
<br />
Sorry. Sometimes the administrators are too busy...<br />
<br />
=== Why are there no projects? ===<br />
<br />
We finished the ones we were working on! If there are no projects showing, you can [[Dev|help us write one]]. No projects does ''not'' mean there is nothing left to archive!<br />
<br />
=== I'm looking at the leaderboard. What's that icon beside the username? ===<br />
<br />
That's just the warrior logo: [[File:Archive_team.png|42px]] (click on the image for a larger version). It means that that person is using the warrior. Those without the icon are running the scripts manually.<br />
<br />
[[Image:Archiveteam-warrior-sticker.png|256px|right]]<br />
<br />
=== What's that guy doing in the logo? ===<br />
<br />
The place is on fire! But don't worry, he safely escaped with the rescued data in his arms.<br />
<br />
=== That’s awesome – can I slap this logo on my laptop to show my Internet-preservation pride? ===<br />
<br />
[http://www.redbubble.com/people/ajhajh/works/12857655-archive-team-warrior-stickers?p=sticker You sure can!] The ArchiveTeam Warrior laptop sticker can start conversations about archiving, if you’re into that.<br />
<br />
=== Where can I file a bug, suggestion, or a feature request? ===<br />
<br />
If the issue is related to the warrior's web interface or the library that grab scripts are using, see [https://github.com/ArchiveTeam/seesaw-kit/issues seesaw-kit issues]. Other issues should be filed into their own [[Dev/Source_Code|repositories]].<br />
<br />
=== I'd like to help write code. Where can I find more info? ===<br />
<br />
Check out the [[Dev]] documentation for details on the infrastructure and details of the source code layout.<br />
<br />
=== I still have a question! ===<br />
<br />
Check out the [[Frequently Asked Questions|general FAQ page]]. Talk to us on [[IRC]]. Use [irc://irc.efnet.org/warrior #warrior] for specific warrior questions or [irc://irc.efnet.org/archiveteam #archiveteam] for general questions.<br />
<br />
== Troubleshooting ==<br />
<br />
=== I'm getting errors when I try to launch the VM. ===<br />
<br />
If you are receiving <code>Breakpoint has been reached (0x80000003)</code>, <code>A critical error has occurred while running the virtual machine and the machine execution has been stopped.</code>, or VT-X errors, you probably do not have virtualization enabled, either because it is turned off in your computer's BIOS or your CPU does not support it.<br />
<br />
You can check CPU support on Linux with <code>cat /proc/cpuinfo | grep "(vmx|svm)" | uniq</code>. If there is a line of output starting with "flags", your processor supports virtualization; if there is no output, it does not. You can check whether virtualization is enabled in the BIOS using the <code>rdmsr</code> utility in your distro's <code>msr-tools</code> package.<br />
<br />
You can check support and BIOS status on Windows using [https://www.microsoft.com/en-us/download/details.aspx?id=592 Microsoft's Hardware-Assisted Virtualization Detection Tool] or [http://openlibsys.org/index-ja.html VirtualChecker].<br />
<br />
To enable virtualization on a CPU with support, reboot the computer and enter the BIOS. The virtualization setting is usually under something like 'CPU configuration' or 'advanced settings'.<br />
<br />
=== I just imported the ova image and the warrior is stuck on "Preparing the data partition". ===<br />
<br />
This issue has cropped up before, and we do not know what causes it. We recommend you delete the warrior image and import the ova again. Testing shows that such a reimport works in the majority of cases.<br />
<br />
=== I can't connect to localhost. ===<br />
<br />
The application is configured to set up port forwarding to the guest machine, and you should be able to access the interface through your web browser at port 8001. If this does not happen, you may need to double-check your machine's network settings (as described [[#How_can_I_run_multiple_virtual_machines_at_the_same_time.3F|above]]).<br />
<br />
=== The warrior can't connect to the internet. ===<br />
<br />
It's possible that the virtual machine has picked up the address of the local DNS cache on your computer, which the virtual machine does not have access to. <br />
<br />
If you experience this on VirtualBox, see [http://askubuntu.com/questions/204953/virtualbox-dns-stopped-working-on-upgrade-to-12-10 this question and answer].<br />
<br />
=== Why am I seeing a message that no item was received? ===<br />
<br />
It means that there is no work available. This can happen for several reasons:<br />
<br />
* The project has just finished and someone is inspecting the work done. If a problem is discovered, items may be re-queued and more work will become available.<br />
* You have checked out/claimed too many items. Reduce your concurrency and let others do some of the work too.<br />
* In a rare case, you have been banned by a tracker administrator because there was a problem with your work: you were requesting too much, you were tampering with the scripts, a malfunction has occurred, or your internet connection is "unclean" (see [[#Can_I_use_whatever_internet_access_for_the_warrior.3F|above]]).<br />
<br />
=== Why am I seeing a message about rate limiting? ===<br />
<br />
Keep in mind that although downloading the internet for fun and digital preservation are the primary goals of all Archive Team activities, serious stress on the target's server may occur. The rate limit is imposed by a [[Tracker#People|tracker administrator]] and should not be subverted.<br />
<br />
(In other words, we don't want to DDoS the servers.)<br />
<br />
=== Why am I seeing a message about code being out of date? ===<br />
<br />
Because there is a new update ready. You do not need to do anything about this; the warrior will update its code every hour. If you are impatient, please restart the warrior and it will download the latest code and resume work.<br />
<br />
=== I'm running the scripts manually and I see a message about code being out of date. ===<br />
<br />
It happens when a bug in the scripts is discovered. Bugs are unavoidable especially when the server is out of our control.<br />
<br />
Try the <code>--auto-update</code> option available in Seesaw version 0.8. However, please be aware that you are now executing code automatically. Be sure to run the scripts in a separate user account for safety.<br />
<br />
=== I see messages about rsync errors. ===<br />
<br />
Uh-oh! Something is not right. Please notify us immediately in the appropriate [[IRC]] channel.<br />
<br />
=== I told the warrior to shut down from the interface, but nothing has changed. ===<br />
<br />
The warrior will attempt to finish the current running tasks before shutting down. If you need to shut down right away, go ahead. Your progress will be lost, but the jobs will eventually cycle out to another user.<br />
<br />
=== The warrior is eating all my bandwidth! ===<br />
<br />
On VirtualBox (relatively recent versions), use this command:<br />
<br />
<pre>vboxmanage bandwidthctl archiveteam-warrior-2 add limit --type network --limit 3m</pre><br />
<br />
This will limit the warrior to 3Mb/s. (Limit units are <code>k</code> for kilobit, <code>m</code> for megabit, <code>g</code> for gigabit, <code>K</code> for kilobyte, <code>M</code> for megabyte, and <code>G</code> for gigabyte.) Adjust as required. :)<br />
<br />
In the latest version of VirtualBox on Windows, the syntax appears to have changed. The correct command now seems to be:<br />
<br />
<pre>VBoxManage bandwidthctl archiveteam-warrior-2 add netlimit --type network --limit 3</pre><br />
<br />
For more information, consult [http://www.virtualbox.org/manual/ch06.html#network_bandwidth_limit the VirtualBox manual (Chapter 6, Section 9)].<br />
<br />
On VMWare (versions 9 and above), select a virtual machine and open Settings → Hardware → Virtual Network Adapter → Advanced. You can set a bandwidth limit here.<br />
<br />
=== The warrior is using up disk space, even though it's not running a project! ===<br />
<br />
Virtual machine disk images do not behave like a regular file. There are several ways to safely reclaim space:<br />
<br />
* Delete the second disk and put back an empty disk. The warrior should reformat the second disk.<br />
* Delete the entire warrior application and re-import it.<br />
* Use the [http://intgat.tigress.co.uk/rmy/uml/index.html zerofree] program and then clone the disk image. Reattach the cloned disk image.<br />
<br />
=== The item I'm working on is downloading thousands of URLs and it's taking hours. ===<br />
<br />
Please notify us in the appropriate [[IRC]] channel. You may need to reboot the warrior.<br />
<br />
=== The instructions to run the software/scripts are awful and they are difficult to set up. ===<br />
<br />
Well, excuuuuse me, princess!<br />
<br />
We're not a professional support team so help us help you help us all. See above for [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|bug reports]], [[#Where_can_I_file_a_bug.2C_suggestion.2C_or_a_feature_request.3F|suggestions]], or [[#I.27d_like_to_help_write_code._Where_can_I_find_more_info.3F|code contributions]].<br />
<br />
== Projects ==<br />
<br />
See [[Warrior projects]].<br />
<br />
== Are you a coder? ==<br />
<br />
Like the warrior? Interested in how it works under the hood? Got software skills? '''[[Dev|Help us improve it!]]'''<br />
<br />
{{Navigation box}}</div>Jrwr