Difference between revisions of "Government Backup"

From Archiveteam
Jump to navigation Jump to search
Line 21: Line 21:


Besides the FTP data download, Archive Team is also doing a general download (where possible) of many crawlable government websites, such as [[USA-Gov|usa.gov]].
Besides the FTP data download, Archive Team is also doing a general download (where possible) of many crawlable government websites, such as [[USA-Gov|usa.gov]].
== Notable Press Mentions and References ==
''Note that the story oscillates between "Internet Archive is adding a mirror in Canada" and "Internet Archive is Moving to Canada".'' The actuality, for anyone viewing this page coming in cold, is that the Internet Archive has been building a mirror in Canada for a significant period of time and has a fully-functioning facility in Canada that has been a presence of some sort for nearly a decade as of 2016. The current effort was merely a speeding up of an inevitable timetable.
* [http://www.theverge.com/2016/11/29/13778188/internet-archive-of-canada-backup-trump-surveillance-censorship The Internet Archive is building a Canadian copy to protect itself from Trump], The Verge, November 29, 2016
* [http://www.nbcnews.com/news/us-news/internet-archive-web-s-warehouse-creating-trump-era-copy-canada-n689916 Internet Archive, Web's Warehouse, Creating Trump-Era Copy in Canada], NBC News, November 29, 2016
* [http://www.dailykos.com/story/2016/11/30/1605487/-The-Internet-Archive-is-Moving-to-Canada The Internet Archive is "Moving to Canada"], The Daily Kos, November 30, 2016
* [http://gothamist.com/2016/11/30/even_the_internet_is_getting_ready.php Even The Internet Archive Is Moving To Canada Because Of Trump], Gothamist, November 30, 2016
* [http://www.huffingtonpost.ca/2016/11/30/archive-org-canada-trump_n_13330492.html Archive.org Moving To Canada Over Trump Censorship Fears], Huffington Post Canada, November 30, 2016

Revision as of 03:33, 30 December 2016

Government data.jpg

The US Government has an awful lot of data, and it's in a lot of places. In 2016, elections were held that indicated deep sea changes in goals and ideals (although previous transitions have always contained such changes). Inspired by this, a number of groups and efforts have risen up to ensure backups of all government data possible are made off-site.

This page contains overviews of the effort by all the teams.

Internet Archive

Internet Archive has two teams, Wayback and Archive-It (archive-it.org), working through listings of government websites and data stores. They are working internally using Internet Archive's crawlers and environment.

#DATAREFUGE

The Data Refuge project (ppehlab.org/datarefuge) has the following Google document about climate datasets.

Archive Team FTP Backup

The Archive Team project is backing up 750+ FTP sites hosted at .MIL and .GOV sites. These two projects can be tracked here (discovery phase) and here (download phase). The results of this download are being sent to this collection.

Archive Team General Websites Download

Besides the FTP data download, Archive Team is also doing a general download (where possible) of many crawlable government websites, such as usa.gov.



Notable Press Mentions and References

Note that the story oscillates between "Internet Archive is adding a mirror in Canada" and "Internet Archive is Moving to Canada". The actuality, for anyone viewing this page coming in cold, is that the Internet Archive has been building a mirror in Canada for a significant period of time and has a fully-functioning facility in Canada that has been a presence of some sort for nearly a decade as of 2016. The current effort was merely a speeding up of an inevitable timetable.