Difference between revisions of "Ftp-gov"

From Archiveteam
Jump to navigation Jump to search
m (MOTHERFUCKER ! ! !)
m (Reverted edits by Megalanya1 (talk) to last revision by Yan)
Line 11: Line 11:
As part of the [[Government Backup|government backup]], we are backing up 750+ FTP sites hosted at .MIL and .GOV sites. The results of this download are being sent to [https://archive.org/details/archiveteam_ftpgov this collection on the Internet Archive].
As part of the [[Government Backup|government backup]], we are backing up 750+ FTP sites hosted at .MIL and .GOV sites. The results of this download are being sent to [https://archive.org/details/archiveteam_ftpgov this collection on the Internet Archive].


== '''MOTHERFUCKER ! ! !''' ==
== How can I help? ==
At this time no script has been completed, For now come into the IRC channel {{IRC|cheetoflee}} and be the first to know how you can get involved!
=== Running a Warrior ===


== '''MOTHERFUCKER ! ! !''' ==
You can start up a [[Warrior]] and there select ''ArchiveTeam's Choice'' for now, Until the scripts are written (this is going to be our highest priority so you will run them as soon as they are released!).<!-- (If you don't really care what you are archiving, select ''ArchiveTeam's Choice'' instead, as at some points ArchiveTeam may priorize another project.)-->


== '''MOTHERFUCKER ! ! !''' ==
=== Running the script manually ===
 
If you use Linux and you're a bit familiar with it, you can try running the script directly.
 
The instructions can be found at [https://github.com/ArchiveTeam/ftp-gov-grab github.com/ArchiveTeam/ftp-gov-grab].
 
{| class="mw-collapsible mw-collapsed" style="text-align:left;"
! Some additional information
|-
| Don't forget to replace YOURNICKHERE with your nickname.
 
The number after <code>--concurrent</code> determines how many threads run at the same time. You can increase this number if your resources (RAM, CPU, bandwidth) are sufficient. However, if you constantly see messages about rate limiting, there is no need to increase the concurrency.
 
If you want to stop the script, please do it gracefully if possible. To do so, create an empty file named '''STOP''' in the folder of the script (terminal command: <code>touch STOP</code>). The script finishes the current item(s) and stops only after that. (If you kill the script immediately, the items get broken, and they will need to be reassigned to another user.) – Before starting the script again, don't forget to remove the STOP file.
 
If you see "Project code is out of date", kill the script, go to its folder (<code>cd ftp-gov-grab</code>) and issue <code><nowiki>git pull https://github.com/ArchiveTeam/</nowiki>ftp-gov-grab</code>. After the updating has finished, re-launch the script.
|}
 
=== Donating to the Internet Archive ===
 
Content downloaded by the ArchiveTeam will be uploaded to the [[Internet Archive]], where it will be stored and be available – hopefully – forever. However, storing it costs thousands of dollars in the long run. So, if you can afford, please consider donating to the Internet Archive, so that this piece of history can be kept for us all. http://archive.org/donate
 
=== Do you like our cause? ===
 
If you want to help in other projects, want to learn more about ArchiveTeam, or even help in development in general, navigate to the [[Main Page]] of this wiki, from there you can reach a lot of information. The Team consists of volunteers working on the projects in their free time, so helping hands (and resources) are always welcome.
 
{{Navigation box}}

Revision as of 16:28, 17 January 2017

US government FTP sites
Ftp-gov logo
Government data.jpg
Status Endangered
Archiving status In progress...
Archiving type Unknown
Project source ftp-gov-grab
Project tracker discovery
download
IRC channel #cheetoflee (on hackint)

As part of the government backup, we are backing up 750+ FTP sites hosted at .MIL and .GOV sites. The results of this download are being sent to this collection on the Internet Archive.

How can I help?

At this time no script has been completed, For now come into the IRC channel #cheetoflee (on hackint) and be the first to know how you can get involved!

Running a Warrior

You can start up a Warrior and there select ArchiveTeam's Choice for now, Until the scripts are written (this is going to be our highest priority so you will run them as soon as they are released!).

Running the script manually

If you use Linux and you're a bit familiar with it, you can try running the script directly.

The instructions can be found at github.com/ArchiveTeam/ftp-gov-grab.

Some additional information
Don't forget to replace YOURNICKHERE with your nickname.

The number after --concurrent determines how many threads run at the same time. You can increase this number if your resources (RAM, CPU, bandwidth) are sufficient. However, if you constantly see messages about rate limiting, there is no need to increase the concurrency.

If you want to stop the script, please do it gracefully if possible. To do so, create an empty file named STOP in the folder of the script (terminal command: touch STOP). The script finishes the current item(s) and stops only after that. (If you kill the script immediately, the items get broken, and they will need to be reassigned to another user.) – Before starting the script again, don't forget to remove the STOP file.

If you see "Project code is out of date", kill the script, go to its folder (cd ftp-gov-grab) and issue git pull https://github.com/ArchiveTeam/ftp-gov-grab. After the updating has finished, re-launch the script.

Donating to the Internet Archive

Content downloaded by the ArchiveTeam will be uploaded to the Internet Archive, where it will be stored and be available – hopefully – forever. However, storing it costs thousands of dollars in the long run. So, if you can afford, please consider donating to the Internet Archive, so that this piece of history can be kept for us all. http://archive.org/donate

Do you like our cause?

If you want to help in other projects, want to learn more about ArchiveTeam, or even help in development in general, navigate to the Main Page of this wiki, from there you can reach a lot of information. The Team consists of volunteers working on the projects in their free time, so helping hands (and resources) are always welcome.