Difference between revisions of "Fortress of Solitude"
TheTechRobo (talk | contribs) (Update for 2022) |
(is -> was) |
||
Line 1: | Line 1: | ||
'''Fortress of Solitude''', often abbreviated as '''FOS''', | '''Fortress of Solitude''', often abbreviated as '''FOS''', was ArchiveTeam's primary staging server, operated by [[User:Jscott|Jason Scott]] (a.k.a. SketchCow). It is, in fact, a virtual machine on the network of the Internet Archive, and had a storage capacity of 16 terabytes as of 2015. | ||
Content downloaded as part of ArchiveTeam projects (including [[ArchiveBot]]) is uploaded to so-called ''staging servers'' via rsync, and after being processed, data is transferred from there to the servers of the [[Internet Archive]]. | Content downloaded as part of ArchiveTeam projects (including [[ArchiveBot]]) is uploaded to so-called ''staging servers'' via rsync, and after being processed, data is transferred from there to the servers of the [[Internet Archive]]. | ||
As of December 2022, it is used very little (if at all). Warrior projects don't use it anymore, and ArchiveBot was updated not to use it in early 2022<ref>[https://hackint.logs.kiska.pw/archiveteam-bs/20221219#c333928 IRC logs from 2022-12-19]</ref><ref>[https://hackint.logs.kiska.pw/archiveteam-bs/20221219#c333937 More IRC logs from 2022-12-19]</ref>. Additionally, on 2022-12-15, [https://hackint.logs.kiska.pw/archiveteam-bs/20221215#c333593 rsync was deactivated]. | As of December 2022, it is used very little (if at all). Warrior projects don't use it anymore, and ArchiveBot was updated not to use it in early 2022<ref>[https://hackint.logs.kiska.pw/archiveteam-bs/20221219#c333928 IRC logs from 2022-12-19]</ref><ref>[https://hackint.logs.kiska.pw/archiveteam-bs/20221219#c333937 More IRC logs from 2022-12-19]</ref>. Additionally, on 2022-12-15, [https://hackint.logs.kiska.pw/archiveteam-bs/20221215#c333593 rsync was deactivated]. | ||
Warrior projects now use several different staging servers, which change often based on project size, urgency, and the total throughput needed to the Internet Archive. The remaining Archive Team data on the server was cleaned up around {{datetime|2023-09-04}}. | |||
== Links == | == Links == |
Latest revision as of 05:57, 15 February 2025
Fortress of Solitude, often abbreviated as FOS, was ArchiveTeam's primary staging server, operated by Jason Scott (a.k.a. SketchCow). It is, in fact, a virtual machine on the network of the Internet Archive, and had a storage capacity of 16 terabytes as of 2015.
Content downloaded as part of ArchiveTeam projects (including ArchiveBot) is uploaded to so-called staging servers via rsync, and after being processed, data is transferred from there to the servers of the Internet Archive.
As of December 2022, it is used very little (if at all). Warrior projects don't use it anymore, and ArchiveBot was updated not to use it in early 2022[1][2]. Additionally, on 2022-12-15, rsync was deactivated.
Warrior projects now use several different staging servers, which change often based on project size, urgency, and the total throughput needed to the Internet Archive. The remaining Archive Team data on the server was cleaned up around 2023-09-04.
Links
- Upload history: Shows when and where the megawarc files (multi-gigabyte compilations of smaller WARC files) of ArchiveBot and ArchiveTeam projects have been uploaded.
- Pipeline monitor: Shows status of pipelines (processes for megawarcing and uploading) of different projects.
- System status: Some resource graphs of the FOS VM instance.