Fortress of Solitude

From Archiveteam
Jump to navigation Jump to search
Archiveteam1.png Historical content

This page or section is not really edited any more, probably because the project got abandoned, information is collected somewhere else in a different form etc.

However, this is a good and important record of ArchiveTeam's ancient times, thus must be preserved, but merging it into an other article would be difficult and/or some pieces of information are missing for a new form.

So feel free to read this, but it has probably nothing to be added now. However, if you resurrect the project or find a way to move this data to a fresh place, you can remove this template.

Fortress of Solitude, often abbreviated as FOS, was ArchiveTeam's primary staging server, operated by Jason Scott (a.k.a. SketchCow). It is, in fact, a virtual machine on the network of the Internet Archive, and had a storage capacity of 16 terabytes as of 2015.

Content downloaded as part of ArchiveTeam projects (including ArchiveBot) is uploaded to so-called staging servers via rsync, and after being processed, data is transferred from there to the servers of the Internet Archive.

As of December 2022, it is used very little (if at all). Warrior projects don't use it anymore, and ArchiveBot was updated not to use it in early 2022[1][2]. Additionally, on 2022-12-15, rsync was deactivated[3]

Warrior projects now use several different staging servers, which change often based on project size, urgency, and the total throughput needed to the Internet Archive. The remaining Archive Team data on the server was cleaned up around 2023-09-04.

As of February 2026, the FOS has been permanently shutdown, since its functions have been fully replaced elsewhere.[4][5]

Links

  • Upload history: Shows when and where the megawarc files (multi-gigabyte compilations of smaller WARC files) of ArchiveBot and ArchiveTeam projects have been uploaded.
  • Pipeline monitor: Shows status of pipelines (processes for megawarcing and uploading) of different projects.
  • System status: Some resource graphs of the FOS VM instance.

References