Difference between revisions of "Dev/Source Code"

From Archiveteam
< Dev
Jump to navigation Jump to search
m (add devnav)
(add dockerfile repo)
Line 11: Line 11:
[https://github.com/ArchiveTeam/seesaw-kit seesaw-kit]
[https://github.com/ArchiveTeam/seesaw-kit seesaw-kit]
:Library that helps build grab scripts and the web interface for the warrior. The name "seesaw" comes from its original behavior: download, upload, and repeat.
:Library that helps build grab scripts and the web interface for the warrior. The name "seesaw" comes from its original behavior: download, upload, and repeat.
[https://github.com/ArchiveTeam/warrior-dockerfile warrior-dockerfile]
:Dockerfile that runs the warrior inside a Docker container.


Projects are in separate repositories typically with the name <code>-grab</code> as a suffix.
Projects are in separate repositories typically with the name <code>-grab</code> as a suffix.

Revision as of 16:44, 4 December 2013

Fork me on GitHub! The warrior uses the following repos:

Client code

Client code includes code that the warrior executes.

warrior-preseed

For constructing the virtual appliance image

warrior-code2

Bootstrap code that is pulled from GitHub by the appliance

seesaw-kit

Library that helps build grab scripts and the web interface for the warrior. The name "seesaw" comes from its original behavior: download, upload, and repeat.

warrior-dockerfile

Dockerfile that runs the warrior inside a Docker container.

Projects are in separate repositories typically with the name -grab as a suffix.

Server code

Server code includes code that the Tracker executes.

universal-tracker

The server of which the Seesaw contacts

warrior-hq

The server of which the warrior appliances contact for project metadata

archiveteam-megawarc-factory

The scripts that bundles the WARC files.

URLTeam code

URLTeam code is independent from the tracker and warrior.

tinyback

The client code that scrapes the shortlinks. It includes a pipeline shim to run the code.

tinyarchive

The server code for the tracker.


Developer Documentation