Difference between revisions of "Tracker"
(add a screenshot) |
|||
(28 intermediate revisions by 9 users not shown) | |||
Line 1: | Line 1: | ||
= General Overview = | == General Overview == | ||
[[File:Tracker_test_project_overview_screenshot.png|right|thumb|Project admin overview]] | [[File:Tracker_test_project_overview_screenshot.png|right|thumb|Project admin overview]] | ||
The [https://github.com/ArchiveTeam/universal-tracker Tracker] software is the center-pivot of Archiveteam's distributed archiving efforts. It hands out items to be downloaded and keeps track of what is completed. Items can be usernames, subdomains, full | The [https://github.com/ArchiveTeam/universal-tracker Tracker] software is the center-pivot of Archiveteam's distributed archiving efforts. It hands out items to be downloaded and keeps track of what is completed. Items can be usernames, subdomains, full URLs, basically any unit we can use to break the site into manageable chunks. The progress of each project can be viewed via the leaderboard interface on https://tracker.archiveteam.org. | ||
[[File:Xanga leaderboard.png|right|thumb|A leaderboard]] | |||
This is a sample from the | The [[ArchiveTeam Warrior|Warrior]] is the yang to the Tracker's yin. The warriors get the list of current projects from the project file on https://warriorhq.archiveteam.org/. | ||
__TOC__ | |||
== API == | |||
This is a sample project snippet from the projects.json file (line breaks included for readability): | |||
<pre> | <pre> | ||
Line 16: | Line 22: | ||
"repository": "https://github.com/ArchiveTeam/streetfiles-grab.git", | "repository": "https://github.com/ArchiveTeam/streetfiles-grab.git", | ||
"logo": "http://archiveteam.org/images/7/7b/Streetfiles-logo.png", | "logo": "http://archiveteam.org/images/7/7b/Streetfiles-logo.png", | ||
"marker_html": "<a href='http://tracker.archiveteam.org/streetfiles/'><img src='http://archiveteam.org/images/7/7b/Streetfiles-logo.png' alt='Streetfiles' width='235' height='50' /></a>", | "marker_html": | ||
"<a href='http://tracker.archiveteam.org/streetfiles/'> | |||
<img src='http://archiveteam.org/images/7/7b/Streetfiles-logo.png' | |||
alt='Streetfiles' width='235' height='50' /></a>", | |||
"deadline": "2013-04-30T23:59:59Z", | "deadline": "2013-04-30T23:59:59Z", | ||
"host": "streetfiles.org", | "host": "streetfiles.org", | ||
Line 28: | Line 37: | ||
It shows where to get the grab code and other project information. | It shows where to get the grab code and other project information. | ||
Here is an example root of the file: | |||
<pre> | |||
{ | |||
"auto_project": "projectslug", | |||
"broadcast_message": "<p>This message is shown only | |||
in the warrior VM web UI at time of writing.</p>", | |||
"tracker_banner_html": "This is shown on the tracker | |||
front page. <em>Wow!</em>", | |||
"warrior": {"seesaw_version":"0.7.0"}, | |||
"projects": [], | |||
} | |||
</pre> | |||
== Hardware == | == Hardware == | ||
The tracker runs on a [ | The tracker runs on a [[Clown hosting#linode|Linode]] instance operated by [[User:Chronomex|chronomex]]. | ||
== Monitoring == | |||
https://tracker.archiveteam.org has a Munin instance located at http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/. | |||
== Software used: == | == Software used: == | ||
* [https://github.com/ArchiveTeam/universal-tracker Universal Tracker] is a Ruby HTTP application that sends and receives JSON payloads and uses Redis for the data store. | * [https://github.com/ArchiveTeam/universal-tracker Universal Tracker] is a Ruby HTTP application that sends and receives JSON payloads and uses Redis for the data store. | ||
* Redis A memory based key value store | * Redis A memory-based key-value store | ||
* [ | * [https://debian.org/ Debian] is the Linux distribution the stack is built upon. | ||
* [https://github.com/ArchiveTeam/warrior-hq warrior-hq] a small Sinatra web app to manage the Warriors and display the geo-location world map. | * [https://github.com/ArchiveTeam/warrior-hq warrior-hq] a small Sinatra web app to manage the Warriors and display the geo-location world map. | ||
You can also [[Tracker Setup|set up your own tracker]]. | |||
== People == | == People == | ||
In case of a tracker maintenance emergency, please contact these active users (as of 2014-08-29). Tracker emergencies only!: | |||
* [[user:chfoo|chfoo]] | |||
* arkiver | |||
{{Navigation box}} | |||
Revision as of 20:38, 1 May 2021
General Overview
The Tracker software is the center-pivot of Archiveteam's distributed archiving efforts. It hands out items to be downloaded and keeps track of what is completed. Items can be usernames, subdomains, full URLs, basically any unit we can use to break the site into manageable chunks. The progress of each project can be viewed via the leaderboard interface on https://tracker.archiveteam.org.
The Warrior is the yang to the Tracker's yin. The warriors get the list of current projects from the project file on https://warriorhq.archiveteam.org/.
API
This is a sample project snippet from the projects.json file (line breaks included for readability):
{ "name": "streetfiles", "title": "Streetfiles", "description": "Streetfiles is closing April, 30th, 2013.", "repository": "https://github.com/ArchiveTeam/streetfiles-grab.git", "logo": "http://archiveteam.org/images/7/7b/Streetfiles-logo.png", "marker_html": "<a href='http://tracker.archiveteam.org/streetfiles/'> <img src='http://archiveteam.org/images/7/7b/Streetfiles-logo.png' alt='Streetfiles' width='235' height='50' /></a>", "deadline": "2013-04-30T23:59:59Z", "host": "streetfiles.org", "leaderboard": "http://tracker.archiveteam.org/streetfiles/", "lat_lng": [ 51, 9 ] },
It shows where to get the grab code and other project information.
Here is an example root of the file:
{ "auto_project": "projectslug", "broadcast_message": "<p>This message is shown only in the warrior VM web UI at time of writing.</p>", "tracker_banner_html": "This is shown on the tracker front page. <em>Wow!</em>", "warrior": {"seesaw_version":"0.7.0"}, "projects": [], }
Hardware
The tracker runs on a Linode instance operated by chronomex.
Monitoring
https://tracker.archiveteam.org has a Munin instance located at http://zeppelin.xrtc.net/corp.xrtc.net/shilling.corp.xrtc.net/.
Software used:
- Universal Tracker is a Ruby HTTP application that sends and receives JSON payloads and uses Redis for the data store.
- Redis A memory-based key-value store
- Debian is the Linux distribution the stack is built upon.
- warrior-hq a small Sinatra web app to manage the Warriors and display the geo-location world map.
You can also set up your own tracker.
People
In case of a tracker maintenance emergency, please contact these active users (as of 2014-08-29). Tracker emergencies only!:
- chfoo
- arkiver