Difference between revisions of "Arto"

From Archiveteam
Jump to navigation Jump to search
Line 2: Line 2:
  
 
== Current status ==
 
== Current status ==
* Enumerating all the users is done through polling for every profile. There are two scripts running currently. One is working upwards from a known ID while the other is working its way downwards.
+
* DONE: Enumerating all the users is done through polling for every profile. There are two scripts running currently. One is working upwards from a known ID while the other is working its way downwards.
* Downloading profiles and avatars, guestbooks, photos and videos works.
+
* DONE: Write a script to downloading profiles and avatars, guestbooks, photos and videos. Downloaded 50,000 users in ~3.5 hours with 10 workers.
* Currently the script is being tested--it seems to work fine. Downloaded 50,000 users in ~3.5 hours with 10 workers.
+
 
 +
The download is chugging along fine on my ([[User:Jchillerup|Jchillerup]] ([[User talk:Jchillerup|talk]])) server. Projected total size around 1TB.
  
 
== Volunteers ==
 
== Volunteers ==
 
* [[User:Jchillerup|Jchillerup]] ([[User talk:Jchillerup|talk]])
 
* [[User:Jchillerup|Jchillerup]] ([[User talk:Jchillerup|talk]])

Revision as of 19:30, 23 April 2016

Arto was the first social media platform in Denmark, used by virtually everyone born in the years 83-93. It's due to be shut down one June 1st.

Current status

  • DONE: Enumerating all the users is done through polling for every profile. There are two scripts running currently. One is working upwards from a known ID while the other is working its way downwards.
  • DONE: Write a script to downloading profiles and avatars, guestbooks, photos and videos. Downloaded 50,000 users in ~3.5 hours with 10 workers.

The download is chugging along fine on my (Jchillerup (talk)) server. Projected total size around 1TB.

Volunteers