Difference between revisions of "User:OrIdow6/Sandbox"

From Archiveteam
Jump to navigation Jump to search
 
Line 1: Line 1:
=== Yahoo Groups ===
=== Yahoo Groups ===
Forum/mailing list that shut down in a process spanning late 2019 to early 2020.
Forum/mailing list that shut down in a process spanning late 2019 to early 2020.
normal_dpos [label="2019 normal webpage grab" color=green];
src -> normal_dpos [arrowhead=empty];
pgoffline [label="PGoffline etc." color=purple];
src -> pgoffline [arrowhead=empty];
api_dpos [label="2019 API grab" color=red];
src -> api_dpos [arrowhead=empty];
//////
api_dpos_on_ia [label="2019 API grab, portion on IA" color=green];
api_dpos -> api_dpos_on_ia [arrowhead=empty];
api_dpos_with_lennier1 [label="2019 API grab, marked/lennier1" color=purple];
api_dpos -> api_dpos_with_lennier1 [arrowhead=empty];
api_dpos_australia [label="2019 API grab, portion \"in australia\" (existence unclear)"];
api_dpos -> api_dpos_australia [arrowhead=empty];
=== Purplesym's "Jsons" ===
Allegedly json files collected by PurpleSym for use in their [[#2018 API grab]].
normal_dpos [label="2019 normal webpage grab" color=green];
src -> normal_dpos [arrowhead=empty];
pgoffline [label="PGoffline etc." color=purple];
src -> pgoffline [arrowhead=empty];
api_dpos [label="2019 API grab" color=red];
src -> api_dpos [arrowhead=empty];
//////
api_dpos_on_ia [label="2019 API grab, portion on IA" color=green];
api_dpos -> api_dpos_on_ia [arrowhead=empty];
api_dpos_with_lennier1 [label="2019 API grab, marked/lennier1" color=purple];
api_dpos -> api_dpos_with_lennier1 [arrowhead=empty];
api_dpos_australia [label="2019 API grab, portion \"in australia\" (existence unclear)"];
api_dpos -> api_dpos_australia [arrowhead=empty];


=== 2018 API grab ===
=== 2018 API grab ===
Test test test
Scrape of the Yahoo Groups API. Led or done by PurpleSym. There is one WARC file per group, and several group-WARCs per IA item. The items are located in [https://archive.org/details/archiveteam_yahoogroups the IA collection archiveteam_yahoogroups], and are distinguishable from everything else in that collection by their upload date in late 2018, and by their thumbnails being a photo of a "Yahoo!" sign (with the exception of [https://archive.org/details/yahoogroup_info_grab something else from about 2 years later]). Although they are in WARC format, they seem to use the resource record-type with synthetic URIs, meaning they will not work in the Wayback Machine.
 


normal_dpos [label="2019 normal webpage grab" color=green];
=== Doranwen's metadata upload ===
src -> normal_dpos [arrowhead=empty];
An IA item located [https://archive.org/details/Yahoo_Groups_Metadata here] created by Doranwen. Contains tables of group metadata, parsed from the [[#2018 API grab|2018 API grab]]
pgoffline [label="PGoffline etc." color=purple];
src -> pgoffline [arrowhead=empty];
api_dpos [label="2019 API grab" color=red];
src -> api_dpos [arrowhead=empty];
//////
api_dpos_on_ia [label="2019 API grab, portion on IA" color=green];
api_dpos -> api_dpos_on_ia [arrowhead=empty];
api_dpos_with_lennier1 [label="2019 API grab, marked/lennier1" color=purple];
api_dpos -> api_dpos_with_lennier1 [arrowhead=empty];
api_dpos_australia [label="2019 API grab, portion \"in australia\" (existence unclear)"];
api_dpos -> api_dpos_australia [arrowhead=empty];

Latest revision as of 05:03, 27 September 2022

Yahoo Groups

Forum/mailing list that shut down in a process spanning late 2019 to early 2020.

2018 API grab

Scrape of the Yahoo Groups API. Led or done by PurpleSym. There is one WARC file per group, and several group-WARCs per IA item. The items are located in the IA collection archiveteam_yahoogroups, and are distinguishable from everything else in that collection by their upload date in late 2018, and by their thumbnails being a photo of a "Yahoo!" sign (with the exception of something else from about 2 years later). Although they are in WARC format, they seem to use the resource record-type with synthetic URIs, meaning they will not work in the Wayback Machine.

Doranwen's metadata upload

An IA item located here created by Doranwen. Contains tables of group metadata, parsed from the 2018 API grab