Difference between revisions of "Yahoo! Groups"

From Archiveteam
Jump to navigation Jump to search
(info about other archivers)
Line 43: Line 43:
|}
|}


Potentially relevant: [https://fanlore.org/wiki/Category:Yahoo!_Groups List of groups with Fanlore pages] (contains both private and public groups)
Potentially relevant: [https://fanlore.org/wiki/Category:Yahoo!_Groups List of groups with Fanlore pages] (contains both private and public groups), [https://archivetransyahoo.noblogs.org/list-of-known-trans-groups/ Archive Trans Yahoo's list] (all private at last check)


== Site structure ==
== Site structure ==

Revision as of 06:01, 20 October 2019

Yahoo! Groups
Yahoo! Groups logo
Groups-yahoo-com.png
URL http://groups.yahoo.com/
Status Closing
Archiving status In progress...
Archiving type Unknown
IRC channel #yahoosucks (on hackint)

Yahoo! Groups is Yahoo's combination mailing list service/web forum; it's the result of the acquisition of eGroups and some other Yahoo! stuff. In addition to archives of and a web interface for mailing lists, it offers file uploads, photo uploads, links, polls, and an events calendar.

Uploading of new content will be disabled 28 October 2019, and all content, including message history, will be deleted 14 December 2019.[1] (The mailing lists themselves will continue to function.)

Public groups can be nominated for archival using this form.

It's been stable for a long time (since the late 90s), long enough for some specialised software to be developed to do backups of it. (Not many other websites can say that.)

Statistics

As of 2019-10-16 the directory lists 5619351 groups. 2752112 of them have been discovered. 1483853 (54%) have public message archives with an estimated number of 2.1 billion messages (1389 messages per group on average so far). 1.8 billion messages (86%) have been archived as of 2018-10-28.

The following graphs are slightly outdated:

Yahoo groups date created.png Yahoo groups messages per group.png Yahoo groups post date.png

Private groups of interest

Group Notes Admin consent?
numberactivation see all the press coverage Not yet contacted; FOI request made
hpslash see Fanlore page Not yet contacted

Potentially relevant: List of groups with Fanlore pages (contains both private and public groups), Archive Trans Yahoo's list (all private at last check)

Site structure

There’s a convenient JSON API. May require logging in and joining a group to use all endpoints:

Note that all paginated responses are limited to the first 500 results and do not return anything new beyond that.

Python Yahoo! Group archivers

  • yahoo-group-archiver scrapes a group using the JSON API and (for private endpoints) the two cookies Yahoo uses to verify a logged-in user. Relevant forks include Frankkkkk and nsapa. Needs merging. Various branches have support (largely untested) for file attachments, photos, links, folders, and events.
  • YahooGroups-Archiver is similar, but scrapes only messages (not files or any other data). It is not currently under active development.
  • yahoo-groups-backup scrapes a group using Selenium, storing message info and metadata (both rendered message body and raw email) into a Mongo database. It also provides a script to dump its data to static HTML pages that can be viewed in the browser.

Other archivers

  • Yahoo Group Archiver: Perl, defunct.
  • PGOffline: Windows, proprietary. 14-day free trial, after which download and export is disabled (but view still works). Includes attachments. Stores data in a SQLite database internally.
  • Yahoo Messages Export: Chrome extension. Messages only. Saves as mbox.

External Links

References