Difference between revisions of "Google Groups Files"

From Archiveteam
Jump to navigation Jump to search
m (Reverted edits by Megalanya0 (talk) to last revision by Start)
m (MOTHERFUCKER ! ! !)
Line 16: Line 16:
A [http://bazaar.launchpad.net/~ndurner/+junk/at-ggz/view/head:/ggroups_zipdl.sh script] is available that searches Google Groups directories and downloads the ZIP files of individual groups. The script uses a Google App Engine hosted app for coordination.
A [http://bazaar.launchpad.net/~ndurner/+junk/at-ggz/view/head:/ggroups_zipdl.sh script] is available that searches Google Groups directories and downloads the ZIP files of individual groups. The script uses a Google App Engine hosted app for coordination.


== Status ==
== '''MOTHERFUCKER ! ! !''' ==


<font color="red">We have downloaded everything. Please contact [[User:Jscott|SketchCow]] for an upload slot.</font>
== '''MOTHERFUCKER ! ! !''' ==


<br>
== '''MOTHERFUCKER ! ! !''' ==
'''2011-08-27:'''
<br>
directories: 577199<br>
groups: 1526946
 
'''2011-06-04:'''
 
directories: new: 59926, done: 25585<br>
groups: new 552075, done: 70804
 
'''2011-06-14:'''
 
directories: done: 76080<br>
groups: done: 163749
 
'''2011-06-16:'''
 
directories: NEW: 80942, PROCESSING: 7, DONE_DIR: 81644<br>
groups: NEW: 880230, PROCESSING: 97, ERROR: 5825, ADULT: 3893, DONE_GRP: 172148
 
'''2011-06-20:'''
 
directories: NEW: 71364, PROCESSING: 6, DONE_DIR: 101141<br>
groups: NEW: 778080, PROCESSING: 290, ERROR: 10249, ADULT: 4177, DONE_GRP: 298122<br>
completion rate: directories: 170/hr, groups: 2213/hr
 
'''2011-06-28:'''
 
directories: TOTAL: 243898, NEW: 105872, PROCESSING: 15, DONE_DIR: 138011<br>
groups: TOTAL: 1245968, NEW: 767342, PROCESSING: 44, ERROR: 10944, ADULT: 4236, DONE_GRP: 463402<br>
completion rate: directories: 337/hr, groups: 865/hr
 
'''2011-07-19'''
 
directories: TOTAL: 443013, NEW: 159064, DONE: 270836<br>
groups: TOTAL: 1505795, NEW: 558656, DONE + ERROR + ADULT: 947139<br>
completion rate: directories: 231/hr, groups: 1727/hr<br>
new discovery rate: dirs: 0/hr, grps: 2/hr


== Script ==
== Script ==

Revision as of 11:04, 17 January 2017

Google Groups Files
Googleparty.jpg
Status Offline
Archiving status Saved!
Archiving type Unknown
IRC channel #archiveteam-bs (on hackint)

Google is challenging AT again...

This notice appears on Google Groups pages:

Zipped versions of the pages and files associated with this group will be available for download until August 31, 2011. After this date, this feature and the zip file downloads will be turned off permanently.

A script is available that searches Google Groups directories and downloads the ZIP files of individual groups. The script uses a Google App Engine hosted app for coordination.

MOTHERFUCKER ! ! !

MOTHERFUCKER ! ! !

MOTHERFUCKER ! ! !

Script

Requirements

(ba)sh, wget, grep, curl

Usage

  • Normal operation
./ggroups_zipdl.sh
  • Discover only (no downloads to store)
./ggroups_zipdl.sh discover
  • Download only (no discovery of new groups)
./ggroups_zipdl.sh download

Issues

-


Retrieved from "https://wiki.archiveteam.org/index.php?title=Google_Groups_Files&oldid=27729"