Difference between revisions of "Google Groups Files"

From Archiveteam
Jump to navigation Jump to search
Line 21: Line 21:
=== Issues ===
=== Issues ===


* The script does only primtive rate limiting (1 request per second). Is that good enough or will get temporarily banned? Talk to ndurner on #archiveteam
* Adult groups have an additional confirmation screen. The script reports those groups to the server as ADULT. Is it possible to confirm from the script? [http://groups.google.com/groups/adult_confirm?_done=http%3A%2F%2Fgroups.google.com%2Fgroup%2Fwives-sharing-arab%2Fdownload%3Fs%3Dpages Example]
* Adult groups have an additional confirmation screen. The script reports those groups to the server as ADULT. Is it possible to confirm from the script? [http://groups.google.com/groups/adult_confirm?_done=http%3A%2F%2Fgroups.google.com%2Fgroup%2Fwives-sharing-arab%2Fdownload%3Fs%3Dpages Example]

Revision as of 17:17, 22 May 2011

Googleparty.jpg

Google is challenging AT again...

This notice appears on Google Groups pages:


Zipped versions of the pages and files associated with this group will be available for download until August 31, 2011. After this date, this feature and the zip file downloads will be turned off permanently.


A script is available that searches Google Groups directories and downloads the ZIP files of individual groups. The script uses a Google App Engine hosted app for coordination.


Script

Requirements

(ba)sh, wget, grep

Usage

./ggroups_zipdl.sh

Issues

  • Adult groups have an additional confirmation screen. The script reports those groups to the server as ADULT. Is it possible to confirm from the script? Example