Cyberpunkreview.com

From Archiveteam
Revision as of 07:47, 20 April 2012 by Aggroskater (talk | contribs)
Jump to navigation Jump to search
Cyberpunkreview.com
Cyberpunkreview.com logo
A screenshot of the home page taken on 10 April 2012.
A screenshot of the home page taken on 10 April 2012.
URL http://cyberpunkreview.com
Status Online!
Archiving status Not saved yet
Archiving type Unknown
IRC channel #archiveteam-bs (on hackint)

Cyberpunkreview.com is a Web site that reviews cyberpunk films, music, art, games and more.

Overview

The site doesn't appear to be inactive. A two month or so hiatus between October and December, but other than that, in good shape. It used to be host to a very popular forum for cyberpunks at http://cyberpunkreview.com/forums/index.php but they recently moved over to a different domain http://cyberpunkforums.com/ that is much more active. I have a penchant for anything cyberpunk and will keep an eye on the site.

It looks like a typical Wordpress instance. Not sure if we have a standard procedure for scraping them or not. Aggroskater 08:10, 19 March 2012 (EDT)

Mirroring

Currently in the process of mirroring with the following command set:

$ wget https://raw.github.com/ArchiveTeam/fortunecity/master/get-wget-warc.sh
$ chmod 0755 get-wget-warc.sh
$ ./get-wget-warc.sh
$ ./wget-warc --no-parent --no-clobber --html-extension --recursive --convert-links --page-requisites -e robots=off -w 5 --random-wait --warc-file=cpr http://cyberpunkreview.com/

Please email me or contact me in the #archiveteam channel if there's a better way of doing this. I've basically just taken the guideline from the Software page and applied it to alard's wget build with warc. The larger projects seem to have a more systematic way of grabbing terabytes worth of data. Since this is a relatively small site, I don't know if that's necessary or not. --Aggroskater 06:58, 13 April 2012 (EDT)

Friday April 20 2012 Update

Mirror complete. Appears fully operational on my machine. Warc gz is 385 megabytes in size. What's next? --Aggroskater 02:54, 20 April 2012 (EDT)

Ydg.jpg

Yeah... so it seems the wordpress site is at www.cyberpunkreview.com and not just cyberpunkreview.com. Running the following to grab the blog itself. Shouldn't take nearly as long. The /wiki and /forums work great from the first run though.


./wget-warc --no-parent --no-clobber --html-extension --recursive --convert-links --page-requisites --exclude-directories=wiki,forums -e robots=off -w 2 --random-wait --warc-file=cpr-wp-fix http://www.cyberpunkreview.com/