Ispygames

From Archiveteam
Jump to navigation Jump to search
Gamespy, IGN, 1up, ugo
Gamespy.jpg
URL http://www.gamespy.com[IA•Wcite•.today•MemWeb] & many others
Status Closing
Archiving status Partially saved
Archiving type Unknown
IRC channel #archiveteam-bs (on hackint)
(formerly #ispygames (on EFnet))
Data[how to use] archiveteam_ignsites
job:35fcc4zofjl5kg52fkbcskgus

The News

IGN hit with layoffs, 1UP, UGO and GameSpy shutting down
1UP, UGO and GameSpy to be shut down
Goodbye, And Thank You From The GameSpy Team

The Problems

  • Once you start digging around these sites you find it to be a mess of inconsistent url schemes and content everywhere.
  • Some files are being hosted on MediaFire.
  • Based on tests the larger and older a site is the more that is missed by a wget crawl due to the url scheme.

What we know

  • We already have a list of almost all the domains involved
  • A clean list with dups and bad domains is already being process and will be posted here when complete.
  • Most of the sites are not that big, but a few are huge.

The plan

  • Save the sites and related content
  • Backup the Twitter feeds for any associated accounts. All my tweets just takes a username and returns the max tweets possible.


wget test command

This if for the gamespy sites. 

USER_AGENT="Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US)"
SAVE_HOST="http://planetdoom.gamespy.com"
WARC_NAME="warc_name"

wget -e robots=off --mirror --page-requisites \ 
--waitretry 5 --timeout 60 --tries 5 --wait 2 \
--warc-header "operator: Archive Team" --warc-cdx --warc-file="$WARC_NAME" \
-U "$USER_AGENT" "$SAVE_HOST" \
--span-hosts --domains=$SAVE_HOST,pcmedia.gamespy.com,pnmedia.gamespy.com,pspmedia.gamespy.com,oystatic.ignimgs.com

Try this for the ign, ugo sites. 

USER_AGENT="Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US)"
SAVE_HOST="http://ve3d.ign.com"
WARC_NAME="warc_name"

wget -e robots=off --mirror --page-requisites \ 
--waitretry 5 --timeout 60 --tries 5 --wait 2 \
--warc-header "operator: Archive Team" --warc-cdx --warc-file="$WARC_NAME" \
-U "$USER_AGENT" "$SAVE_HOST"

IGN domains

In progress

Ready to grab


untested


These might be asset only hosting sites

Redirects

Gamespy Domains

Ready to grab

In Progress

Redirects

1up.com

On 2016-05-24, http://www.1up.com has been thrown into ArchiveBot with job:35fcc4zofjl5kg52fkbcskgus.


Retrieved from "https://wiki.archiveteam.org/index.php?title=Ispygames&oldid=47925"