Portalgraphics.net

From Archiveteam
Jump to navigation Jump to search
portalgraphics.net
Portalgraphics.net logo
URL http://portalgraphics.net/[IAWcite.todayMemWeb]
Status Special case
Archiving status In progress...
Archiving type Unknown
Project source portalgraphics-grab
Project tracker portalgraphics
IRC channel #archiveteam-bs (on hackint)

portalgraphics.net is an art website that primarily displays images created with openCanvas.

On July 27th 2016 Japan Time, the site will undergo a "service change" and will primarily become a "rendering" site. During the overhaul, data will be deleted, including user data and associated data, which assumedly includes images a user uploaded

Notice

http://www.portalgraphics.net/pg/guide/en_news20160520.html[IAWcite.todayMemWeb]

All data in PGN Community will be deleted on July 27th, 2016.

- PGN Community user account data

- Uploaded illustration data (event file, event animation file)

- Data posted to community (forum)

If you would like to save an event file or event animation file posted to the PGN community, please download them by July 27th, 2016.

Regarding the personal information in your PGN Community account, we will delete it in a secure and responsible way

according to the privacy policy upon the end of the service.

The Project

The goal is to get as much of the site saved on Wayback Machine as much as possible. The good news is that important URLs are based around numbers

URLs

Page URLs

  • Sitemap[IAWcite.todayMemWeb]
  • http://portalgraphics.net/pg/illust/?image_id=n
    • The info page for a given image
  • http://portalgraphics.net/pg/illust/?image_id=n&size=full
    • Full size view of an image

n can be anywhere from 1 to 90360 (and counting). New images are added daily

Direct Image URLs

  • http://www.portalgraphics.net/data/image/fullsize/m/n.jpg
  • http://www.portalgraphics.net/data/image/resize/m/n.jpg
  • http://www.portalgraphics.net/data/image/preview/m/n.jpg
  • http://www.portalgraphics.net/data/image/preview_s/m/n.jpg

n is the same number as n from the page URL. m is n rounded down to the thousandth, unless n is less than 1000, in which case m is 0000. So if n is 3234, m is 3000. If n is 253, m is 0000

Caveats

If an image has been taken down, viewing a page URL will either yield the message "This illustration has been deleted already, or it does not exist.( illust_index:get_no_image_data. )" or "This page's ID is invalid, or you do not have authority to access to this page.( id )". In the latter case, viewing an image directly will still work, while in the former case, a direct image URL will redirect to a dedicated 404 page while still yielding a status code of 200.

Saving ranking pages[IAWcite.todayMemWeb] properly may be impossible, as functionality relies on the current time as a UNIX timestamp in the URL, generated by Date.now()

If the site's servers are overwhelmed, the page will be rendered with the message "回線が込み合っております。時間をおいて再度アクセスしてください" ("The lines are crowded. Please try again at a later time") while still yielding a status code of 200.

Some areas of the site, such as http://www.portalgraphics.net/pg/plan_portal/[IAWcite.todayMemWeb] and http://www.portalgraphics.net/oc/lecture/[IAWcite.todayMemWeb] are Japanese-exclusive; clicking the "English" link will take you to the front page.

Other site structure info

Language setting is enforced via the cookie "langset" set to either "en" or "ja".

How can I help?

Running a Warrior

You can start up a Warrior and there select portalgraphics.net. (If you don't really care what you are archiving, select ArchiveTeam's Choice instead, as at some points ArchiveTeam may priorize another project.)

Running the script manually

If you use Linux and you're a bit familiar with it, you can try running the script directly.

The instructions can be found at github.com/ArchiveTeam/portalgraphics-grab.

Some additional information
Don't forget to replace YOURNICKHERE with your nickname.

The number after --concurrent determines how many threads run at the same time.

If you want to stop the script, please do it gracefully if possible. To do so, create an empty file named STOP in the folder of the script (terminal command: touch STOP). The script finishes the current item(s) and stops only after that. (If you kill the script immediately, the items get broken, and they will need to be reassigned to another user.) – Before starting the script again, don't forget to remove the STOP file.

If you see "Project code is out of date", kill the script, go to its folder (cd portalgraphics-grab) and issue git pull https://github.com/ArchiveTeam/portalgraphics-grab. After the updating has finished, re-launch the script.

The grabber script is designed so that the warrior will shut down if the servers are too busy, so as to avoid grabbing the "servers are too busy" message instead of the intended page

Donating to the Internet Archive

Content downloaded by the ArchiveTeam will be uploaded to the Internet Archive, where it will be stored and be available – hopefully – forever. However, storing it costs thousands of dollars in the long run. So, if you can afford, please consider donating to the Internet Archive, so that this piece of history can be kept for us all. http://archive.org/donate

Do you like our cause?

If you want to help in other projects, want to learn more about ArchiveTeam, or even help in development in general, navigate to the Main Page of this wiki, from there you can reach a lot of information. The Team consists of volunteers working on the projects in their free time, so helping hands (and resources) are always welcome.

Manual archiving without a Warrior

Get as many pages saved on Wayback Machine as possible by finding an URL and prefixing it with http://web.archive.org/save/

Stretch Goals