Difference between revisions of "DeviantArt"
(Mass-edit to update uses of Template:IRC) |
TheTechRobo (talk | contribs) (Restructure; add downloadiant) |
||
| Line 10: | Line 10: | ||
Currently there's few good solutions for backing up deviantarts, as the rest fail to build or fail to interact with the site, or just fail. Currently the best is “deviantart-gallery-downloader” by xofred. | Currently there's few good solutions for backing up deviantarts, as the rest fail to build or fail to interact with the site, or just fail. Currently the best is “deviantart-gallery-downloader” by xofred. | ||
== Vital signs == | |||
TODO: Put the "scares" mentioned on the talk page here. | |||
== Software == | |||
=== deviantart-gallery-downloader === | |||
This script will get full-sized images, whereas right-clicking hasn't in the past. It will also check to see if things have already been ripped, and rip any new changes to reduce traffic. | This script will get full-sized images, whereas right-clicking hasn't in the past. It will also check to see if things have already been ripped, and rip any new changes to reduce traffic. | ||
==== Things needed ==== | |||
== Things needed == | |||
* git | * git | ||
| Line 21: | Line 26: | ||
* A disposable dA account with adult images turned on (to make sure all images are gotten) | * A disposable dA account with adult images turned on (to make sure all images are gotten) | ||
== Getting the software and dependencies == | ==== Getting the software and dependencies ==== | ||
sudo apt-get install git ruby-dev | sudo apt-get install git ruby-dev | ||
| Line 34: | Line 39: | ||
== Usage == | ==== Usage ==== | ||
To rip an entire main gallery with no organization of the images on an album basis, run: | To rip an entire main gallery with no organization of the images on an album basis, run: | ||
| Line 46: | Line 51: | ||
ruby with_login.rb LOGIN-EMAIL PASSWORD http://USERID.deviantart.com/ALBUM_NAME | ruby with_login.rb LOGIN-EMAIL PASSWORD http://USERID.deviantart.com/ALBUM_NAME | ||
== Caveats == | ==== Caveats ==== | ||
No SSL auth, this could be done with a slight re-jiggering of code and a dependency on some ruby-SSL dep to offload that work. | No SSL auth, this could be done with a slight re-jiggering of code and a dependency on some ruby-SSL dep to offload that work. | ||
| Line 53: | Line 58: | ||
*Use a burner account until this script is made a bit more secure* | *Use a burner account until this script is made a bit more secure* | ||
=== downloadiant === | |||
[[User:TheTechRobo]] made a simple script to download a user's gallery URLs. | |||
There's currently functions for scraping an individual post and a specific gallery, but that code is not yet exposed because it sucks. | |||
It can also be used as a module. Documentation coming soon™ | |||
==== Things needed ==== | |||
* Python 3 | |||
* requests | |||
* Preferably, a DeviantArt account (only watermarked images are available to anonymous users) | |||
<i>this should preferably be a burner account</i> | |||
* A cookies.txt file for that account (if you don't want to log in, make it an empty file) | |||
==== Usage ==== | |||
Usage instructions can be found at [https://github.com/TheTechRobo/downloadiant the repo]. | |||
== Gallery == | == Gallery == | ||
Revision as of 15:51, 1 May 2022
| DeviantART | |
| |
| |
| URL | http://deviantart.com/ |
| Status | Online! |
| Archiving status | Not saved yet |
| Archiving type | Unknown |
| IRC channel | #devianttart (on hackint) |
Currently there's few good solutions for backing up deviantarts, as the rest fail to build or fail to interact with the site, or just fail. Currently the best is “deviantart-gallery-downloader” by xofred.
Vital signs
TODO: Put the "scares" mentioned on the talk page here.
Software
deviantart-gallery-downloader
This script will get full-sized images, whereas right-clicking hasn't in the past. It will also check to see if things have already been ripped, and rip any new changes to reduce traffic.
Things needed
- git
- gem (ruby-dev)
- mechanize
- A disposable dA account with adult images turned on (to make sure all images are gotten)
Getting the software and dependencies
sudo apt-get install git ruby-dev
sudo gem update
sudo gem install mechanize
git clone https://github.com/xofred/deviantart-gallery-downloader.git
cd deviantart-gallery-downloader
Usage
To rip an entire main gallery with no organization of the images on an album basis, run:
ruby with_login.rb LOGIN-EMAIL PASSWORD "http://USERID.deviantart.com/gallery/?catpath=/"
That "/?catpath=/" on the end is important because it grabs all the images where as with the default gallery URL it does not.
For an album:
ruby with_login.rb LOGIN-EMAIL PASSWORD http://USERID.deviantart.com/ALBUM_NAME
Caveats
No SSL auth, this could be done with a slight re-jiggering of code and a dependency on some ruby-SSL dep to offload that work.
User creds are in the process name being run. Use with caution on a multi-user system. A simple ps -A will reveal your creds.
- Use a burner account until this script is made a bit more secure*
downloadiant
User:TheTechRobo made a simple script to download a user's gallery URLs.
There's currently functions for scraping an individual post and a specific gallery, but that code is not yet exposed because it sucks.
It can also be used as a module. Documentation coming soon™
Things needed
- Python 3
- requests
- Preferably, a DeviantArt account (only watermarked images are available to anonymous users)
this should preferably be a burner account
- A cookies.txt file for that account (if you don't want to log in, make it an empty file)
Usage
Usage instructions can be found at the repo.
Gallery
DeviantART's home page in 2017
