Difference between revisions of "Viddy"

From Archiveteam
Jump to navigation Jump to search
(Removed page from the "Archives not in collection yet" category and linked to the collection)
(12 intermediate revisions by 5 users not shown)
Line 5: Line 5:
| description =  
| description =  
| URL = http://www.viddy.com
| URL = http://www.viddy.com
| project_status = {{closing}}
| project_status = {{offline}}
| archiving_status = {{in progress}}
| archiving_status = {{saved}} (most of it)
| source = [https://github.com/ArchiveTeam/viddy-grab viddy-grab], [https://github.com/ArchiveTeam/viddy-items viddy-items]
| source = [https://github.com/ArchiveTeam/viddy-grab viddy-grab], [https://github.com/ArchiveTeam/viddy-items viddy-items]
| tracker = [http://tracker.archiveteam.org/viddy/ viddy]
| tracker = [http://tracker.archiveteam.org/viddy/ viddy]
| irc = viddiot
| irc = viddiot
}}
}}
Viddy is a video hosting service like Instagram. The service has its own url shortener service viddy.it, just to make sure the impact of the closure is even worse.
Viddy was a video hosting service like Instagram. The service had its own url shortener service viddy.it, just to make sure the impact of the closure is even worse.


Viddy announced to be shutting down December 15th 2014 after joining [http://www.fullscreen.com Fullscreen].
Viddy announced to be shutting down December 15th 2014 after joining [http://www.fullscreen.com Fullscreen].
See also [[Epic]], another Viddy site, with the same shutdown date. ArchiveTeam saved that with tools developed for Viddy.


== Shutdown ==
== Shutdown ==
Line 31: Line 33:
=== API Scraping ===
=== API Scraping ===


Through scraping the public API (reference for dedicated API [http://developer.viddy.com/docs here] - this mostly applies to the public API: http://viddy.com/v1/... ), computerfreak is compiling a list of user IDs (currently ~4 million retrieved) and media IDs (currently ~500k retrieved). These are available [http://archiveteam.nickproductions.com/viddy/ here] (user IDs in the viddy_user* files, and the media data (UserID, MediaID, comment_count, like_count, view_count) in the viddy_medias* files).
Through scraping the public API (reference for dedicated API [http://developer.viddy.com/docs here] - this mostly applies to the public API: http://viddy.com/v1/... ), computerfreak is compiling a list of user IDs (currently ~4 million retrieved) and media IDs (currently ~500k retrieved). These are available [https://archive.org/details/viddy_lists here] (user IDs in the viddy_user* files, and the media data (UserID, MediaID, comment_count, like_count, view_count) in the viddy_medias* files).


The user IDs were obtained by doing a BFS on user's followers (script stopped after about 2 days of running), and the medias were then obtained by getting the media listings for each user. <s>Obviously this is not every single user or every single video, but it is certainly a good starting point.</s> As of Nov. 29, computerfreak is continuously running a script to get new user IDs and is pulling off the new IDs and fetching the associated media info.
The user IDs were obtained by doing a BFS on user's followers (script stopped after about 2 days of running), and the medias were then obtained by getting the media listings for each user. <s>Obviously this is not every single user or every single video, but it is certainly a good starting point.</s> As of Nov. 29, computerfreak is continuously running a script to get new user IDs and is pulling off the new IDs and fetching the associated media info.


== How can I help? ==
== Archiving report ==
 
=== Content discovery ===
 
Viddy item discovery is being done through the [[URLTeam]] project, scraping the [http://www.viddy.it www.viddy.it] shortener. If you want to take part, join that project, see details on its page. (You'll get tasks of other shorteners as well, they are distributed randomly. You should start multiple threads.)
 
=== Content grab ===
 
==== Running a Warrior ====
 
You can start up a [[Warrior]] and there select ''Viddy''. (If you don't really care what you are archiving, select ''ArchiveTeam's Choice'' instead, as at some points ArchiveTeam may priorize another project.)
 
==== Running the script manually ====
 
If you use Linux and you're a bit familiar with it, you can try running the script directly.
 
The instructions can be found at [https://github.com/ArchiveTeam/viddy-grab github.com/ArchiveTeam/viddy-grab].
 
{| class="mw-collapsible mw-collapsed" style="text-align:left;"
! Some additional information
|-
| Don't forget to replace YOURNICKHERE with your nickname.
 
The number after <code>--concurrent</code> determines how many threads run at the same time. You can increase this number if your resources (RAM, CPU, bandwidth) are sufficient. However, if you constantly see messages about rate limiting, there is no need to increase the concurrency.
 
If you want to stop the script, please do it gracefully if possible. To do so, create an empty file named '''STOP''' in the folder of the script (terminal command: <code>touch STOP</code>). The script finishes the current item(s) and stops only after that. (If you kill the script immediately, the items get broken, and they will need to be reassigned to another user.) – Before starting the script again, don't forget to remove the STOP file.
 
If you see "Project code is out of date", kill the script, go to its folder (<code>cd viddy-grab</code>) and issue <code><nowiki>git pull https://github.com/ArchiveTeam/</nowiki>viddy-grab</code>. After the updating has finished, re-launch the script.
|}
 
=== Donating to the Internet Archive ===
 
Content downloaded by the ArchiveTeam will be uploaded to the [[Internet Archive]], where it will be stored and be available – hopefully – forever. However, storing it costs thousands of dollars in the long run. So, if you can afford, please consider donating to the Internet Archive, so that this piece of history can be kept for us all. http://archive.org/donate
 
== Archiving status ==


2014 November: Discovery started through URLTeam project, and user ''computerfreak'' also did an efficient discovery.
2014 November: Discovery started through URLTeam project, and user ''computerfreak'' also did an efficient discovery.


Video downloading: started 2014-12-01, finished 2014-12-10. Downloaded ~3,200,000 videos.
Video downloading: started 2014-12-01.
User pages downloading: started 2014-12-11.


User pages downloading: started 2014-12-11, in progress. Downloading ~13 million pages.
Although viddy.com was shut down on 2014-12-15, some of the servers stayed alive, from which we went on downloading until 2014-12-17.


== Download Your Data ==
We grabbed what we knew of (discovered).


:"We’ve made it easy for you to download your content before this date [December 15th 2014]! Please click the button [...] and log in with your username / password to get started."<ref>http://viddy.com</ref>
== Archives ==
You can find Viddy archives in the [https://archive.org/search.php?query=Archiveteam%20viddy archiveteam_viddy collection].


The link: http://www.viddy.com/download
{{Navigation box}}


== References ==
[[Category:Video hosting]]
<references/>

Revision as of 10:39, 13 April 2019

Viddy
Viddy logo
Viddy - Capture Life in the Moment..png
URL http://www.viddy.com
Status Offline
Archiving status Saved! (most of it)
Archiving type Unknown
Project source viddy-grab, viddy-items
Project tracker viddy
IRC channel #viddiot (on hackint)

Viddy was a video hosting service like Instagram. The service had its own url shortener service viddy.it, just to make sure the impact of the closure is even worse.

Viddy announced to be shutting down December 15th 2014 after joining Fullscreen.

See also Epic, another Viddy site, with the same shutdown date. ArchiveTeam saved that with tools developed for Viddy.

Shutdown

Message on viddy.com website:

"Viddy is powering down, but you’ll hear from us again soon…
We’ve been building something new and exciting since joining Fullscreen in January, and as we focus on the future, Viddy will be pulled from the App Store on Tuesday, November 4th, 2014, and will officially shut down Monday, December 15th, 2014."

Site Structure

  • www.viddy.com/JustinBieber/v/soundcheck-LDS3p9
  • www.viddy.com/media/af2745dd-d085-4b3a-9017-085f72f6334a
  • www.viddy.it/Syv46W

API Scraping

Through scraping the public API (reference for dedicated API here - this mostly applies to the public API: http://viddy.com/v1/... ), computerfreak is compiling a list of user IDs (currently ~4 million retrieved) and media IDs (currently ~500k retrieved). These are available here (user IDs in the viddy_user* files, and the media data (UserID, MediaID, comment_count, like_count, view_count) in the viddy_medias* files).

The user IDs were obtained by doing a BFS on user's followers (script stopped after about 2 days of running), and the medias were then obtained by getting the media listings for each user. Obviously this is not every single user or every single video, but it is certainly a good starting point. As of Nov. 29, computerfreak is continuously running a script to get new user IDs and is pulling off the new IDs and fetching the associated media info.

Archiving report

2014 November: Discovery started through URLTeam project, and user computerfreak also did an efficient discovery.

Video downloading: started 2014-12-01. User pages downloading: started 2014-12-11.

Although viddy.com was shut down on 2014-12-15, some of the servers stayed alive, from which we went on downloading until 2014-12-17.

We grabbed what we knew of (discovered).

Archives

You can find Viddy archives in the archiveteam_viddy collection.

Retrieved from "https://wiki.archiveteam.org/index.php?title=Viddy&oldid=36440"