Difference between revisions of "Yahoo! Video Warroom"

From Archiveteam
Jump to navigation Jump to search
(→‎Phase One: Username Acquisition: Moved my shit to the DONE column.)
Line 18: Line 18:
* '''1,750,000''' - '''2,000,000''' Underscor
* '''1,750,000''' - '''2,000,000''' Underscor
* '''2,000,000''' - '''2,250,000''' Joey
* '''2,000,000''' - '''2,250,000''' Joey
* '''2,250,000''' - '''2,500,000''' Underscor/Chronomex (Chronomex is finishing)
* '''2,500,000''' - '''2,750,000''' Soultcer
* '''2,500,000''' - '''2,750,000''' Soultcer
* '''2,750,000''' - '''3,000,000''' Underscor
* '''2,750,000''' - '''3,000,000''' Underscor
Line 23: Line 24:
* '''3,250,000''' - '''3,500,000''' Underscor
* '''3,250,000''' - '''3,500,000''' Underscor
* '''3,500,000''' - '''4,000,000''' Chronomex  
* '''3,500,000''' - '''4,000,000''' Chronomex  
* '''4,000,000''' - '''4,250,000''' Chronomex (gir)
* '''4,250,000''' - '''4,500,000''' Chronomex (dedi)
* '''4,750,000''' - '''5,000,000''' Underscor
* '''4,750,000''' - '''5,000,000''' Underscor
* '''5,000,000''' - '''5,300,000''' Jason Scott
* '''5,000,000''' - '''5,300,000''' Jason Scott
Line 35: Line 38:
===Continuing===
===Continuing===


* '''2,250,000''' Underscor/Chronomex (Chronomex is finishing)
* '''4,000,000''' Chronomex (gir)
* '''4,250,000''' Chronomex (dedi)
* '''4,500,000''' Underscor (.202)
* '''4,500,000''' Underscor (.202)
* '''5,250,000''' Jason Scott/Spirit (Spirit is finishing)
* '''5,250,000''' Jason Scott/Spirit (Spirit is finishing)

Revision as of 02:45, 21 February 2011

Planning room for Yahoo! Video.

Yahoovideo.jpg

Phase One: Username Acquisition

"You people are working so hard!"

Acquiring the usernames and which have videos is done by the script yvscan. Ask Jason for a copy. The process is somewhat slow, as going too fast gets the dreaded 999. As a result, we need a large number of people and machines doing the work, so we have to put them here to keep track of who's doing what. The scraper pulls in userpics, a copy of the user page, and generates a userlist.txt of all the accounts it has found.

There are roughly 9,360,000 user accounts on Yahoo Video. (Let us not fool ourselves as to thinking these are real people.) Some are "Networks", i.e. collections of other videos (but not many, maybe 1 out of every 50,000, or less.) Most have no videos at all, but to make a hitlist of videos to download, we need those.

Finished

  • 0,000,000 - 0,750,000 Jason Scott/Chronomex
  • 0,750,000 - 1,000,000 Chronomex
  • 1,000,000 - 1,750,000 Joey
  • 1,750,000 - 2,000,000 Underscor
  • 2,000,000 - 2,250,000 Joey
  • 2,250,000 - 2,500,000 Underscor/Chronomex (Chronomex is finishing)
  • 2,500,000 - 2,750,000 Soultcer
  • 2,750,000 - 3,000,000 Underscor
  • 3,000,000 - 3,250,000 Soultcer
  • 3,250,000 - 3,500,000 Underscor
  • 3,500,000 - 4,000,000 Chronomex
  • 4,000,000 - 4,250,000 Chronomex (gir)
  • 4,250,000 - 4,500,000 Chronomex (dedi)
  • 4,750,000 - 5,000,000 Underscor
  • 5,000,000 - 5,300,000 Jason Scott
  • 5,500,000 - 5,750,000 Ymgve
  • 5,750,000 - 6,000,000 Underscor
  • 7,500,000 - 8,000,000 Jason Scott
  • 8,000,000 - 8,250,000 Spirit
  • 8,250,000 - 8,500,000 Sungo
  • 8,750,000 - 9,000,000 Spirit
  • 9,000,000 - 9,360,000 Jason Scott/Underscor/Ymgve

Continuing

  • 4,500,000 Underscor (.202)
  • 5,250,000 Jason Scott/Spirit (Spirit is finishing)
  • 6,000,000 Underscor (.197)
  • 6,250,000 Underscor (.203)
  • 6,750,000 Underscor (Not running)
  • 8,500,000 Sungo

Phase Two: Video Acquisition

"Oh my god, some of these videos!"

Once the hotlists of who has videos have been grabbed (and that is going to happen rather shortly, thanks to the army of folks), we'll be running a program called grapefruit (the g and fruit are silent, ræp) that yanks down all the videos from a given user. The number of users with video is a tiny percentage of the total users (we're seeing rates of less than 1 video-keeping user for every 10-20 of the users, and less), it will still be significant diskspace. It's video, after all. After an initial test run of grapefruit, we'll start handing out numbers and hitlists to people, and they'll begin downloading.

We have no idea where we're going to put this. We're going to need a bigger boat.

Finished

  • 0,100,000 - 0,200,000 (6,247 Users, x videos, 159gb) Underscor
  • 0,200,000 - 0,300,000 (6,461 Users, x videos, 141gb) Underscor
  • 0,400,000 - 0,500,000 (6,231 Users, x videos, 159gb) Underscor
  • 0,750,000 - 0,800,000 (3,735 Users, 1,097 videos, 7gb) atg (Use as test)
  • 2,500,000 - 2,600,000 (3,949 Users, 7,849 videos, 82gb) Zumthing
  • 3,000,000 - 3,100,000 (6,297 Users, 18,418 videos, 163gb) Guan
  • 3,100,000 - 3,200,000 (5,760 Users, 15,661 videos, 186gb) Masterono
  • 7,700,000 - 7,800,000 (4,028 Users, 15,037, 171gb) K4K
  • 7,500,000 - 7,600,000 (4,347 Users, 20,418 videos, 240gb) Guan
  • 9,000,000 - 9,050,000 (1,745 Users) atg
  • 9,050,000 - 9,100,000 (1,796 Users, 6,142 videos, 79gb) Masterono
  • 9,200,000 - 9,300,000 (8,941 Users, 30,179 videos, 341gb) Zumthing

In-Process

  • 0,000,000 - 0,100,000 (72,176 Users) Underscor 0-10k Done
  • 0,300,000 - 0,400,000 (6,909 Users) Underscor Rebuilding
  • 0,500,000 - 0,600,000 (6,543 Users) Underscor Rebuilding
  • 0,600,000 - 0,700,000 (7,833 Users) Underscor Rebuilding
  • 0,800,000 - 0,850,000 (3,140 Users) Crust
  • 0,850,000 - 0,900,000 (3,479 Users) filer
  • 0,900,000 - 1,000,000 (6,453 Users) K4K
  • 1,000,000 - 1,100,000 (6,331 Users) Zumthing
  • 1,100,000 - 1,200,000 (7,613 Users) NovaKing
  • 1,200,000 - 1,300,000 (7,130 Users) drspangle
  • 1,300,000 - 1,400,000 (7,598 Users) sep332
  • 1,400,000 - 1,500,000 (5,194 Users) beardicus
  • 1,500,000 - 1,600,000 (5,252 Users) NovaKing
  • 1,600,000 - 1,700,000 (4,933 Users) Masterono
  • 1,700,000 - 1,800,000 (4,368 Users) atg
  • 3,200,000 - 3,250,000 (2,603 Users) Soultcer
  • 5,100,000 - 5,150,000 (3,254 Users) Spirit
  • 5,150,000 - 5,200,000 (3,313 Users) guan
  • 7,600,000 - 7,700,000 (4,200 Users) NovaKing
  • 9,100,000 - 9,150,000 (1,989 Users) Killface
  • 9,150,000 - 9,200,000 (5,173 Users) Underscor (Running) view status here
  • 9,250,000 - 9,300,000 (2,835 Users) drspangle
  • 9,300,000 - 9,360,000 (2,179 Users) Robertcu

Statistics

"Why didn't more people use it! It was awesome!"

People like easy to quote statistics from a project, so here are some, with others coming soon.

Yahoo! Video officially started as a user content system in June of 2006. Previously, it had been a directory of other video sites around the net (harkening back to Yahoo's previous life as a directory instead of its short burst as a content creator). From the start, it was called a "YouTube Clone" and other derisive terms.

However, users did decide to go for this new environment. Archive Team found about 9,360,000 accounts in use on Yahoo Video. "In Use" is a relative term, of course - many, many users consist of no uploaded videos, no user picture, and no other activity - just a name. We'll have more, but for example, of 1.5 million accounts we've scanned so far, only 146,600 have uploaded videos, and if you shear off the first 100,000 (i.e., frontloaded with content partner) accounts, that 10% figure drops down to 5%.

It didn't take very long for users to figure out Yahoo! Video is not the way to go, either as participants or as viewers. The most popular video, "Baby Raccoons Saved from Soda Machine" has 14 million views. Compare with one of the top videos on YouTube - Justin Beiber performing "Baby" with Ludacris, which has 457 million views. By the time the raccoons are viewed, the next most popular video, "Worst Best Man Ever", clocks in at just over 10 million views. After the first 20 videos, the views per video are down to about 4 million. By the time we get to the top 100, we're already skirting 1 million. Again, a single video on Youtube, the most popular, has a number of views basically the same as the top 100 Yahoo! videos combined.