Difference between revisions of "URLTeam"
(→Alive) |
(move spne-ws to warrior list) |
||
Line 652: | Line 652: | ||
| ? | | ? | ||
| see snipurl entry; uses custom code | | see snipurl entry; uses custom code | ||
|- style="background-color: pink;" | |||
| {{urlteam_tracker|spne-ws}} | |||
| ? | |||
| {{CURRENTYEAR}}-{{CURRENTMONTH}}-{{CURRENTDAY}} | |||
| 2015-12-20 | |||
| 1,000 | |||
| http://spne.ws/9iN | |||
| ? | |||
| Silicon Prairie News private shortener ; Valid HTTP code is 301. Invalid is 301 as well, but to "http://www.siliconprairienews.com/?awesm=spne.ws_1&utm_medium=spne.ws-root&utm_source=direct-spne.ws&utm_content=root" - Alphabet is A-Z a-z 0-9, most appear to be 3 or less characters. No apparent method to publicly create new URLs. | |||
|- style="background-color: lightgray;" | |- style="background-color: lightgray;" | ||
| {{urlteam_tracker|t7-hu}} | | {{urlteam_tracker|t7-hu}} | ||
Line 921: | Line 930: | ||
* soc.li - Gigya inc. | * soc.li - Gigya inc. | ||
* soli.dm - Solid Media Group - Domain registered 2014-05-26, Google search shows 566 results as of 12-16-2015. Alphabet: A-Z a-z 0-9 (typically 5 characters long). Valid HTTP Code is 301, invalid is 404. Nonsequential shorturls, no public ability to create shorturls. | * soli.dm - Solid Media Group - Domain registered 2014-05-26, Google search shows 566 results as of 12-16-2015. Alphabet: A-Z a-z 0-9 (typically 5 characters long). Valid HTTP Code is 301, invalid is 404. Nonsequential shorturls, no public ability to create shorturls. | ||
* spnsr.tw - sponsoredtweets.com | * spnsr.tw - sponsoredtweets.com | ||
* surl.co.uk - Many shortening options. | * surl.co.uk - Many shortening options. |
Revision as of 06:09, 21 December 2015
Urlteam | |
![]() url shortening was a fucking awful idea | |
URL | http://urlte.am |
Status | Online! |
Archiving status | In progress... |
Archiving type | Unknown |
Project source | Old: urlteam-stuff tinyback tinyarchive |
Project tracker | http://tracker.archiveteam.org:1337/ (HTTPS) |
IRC channel | #urlteam (on hackint) |
TinyURL, bit.ly and other similar services allow long URLs to be converted to smaller ones on their specific service; the small URL is visited by a consumer and their web browser is redirected to the long URL.
Such services are a ticking timebomb. If they go away, get hacked or sell out millions of links will be lost (see Wikipedia: Link Rot). Archive.org/301Works is acting as an escrow for URL shortener databases, but they rely on URL shorteners to actually give them their databases. Even 301Works founding member bit.ly does not actually share their databases and most other big shorteners don't share theirs either.
301Work cooperation
The fine folks at archive.org have provided us with upload permissions to the 301Works archive: http://www.archive.org/details/301utm. They unfortunately do not want to make them downloadable, but the same data is in our torrents too, just in a different format (we use pipe-delimited, xz-compressed files while 301works uses comma-delimited uncompressed files).
Tools
- fetcher.pl: Perl-based scraper by User:Chronomex
- TinyBack: Python 2.x-based, distributed scraper (formerly used)
- Terror of Tiny Town: currently used by ArchiveTeam
Terror of Tiny Town
The easiest way to help with scraping is to run the Warrior and select the URLTeam 2 project. You can also run ToTT outside the warrior; to do so, follow the instructions at https://github.com/ArchiveTeam/terroroftinytown-client-grab.
Researching URL Shorteners
Here's what to do when you've come across a new URL shortener that should be archived. At minimum, please follow the first step. Anything beyond that is more helpful.
- Add it to the Alive section of this page in alphabetical order and the current date (hint: 5 tildes (~~~~~) will do that automatically). Please include whatever information you have, but at the absolute minimum, we need the domain.
- Check the homepage. Is there a public method to create a shorturl? If so, create one and include it in the wiki. If not, note that in the wiki.
- If you were able to create a shorturl, try making a second. Is it sequential? For example, if the first link was foo.bar/dbE4g and the second link is foo.bar/dbE4h (or very close to it), it's probably sequential. If you get foo.bar/dbE4g followed by foo.bar/g4rTh, it's probably random. Note on the wiki whether the shorturls are random or sequential.
- Run
curl -I http://url.short/validshortcode
and see which HTTP status code is returned. Also note whether it returns the destination in the Location: header. Note both on the wiki. - Run
curl -I http://url.short/invalidshortcode
and see which HTTP status code is returned. Note that on the wiki. - Check the homepage, and see if they give a total number of shorturls that their service provides. If so, note that on the wiki.
URL shorteners
Non-warrior projects
Name | Est. number of shorturls | Scraping done by | Status | Comments | # in dump |
---|---|---|---|---|---|
http://goo.gl | ? | User:Scumola | started (2011-03-04) | goo.gl throttles pulls ; (this apparently didn't make it in the last old-style dump) | 0 |
http://ff.im | ? | User:Chronomex | only used by FriendFeed, no interface to shorten new URLs | 1,189,782 | |
http://4url.cc | 1279 (2009-08-14)[1] | User:Chronomex | dead (2011-02-15) | 1,279 | |
http://litturl.com | 17096 (2010-04-15)[2] | User:Chronomex | dead (2010-11-18) | 17,096 | |
http://xs.md | 3084 (2009-08-15)[3] | User:Chronomex | done | dead (2010-11-18) | 3,084 |
http://url.0daymeme.com | 14867 (2009-08-14)[4] | User:Chronomex | done | dead (2010-11-18) | 14,867 |
http://tr.im (old) | 1990425 | ? | got what we could | dead (2011-12-31) | 1,990,425 |
visibli (hex) | 16777216 | User:Chfoo Warrior | In progress Done. 15104865 301MB |
Using links.sharedby.co/links/ as URL prefix. |
? |
http://post.ly (Posterous) | ? | Warrior/EC2 | done | dead (divided up in 11 files in the last old-style dump) | 153,281,595 |
http://zapd.co Zapd | 326592 | User:Chfoo | Done. 144093 1.7M | xxxx.zapd.co. Uploaded to IA | 0 |
http://bre.ad Bre.ad | 120932351 | User:Chfoo | Incomplete (59771889 examined). 54506 1.2MB | de.ad (2013-11-18). Uploaded to IA
Got what I can without overloading their EC2 instance. |
0 |
http://arseh.at | ? | ? | ? | also worked on as a Warrior job, see below. | 23,655 |
http://bit.ly | ? | ? | ? | divided up into 3,835 files in the last old-style dump, totaling 39 GB (compressed!); also worked on as a Warrior job, see below. | 1,507,816,439 |
http://is.gd | ? | ? | ? | divided up into 125 files (totally 8.5 GB) in the last old-style dump; also worked on as a Warrior job, see below. | 302,434,257 |
http://kl.am | ? | ? | ? | Dead (as of 03:00, 3 December 2015 (EST)) | 1,870,335 |
http://links.sharedby.co | ? | ? | ? | in a file called links.sharedby.co-links.txt.xz in the last old-style dump | 9,298,101 |
http://ow.ly | ? | ? | ? | divided up into 23 files (totaling 4.5 GB) in the last old-style dump; also worked on as a Warrior job, see below. | 328,901,265 |
http://surl.ws | ? | ? | ? | Yes, there really are only 48 listed. | 48 |
http://tny.im | ? | ? | ? | 1,614 | |
http://snipurl.com | ? | ? | ? | divided up into 8 files in the last old-style dump (for a total of 6.8 GB compressed, though); also worked on as a Warrior job, see below. | 368,750,225 |
http://tinyurl.com | ? | ? | ? | divided up into 60 files (totaling 9.4 GB) in the last old-style dump; also worked on as a Warrior job, see below. | 470,413,092 |
http://tr.im (new) | ? | ? | ? | in the last old-style dump as a file called tr.im-relaunched.txt.xz | 1,266,068 |
http://ur1.ca | ? | ? | ? | (Note this is named "ur" followed by the digit one, not L.) | 8,432,282 |
http://vbly.us | ? | ? | ? | also worked on as a Warrior job, see below. | 114,924 |
http://xym.kr | ? | ? | ? | 144 | |
twitter-unrolled-urls-spritzer-stream | ? | ? | ? | in a 4.6GB file named: twitter-unrolled-urls-spritzer-stream-20111015-20130318.txt.xz ; there's a note about it in the README file | 257,993,902 |
Name | Number of shorturls | Scraping done by | Status | Comments | # in dump |
# in dump refers to the number of short URLs included in the last old-style dump, URLTeamTorrentRelease2013July.
For the latest TinyTown updates, please see chfoo's spreadsheet.
Warrior projects
Pink background refers to currently running projects; gray background to ones that aren't currently making new short URLs.
Warrior project name | Est. # shorturls | Last scraped date | Initially scraped date | # checked | Example URL | Incr | Comments |
---|---|---|---|---|---|---|---|
0rz-tw +/- | ? | 2024-04-24 | 2015-12-20 | 0 | http://0rz.tw/6eX6j | ? | Has a list of existing URLs on front page; all 5 characters long |
1r-hu +/- | ? | 2014-12-02 | 2014-12-02 | 1,346,050 | ? | ? | Done |
2-gp +/- | ? | 2015-12-20 | 2015-12-14 | 17,780,989 | http://2.gp/GDYZ (created 21:34, 21 November 2015 (EST)) | Y | 4-character alphanumeric (excluding "similar looking letters"); seems to check that URL resolves; returns 302 for existing AND non-existing shortcodes (just returns "Location: /" for non-existing ones); checked all 4 character ones, and some 5 characters in 2015-12-14 through 2015-12-20 scrape |
2jump-info +/- | ? | 2014-12-02 | 2014-12-02 | 298,949 | ? | ? | Banned |
2-ly +/- | ? | 2015-12-20 | 2015-12-14 | 21,739,150 | http://2.ly/xr | Y | looks very similar to 2.gp (but not an alias); returns 302 for existing AND non-existing shortcodes (just returns "Location: /" for non-existing ones); checked all 4 character ones, and some 5 characters in 2015-12-14 through 2015-12-20 scrape |
adjix +/- | ? | 2015-1-24 | 2014-12-13 | 8,615,100 | ? | ? | Appears down; uses custom code |
alturl-com +/- | ? | 2015-05-27 | 2015-03-06 | 39,367,900 | http://alturl.com/wqok | ? | Appears to redirect to http://shorturl.com ; Probably sequential/loweralpha; uses custom code |
ar-gy +/- | ? | 2014-12-18 | 2014-12-17 | 3,303,100 | ? | ? | Appears down; Argyle Social, main page 404s, existing urls still work |
arseh-at +/- | ? | 2015-01-15 | 2015-01-11 | 1,842,350 | ? | Y | Appears down; new shorturls: sequential |
awe-sm +/- | ? | 2015-04-04 | 2014-12-24 | 967,591,000 | ? | ? | main page redirects, doesn't allow for new urls to be publicly shortened, existing urls still work; uses custom code |
bitly_6 +/- | 50,000,000,000 | 2024-04-24 | 2014-11-22 | 4,297,969,800 | https://bit.ly/1Zmfo8z | N | done: non-sequential 6 characters; current: non-sequential, 6 characters; uses custom code |
bull-hn +/- | 50,000 | 2015-11-15 | 2015-11-15 | 20,555 | http://bull.hn/l/19JQE/ | ? | Vanity URL shortner for a recruiting company, "Bullhorn Reach" |
burl-se +/- | 1,500 | 2015-11-08 | 2014-11-06 | 3,250 | http://burl.se/428 | Y | 200 re-checked on 2015-11-08 |
ccl-hu +/- | ? | 2015-12-15 | 2015-12-15 | 97,261 | ? | ? | seems to always return 301, even for non-existing links; random sample didn't find any real ones (checked as of 02:03, 7 December 2015 (EST)); nothing found in 100,000 checks -- I think it's dead. |
chilp-it +/- | ? | 2015-12-15 | 2015-12-15 | 20,000 | http://chilp.it/1d9c9d1 | N | seems to allow public creation of shorturls; as of 21:52, 21 November 2015 (EST) ; returns 301 for existing AND non-existing shortcodes (just returns "Location: http://chilp.it/404.php" for non-existing ones); non-incremental; appears to just use lowercase letters and digits; attempted scraping FAILED -- need to look into why |
da-gd +/- | 165,000 | 2024-04-24 | 2015-12-14 | 1,297,450 | http://da.gd/dZdp8 | N | source code: https://github.com/relrod/dagd - Of note, this shortener will pass along anything after the slash: da.gd/g -> google.com; da.gd/g/mail -> google.com/mail |
df4-us +/- | 25,133 | 2015-12-18 | 2015-12-18 | 47,850 | http://df4.us/mn4 | ? | daringfireball.net private shortener : Alive 12-17-2015, no public method to create new URLs. Alphabet appears to be a-z 0-9, most results are 3 characters or less (df4.us/mn4, df4.us/8, df4.us/ib) Valid URLs 301, location is included in header. Invalid URLs 302 to http://daringfireball.net ; on 2015-12-18 -- did a scan of everything up through 3 characters; last found one was seq # 31903 (om7) ; run a rescan next year |
db-tt +/- | ? | 2015-12-12 | 2015-12-05 | 43,421,600 | https://db.tt/FnHZSr77 https://db.tt/b5gwXppx |
N | Official shortner for Dropbox ; most 8 characters; seen a few that are 7 characters) Only found 21 redirects in over 40 million searches; the space has over 200 *trillion* possibilities. |
dld-bz +/- | 2015-12-15 | 2015-12-05 | 48,897,650 | http://dld.bz/dGjTy | ? | "private URL shortening service"; found 8,639,481 in first scrape; we've pretty much covered everything through 4 characters, plus part of 5 | |
dwurl-hu +/- | 2015-11-16 | 2015-11-16 | 3,473,050 | http://dwurl.hu/gMEtiA ( created 01:36, 2 November 2015 (EST)) | N | Allows public shortening; appears to give 6 character, mixed case alphabetic (no digits), non-incremental URLs | |
feedly_8 +/- | ? | 2015-01-03 | 2015-01-03 | 129,762,450 | ? | ? | Banned; uses custom code |
fwdurl-net +/- | ? | 2024-04-24 | 2015-11-16 | 9,817,561 | http://fwdurl.net/uDRZ4TGAj6V (created Nov 16, 2015) http://fwdurl.net/aYwa (created Dec 17, 2013) http://fwdurl.net/bjkDtwYAoWSF (created Dec 4, 2015) |
? | responds very slowly; stats (including creation date, & hit count) available by suffixing "!" |
isgd_6 +/- | 934,134,706 (as of 2013-05-20) | 2024-04-24 | 2014-11-22 | 2,286,564,700 | http://is.gd/mBNPCM | ? | done: sequential up to ZZZZZ ; new shorturls: non-sequential, 6 characters; uses custom code |
jdem-cz +/- | 1,424,052 | 2015-12-15 | 2015-12-15 | 1,000 | http://jdem.cz/bw388 | Y(?) | random (?) last digit; attempted scraping FAILED -- need to look into why |
kcy-me +/- | ? | 2015-11-22 | 2014-11-06 | 5,239,050 | http://kcy.me/28trr | ? | Shortening service for http://karmacracy.com ; requires free account to create short URLs ; ran initially for one day, re-checked a year later |
korta-nu +/- | ? | 2015-11-22 | 2015-04-11 | 12,767,850 | http://korta.nu/9ob | ? | Initial run ended on 2015-05-27; doing a 2nd pass through the 3-character values starting 2015-11-22 |
lnk-sk +/- | 24,000 | 2024-04-24 | 2015-12-18 | 2,200 | http://lnk.sk/6aw | Y | site is alive as of 01:31, 9 December 2015 (EST); returns 302 for both existing and non-existing URLs |
lurl-no +/- | 2,518 | 2015-12-18 | 2015-12-18 | 3,700 | http://lurl.no/aZ | Y | site is up, says "Note: as a result of huge amounts of spam, new lurls are currently disabled." as of 01:31, 9 December 2015 (EST); grabbed all of them on 2015-12-18. |
migre-me +/- | 269,383,546 | 2024-04-24 | 2015-11-08 | 68,498,715 | http://migre.me/sd9AB | Y | up to 5 characters, mixed case alphanumeric, currently around sot00 (as of 03:01, 14 December 2015 (EST)); Interestingly, the 3,822,506 codes from 4JXAG to 50000 are all empty. 4JXAG was created at "07/06/2011 17:06:46" while 50000 was created at "07/06/2011 03:00:00". 50je0 was created at 07/06/2011 17:05:05[IA•Wcite•.today•MemWeb]. So it looks like it was handing out both ranges for a few hours, then cut over to just 5's, leaving three million empty. Fascinating. |
mysp-ac +/- | ? | 2015-04-04 | 2015-02-09 | 16,245,049 | ? | ? | uses custom code |
nig-gr +/- | ? | 2015-12-06 | 2014-11-06 | 15,145,600 | ? | ? | Home page is a blank black screen. (as of 01:38, 9 November 2015 (EST)); re-scan of 2-character range (nothing new found); and 4 character range on 2015-12-06 (started on the 4th, ran till the 7th) |
ow-ly +/- | ? | 2015-03-10 | 2015-01-20 | 367,074,900 | http://ow.ly/UVFi7 | Y | owned by Hootsuite; new shorturls: sequential ; (aliases: http://htl.li , http://ht.ly , http://owl.li ); uses custom code |
ph-ly +/- | ? | 2015-04-04 | 2014-12-13 | 989,290,500 | ? | ? | Related to the pond called Philadelphia, where links are born and raised, doesn't allow for new urls to be publicly shortened, existing urls still work |
piciurl-hu +/- | ? | 2015-12-01 | 2015-04-11 | 255,950 | http://piciurl.hu/7wr | Y | Initial scrape done on 2015-04-11; new scrape done on 2015-12-01 (up to seq# 11043) |
p-ly +/- | 62,000 | 2015-12-09 | 2015-12-09 | 17,015,150 | http://p.ly/abcd | ? | (aka re.p.ly) ; it has a shut down message (added sometime between May 1, 2012 and June 14, 2012) but promises to keep existing URLs working as of 01:03, 10 December 2015 (EST) (had 61,306 short URLs as of May 1, 2012); this WB entry shows some short URLs (5 characters, alphanumeric) |
pub-vitrue-com +/- | ? | 2014-11-22 | 2014-11-16 | 15,067,550 | ? | ? | Now part of Oracle; uses custom code |
qr-cx +/- | 2,377,573 | 2015-12-08 | 2015-12-08 | 5,200 | http://qr.cx/Us5p | ? | not allowing new shorturls as of 02:09, 9 December 2015 (EST) |
rod-gs +/- | ? | 2015-12-05 | 2015-12-05 | 6,250 | http://rod.gs/1Fl | Y | up to 3 characters, alphanumeric, creating new ones appears to hang (as of 02:14, 2 November 2015 (EST)) (returns 301 for existing; 404 for non-existing); searched up to 1aqa on 2015-12-05 |
sharedby-co_6 +/- | ? | 2024-04-24 | 2015-01-29 | 46,587,150 | ? | ? | (Also see http://vsb.li. Double redirects via USERNAME.sharedby.co/share/XXXXXX ) (and http://shrd.by ); uses custom code |
shar-es +/- | ? | 2015-04-08 | 2014-12-13 | 1,031,784,400 | ? | ? | Still resolves URLs, but the homepage is 404; related to http://sharethis.com ; uses custom code |
shrt-st +/- | ? | 2014-11-06 | 2014-11-06 | 738,600 | http://shrt.st/vpz | Y | Appears down; doesn't allow new urls to be shortened, existing urls still work. |
srtn-us +/- | ? | 2015-12-01 | 2014-11-06 | 55,800 | http://srtn.us/10zd | Y | still resolves URLs, but site just shows blank page; first scrape on 2014-11-06; re-checked from seq# 47929 through 48441 on 2015-12-01 |
snipurl +/- | ? | 2015-03-06 | 2015-01-24 | 181,015,750 | ? | Y | new shorturls: sequential ; snipr.com / snipurl.com / snurl.com / sn.im - Appears incremental - Ex: http://snipr.com/27nvst http://snipr.com/27nvtt. snipr.com and snipurl.com work but appear infected with malware. ; uses custom code |
snipurl_range2 +/- | ? | 2015-04-20 | 2015-03-06 | 293,372,600 | ? | ? | see snipurl entry; uses custom code |
spne-ws +/- | ? | 2024-04-24 | 2015-12-20 | 1,000 | http://spne.ws/9iN | ? | Silicon Prairie News private shortener ; Valid HTTP code is 301. Invalid is 301 as well, but to "http://www.siliconprairienews.com/?awesm=spne.ws_1&utm_medium=spne.ws-root&utm_source=direct-spne.ws&utm_content=root" - Alphabet is A-Z a-z 0-9, most appear to be 3 or less characters. No apparent method to publicly create new URLs. |
t7-hu +/- | ? | 2014-12-13 | 2014-12-13 | 585,800 | ? | ? | Doesn't make any more shorturls |
tighturl-com +/- | ? | 2014-11-22 | 2014-11-16 | 3,123,300 | http://tighturl.com/30xu http://tighturl.com/30xv |
Y | (alias: 2tu.us); appears to do case folding; uses custom code |
tinyurl_7 +/- | 10,000,000,000 | 2024-04-24 | 2014-11-22 | 2,799,333,900 | http://tinyurl.com/mxzufis | N | done: sequential to zzzzzz; current: non-sequential, 7 characters; uses custom code |
tinyurl-hu_4 +/- | ? | 2015-11-01 | 2015-08-13 | 20,308,700 | http://tinyurl.hu/4q22 | ? | uses custom code |
trap-it +/- | ? | 2015-02-20 | 2015-01-01 | 3,130,300 | ? | ? | first scrape (only covering 5-character codes) from 2015-01-01 through 2015-02-20; next scrape (starting at 0c4uk) began on 2015-12-04 -- unable to load anything (although manual checks of previously found ones seemed to work) |
tr-im_gravity4 +/- | ? | 2014-12-12 | 2014-12-01 | 42,813,150 | ? | ? | done: sequential to 42pzz ; dead (2014-JUL-17) ; Appears incremental - Ex: http://tr.im/44tn2 http://tr.im/44tn4 |
ur1-ca +/- | ? | 2014-12-20 | 2014-12-17 | 10,874,150 | ? | ? | new shorturls: sequential ; FOSS, run by StatusNet; claims to offer a download of their database, but it just contains garbage |
u-to +/- | ? | 2024-04-24 | 2015-05-02 | 54,190,499 | ? | ? | Doesn't allow new shortened URLs, as of 01:57, 19 November 2015 (EST) |
u4-hu +/- | ? | 2014-11-16 | 2014-11-16 | 178,250 | ? | ? | Appears down |
vbly-us +/- | ? | 2015-11-09 | 2015-01-11 | 628,650 | http://vbly.us/2mwv | Y | new shorturls: sequential; 2015-11-09 scape from 2jp6 up to 2mwv (seq # 123000) |
vgd_6 +/- | ? | 2024-04-24 | 2015-02-14 | 1,919,914,800 | ? | ? | uses custom code |
viddy-it +/- | ? | 2014-12-18 | 2014-11-16 | 832,351,700 | ? | ? | dead; viddy; partially saved |
waa-ai +/- | ? | 2014-11-16 | 2014-11-16 | 2,151,400 | ? | ? | Requires free login to create shorturls |
xco +/- | ? | 2014-11-22 | 2014-11-06 | 80,319,800 | http://x.co/1IxUV http://x.co/1IxUW |
Y | Appears incremental, but custom ones also exist (up to 10 characters); requires (free) GoDaddy account to create short URLs; uses custom code |
xrl-us +/- | ? | 2015-01-10 | 2014-12-12 | 161,601,700 | ? | ? | self-saved; Thank you Metamark for the database dump! |
xrl-us_lowercase +/- | ? | 2015-01-14 | 2015-01-10 | 28,675,900 | ? | ? | see xrl-us entry |
y-ahoo-it_5 +/- y-ahoo-it_6 +/- y-ahoo-it_8 +/- | ? | 2015-04-04 | 2014-11-06 | ? | ? | ? | Partial y-ahoo-it_5: 982,090,300 checked between 2014-11-06 and 2015-02-25 y-ahoo-it_6: 1,670,279,150 checked between 2014-11-06 and 2015-04-03 y-ahoo-it_8: 1,952,022,300 checked between 2014-11-06 and 2015-04-04 . Now dead. |
yatuc +/- | ? | 2014-12-13 | 2014-12-13 | 597,150 | ? | ? | Not accepting new urls; uses custom code |
yoolink-to +/- | ? | 2015-11-08 | 2014-11-16 | 333,450 | http://yoolink.to/1dwa | Y | Up to 3 characters scraped on 2014-11-16 (a small 2 character segment re-scraped on 2014-11-22); 4 characters (up to 1dwa) scraped starting 2015-11-08 |
Warrior project name | Est. # shorturls | Last scraped date | Initially scraped date | # checked | Example URL | Incr | Comments |
Alive
(please keep list alphabetized, and list verification dates inline)
Sources include: http://blog.go2.me/2009/01/exhausting-review-of-link-shorteners.html[IA•Wcite•.today•MemWeb] (last updated 2009-08-14), http://code.google.com/p/shortenurl/wiki/URLShorteningServices[IA•Wcite•.today•MemWeb] (Updated May 19, 2011; not fully integrated yet), https://www.hashtags.org/platforms/twitter/list-of-url-shorteners/[IA•Wcite•.today•MemWeb]
- adf.ly - incremental, but displays interstitial ads, so requires custom code; Ex: http://adf.ly/bnpYL ; http://adf.ly/1RP4DP (current as of 01:38, 10 November 2015 (EST))
- adfoc.us - displays interstitial ads; appears to block curl; so requires custom code
- bc.vc - displays interstitial ads ; Example: http://bc.vc/8nCbMs
- budurl.com - Appears non-incremental, apparently all custom names; only paying clients allowed to create URLs (checked as of 02:03, 7 December 2015 (EST))
- buff.ly - Buffer App ; ex: http://buff.ly/1fPIjQf (301 - existing; 404 - non-existing), non-incremental (checked as of 02:03, 7 December 2015 (EST))
- buzurl.com - Example: http://buzurl.com/li04 ; link broken, home page is blank as of 23:40, 19 December 2015 (EST)
- cl.ly - CloudApp ; requires application to create short URLs
- cmt.com - Country Music Television
- cur.lv (CoinURL.com) ; Subdomains include: bit, go, in, jump, link, me, my, n, name, now, to.
- decenturl.com - Not at all easy to scrape.
- del.ly - sprinklr
- dlvr.it - Requires free login; then requires connecting to another service; URLs are shortened when sent through. ( as of 01:36, 2 November 2015 (EST))
- doiop.com - Appears non-incremental
- durl.me -- appears to allow public creation of shorturls; as of 22:00, 21 November 2015 (EST)
- easyurl.net - Appears non-incremental. Ex: http://easyurl.net/afd2f
- fav.me - Used by DeviantArt. Ex: http://fav.me/d31sfml
- flip.it - Flipboard
- flpbd.it - Flipboard
- fnd.us (See offical shorteners)
- fos.hu – incremental alphanumeric, but shares pattern with an image sharing service
- gkurl.us -- appears to allow public creation of shorturls; as of 22:00, 21 November 2015 (EST)
- none that start with h yet.
- ity.im -- shows adverts, not clear if it still works as of 23:40, 19 December 2015 (EST)
- none that start with j yet.
- kics.it – Restricted access to shourturl creation
- lien2.com - http://lien2.com/go/a6cx ; seems-non-incremental, only 583 shortened urls (as of 02:27, 29 November 2015 (EST) )
- linkbucks.com
- lin.io - uses frame/toolbar (site is alive as of 01:09, 7 December 2015 (EST))
- ln.is - linkis.com (also provides a way to comment on the linked page) ; ex: http://ln.is/vine.co/v/UA0PH -- the destination server appears to be included in the shortcode, which should make it harder to scrape (as of 02:56, 12 December 2015 (EST))
- lnq.me - http://lnq.me/DnXtHO ; 6-character, alphanumeric, seems-non-incremental ; http://lnq.me/preview/en/ -- which seems to some kind of bizarre guessing if you put in less than 6 characters (as of 20:33, 21 November 2015 (EST) )
- lt.tl - site is up, says "Service will be back soon..." as of 01:31, 9 December 2015 (EST)
- ly.my - alive as of 01:09, 7 December 2015 (EST)
- m112.hu
- me2.hu
- mgnet.me - for torrent magnet URIs.
- miniurl.hu
- MinURL.fr - site alive as of 01:53, 9 December 2015 (EST)
- moourl.com – Random (alive as of 01:09, 7 December 2015 (EST))
- my.dot.tk/tweak - Appears non-incremental
- nblo.gs -- no obvious way to create URLs from the home page as of 20:08, 7 November 2015 (EST)
- nbx.ch -- private shortener; appears up as of 01:53, 9 December 2015 (EST)
- news.me -- no obvious way to create URLs from the home page as of 20:08, 7 November 2015 (EST)
- nohref.hu – Allows custom shorturl & deletes links after a specified time period (or 1 year without use)
- notlong.com - Appears to be alpha-only - Ex: http://yeitoo.notlong.com/ ; doesn't seem to be allow creating new shorturls, as of 20:08, 7 November 2015 (EST)
- nutshellurl.com - Appears incremental. 301s to a redirector script, which then 301s you to the destination.
- none that start with o yet.
- p.pw -- sells interstitial ads before showing the full URL; likely to be harder to scrape (as of 20:08, 7 November 2015 (EST))
- pear.ly - Used by pearltrees.com. Ex: http://pear.ly/6J1H (returns 301 for existing AND non-existing shorturls as of 15:30, 5 December 2015 (EST))
- pnut.co - see nutshellurl.com Ex: http://pnut.co/3a (returns 200 on a HEAD request; will need to use GET requests)
- po.st -- "social sharing platform"; no obvious way to create URLs from the home page (as of 20:08, 7 November 2015 (EST))
- prsm.tc - getprismatic.com ; ex: http://prsm.tc/GB2HP2 -> http://getprismatic.com/story/1428656915049?share=MzY4MjEx.MTQyODY1NjkxNTA0OQ.gH9aD6dy4y7zDFgIYQcLrW9KaeE -> (via some convoluted mess) http://scvincent.com/2015/04/10/when-reviews-really-matter/ ; non-redirects still get redirected to http://getprismatic.com/404
- qik.li - site appears to allow public shortening as of 02:24, 12 December 2015 (EST)
- qurl.com - site appears to allow public shortening as of 01:03, 10 December 2015 (EST) (also runs a image sharing service)
- r.ebay.com
- sdai.ly – Allows custom shorturl
- shorl.com -
Doesn't appear guessable- Ex: http://shorl.com/tisikestibahu - Alive as of 12-17-2015. Alphabet is "Koremutake", an alphabet of 128 phonetically unique phonemes, which is documented here: https://gist.github.com/anonymous/599ba4c17599cd213005. Will need custom code to accommodate a custom alphabet, but it is absolutely guessable. - shorte.st - sells interstitial ads before showing the full URL; likely to be harder to scrape
- shrinkurl.us - Still resolves, but does not allow creating new URLs ("The URL you entered was not valid or did not exist.")
- smarturl.eu / joturl.com - Doesn't appear guessable, HTML redirect.
- smarturl.it - smartURL
- soa.li - Gigya inc.
- soc.li - Gigya inc.
- soli.dm - Solid Media Group - Domain registered 2014-05-26, Google search shows 566 results as of 12-16-2015. Alphabet: A-Z a-z 0-9 (typically 5 characters long). Valid HTTP Code is 301, invalid is 404. Nonsequential shorturls, no public ability to create shorturls.
- spnsr.tw - sponsoredtweets.com
- surl.co.uk - Many shortening options.
- techme.me - Techmeme
- tinyarrows.com / ta.gd / ri.ms / ➡.ws / ➨.ws / ➯.ws / ➔.ws / ➞.ws / ➽.ws / ➹.ws / ✩.ws / ✿.ws / ❥.ws / ›.ws / ⌘.ws / ‽.ws / ☁.ws - Appears non-incremental: uses user-defined words for URLs (e.g. http://➡.ws/URLTEAM)
- tiny.cc - Appears non-incremental (alive as of 18:21, 12 December 2015 (EST))
- totesz.hu/x – Allows custom shorturl
- trib.al -- Does not appear to allow public creation of new short-URLs; owned by SocialFlow
- twitthis.com -- requires a Twitter account to create shortURLs (as of 20:08, 7 November 2015 (EST))
- trunc.it -- closed, but still resolving existing URLs as of 17:43, 12 December 2015 (EST); http://trunc.it/pssga ; returns 301 for existing and non-existing shortcodes
- urlcut.com - "We are not currently accepting new redirects at this time." ; existing ones seem to still work, e.g. http://urlcut.com/1xvha (as of 02:09, 2 November 2015 (EST)) ; it returns 302 for both existing *AND* non-existing URLs, preventing its scraping with the default code (as of 00:49, 5 December 2015 (EST))
- usite.hu/link.php – Numeric incremental, public database
- u.to ; requires GET (not HEAD) requests; returns 302 with target in Location header, 404 for invalid ; Example: http://u.to/HzA-Aw ; as of 23:40, 19 December 2015 (EST)
- vk.cc -- no obvious way to create URLs from the home page (as of 20:08, 7 November 2015 (EST))
- none that start with w or x yet.
- y2u.be - meant for YouTube videos, simply redirects anything to the corresponding YouTube ID, i.e. http://www.y2u.be/7458qm becomes http://www.youtube.com/watch?v=7458qm (as such, not relevant to URLTeam)
- yep.it -- allows custom shortcodes; validates provided URL; example: http://yep.it/bgnhpu ; seems non-incremental, only lowercase letters; appears to make the whole database available via: http://yep.it/stat.php?page=5719 (as of 20:08, 7 November 2015 (EST))
- none that start with z yet.
"Official" shorteners
- ask.fm - Ex: http://ask.fm/a/40k05kgp -> http://ask.fm/Q7Niki/answer/42128504404 ; seems non-incremental
- bln.gs - Blingee (format: bln.gs/b/28fss0 and bln.gs/b/1)
- CokeURL.com - Coca-Cola (examples: CokeURL.com/3yuz9 ; CokeURL.com/vs5s ; Cokeurl.com/theaterseat )
- di.sn - Disney
- fb.me - Facebook
- flic.kr - Flickr
- fnd.us - Fundrazr.com
- fxn.ws - Fox News
- g.co - Google (used for Google products and services)
- getpocket.com/s/ - Pocket
- goo.gl - Google
- go.usa.gov - USA Government (and since they control the Internets, it doesn't get much more official than this)
- git.io - GitHub only URLs
- gty.im - Getty Images (format: gty.im/488068439; links by editorial number)
- gu.com - The Guardian (weird format - https://gu.com/p/3f7ca )
- hub.me - HubPages
- ift.tt - IFTTT
- igg.me - Indiegogo http://igg.me/at/defendbitcoinmagazine ; http://igg.me/at/1NaE6yoZIaY most seem to use chosen names
- lnkd.in - LinkedIn
- mfi.re - MediaFire
- msft.it - Microsoft (or maybe something called "Sprinklr"?)
- mysp.ac - Myspace
- nydn.us - New York Daily News
- off365.ms - Office 365
- pocket.co - Pocket
- post.ly - Posterous
- qr.ae - Quora
- redd.it - Reddit
- reut.rs - Reuters
- rsg.ms - Rockstar Games
- skfb.ly - Sketchfab
- spoti.fi - Spotify
- stanford.io - Stanford University
- su.pr - StumbleUpon
- sx3.se - swedishstartupspace.se
- t.co - Twitter
- ti.me - Time Magazine
- tmblr.co - Tumblr (redirects to www.tumblr.com which does the actual redirection); Z4fZpx1gfu_mU ;
ZIKCSm1uGRMbv ; ZAvEqsfi4_rO ; Zqar4t1x8GPpN ; ZJ8Wby1L9QRac The shortcodes are TOO LONG for terroroftinytown to handle...
- tw.appstore.com - Apple App Store
- uoft.me - University of Toronto
- upl.nu - Ung Pirat (Youth Pirate Party, Sweden)
- vstphl.ly - Visit Philly
- wapo.st - Washington Post
- wh.gov - White House (format: wh.gov/i3lXR) (as of 20:53, 5 December 2015 (EST), has no database, just expands wh.gov into www.whitehouse.gov)
- wp.me - Wordpress.com
- youtu.be - YouTube
- hrts.me - University of Hertfordshire. Seems to be 5 characters long. a-z with usage of capitals and non capitals. Includes numbers. Mainly used on https://twitter.com/UniofHerts
bit.ly aliases
A bit.ly alias works just like a bit.ly URL. The shortcode is the same, it sets the same bit.ly cookie, and DNS resolving the address shows the IP addresses are the same as bit.ly. The homepage may be different however.
- abcn.ws - ABC News (examples: abcn.ws/1aOoijH ; abcn.ws/okiWbi )
- 1.usa.gov - USA Government
- 4sq.com - Foursquare
- 757live.ga
- ada.ms
- aje.me - Aljazeera
- amzn.to - Amazon
- arfo.sk
- atfp.co - Foreign Policy
- bbc.in - BBC
- bbnew.be
- bbybgrl.com
- binged.it - Bing (bonus points for being longer than bing.com)
- bnkrpt.am - Bankrupting America
- bzfd.it - Buzzfeed
- calltrack.es
- canva.link
- carrot.cr - Carrot Creative
- cb.com - Career Builder
- chzb.gr - Cheezeburger
- cmplx.it - Complex Magazine
- cnet.co - CNET
- cnnmon.ie - CNN Money
- conta.cc - Constant Contact Inc.
- corb.is - Corbis Images
- cot.ag
- cpurl.net - Current Photographer.com
- curbed.cc - Curbed.com
- dag.gy
- dennysd.in - Denny's Restaurants
- dtoid.it - Destructoid
- dwqn.me
- econ.st - The Economist
- emarketee.rs - Emarketeers
- engri.sh - Engrish.com
- eonli.ne - E! Online
- es.pn - ESPN
- fakes.pn - The Fake ESPN (at lockerdome.com)
- fanpa.ge - Fanpage.it
- feedly.com/k/ - redirect, see below for their own
- fencetimesweep.com
- flts.tk
- fltsim.me
- gaw.kr - Gawker
- geekiss.im - Geekismo
- grd.to - The Grid TO
- grn.bz - GreenBiz
- gtg.lu - GetGlue
- hoblu.es - House of Blues
- hub.am - HubSpot
- huff.to - Huffington Post
- ift.tt - IFTTT
- j.mp - bit.ly[5]
- joga.bo
- jrnl.to - thejournal.ie
- kck.st - Kickstarter
- kore.us
- m.ly
- marsdd.it - MaRS Discovery District
- mbist.ro - MediaBistro
- mojo.ly - Mother Jones
- muo.fm - MakeUseOf
- mwne.ws - MarketWired News
- ncl.uz
- nie.mn - Neiman Journalism Lab
- nilegui.de
- njlle.me
- nokia.ly - Nokia
- nyti.ms - New York Times
- onforb.es - Forbes
- onion.com - The Onion
- pops.ci - Popular Science
- popu.pe - Pop-Up Pantry
- proof.ly
- propub.ca - ProPublica
- psxs.us
- read.bi - Business Insider
- rnk.me - as of 02:24, 12 December 2015 (EST)
- rseo.co - realseo
- s831.us - Studio831 - whatever that is
- saggia.me
- sbn.to - sbnation
- sens.sc
- shr.li
- skygrid.me - SkyGrid
- slackers.co - slackers.com
- smle.us
- squid.us - Laughing Squid
- s.shr.lc - shareaholic - Naive, redirects any shortcode to bit.ly
- stay.am
- stjo.es - St. Joseph Media
- tag.my
- tcrn.ch - Techcrunch
- theatln.tc - The Atlantic
- tnw.co - The Next Web
- tom.hn - Tom Hillenbrand
- toms.sh - TOMS Shoes
- tvt.ag - tvtag.com
- txpr.de - TexasStore
- unr.ly - Unruly media
- usat.ly - USA Today Newspaper
- vrge.co - The Verge
- wkdb.it
- yhoo.it - Yahoo! (not to be confused with y.ahoo.it, their non-bitly public url shortener)
- zite.to - Zite
Dead or Broken
(please keep list alphabetized)
- 1link.in - Website dead
- 1url.com - Server not responding as of 16:36, 12 December 2015 (EST)
- 2big.at - Server not responding as of 16:36, 12 December 2015 (EST)
- 301.to - Server not responding as of 16:36, 12 December 2015 (EST)
- 307.to - DNS not responding as of 16:15, 12 December 2015 (EST)
- 6url.com - HTML redirect, Error 500
- abcurl.net - DNS not responding as of 16:15, 12 December 2015 (EST)
- abra.me - server down as of 21:52, 21 November 2015 (EST)
- adcrun.ch - parking page as of 18:06, 12 December 2015 (EST)
- ad.vu - mirror of adjix.com, application not found; DNS not responding as of 16:15, 12 December 2015 (EST)
- arm.in - domain for sale as of 21:44, 21 November 2015 (EST)
- arst.ch - Server not responding as of 16:36, 12 December 2015 (EST)
- aurls.info - DNS not responding as of 01:26, 7 December 2015 (EST)
- bacn.me
- be.vc
- biglnk.com - dead, replaced with unrelated blog
- Buk.me - DNS not responding as of 01:26, 7 December 2015 (EST)
- bwtm.co - DNS fails to resolve.
- calyp.co - Server error. 403 - Forbidden: Access is denied.
- canurl.com - Website dead
- catchylink.com - Advertising a mutual fund as of 01:31, 13 December 2015 (EST)
- catchyurl.co
- cf.ly (CashFly.com) -- redirects to happydaydeals4you.com as of 02:04, 7 December 2015 (EST)
- chod.sk - Appears non-incremental, not resolving
- cli.gs - Server not responding as of 16:36, 12 December 2015 (EST); Appears non-incremental
- clk.my - DNS not responding as of 01:26, 7 December 2015 (EST)
- cl.lk - DNS not responding as of 16:15, 12 December 2015 (EST)
- clop.in -- domain parked as of 21:52, 21 November 2015 (EST)
- Crum.pl - DNS not responding as of 01:26, 7 December 2015 (EST)
- come.to - (wayback of homepage) Related to various .to shorteners. Started in 1997, killed in 2013 after parent company died.
- coge.la -- just a logo as of 22:00, 21 November 2015 (EST)
- da.co - Parked.
- dft.ba - Server gone as of 01:11, 17 November 2015 (EST) ; site had shutdown message (claiming links would continue to work), from July 2015 through Sept 2015.
- digg.com - discontinued - [1]
- dopen.us - DNS not responding as of 16:15, 12 December 2015 (EST)
- dwarfurl.com - Website dead/Numeric, appears incremental: http://dwarfurl.com/08041
- easy.tc - DNS not resolving.
- easyuri.com - Website dead/Appears hex incremental with last digit random/checksum: http://easyuri.com/1339f , http://easyuri.com/133a3
- eqent.me - Improper redirect to bitly.
- feedzil.la - Domain parked.
- fon.gs - server down as of 22:00, 21 November 2015 (EST); DNS not responding as of 16:15, 12 December 2015 (EST)
- freak.to - DNS not responding as of 16:15, 12 December 2015 (EST)
- fuzzy.to - DNS not responding as of 16:15, 12 December 2015 (EST)
- fwd4.me - redirects to a site about traffic cameras as of 22:00, 21 November 2015 (EST)
- go2cut.com - Website dead
- gob.li - Golbin Ridge Limited. Timed out
- gonext.org - not resolving
- go.to - sold its domains on Sedo apparently.
- go2.me - everything 404s
- g.ro.lt - DNS not responding as of 16:15, 12 December 2015 (EST)
- gx.si
- gyar.eu - Server gone as of 01:07, 17 November 2015 (EST) (examples: http://gyar.eu/c8 ; http:// gyar.eu/agB)
- hao.jp - Server not responding as of 16:36, 12 December 2015 (EST)
- hashonomy.com - Timed out
- hj.to -- server requests HTTP Basic auth as of 22:05, 21 November 2015 (EST)~
- href.hu
- href.in - DNS not responding as of 16:15, 12 December 2015 (EST)
- htcdev.net - DNS not resolving.
- hurl.no - Shut down sometime between March 5, 2011 and May 29, 2011 due to an influx of spam. As of 02:24, 3 December 2015 (EST), the domain appears to be owned by someone else.
- iawtp.me - DNS not resolving
- icymi.me - DNS not resolving
- iKr.me - Asian-script spam site as of 02:24, 3 December 2015 (EST)
- ilix.in - domain parked
- imfy.us - requires a recaptcha to get to the linked site, and avast goes nuts. DNS fails to resolve.
- inspr.in - Inspired Beta. Can't find server
- irt.me - DNS not resolving as of 02:24, 3 December 2015 (EST)
- ix.it - Not resolving
- jijr.com - Doesn't appear to be a shortener, now parked
- joomlagyar.hu/usb - DNS not resolving
- jump.to - dead as of February 1, 2013
- keTKP.in - DNS not responding as of 01:26, 7 December 2015 (EST)
- Kots.Nu - DNS not responding as of 01:26, 7 December 2015 (EST)
- kissa.be - "Kissa.be url shortener service is shutdown"
- kl.am - "kl.am Closes its Shell"
- krz.ch - redirects to idealizer.ch (SEO company) as of 02:24, 3 December 2015 (EST)
- kuijt.nu - replaced with unrelated site
- kurl.us - Parked.
- k.vu - Server not responding as of 16:36, 12 December 2015 (EST)
- l.gg - server not responding as of 01:31, 13 December 2015 (EST)
- liltext.com - DNS not responding as of 16:15, 12 December 2015 (EST)
- linkee.com - shut down with a notice on July 23, 2014
- liurl.cn - DNS not responding as of 16:15, 12 December 2015 (EST)
- lk.to
- ln-s.net - Server not responding as of 16:36, 12 December 2015 (EST)
- ln-s dot ru - DNS not responding as of 16:15, 12 December 2015 (EST)
- LNK.by - Cyrillic domain parking page as of 01:09, 7 December 2015 (EST)
- lnk.gd - "This account has been suspended. Either the domain has been overused, or the reseller ran out of resources." as of 17:51, 12 December 2015 (EST)
- lnk.ly - DNS not resolving as of 01:09, 7 December 2015 (EST)
- lnk.ms - Server not responding as of 16:36, 12 December 2015 (EST)
- lnk.nu - parking page as of 01:53, 9 December 2015 (EST)
- lnkurl.com - Website dead
- l.pr - LinksPreadeR (review from TechCrunch[IA•Wcite•.today•MemWeb]) - DNS not resolving as of 01:09, 7 December 2015 (EST)
- mangk.us - DNS not responding as of 01:36, 7 December 2015 (EST)
- marv.ly - DNS fails to resolve.
- mash.to - Cannot connect ; Server not responding as of 16:36, 12 December 2015 (EST)
- memurl.com - Pronounceable. Broken.
- me.lt - Connection refused.
- mens.hm - Not responding (timeout)
- micURL.com - parking page as of 01:53, 9 December 2015 (EST)
- miklos.dk - Doesn't appear guessable: http://miklos.dk/!z7bA6a - "Vi arbejder på sagen..."
- min2.me - now a CDN called bit2me (?) as of 01:53, 9 December 2015 (EST)
- mindless.co
- minilien.com - Doesn't appear guessable: http://minilien.com/?9nyvwnA0gh - Website dead
- minilink.org - parking page as of 01:53, 9 December 2015 (EST)
- minim.in - Times out
- minurl.org - Presently in ERROR 404
- ms.me - Parked.
- msplinks.com - Used by Myspace[2]
- mtw.tl - everything 403s
- muhlink.com - Not resolving
- myloc.me - Server not responding as of 16:36, 12 December 2015 (EST)
- MySp.in - parking page as of 01:53, 9 December 2015 (EST)
- mytinyurl.com - redirects to an unrelated image
- myurl.us - cpanel frontend
- MyURL.in - DNS not responding as of 16:15, 12 December 2015 (EST)
- myv.bz - Not resolving
- ndurl.com - redirects to site offering "Minecraft for Free" as of 01:53, 9 December 2015 (EST)
- nm.ly - DNS not responding as of 01:36, 7 December 2015 (EST)
- nn.nf - DNS not responding as of 16:15, 12 December 2015 (EST)
- not.my - DNS not responding as of 16:15, 12 December 2015 (EST)
- nyturl.com - NY Times (bonus points for being longer than nyt.com, which they own). Taken by squatters
- oc1.us - parking page as of 17:51, 12 December 2015 (EST)
- omf.gd - DNS not responding as of 01:53, 9 December 2015 (EST) ; Server not responding as of 16:36, 12 December 2015 (EST)
- om.ly - DNS not responding as of 16:15, 12 December 2015 (EST)
- onvzi.com - DNS fails to resolve.
- otf.me - Empty WordPress site
- para.pt - parking page as of 01:31, 13 December 2015 (EST)
- Pendek.in - parking page as of 01:53, 9 December 2015 (EST)
- Pic.gd - appears to be an image sharing site as of 01:53, 9 December 2015 (EST)
- Piko.me - DNS not responding as of 01:36, 7 December 2015 (EST)
- PiURL.com - DNS not responding as of 01:36, 7 December 2015 (EST)
- ping.fm - Fails to resolve.
- pli.gs - DNS not responding as of 16:15, 12 December 2015 (EST)
- pln.so - Not working.
- Plo.cc - parking page as of 01:53, 9 December 2015 (EST)
- plzretwt.me - Fails to resolve.
- pp.gg - DNS not responding as of 16:15, 12 December 2015 (EST)
- pt2.me - default server page as of 02:09, 9 December 2015 (EST)
- pulsene.ws - Expired. Parked by GoDaddy.
- Puke.It - parking page as of 02:09, 9 December 2015 (EST)
- qlnk.net - DNS not responding as of 16:15, 12 December 2015 (EST)
- qu.tc - DNS not responding as of 16:15, 12 December 2015 (EST)
- qurlyq.com - Javascript redirect. Appears sequential: http://qurlyq.com/5nf. Domain parked.
- qux.in - Parking page as of 01:04, 10 December 2015 (EST)
- rb6.me - redirects to "coming soon" page as of 17:51, 12 December 2015 (EST)
- RDE.me - GoDaddy parking page as of 01:04, 10 December 2015 (EST)
- re.ad - Fails to resolve.
- readthis.ca - Server not responding as of 16:36, 12 December 2015 (EST)
- redir.ec - 403 Forbidden as of 17:51, 12 December 2015 (EST)
- redirx.com - Lowercase alpha only, appears sequential or guessable - Ex: http://redirx.com/?wyok. Website still online but does not resolve existing URLs nor does it allow creating new ones (responds with the message: blame the spammers)
- retwt.me - Server fails to respond as of 16:36, 12 December 2015 (EST)
- r.im - page is blank (but contains title) as of 01:04, 10 December 2015 (EST)
- riz.gd - DNS not responding as of 16:15, 12 December 2015 (EST)
- RT.nu - parking page as of 02:24, 12 December 2015 (EST)
- RubyURL.com - DNS not responding as of 02:24, 12 December 2015 (EST) ; Server not responding as of 16:36, 12 December 2015 (EST)
- rww.tw - Server not responding as of 16:36, 12 December 2015 (EST)
- s3nt.com - Probably sequential. http://s3nt.com/aa goes somewhere different from /ab . Domain parked.
- s4c.in - DNS not responding as of 16:15, 12 December 2015 (EST)
- Sai.ly - DNS not responding as of 01:36, 7 December 2015 (EST)
- sameurl.com - Server not responding as of 16:36, 12 December 2015 (EST)
- say.ly - redirects to unrelated site
- sdut.us - DNS not responding as of 16:15, 12 December 2015 (EST)
- see.sc - Fails to resolve.
- Short.ie - DNS not responding as of 16:15, 12 December 2015 (EST)
- shortlinks.co.uk - Working again. Maybe not. ; DNS not responding as of 16:15, 12 December 2015 (EST)
- short.nr - DNS not responding as of 01:31, 13 December 2015 (EST)
- short.to - Domain is parked - Probably sequential/loweralpha: http://short.to/msmp ; DNS not responding as of 16:15, 12 December 2015 (EST)
- Short.Url - DNS not responding as of 01:26, 7 December 2015 (EST)
- shout.to - DNS not responding as of 16:15, 12 December 2015 (EST)
- shrt.st - DNS not responding as of 16:15, 12 December 2015 (EST)
- shrinklink.co.uk - Doesn't appear sequential: http://www.shrinklink.co.uk/45bmx , www.shrinklink.co.uk/npk6xp . Domain parked.
- Shrtn.com - DNS not responding as of 01:36, 7 December 2015 (EST)
- shrtn.us - myshorturls.appspot.com. 404, does not resolve
- Shw.me - DNS not responding as of 01:36, 7 December 2015 (EST)
- simurl.com - Doesn't appear guessable - Ex: http://simurl.com/panpes. Website is blank; does not resolve URLs ("This SimURL is now inactive") ; parking page as of 17:51, 12 December 2015 (EST)
- siteo.us - returns "521 Origin Down" as of 17:51, 12 December 2015 (EST)
- sl.ly - DNS not responding as of 01:36, 7 December 2015 (EST)
- s.me - Domain parked.
- smf.is - DNS not resolving.
- sns.mx - SNS Analytics, domain parked
- song.ly - DNS not responding as of 01:36, 7 December 2015 (EST)
- spedr.com - Server not responding as of 16:36, 12 December 2015 (EST)
- sq.com - Now redirects to Singapore Airlines.
- surl.hu – Last contact on 2014-07-16, nearly 2M sURLs gone. Domain taken but idle now ; DNS not responding as of 16:15, 12 December 2015 (EST)
- SwU.me - Server not responding as of 16:36, 12 December 2015 (EST)
- TimesURL.at - DNS not responding as of 01:36, 7 December 2015 (EST)
- tini.us - Server not responding as of 16:36, 12 December 2015 (EST)
- tiny.ly - DNS not resolving.
- TinyPl.us - DNS not responding as of 01:36, 7 December 2015 (EST)
- tinyuri.ca - DNS not responding as of 16:15, 12 December 2015 (EST)
- tllg.net - Server not responding as of 16:36, 12 December 2015 (EST)
- tm.to - Twtmore has "flown away"
- tnij.org - DNS not responding as of 16:15, 12 December 2015 (EST)
- to.gg - Global Giving, everything 503s
- traceurl.com - DNS fails to resolve.
- tr.im (1st generation) - "Be back soon!"
- tpm.ly - DNS not responding as of 16:15, 12 December 2015 (EST)
- twitterurl.net - Server not responding as of 16:36, 12 December 2015 (EST)
- twitterurl.org - DNS not responding as of 16:15, 12 December 2015 (EST)
- tw6.us - DNS not responding as of 01:36, 7 December 2015 (EST)
- tweetburner.com / twurl.nl - Appears incremental, everything 404s
- twixar.com - "Estamos fora do ar por algum tempo, mas estamos trabalhando para voltar a oferecer o serviço para encurtar URLs longa em breve!"
- twthpr.co - DNS not resolving.
- Twip.us - Server not responding as of 16:36, 12 December 2015 (EST)
- twitpwr.com - Domain parked.
- twitt.hu
- twurl.nl - Server not responding as of 16:36, 12 December 2015 (EST)
- u76.org - Server not responding as of 16:36, 12 December 2015 (EST)
- u.mavrev.com - Stopped accepting new urls. Now times out
- unfaker.it - DNS not responding as of 01:36, 7 December 2015 (EST)
- u.nu - "The shortest URLs. period." Website dead since at least 1st of october 2010 (http://web.archive.org/web/20100104023208/http://u.nu/)
- urizy.com - DNS not responding as of 01:36, 7 December 2015 (EST)
- url360.me - DNS not responding as of 16:15, 12 December 2015 (EST)
- url9.com - Sequential, alphanumeric. Leading 0s are significant. "The site is working correctly."
- URL.AG - DNS not responding as of 01:36, 7 December 2015 (EST)
- urlborg.com - 404 Not Found.
- url.co.uk - DNS not responding as of 16:15, 12 December 2015 (EST)
- urlcover.com - Domain parked.
- urlG.info - DNS not responding as of 01:36, 7 December 2015 (EST)
- urlhawk.com - Domain parked.
- url-press.com - Suspended by web host.
- urlsinn.com - DNS not resolving.
- urlsmash.com - DNS not resolving.
- urltea.com - Dreamhost's coming soon page.
- urlu.ms - DNS not responding as of 01:36, 7 December 2015 (EST)
- urlvi.be - Domain parked.
- urlx.org - Owner has agreed to share his database
- ur.ly - DNS not responding as of 01:36, 7 December 2015 (EST)
- uxp.in -
still resolves URLs, but site just shows blank page. Domain parked.
- vb.ly - DNS not responding as of 16:15, 12 December 2015 (EST) (but see above)
- vibemag.co - Vibe Magazine. Times out
- vi.ly - DNS not responding as of 01:36, 7 December 2015 (EST)
- vl.am - Server not responding as of 16:36, 12 December 2015 (EST)
- vsb.li / links.visibli.com/links/ - The latter uses truncated md5 hex string. See sharedby.co.
- w3t.org - 403 Forbidden.
- wipi.es - DNS not responding as of 16:15, 12 December 2015 (EST)
- wlink.us - Domain parked.
- wl.tl - DNS not resolving.
- wwy.me
- xaddr.com - Domain parked.
- xil.in - Under construction.
- x.se - Cannot resolve, but www.x.se works.
- xym.kr - Gibberish (?) Korean text blog.
- y.ahoo.it - Yahoo
- yweb.com - Suspicious iframe with long url and fake loading gif image.
- zi.ma - DNS not resolving.
- zip.li - parking page as of 17:51, 12 December 2015 (EST)
- zip.sm - was a redirect to joturl.com. Now times out
- ZipMyURL.com - Server not responding as of 16:36, 12 December 2015 (EST)
Discontinued
- adjix.com -
Still resolves URLs, but site does not work: "The requested application was not found on this server."- Is static host on AWS service.[6] - feedly.com/e/ - realized that URL shorteners were bad [7]. Non-cooperative.
- icanhaz.com -- shut down sometime around June 2010; IA dump that should be un-darked.
- lks.uk.to -- no DNS as of 03:01, 15 December 2015 (EST) ; has a dump on IA in 301Works; need to ping them about un-darking it.
- metamark.net / xrl.us - no longer allowing new urls to be shortened, existing urls still work (Ex. http://xrl.us/bfabog). Uploaded a database dump to Internet archive.
- pnt.me - Doesn't appear guessable, too big a space to bruteforce: http://pnt.me/FzAblc (DNS not responding as of 16:15, 12 December 2015 (EST)) IA dump that should be un-darked.
- s.tt - shortener of http://repost.us[IA•Wcite•.today•MemWeb]. There is a dump on IA: https://archive.org/details/stt-7-18-14 -- but it is still restricted, contrary to 301works rules ("a closing company will agree to allow 301Works to publish the mappings", as stated here). Someone should ping IA about this.
- urlbrief.com - supposedly co-operated with 301Works.org -- but the collection is empty, and DNS doesn't respond as of 02:44, 15 December 2015 (EST). Someone should ping IA and ask them to un-dark the collection, if there is anything, per the 301works rules.
- va.mu - server is down as of 23:04, 15 December 2015 (EST); 16 items on IA that should be un-darked.
- Zapt.In - 404's as of 23:10, 15 December 2015 (EST) ; https://archive.org/details/ZaptinShortedUrlsIn20113110 should be un-darked
External lists to integrate
(not yet checked or de-duplicated, please move them (and comment with at least the date) when you do check them)
shortenurl/wiki/URLShorteningServices and longurl.org/services
From: http://code.google.com/p/shortenurl/wiki/URLShorteningServices[IA•Wcite•.today•MemWeb] From http://longurl.org/services[IA•Wcite•.today•MemWeb]
(filtered out ones with no DNS, or a server that didn't respond with status code 200)
1link.in 2.gp 2tu.us 3.ly 6url.com 7.ly 7rz.de afx.cc a.gd a.gg alturl.com a.nf ar.gy atu.ca b23 dot ru bloat.me bsa.ly canurl.com chilp.it cliccami.info clickthru.ca cutt.us decenturl.com dfl8.me digbig.com disq.us dld.bz doiop.com do.my easyuri.com easyurl.net eepurl.com fa.by fff.to fire.to firsturl.de fly2.ws Fly2.ws fwib.net gizmo.do gl.am gurl.es Gurl.es hex.io hiderefer.com hmm.ph Hop.im icanhaz.com idek.net is.gd its.my jijr.com Kisa.Ch kissa.be kl.am l9k.net linkbun.ch lnkurl.com lru.jp lurl.no macte.ch merky.de migre.me miniurl.com moourl.com mrte.ch notlong.com nsfw.in nutshellurl.com nxy.in omoikane.net orz.se o-x.fr ptiturl.com reallytinyurl.com redirects.ca rt.nu s7y.us safe.mn Safe.mn ShadyURL.com shorl.com shortn.me shorturl.com show.my shrinkify.com shrten.com slki dot ru smallr.com Smallr.net SMFU.in smsh.me smurl.name Snipie.com snipr.com snipurl.com snkr.me snurl.com sp2.ro srnk.net srs.li tgr.me tighturl.com tiny.ly tiny.pl tl.gd tmi.me to.je to.vg trumpink.lt tsort.us tweet.me twiturl.de twtr.us twurl.cc ub0.cc Uiop.Me ulu.lu u.mavrev.com u.nu updating.me ur1.ca url4.eu url.az URLCorta.es url.ie urlx.ie URLZ.at urlzen.com use.my Virl.co vm.lc VTC.es W3T.org w55.de wa.la wapurl.co.uk XiY.net xr.com XR.com xrl.in xrt.me xurl.es xxsURL.de y.ahoo.it yatuc.com ye.pe yiyd.com zi.ma Zi.ma Z.PE zud.me zurl.ws zz.gd ZZ.GD
(here's a list of ones from the above sources whose servers returned non-200; the status code is prefixed)
301 aa.cx 301 all.fuseurl.com 301 b2l.me 301 bizj.us 301 budurl.com 301 clck dot ru 301 cl.ly 301 cort.as 301 dai.ly 301 dlvr.it 301 fbshare.me 301 ff.im 301 firsturl.net 301 flq.us 301 fuseurl.com 301 fwd4.me 301 go.ign.com 301 goshrink.com 301 hulu.com 301 hurl.me 301 hurl.ws 301 Hurl.ws 301 ir.pe 301 J2j.de 301 klck.me 301 lnkd.in 301 minurl.fr 301 moby.to 301 nbc.co 301 ow.ly 301 post.ly 301 profile.to 301 pub.vitrue.com 301 redirx.com 301 ri.ms 301 SFU.ca 301 shrinkr.com 301 starturl.com 301 ta.gd 301 tnw.to 301 togoto.us 301 to.ly 301 to.ly 301 toysr.us 301 tra.kz 301 tra.kz 301 tr.im 301 tr.im 301 twhub.com 301 urlborg.com 301 urlBorg.com 301 urlcut.com 301 vgn.am 301 Voizle.com 301 x.vu 301 X.vu 301 yfrog.com 301 yuarel.com 301 zi.mu 302 2su.de 302 4url.cc 302 eweri.com 302 fav.me 302 fb.me 302 flic.kr 302 go.9nl.com 302 Good.ly 302 goo.gl 302 go.usa.gov 302 hsblinks.com 302 ix.lt 302 liip.to 302 linkbee.com 302 lt.tl 302 ooqx.com 302 qy.fi 302 r.im 302 shrt.fr 302 shrt.ws 302 surl.co.uk 302 tinylink.in 302 t.lh.com 302 twitclicks.com 302 URLoo.com 302 wp.me 302 xrl.us 302 xurl.jp 302 youtu.be 302 z0p.de 302 Zi.pe 403 adjix.com 403 bacn.me 403 clop.in 403 htxt.it 403 ilix.in 403 ping.fm 403 rickroll.it 403 shink.de 403 shrunkin.com 403 twirl.at 403 Twirl.at 403 urlcover.com 403 urli.nl 403 URLi.nl 403 urlshorteningservicefortwitter.com 403 zzang.kr 404 ctvr.us 404 ru.ly 404 shar.es 404 totc.us 404 urlenco.de 405 4ms.me 405 4sq.com 405 amzn.to 405 azc.cc 405 bcool.bz 405 binged.it 405 bit.ly 405 bravo.ly 405 chzb.gr 405 conta.cc 405 cot.ag 405 crks.me 405 digg.com 405 huff.to 405 lat.ms 405 nblo.gs 405 n.pr 405 nyti.ms 405 onforb.es 405 on.mktw.net 405 politi.co 405 qte.me 405 read.bi 405 slate.me 405 tbd.ly 405 tcrn.ch 405 tgr.ph 405 tny.com 405 urls.im 405 usat.ly 405 wapo.st 405 yhoo.it 406 krunchd.com 406 tiniuri.com 503 mke.me 503 rurl.org 503 t.cn 503 yep.it
Mashable
From http://mashable.com/2008/01/08/url-shortening-services[IA•Wcite•.today•MemWeb]
Not copied in yet
bit.do/list-of-url-shorteners
From http://bit.do/list-of-url-shorteners.php[IA•Wcite•.today•MemWeb]
q.gs viralurl.com Frank Bauer recommends the worlds largest & fastest growing Link Cloaker, Shortener & List Builder... ViralURL.com "Instantly Harness the Power of ViralURL" vur.me The worlds largest & fastest growing Link Cloaker, Shortener & List Builder... ViralURL.com cutt.us CUTTUS | URL Shortening Service, URL Shortener Example: http://cutt.us/url-shortener and http://cutt.us/bitdo u.bb yourls.org YOURLS: Your Own URL Shortener crisco.com CRISCO is Cooking - Recipes, Cooking Tips, Baking Ideas, Recipe Videos, and Product information: Olive Oils, Cooking Sprays, Cooking Oils, Shortening - Crisco® x.co URL Shortener | X.co URL Redirection Service by Go Daddy Example: http://x.co/5PSLK prettylinkpro.com Affiliate Link Cloaker and URL Shortener for WordPress: Pretty Link Pro viralurl.biz Frank Bauer recommends the worlds largest & fastest growing Link Cloaker, Shortener & List Builder... ViralURL.com adcraft.co AdCraft.co - Shorten links, Make money virl.ws Frank Bauer recommends the worlds largest & fastest growing Link Cloaker, Shortener & List Builder... ViralURL.com scrnch.me Powered Exclusively by the scrnch.me URL Shortening Service filoops.info Filoops - Shorten Your Long URLs for net surfing pleasure (too many banners) vurl.bz Frank Bauer recommends the worlds largest & fastest growing Link Cloaker, Shortener & List Builder... ViralURL.com vzturl.com VztURL.com - Free URL shortening, tracking, rotator & cloaking! Example: http://vzturl.com/apa83 lemde.fr bitly | shorten, share and track your links qr.net QR Code Generator URL shortener Example: http://qr.net/bitdo 1url.com 1URL.com - Your #1 URL Shortening & Redirection Service! tweez.me Tweez.me - Free Premium URL Shortening Service 7vd.cn 7vd.cn - Baidu Short URL service Example: http://7vd.cn/rjtS dft.ba DFT.BA is a url shortener submitted by Michael Mattice. "Don't forget to be awesome - custom shortened name", by DFTBA Records. Examples: http://dft.ba/-aWOr http://dft.ba/-bitdo http://dft.ba/-urlshortener aka.gr AKA GR is a Greek url shortener, submitted by Konstantinos Botonakis. With sponsored ads. Powered by Botonakis. Sample short url: http://aka.gr/bit tr.im
vanityurlshorteners.com
Not copied in yet
Archives
Check out Audit2014 and help audit the archives. In particular, the stuff not on Internet Archive needs to be uploaded.
- See the latest torrent release for URLs before Tinytown. A copy is available at URLTeamTorrentRelease2013July
- Tinytown results are uploaded to the Internet Archive. They are incremental, so you will need to download them all to get all URLs.
- They are formatted as follows:
- Each IA item (which can be downloaded in full via BitTorrent or as a zip file) contains multiple zip files, named
PROJECT_NAME.TIMESTAMP.zip
(wherePROJECT_NAME
is the warrior project name (as listed in the table below, and on http://tracker.archiveteam.org:1337/status) andTIMESTAMP
is a dash-separated timestamp matching the name of the item. - Each zip file contains a subdirectory matching the
PROJECT_NAME
, which contains a file namedPROJECT_NAME.meta.json.xz
and one or more files whose names start with one or more underscores, followed by.txt.xz
. - The
xz
files can be decompressed with the wikipedia:XZ Utils. - The
meta.json
file is a copy of the project settings (as linked from the table below) at the time the dump was made. - The
txt
files contain the actual URLs, in BEACON format. - The simple description of BEACON format is that each line (except for a few header lines) consists of the shortcode, followed by a vertical bar, followed by the original URL.
- Each IA item (which can be downloaded in full via BitTorrent or as a zip file) contains multiple zip files, named
- They are formatted as follows:
References
- ↑ http://github.com/chronomex/urlteam
- ↑ http://github.com/chronomex/urlteam
- ↑ http://github.com/chronomex/urlteam
- ↑ http://github.com/chronomex/urlteam
- ↑ http://blog.bitly.com/post/179664996/go-ahead-and-j-mp
- ↑ https://twitter.com/Adjix/status/154222637801943041
- ↑ http://blog.feedly.com/2014/10/28/feedly-url-shortener-retired/
Weblinks
Common URL shortening software
Ha-ha! Please don't run a URL shortening service.