Difference between revisions of "URLs"

From Archiveteam
Jump to navigation Jump to search
(Add urls-sources)
 
Line 10: Line 10:
}}
}}


The '''URLs project''' is a continuous generic project to archive random URLs from various sources, e.g. external links discovered in other projects or in older archives. Current projects as of early 2021 that send outlinks to URLs include the [[Reddit]] and [[Yahoo! Answers]] projects.
The '''URLs project''' is a continuous generic project to archive random URLs from various sources, e.g. external links discovered in other projects or in older archives. Current projects as of early 2021 that send outlinks to URLs include the [[Reddit]] and [[Yahoo! Answers]] projects. [[User:TheTechRobo]]'s Discord dumps usually have extracted URLs and attachments get sent there too, and lists of URLs can be submitted.


Important note: If you run this project, you'll likely see your IP get banned from Facebook, Instagram, YouTube, etc., and using those sites may become difficult (e.g. constant captchas, forced login). Also, if you run at significant speed, you'll likely see abuse notices, IP blacklists, and so on.
Important note: If you run this project, you'll likely see your IP get banned from Facebook, Instagram, YouTube, etc., and using those sites may become difficult (e.g. constant captchas, forced login). Also, if you run at significant speed, you'll likely see abuse notices, IP blacklists, and so on.

Latest revision as of 02:53, 28 August 2022

URLs
URL https://url.spec.whatwg.org/
Status Special case
Archiving status In progress...
Archiving type Unknown
Project source urls-grab
urls-sources
Project tracker urls
IRC channel #// (on hackint)
Data? archiveteam_urls

The URLs project is a continuous generic project to archive random URLs from various sources, e.g. external links discovered in other projects or in older archives. Current projects as of early 2021 that send outlinks to URLs include the Reddit and Yahoo! Answers projects. User:TheTechRobo's Discord dumps usually have extracted URLs and attachments get sent there too, and lists of URLs can be submitted.

Important note: If you run this project, you'll likely see your IP get banned from Facebook, Instagram, YouTube, etc., and using those sites may become difficult (e.g. constant captchas, forced login). Also, if you run at significant speed, you'll likely see abuse notices, IP blacklists, and so on.