Difference between revisions of "Bintray"

From Archiveteam
Jump to navigation Jump to search
(Created page with "{{Infobox project | title = Bintray | URL = https://bintray.com/ | project_status = {{closing}} | archiving_status = {{inprogress}} | source = [https://github.com/ArchiveTeam/...")
 
(Imagery and a navbox)
(One intermediate revision by one other user not shown)
Line 1: Line 1:
{{Infobox project
{{Infobox project
| title = Bintray
| title = Bintray
| logo = Bintray logo.png
| image = Bintray - 6-20-21.png
| URL = https://bintray.com/
| URL = https://bintray.com/
| project_status = {{closing}}
| project_status = {{closing}}
Line 11: Line 13:


'''Bintray''' is a software distribution platform by JFrog. It closed on 2021-05-01 but is still serving (some) content for the time being.
'''Bintray''' is a software distribution platform by JFrog. It closed on 2021-05-01 but is still serving (some) content for the time being.
== Account of grab ==
[[User:OrIdow6|OrIdow6]] was the main author of the Bintray grab script, and procrastinated in the process of writing it. This led to less data being captured than might have otherwise happened. Items were at first users, which included normal user pages, all their repositories etc., the index of the downloads for that user, and non-CDN hosted download files for that user; and CDN-hosted download files.
When the site shut down, normal user pages/metadata stayed up, and some downloads stayed up (perhaps it was cached); so download listings and files were split off into their own items, using a confusing hack to effectively requeue failed downloads through backfeed. This enabled downloads to cycle around until they hit a machine that was able to grab them. After a few days, these too stopped being served, and only some official/paid downloads remain(ed).
Things to avoid in the future:
* Waiting too long to finish the grab script.
* Putting huge chunks of the download section, which had a very simple structure, in single items, instead of splitting it up.
{{Navigation box}}

Revision as of 04:20, 21 June 2021

Bintray
Bintray logo
Bintray - 6-20-21.png
URL https://bintray.com/
Status Closing
Archiving status In progress...
Archiving type Unknown
Project source bintray-grab
Project tracker bintray
IRC channel #binnedtray (on hackint)

Bintray is a software distribution platform by JFrog. It closed on 2021-05-01 but is still serving (some) content for the time being.

Account of grab

OrIdow6 was the main author of the Bintray grab script, and procrastinated in the process of writing it. This led to less data being captured than might have otherwise happened. Items were at first users, which included normal user pages, all their repositories etc., the index of the downloads for that user, and non-CDN hosted download files for that user; and CDN-hosted download files.

When the site shut down, normal user pages/metadata stayed up, and some downloads stayed up (perhaps it was cached); so download listings and files were split off into their own items, using a confusing hack to effectively requeue failed downloads through backfeed. This enabled downloads to cycle around until they hit a machine that was able to grab them. After a few days, these too stopped being served, and only some official/paid downloads remain(ed).

Things to avoid in the future:

  • Waiting too long to finish the grab script.
  • Putting huge chunks of the download section, which had a very simple structure, in single items, instead of splitting it up.