Difference between revisions of "CurseForge"

From Archiveteam
Jump to navigation Jump to search
m (→‎URL patterns: New section)
(Added API grab - Includes info from pokechu22)
Line 3: Line 3:
| URL = https://curseforge.com
| URL = https://curseforge.com
| project_status = {{online}}
| project_status = {{online}}
| archiving_status = {{unknown}}
| archiving_status = {{inprogress}} (API data) <br /><small>{{notsavedyet}} (website)</small>
}}
}}
'''Curseforge''' ({{URL|https://curseforge.com|curseforge.com}}) is a game modification hosting website. It is particularly notable for being the ''de facto'' website for hosting community-made [[Minecraft]] mods.
'''Curseforge''' ({{URL|https://curseforge.com|curseforge.com}}) is a game modification hosting website. It is particularly notable for being the ''de facto'' website for hosting community-made [[Minecraft]] mods.
Line 15: Line 15:


However, there is a <code>projects</code> endpoint which is a number incrementing from 1 to infinity; as such, these URLs can be guessed very easily. This is the internal identifier, and redirects to the pretty URL slug. (This number is used in various other places in the API.) For example, {{URL|https://curseforge.com/projects/225643}} redierects to {{URL|https://www.curseforge.com/minecraft/mc-mods/botania}}.
However, there is a <code>projects</code> endpoint which is a number incrementing from 1 to infinity; as such, these URLs can be guessed very easily. This is the internal identifier, and redirects to the pretty URL slug. (This number is used in various other places in the API.) For example, {{URL|https://curseforge.com/projects/225643}} redierects to {{URL|https://www.curseforge.com/minecraft/mc-mods/botania}}.
==API Archival==
API documentation found at {{URL|https://docs.curseforge.com|docs.curseforge.com}}. A list of information not found in the official documentation is found below:
* https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/download leads to the download of each of the fileIDs found in https://www.curseforge.com/api/v1/mods/{modid}/
* https://www.curseforge.com/api/v1/mods/{modid}/description/ does not work
* https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/change-log/ exists
* https://www.curseforge.com/api/v1/mods/{modid}/comments/ exists
* https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/additional-files/ exists
Below is a table of [[ArchiveBot]] runs on the API:
{| class="wikitable sortable plainlinks"
! rowspan=2 | API !! rowspan=2 | Status !! colspan=6 | Archive details
|-
! Tool !! URL list !! Job !! Date !! Size !! Objects
|-
| https://www.curseforge.com/api/v1/mods/{modId}/files || {{saved}}
|  [[ArchiveBot]] (!a) || {{URLAB|https://transfer.archivete.am/inline/4DZe6/curseforge_modids.txt | curseforge_modids.txt}} || [https://archive.fart.website/archivebot/viewer/job/ckpte ckpte] || 2024-01-19 || || 1 warc
|-
| https://www.curseforge.com/api/v1/mods/{modid}/files?pageIndex={index} || {{saved}}
|  [[ArchiveBot]] (!a) || {{URLAB|https://transfer.archivete.am/inline/GqdCj/www.curseforge.com_api_later_pages.txt | www.curseforge.com_api_later_pages.txt}} || [https://archive.fart.website/archivebot/viewer/job/8f579 8f579] || 2024-01-20 || || 1 warc
|-
| https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/additional-files || {{saved}}
|  [[ArchiveBot]] (!a) || {{URLAB|https://transfer.archivete.am/inline/ulxiO/www.curseforge.com_api_additional_files.txt | www.curseforge.com_api_additional_files.txt}} || [https://archive.fart.website/archivebot/viewer/job/e9np9 e9np9] || 2024-01-20 || || 1 warc
|-
| https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/additional-files || {{saved}}
|  [[ArchiveBot]] (!a) || {{URLAB|https://transfer.archivete.am/inline/coaBL/www.curseforge.com_api_double_additional_files.txt | www.curseforge.com_api_double_additional_files.txt}} || [https://archive.fart.website/archivebot/viewer/job/52ily 52ily] || 2024-01-21 || || 1 warc
|-
| https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/download || {{inprogress}}
|  [[ArchiveBot]] (!a) || {{URLAB|https://transfer.archivete.am/inline/B6usy/www.curseforge.com_api_mods_download.txt | www.curseforge.com_api_mods_download.txt}} || [https://archive.fart.website/archivebot/viewer/job/47cah 47cah]  || 2024-01-22 || || >443 warcs
|-
| https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/comments || {{notsavedyet}}
|  [[ArchiveBot]] (!a) ||  ||  ||  ||  || 
|-
| https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/change-log/ || {{notsavedyet}}
|  [[ArchiveBot]] (!a) ||  ||  ||  ||  || 
|-
| Search || {{notsavedyet}}
|  [[ArchiveBot]] (!a) ||  ||  ||  ||  || 
|-
| Profile Pictures || {{notsavedyet}}
|  [[ArchiveBot]] (!a) ||  ||  ||  ||  || 
|-
|}
Each run uses information from one of the previous runs. The first list was made by incrementing the modID from 0 to 999,999.
While https://www.curseforge.com/api/v1/mods/963238 looks like it should provide information about each mod, it always gives 403 Forbidden resource (unlike nonexistent endpoints, which give 404 Cannot GET /api/v1/nonexistent). Information about individual mods is available via the search API (https://www.curseforge.com/api/v1/mods/search?gameId=432&index=0), but the search API only gives at most 10,000 results for each query, so queries will need to be chosen that give less than that many results.

Revision as of 00:09, 1 February 2024

CurseForge
URL https://curseforge.com
Status Online!
Archiving status In progress... (API data)
Not saved yet (website)
Archiving type Unknown
IRC channel #archiveteam-bs (on hackint)

Curseforge (curseforge.com[IA•Wcite•.today•MemWeb]) is a game modification hosting website. It is particularly notable for being the de facto website for hosting community-made Minecraft mods.

Events

Forums deprecation

On 2022 December 25, CurseForge's Authors[IA•Wcite•.today•MemWeb] and Minecraft[IA•Wcite•.today•MemWeb] forums were marked as deprecated Soon™.

URL patterns

CurseForge is organized into 'projects'. Each project has a video game and a project type attached; this is how the URL slug is determined. For example, https://www.curseforge.com/minecraft/mc-mods/botania[IA•Wcite•.today•MemWeb] has components for the video game (Minecraft) and the type (mc-mod). This makes guessing URLs extremely difficult.

However, there is a projects endpoint which is a number incrementing from 1 to infinity; as such, these URLs can be guessed very easily. This is the internal identifier, and redirects to the pretty URL slug. (This number is used in various other places in the API.) For example, https://curseforge.com/projects/225643[IA•Wcite•.today•MemWeb] redierects to https://www.curseforge.com/minecraft/mc-mods/botania[IA•Wcite•.today•MemWeb].

API Archival

API documentation found at docs.curseforge.com[IA•Wcite•.today•MemWeb]. A list of information not found in the official documentation is found below:

Below is a table of ArchiveBot runs on the API:

API Status Archive details
Tool URL list Job Date Size Objects
https://www.curseforge.com/api/v1/mods/{modId}/files Saved! ArchiveBot (!a) curseforge_modids.txt (AB · WB) ckpte 2024-01-19 1 warc
https://www.curseforge.com/api/v1/mods/{modid}/files?pageIndex={index} Saved! ArchiveBot (!a) www.curseforge.com_api_later_pages.txt (AB · WB) 8f579 2024-01-20 1 warc
https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/additional-files Saved! ArchiveBot (!a) www.curseforge.com_api_additional_files.txt (AB · WB) e9np9 2024-01-20 1 warc
https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/additional-files Saved! ArchiveBot (!a) www.curseforge.com_api_double_additional_files.txt (AB · WB) 52ily 2024-01-21 1 warc
https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/download In progress... ArchiveBot (!a) www.curseforge.com_api_mods_download.txt (AB · WB) 47cah 2024-01-22 >443 warcs
https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/comments Not saved yet ArchiveBot (!a)
https://www.curseforge.com/api/v1/mods/{modid}/files/{fileid}/change-log/ Not saved yet ArchiveBot (!a)
Search Not saved yet ArchiveBot (!a)
Profile Pictures Not saved yet ArchiveBot (!a)

Each run uses information from one of the previous runs. The first list was made by incrementing the modID from 0 to 999,999.

While https://www.curseforge.com/api/v1/mods/963238 looks like it should provide information about each mod, it always gives 403 Forbidden resource (unlike nonexistent endpoints, which give 404 Cannot GET /api/v1/nonexistent). Information about individual mods is available via the search API (https://www.curseforge.com/api/v1/mods/search?gameId=432&index=0), but the search API only gives at most 10,000 results for each query, so queries will need to be chosen that give less than that many results.

Retrieved from "https://wiki.archiveteam.org/index.php?title=CurseForge&oldid=51639"