Difference between revisions of "Apple Daily"

From Archiveteam
Jump to navigation Jump to search
(Add en videos)
(Mass-edit to update uses of Template:IRC)
(25 intermediate revisions by 3 users not shown)
Line 2: Line 2:
| title = Apple Daily
| title = Apple Daily
| URL = https://hk.appledaily.com/
| URL = https://hk.appledaily.com/
| project_status = {{endangered}}
| project_status = {{offline}}
| archiving_status = {{inprogress}}
| archiving_status = {{partiallysaved}}
| irc = archiveteam-bs
| irc_network = hackint
}}
}}


'''Apple Daily''' is a Hong Kong newspaper. It is critical of the Chinese government and thus always under pressure. In June 2021, their headquarters were raided (again) by Hong Kong Police, and several key people were arrested, putting its future once again in doubt. Apple Daily has said that their assets have been seized and with no way to pay their staff, Apple Daily is likely going to collapse in the coming days.<ref>https://en.appledaily.com/apple-daily-to-shut-in-days-unless-government-agrees-to-last-ditch-plea-to-unfreeze-assets/JKXIS3OPZNFIFAJWU3PMO2R6R4</ref>
'''Apple Daily''' was a Hong Kong newspaper. It was critical of the Chinese government and thus always under pressure. In June 2021, their headquarters were raided (again) by Hong Kong Police, and several key people were arrested, putting its future once again in doubt. Apple Daily said that their assets have been seized and with no way to pay their staff, Apple Daily is likely going to collapse in the coming days.<ref>https://en.appledaily.com/apple-daily-to-shut-in-days-unless-government-agrees-to-last-ditch-plea-to-unfreeze-assets/JKXIS3OPZNFIFAJWU3PMO2R6R4</ref> Mid-day (UTC) June 21 2021, the newspaper {{URL|https://en.appledaily.com/apple-daily-to-shut-in-days-unless-government-agrees-to-last-ditch-plea-to-unfreeze-assets/JKXIS3OPZNFIFAJWU3PMO2R6R4|announced}} that it was likely to shut down soon. On 2021-06-23 at 23:59 HKT (UTC+8), Apple Daily's website was replaced by a shutdown message.


Mid-day (UTC) June 21 2021, the newspaper [https://en.appledaily.com/apple-daily-to-shut-in-days-unless-government-agrees-to-last-ditch-plea-to-unfreeze-assets/JKXIS3OPZNFIFAJWU3PMO2R6R4 announced] that it is likely to shut down soon, which led (after a rush of people telling ArchiveTeam about it) to a set of panic grabs to capture essential material (for example, the page HTML was captured, but not images), which seem to have been successful. Current work thus focuses on staying updated and getting a more thorough copy of the site.
There is a separate publication of the same name in Taiwan. It is a joint venture between Next Digital (the sole owner of the Hong Kong newspaper) and Taiwanese companies and largely independent.
 
For similar at-risk sites, see [[Hong Kong media]].


== Archival ==
== Archival ==
Line 16: Line 16:
{{URL|https://hk.appledaily.com/}} is the main website of the publication.
{{URL|https://hk.appledaily.com/}} is the main website of the publication.


* Recursive crawl with [[ArchiveBot]] {{inprogress}} since 2021-06-17: {{Job|2u3qbx8mpv42jxi76wq27fbb2}}
* {{partiallysaved}} through recursive crawl with [[ArchiveBot]] started on 2021-06-17: {{Job|2u3qbx8mpv42jxi76wq27fbb2}}
* Article pages listed in the sitemaps {{saved}} through [[URLs]] on 2021-06-21 (no images etc.)
* Article pages listed in the sitemaps {{saved}} through [[URLs]] on 2021-06-21 (no images etc.)
** URLs extracted from the sitemaps by rewby: https://transfer.archivete.am/fzhO1/sorted_urls.txt
** URLs extracted from the sitemaps by rewby: https://transfer.archivete.am/fzhO1/sorted_urls.txt
Line 23: Line 23:
* Videos (M3U8 and TS segments) from article pages extracted by [[User:Jodizzle]] in several parts:
* Videos (M3U8 and TS segments) from article pages extracted by [[User:Jodizzle]] in several parts:
** Part 1 {{saved}} with ArchiveBot on 2021-06-22: https://transfer.archivete.am/15b9yl/hk.appledaily.com-m3u8s-expanded.1.txt and {{Job|atm5u7fjmgegw508c90ty32wi}}
** Part 1 {{saved}} with ArchiveBot on 2021-06-22: https://transfer.archivete.am/15b9yl/hk.appledaily.com-m3u8s-expanded.1.txt and {{Job|atm5u7fjmgegw508c90ty32wi}}
** Part 2 {{inprogress}} with ArchiveBot on 2021-06-22: https://transfer.archivete.am/RZHFJ/hk.appledaily.com-m3u8s-expanded.2.txt and {{Job|183qpki4h8e40cswj2035wqmf}}
** Part 2 {{saved}} with ArchiveBot on 2021-06-22/23: https://transfer.archivete.am/RZHFJ/hk.appledaily.com-m3u8s-expanded.2.txt and {{Job|183qpki4h8e40cswj2035wqmf}}
** More parts {{upcoming}}
** Part 3 {{saved}} with ArchiveBot on 2021-06-23: https://transfer.archivete.am/OIkBX/hk.appledaily.com-m3u8s-expanded.3.txt and {{Job|5ue8wjnyg1gbg1g7x420b5gpg}}
** Part 4 {{saved}} with ArchiveBot on 2021-06-23: https://transfer.archivete.am/CKU9J/hk.appledaily.com-m3u8s-expanded.4.txt and {{Job|91rs9mykjwyxmj5vekc8ol1qf}}
** Part 5 {{saved}} with ArchiveBot on 2021-06-23: https://transfer.archivete.am/11wYuN/hk.appledaily.com-m3u8s-expanded.5.txt and {{Job|cxp0gi0dive8hio7t156y9o3r}}
** Part 6 {{saved}} with ArchiveBot on 2021-06-24: https://transfer.archivete.am/otOy9/hk.appledaily.com-m3u8s-expanded.6.txt and {{Job|9ljog0j9hmnldeezf0stom0e5}}
** Part 7 {{saved}} with ArchiveBot on 2021-06-25: https://transfer.archivete.am/fWFn3/hk.appledaily.com-m3u8s-expanded.7.txt and {{Job|aq23fh1ps9z41xpr0w9wavrap}}
** Part 8 {{saved}} with ArchiveBot on 2021-06-25: https://transfer.archivete.am/BGWhY/hk.appledaily.com-m3u8s-expanded.8.txt and {{Job|avevbq0gi0aatbvkczlnpwj05}}
* Videos (MP4s) from article pages extracted by [[User:Jodizzle]]:
** {{saved}} with ArchiveBot on 2021-06-25/26: https://transfer.archivete.am/9uBqJ/hk.appledaily.com-mp4s.1.txt and {{Job|6nvm0nm0fhhefw3te98sf89mt}}
* Videos (MP4s) from the <code>/archive/YYYYMMDD/</code> daily digests retrieved from the CDN host on 2021-06-23 and extracted by [[User:JustAnotherArchivist]]:
** {{saved}} with ArchiveBot on 2021-06-24/25: https://transfer.archivete.am/HJ9do/hk.appledaily.com-archive-mp4s-0 and {{Job|egb2fhxs2id0eifu6h0hxml4j}}
** {{saved}} with ArchiveBot on 2021-06-24/25: https://transfer.archivete.am/5CTJr/hk.appledaily.com-archive-mp4s-1 and {{Job|3ttbxwgfrs6sylmf2gf0s5ln0}}
** {{saved}} with ArchiveBot on 2021-06-24/25: https://transfer.archivete.am/Y8RPU/hk.appledaily.com-archive-mp4s-2 and {{Job|3uv4cein0hoxevwnp8syf47al}}
** {{saved}} with ArchiveBot on 2021-06-24/25: https://transfer.archivete.am/O6wZq/hk.appledaily.com-archive-mp4s-3 and {{Job|aszu95klth25apfk6ds195fse}}
** {{saved}} with ArchiveBot on 2021-06-24/25: https://transfer.archivete.am/6l0rk/hk.appledaily.com-archive-mp4s-4 and {{Job|26tzgb9lvusg1xqkf2tpu33cz}}
** All videos (including M3U8) from that retrieval with a bit of extra info: https://transfer.archivete.am/IJGRu/hk.appledaily.com-archive-videos.zst
*** M3U8s + TS segments not present in jodizzle's M3U8s part 1 through 8:
**** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.notkiska.pw/GtmmC/hk.appledaily.com-archive-m3u8s.1.txt and {{Job|bp57iwrotlupgd7ce2fqtny4l}} (Note: This list ''does'' contain the TS segments, even though the filename lacks the '-expanded' term.)
***** {{saved}} with ArchiveBot on 2021-06-29: https://transfer.archivete.am/13w5i3/hk.appledaily.com-archive-hd.m3u8s and {{Job|2q9fyohs6x0spikra93irji3c}}, containing the top-level 'hd.m3u8' URLs accidentally left out of {{Job|bp57iwrotlupgd7ce2fqtny4l}}.
* Videos from dav3's video list that aren't in the lists above (jodizzle M3U8 part 1 through 8, jodizzle MP4, JAA parts 0 through 4):
** Original list: https://transfer.archivete.am/rtGCF/hk%20appledaily%20video%20data%202014-2021.zip (rehosted from https://mega.nz/file/UgNU2DTD#mycIn1NqzWHEHhnPi2q45cM7PqiGyzHRC-Aw_OPUI0g)
** Filtered: https://transfer.archivete.am/4O5K7/hk.appledaily.com-dav3-video-urls-filtered.zst
** MP4s {{saved}} with ArchiveBot on 2021-06-25: https://transfer.archivete.am/6J3RF/hk.appledaily.com-dav3-mp4s-filtered and {{Job|2b40d56koxillrhd8ibox0fs}}
** M3U8s + TS segments {{saved}} with ArchiveBot on 2021-06-26: https://transfer.notkiska.pw/PbHyb/hk.appledaily.com-dav3-m3u8s-filtered-expanded and {{Job|p60jidwl73jsjlxh30ki5sv9}}
*** {{saved}} with ArchiveBot on 2021-06-29: https://transfer.archivete.am/GnFAl/hk.appledaily.com-dav3-m3u8s-filtered and {{Job|l9gobcqcm9saq3e1aynbhfsx}}, containing the 'hd.m3u8' URLs accidentally left out of {{Job|p60jidwl73jsjlxh30ki5sv9}}.
** Fixed file for part of that list: https://transfer.archivete.am/14x3GF/video_data_2014-2018_V2.zip (rehosted from https://mega.nz/file/V18g3B6b#JXAAje1bTPNox-z-vdIEN5cPLdZbQWu48K4ePfybs1w)
** Extra videos (all MP4s) {{saved}} with ArchiveBot on 2021-06-25: https://transfer.archivete.am/hoAU8/hk.appledaily.com-dav3-video-urls-v2-filtered and {{Job|2j0045cs5s8nis2st7j04yo4j}}
* Original article images:
** The site used a resizing service thing to dynamically resize images as needed. The URLs for these resized images contain the references for the original images.
** dav3's list: https://transfer.archivete.am/xSRbu/2014-2018_image_data.zip (rehosted from https://mega.nz/file/40cVHKJa#oK1FOJibRxhB4ZjdgMyfh2_RWR3nZ0U38SBsGuQI08U) and https://transfer.archivete.am/DtK5q/2019-2021_image_data.zip (rehosted from https://mega.nz/file/NoNDASRL#NCG5tNkoh2kC9U4MqEQBALePvTOI8q9kLq07YB_ZcNA)
** ArchiveBot {{Job|2u3qbx8mpv42jxi76wq27fbb2}} list: https://transfer.archivete.am/UmdL5/hk.appledaily.com-images.zst
*** Post-processing of the resizer URLs: <code><nowiki>perl -pe 's,^https?://[^/]+/resizer/[^/]+/(\d+x\d+/)?(filters:quality\(\d+\)/)?,,; s,^([^/.]+)/,https://\1.s3.amazonaws.com/,; s,^(?!https?://),https://,'</nowiki></code>
** ArchiveBot {{Job|cq818fq2c4576r7ebyokwt1q2}} (Twitter account) list: https://transfer.archivete.am/PSAGY/twitter-@appledaily_hk-images.zst
** dav3's list {{partiallysaved}} with ArchiveBot {{Job|7aj3s1gn5re97wawqazi1655x}}; aborted in favour of the combination below.
** Combination of the three lists, 995804 images in total (with some duplicates served from different URLs) in separate parts:
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/FIO8h/hk.appledaily.com-images-originals-0 and {{Job|52oyc1wd8infujsq1rnjvfwn5}}
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/DmA8n/hk.appledaily.com-images-originals-1 and {{Job|cd8oqtrwztsdqjhltylyn4uhj}}
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/xRkYE/hk.appledaily.com-images-originals-2 and {{Job|6u6aabikwqa99r4a1v86gsah7}}
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/FCAyB/hk.appledaily.com-images-originals-3 and {{Job|eglpde69zgo6tlj3hdcivm3w1}}
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/zpHrq/hk.appledaily.com-images-originals-4 and {{Job|85svti0acvfh6xqq4ckxrwnl5}}
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/rvH51/hk.appledaily.com-images-originals-5 and {{Job|79s4sfex2pbuyiz0biworqwng}}
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/13LurA/hk.appledaily.com-images-originals-6 and {{Job|aeqrverzldgvwhdjzvbv5vcdy}}
*** {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/5ablC/hk.appledaily.com-images-originals-7 and {{Job|b4ns4i46kkgjw377ds5qid2q1}}
* Another list from dav3 for the last few days, containing images and videos: https://transfer.archivete.am/UnV7C/20210620-20210622_image_video_urls.zip (rehosted from https://mega.nz/file/wp10zBaY#8QQ21fqaFl_b1JRdOSx4Gy4axJSG97hX5RTpZQvuYLs)
** Images {{saved}} with ArchiveBot on 2021-06-26: https://transfer.archivete.am/fQ2GL/hk.appledaily.com-images-originals-8 and {{Job|91dvawyx0x6oii63d81wi0kg4}}


=== Others ===
=== Others ===
* https://en.appledaily.com/ {{inprogress}}
* https://en.appledaily.com/ {{saved}}
** {{partiallysaved}} by recursive crawls with ArchiveBot on 2021-06-18 and 2021-06-21: {{Job|5d3od6h5d3g2dsc39q79er9s3}}
** {{partiallysaved}} by recursive crawls with ArchiveBot on 2021-06-18 and 2021-06-21: {{Job|5d3od6h5d3g2dsc39q79er9s3}}
*** Incomplete because the site uses JavaScript pagination and the sitemap only returns articles from the past month.
*** Incomplete because the site uses JavaScript pagination and the sitemap only returns articles from the past month.
** Full pagination {{saved}} with ArchiveBot on 2021-06-22: https://transfer.archivete.am/8QFjZ/en.appledaily.com-pagination and {{Job|dhpyv9xtvusns9tu4zxbsc8mb}}
** Full pagination {{saved}} with ArchiveBot on 2021-06-22: https://transfer.archivete.am/8QFjZ/en.appledaily.com-pagination and {{Job|dhpyv9xtvusns9tu4zxbsc8mb}}
** Articles from the pagination {{inprogress}} with ArchiveBot and [[URLs]]: https://transfer.archivete.am/12W4cM/en.appledaily.com-articles and {{Job|18htae9bm7std751bvsz9qcuo}}
** Articles from the pagination {{saved}} with ArchiveBot and [[URLs]]: https://transfer.archivete.am/12W4cM/en.appledaily.com-articles and {{Job|18htae9bm7std751bvsz9qcuo}}
** Images in the pagination (thumbnails as well as resizer part stripped for the original image) {{inprogress}} with ArchiveBot: https://transfer.archivete.am/15G3Pz/en.appledaily.com-article-thumbnails and {{Job|a3gqk6jomr56l4eq8m5i3nva4}}
** Images in the pagination (thumbnails as well as resizer part stripped for the original image) {{saved}} with ArchiveBot: https://transfer.archivete.am/15G3Pz/en.appledaily.com-article-thumbnails and {{Job|a3gqk6jomr56l4eq8m5i3nva4}}
** Videos for articles with a video indication on the pagination {{inprogress}} with ArchiveBot: https://transfer.archivete.am/HjaVv/en.appledaily.com-videos.zst and {{Job|7nu86pb9qmoq7s8fgzly9dwq7}}
** Videos for articles {{saved}} with ArchiveBot: https://transfer.archivete.am/HjaVv/en.appledaily.com-videos.zst and {{Job|7nu86pb9qmoq7s8fgzly9dwq7}}
* https://twitter.com/appledaily_hk {{saved}} via socialbot/ArchiveBot on 2021-06-17: {{Job|cq818fq2c4576r7ebyokwt1q2}}
* https://twitter.com/appledaily_hk {{saved}} via socialbot/ArchiveBot on 2021-06-17: {{Job|cq818fq2c4576r7ebyokwt1q2}}
* https://t.me/appledailyhk {{saved}} via ArchiveBot on 2021-06-18: {{Job|bledkz91htfdcampuoj6citd0}}
* https://t.me/appledailyhk {{saved}} via ArchiveBot on 2021-06-18: {{Job|bledkz91htfdcampuoj6citd0}}
* https://www.youtube.com/c/蘋果動新聞HKAppleDaily (aka [https://www.youtube.com/user/appleactionews /user/appleactionews] and [https://www.youtube.com/channel/UCeqUUXaM75wrK5Aalo6UorQ /channel/UCeqUUXaM75wrK5Aalo6UorQ]): over 70000 videos in the stash of {{IRC|youtubearchive|network=hackint}} as of 2021-06-22 through repeated downloads; the actual channel only has [https://www.youtube.com/playlist?list=UUeqUUXaM75wrK5Aalo6UorQ 19937 videos] as of 2021-06-22 12:05 UTC
* https://www.youtube.com/c/蘋果動新聞HKAppleDaily (aka [https://www.youtube.com/user/appleactionews /user/appleactionews] and [https://www.youtube.com/channel/UCeqUUXaM75wrK5Aalo6UorQ /channel/UCeqUUXaM75wrK5Aalo6UorQ]): over 70000 videos in the stash of {{IRC|youtubearchive}} as of 2021-06-22 through repeated downloads; the actual channel only has [https://www.youtube.com/playlist?list=UUeqUUXaM75wrK5Aalo6UorQ 19937 videos] as of 2021-06-22 12:05 UTC
** Metadata from Playboard collected by thuban and {{saved}} with ArchiveBot since 2021-06-24: https://transfer.archivete.am/P369h/appledaily_videos_playboard_urls.txt and {{Job|cpieggl3v90dvbhburt02m5n1}}
* https://www.youtube.com/channel/UCCzKM7UMxGCPAgUDXmFw5Gg: 15525 videos in the youtubearchive stash and actual channel unavailable as of 2021-06-26
** Metadata from Playboard collected by thuban and {{saved}} with ArchiveBot on 2021-06-25/26: https://transfer.archivete.am/J0QXS/playboard_UCCzKM7UMxGCPAgUDXmFw5Gg_urls.txt.zst and {{Job|61s5bai6nzgotm2ijcf6tc2fb}}
* https://www.youtube.com/channel/UC-8CVMKt5Zlju_i07zhkC-Q: 25k videos in the youtubearchive stash and actual channel unavailable as of 2021-06-26
** Metadata from Playboard collected by thuban and {{saved}} with ArchiveBot on 2021-06-25/26: https://transfer.archivete.am/dDyMC/playboard_UC-8CVMKt5Zlju_i07zhkC-Q_urls.txt.zst and {{Job|6vwi7e1gfa5qfylqvg8ttzg78}}
* https://tw.appledaily.com/ {{inprogress}} via ArchiveBot since 2021-06-21: {{Job|71oq3dclnbywik2r2233a72cj}}
* https://tw.appledaily.com/ {{inprogress}} via ArchiveBot since 2021-06-21: {{Job|71oq3dclnbywik2r2233a72cj}}
** The Taiwanese publication is at least partly independent from the Hong Kong one and likely less at risk.
** The Taiwanese publication is at least partly independent from the Hong Kong one and likely less at risk. It is still online as of 2021-06-23 18:10 UTC.
* https://www.nextdigital.com.hk/ {{saved}} via ArchiveBot on 2021-06-23: {{Job|bey80bq7khf228engfjl7588h}}
* Countless obscure subdomains {{saved}} (some likely {{partiallysaved}}) with ArchiveBot on 2021-06-21:
* Countless obscure subdomains {{saved}} (some likely {{partiallysaved}}) with ArchiveBot on 2021-06-21:
** http://arc-static.appledaily.com/
** http://arc-static.appledaily.com/

Revision as of 19:12, 31 October 2021

Apple Daily
URL https://hk.appledaily.com/
Status Offline
Archiving status Partially saved
Archiving type Unknown
IRC channel #archiveteam-bs (on hackint)

Apple Daily was a Hong Kong newspaper. It was critical of the Chinese government and thus always under pressure. In June 2021, their headquarters were raided (again) by Hong Kong Police, and several key people were arrested, putting its future once again in doubt. Apple Daily said that their assets have been seized and with no way to pay their staff, Apple Daily is likely going to collapse in the coming days.[1] Mid-day (UTC) June 21 2021, the newspaper announced[IAWcite.todayMemWeb] that it was likely to shut down soon. On 2021-06-23 at 23:59 HKT (UTC+8), Apple Daily's website was replaced by a shutdown message.

There is a separate publication of the same name in Taiwan. It is a joint venture between Next Digital (the sole owner of the Hong Kong newspaper) and Taiwanese companies and largely independent.

For similar at-risk sites, see Hong Kong media.

Archival

hk.appledaily.com

https://hk.appledaily.com/[IAWcite.todayMemWeb] is the main website of the publication.

Others