Talk:US Government
Revision as of 23:48, 17 August 2025 by Anonymoususer852 (talk | contribs) (Updating comment as I was redirected to the same page in less than 3 months.)
Before starting this project
Some US government websites like The Electronic Code of Federal Regulations (ecfr.gov) may block your IP address from scraping, redirecting you to instead https://unblock.federalregister.gov when running the project and viewing the log(s). For instance,
Received item 'https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182' from tracker Starting PrepareDirectories for Item https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182 Finished PrepareDirectories for Item https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182 Starting WgetDownload for Item https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182 Using global timeout 40 Bad redirect to https://unblock.federalregister.gov. 1=302 https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182
This means you will need to manually visit https://unblock.federalregister.gov request access from your IP address and complete the captcha as required. It is also not a set-and-forget process, as you may need to do this again in the next three months month or so.
Anonymoususer852 (talk) 23:48, 17 August 2025 (UTC)