Talk:US Government

Before starting this project

Some US government websites like The Electronic Code of Federal Regulations (ecfr.gov) may block your IP address from scraping, redirecting you to instead https://unblock.federalregister.gov when running the project and viewing the log(s). For instance,

 Received item 'https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182' from tracker
 Starting PrepareDirectories for Item https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182
 Finished PrepareDirectories for Item https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182
 Starting WgetDownload for Item https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182
 Using global timeout 40
 Bad redirect to https://unblock.federalregister.gov.
 1=302 https://drafting.ecfr.gov/on/2024-09-09/title-47/section-27.1182

This means you will need to manually visit https://unblock.federalregister.gov request access from your IP address and complete the captcha as required. It is also not a set-and-forget process, as you may need to do this again in the next three months month or so.

Anonymoususer852 (talk) 23:48, 17 August 2025 (UTC)