Difference between revisions of "Elections/2021 UK elections"
Jump to navigation
Jump to search
(Added link to twitter scrape output.) |
(Updated link to twitter scrape with smaller list, de-duplicated from previous (2019 UK general election) scrape) |
||
| Line 11: | Line 11: | ||
After processing this data, the end result is as follows: | After processing this data, the end result is as follows: | ||
* 3904 [https://web.archive.org/web/20210509115449/https://www.tardis.ed.ac.uk/~andrewferguson/uk_elections_2021_betamax/twitter-usernames.txt Twitter usernames] of political parties / candidates<br />[[User:Betamax]] ran a manual [https://github.com/JustAnotherArchivist/snscrape scrape] to grab the tweets (with media and outlinks). This produced a [https://web.archive.org/web/ | * 3904 [https://web.archive.org/web/20210509115449/https://www.tardis.ed.ac.uk/~andrewferguson/uk_elections_2021_betamax/twitter-usernames.txt Twitter usernames] of political parties / candidates<br />[[User:Betamax]] ran a manual [https://github.com/JustAnotherArchivist/snscrape scrape] to grab the tweets (with media and outlinks). This produced a [https://web.archive.org/web/20210511192808/https://www.tardis.ed.ac.uk/~andrewferguson/uk_elections_2021_betamax/uk_elections_2021_twitter_scrape.txt list] (900MB in size) list containing 17.8 million URLs (13.1 million tweets plus outlinks and media links). | ||
* 4175 [https://web.archive.org/web/20210509115426/https://www.tardis.ed.ac.uk/~andrewferguson/uk_elections_2021_betamax/facebook-url.txt Facebook pages] | * 4175 [https://web.archive.org/web/20210509115426/https://www.tardis.ed.ac.uk/~andrewferguson/uk_elections_2021_betamax/facebook-url.txt Facebook pages] | ||
* 318 [https://web.archive.org/web/20210509115431/https://www.tardis.ed.ac.uk/~andrewferguson/uk_elections_2021_betamax/instagram-urls.txt Instagram profiles] | * 318 [https://web.archive.org/web/20210509115431/https://www.tardis.ed.ac.uk/~andrewferguson/uk_elections_2021_betamax/instagram-urls.txt Instagram profiles] | ||
Revision as of 19:32, 11 May 2021
The 2021 UK elections were not a general election, but were a series of elections held across the UK:
- Council, Constabulary and Mayoral elections in England
- Welsh Parliament elections in Wales
- Scottish Parliament elections in Scotland
Work based upon Democracy Club information
User:Betamax collected and processed data from Democracy Club, a UK non-profit organisation with crowdsourced information on candidates and political parties for the elections. In particular, the Candidate Database was particularly helpful, although several other spreadsheets were also provided by members of Democracy Club.
After processing this data, the end result is as follows:
- 3904 Twitter usernames of political parties / candidates
User:Betamax ran a manual scrape to grab the tweets (with media and outlinks). This produced a list (900MB in size) list containing 17.8 million URLs (13.1 million tweets plus outlinks and media links). - 4175 Facebook pages
- 318 Instagram profiles
- 89 Youtube channels (and a Dailymotion channel) used by parties / candidates
- 530 Political Party websites
This has been further processed down to 522 websites: reprocessed list. - 1273 Candidate Websites
This has been further processed down to 1101 websites: reprocessed list. - 2503 Candidate Web pages (these have been linked to separately and include manifestos, etc... - there will likely be a large overlap between these pages and the candidate websites, but I think it is best to archive these as well).
Completed as ArchiveBot Job ID 32g60eq89ir3jt7xm7htfrk81