WikiTeam
Tools and source code
- WikiTeam Google Code repo (MediaWiki wikis scrapper, it generates a XML dump, very cool;download images if desired too)
- There are many wiki engines, the most famous is MediaWiki. So, the tools must me ready to read data from almost every wiki engine to saved them all.
- Scripts of a guy who saved Wikitravel
Wiki dumps
Wiki | Wiki is online? | Dumps available? (official or home-made) | Comments/Details | Saved by us? Who? Where? |
---|---|---|---|---|
Anarchopedias | - | |||
Archive Team Wiki | Yes | Official: no. Home-made: yes | - | WikiTeam |
Bulbapedia | Yes | Official: no. Home-made: no | - | dr-spangle is working on it with a self-built PHP downloader |
Citizendium | Yes | Official: daily (no full history). Home-made: yes, April 2011 | No image dumps available | |
EditThis | Yes | Official: no. Home-made: in progress | ||
enciclopedia.us.es | Yes | Official: no. Home-made: no | Sysop sent me page text sql tables | emijrp |
Gentoo wikis | Yes | Official: no. Home-made: yes | WikiTeam | |
GNUpedia | No | Official: no. Home-made: no | No database. This "wiki encyclopedia" was only HTML pages. Only ~3 articles were sent to the mailing list. After that, the project was closed | - |
Metapedia | Yes | Official: ?. Home-made: no | - | - |
Neoseeker | Yes | Official: ?. Home-made: no | - | - |
Nupedia | No | Official: ?. Home-made: Yes, saved from IA | - | - |
OmegaWiki | Yes | Official: daily | - | - |
OpenStreetMap | Yes | Official: Yes. Home-made: no | ||
OpenSUSE wikis | Yes | Official: no. Home-made: in progress | - | - |
OSDev | Yes | Official: weekly | - | Not yet |
Scout wikis | ||||
Uncyclomedias | ||||
Wikanda | Yes | Official: no. Home-made: yes | - | emijrp |
Wikia | Yes | Official: on demand | No image dumps available | Not yet |
WikiFur | Yes | Official: yes | No image dumps available | Not yet |
WikiHow | ||||
Wikimedia Commons | Yes | Official: periodically | No image dumps available | Not yet |
Wikipedia | Yes | Official: periodically | No image dumps available. English Wikipedia dump uses to be very old | Not yet |
Wiki-site.com | ||||
WikiTravel | Yes | Official: not yet. Home-made: yes, another of 2010-06-14 | - | WikiTeam |
Tips
Some tips:
- When downloading Wikipedia/Wikimedia Commons dumps, pages-meta-history.xml.7z and pages-meta-history.xml.bz2 are the same, but 7z use to be smaller (better compress ratio), so use 7z.
Closing/In danger
- Gentoo wikis: Error 503 Service Unavailable as of 2011-04-06 http://s23.org/wikistats/gentoo_html.php
Offline wikis and wikifarms
elwiki.com
- 2011
- wik.is
- 2010
- 2009
- 2008
- Scribblewiki (wikifarm)
External links
- http://wikiindex.org - A lot of wikis to save
- http://wiki1001.com/
- http://meta.wikimedia.org/wiki/List_of_largest_wikis
- http://s23.org/wikistats/
- http://en.wikipedia.org/wiki/Comparison_of_wiki_farms
- http://en.wikipedia.org/wiki/User:Emijrp/Wikipedia_Archive
- http://blog.shoutwiki.com/
- http://wikiheaven.blogspot.com/