Difference between revisions of "WikiTeam"

From Archiveteam
Jump to navigation Jump to search
(Added EncyclopediaDramatica.ch (new ED) to the Wiki dumps table)
m (→‎Wiki dumps: Table cleanup)
Line 50: Line 50:
| Bulbapedia || Yes || Official: no. Home-made: no || - || dr-spangle is working on it with a self-built PHP downloader
| Bulbapedia || Yes || Official: no. Home-made: no || - || dr-spangle is working on it with a self-built PHP downloader
|-
|-
| [[Citizendium]] || Yes || Official: [http://en.citizendium.org/wiki/CZ:Downloads daily] (no full history). Home-made: [[Citizendium|yes]], April 2011 || No image dumps available ||  
| [[Citizendium]] || Yes || Official: [http://en.citizendium.org/wiki/CZ:Downloads daily] (no full history). Home-made: [[Citizendium|yes]], April 2011 || No image dumps available || -
|-
|-
| [http://s23.org/wikistats/editthis_html.php EditThis] || Yes || Official: no. Home-made: in progress
| [http://s23.org/wikistats/editthis_html.php EditThis] || Yes || Official: no. Home-made: in progress || - || -
|-
|-
| enciclopedia.us.es || Yes || Official: no. Home-made: no || Sysop sent me page text sql tables || emijrp
| enciclopedia.us.es || Yes || Official: no. Home-made: no || Sysop sent me page text sql tables || emijrp
|-
|-
| [[Encyclopedia Dramatica]] || No || Official: no. Home-made: partial  || WebEcology Project Article Dump (~9000 Articles)<br />Most of the Images probably Lost || &nbsp;
| [[Encyclopedia Dramatica]] || No || Official: no. Home-made: partial  || WebEcology Project Article Dump (~9000 Articles)<br />Most of the Images probably Lost || -
|-
|-
| [[Encyclopedia Dramatica|Encyclopedia Dramatica.ch]]<br />(new ED) || Yes || Official: ? Home-made: ?  || Slowly being rebuilt from old sources.<br />Should be up for a while but for who knows how long? || -
| [[Encyclopedia Dramatica|Encyclopedia Dramatica.ch]]<br />(new ED) || Yes || Official: ? Home-made: ?  || Slowly being rebuilt from old sources.<br />Should be up for a while but for who knows how long? || -
|-
|-
| [http://s23.org/wikistats/gentoo_html.php Gentoo wikis] || Yes || Official: no. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=gentoo yes] || || WikiTeam
| [http://s23.org/wikistats/gentoo_html.php Gentoo wikis] || Yes || Official: no. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=gentoo yes] || - || WikiTeam
|-
|-
| GNUpedia || No || Official: no. Home-made: no || No database. This "wiki encyclopedia" was only HTML pages. Only ~3 articles were sent to the mailing list. After that, the project was closed || -
| GNUpedia || No || Official: no. Home-made: no || No database. This "wiki encyclopedia" was only HTML pages. Only ~3 articles were sent to the mailing list. After that, the project was closed || -
Line 68: Line 68:
| [http://s23.org/wikistats/metapedias_html.php Metapedia] || Yes || Official: ?. Home-made: no || - || -
| [http://s23.org/wikistats/metapedias_html.php Metapedia] || Yes || Official: ?. Home-made: no || - || -
|-
|-
| [http://s23.org/wikistats/scoutwiki_html.php Neoseeker] || Yes || Official: ?. Home-made: no || - || -
| [http://s23.org/wikistats/scoutwiki_html.php Neoseeker] aka Scout wikis || Yes || Official: ?. Home-made: no || - || -
|-
|-
| [[Nupedia]] || No || Official: ?. Home-made: Yes, saved from IA || - || -  
| [[Nupedia]] || No || Official: ?. Home-made: Yes, saved from IA || - || -  
Line 74: Line 74:
| OmegaWiki || Yes || Official: [http://www.omegawiki.org/Development daily] || - || -  
| OmegaWiki || Yes || Official: [http://www.omegawiki.org/Development daily] || - || -  
|-
|-
| OpenStreetMap || Yes || Official: Yes. Home-made: no
| OpenStreetMap || Yes || Official: Yes. Home-made: no || - || -
|-
|-
| [http://s23.org/wikistats/opensuse_html.php OpenSUSE wikis] || Yes || Official: no. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=opensuse in progress] || - || -  
| [http://s23.org/wikistats/opensuse_html.php OpenSUSE wikis] || Yes || Official: no. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=opensuse in progress] || - || -  
|-
|-
| OSDev || Yes || Official: [http://wiki.osdev.org/OSDev_Wiki:About weekly] || - || Not yet
| OSDev || Yes || Official: [http://wiki.osdev.org/OSDev_Wiki:About weekly] || - || Not yet
|-
| [http://s23.org/wikistats/scoutwiki_html.php Scout wikis]
|-
|-
| [http://tvtropes.org TV Tropes] || Yes || Official: No Unofficial: In progress || No dump mechanism, using wget -nc -r -p -l 0 -np -w 45 -E -k -T 10 -nv -x "http://tvtropes.org" || DoubleJ
| [http://tvtropes.org TV Tropes] || Yes || Official: No Unofficial: In progress || No dump mechanism, using wget -nc -r -p -l 0 -np -w 45 -E -k -T 10 -nv -x "http://tvtropes.org" || DoubleJ
|-
|-
| [http://s23.org/wikistats/uncyclomedia_html.php Uncyclomedias]
| [http://s23.org/wikistats/uncyclomedia_html.php Uncyclomedias] || - || - || - || -
|-
|-
| Wikanda || Yes || Official: no. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=wikanda yes] || - || emijrp
| Wikanda || Yes || Official: no. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=wikanda yes] || - || emijrp
Line 92: Line 90:
| [http://wikifur.com WikiFur] || Yes || Official: [http://dumps.wikifur.com/ yes] || No image dumps available || Not yet  
| [http://wikifur.com WikiFur] || Yes || Official: [http://dumps.wikifur.com/ yes] || No image dumps available || Not yet  
|-
|-
| WikiHow  
| WikiHow || - || - || - || -
|-
|-
| [[Wikimedia Commons]] || Yes || Official: [http://dumps.wikimedia.org/commonswiki/latest/ periodically] || No image dumps available || Not yet  
| [[Wikimedia Commons]] || Yes || Official: [http://dumps.wikimedia.org/commonswiki/latest/ periodically] || No image dumps available || Not yet  
Line 98: Line 96:
| [[Wikipedia]] || Yes || Official: [http://dumps.wikimedia.org/backup-index.html periodically] || No image dumps available. English Wikipedia dump uses to be very old || Not yet  
| [[Wikipedia]] || Yes || Official: [http://dumps.wikimedia.org/backup-index.html periodically] || No image dumps available. English Wikipedia dump uses to be very old || Not yet  
|-
|-
| [http://s23.org/wikistats/wikisite_html.php Wiki-site.com]
| [http://s23.org/wikistats/wikisite_html.php Wiki-site.com] || - || - || - || -
|-
|-
|  WikiTravel || Yes || Official: [http://wikitravel.org/en/Wikitravel:Database_dump not yet]. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=wikitravel yes], another of [http://dl.dropbox.com/u/63233/Wikitravel/Complete%20zip/WikitravelComplete14-June-2010.7z 2010-06-14] || - || WikiTeam  
|  WikiTravel || Yes || Official: [http://wikitravel.org/en/Wikitravel:Database_dump not yet]. Home-made: [http://code.google.com/p/wikiteam/downloads/list?can=1&q=wikitravel yes], another of [http://dl.dropbox.com/u/63233/Wikitravel/Complete%20zip/WikitravelComplete14-June-2010.7z 2010-06-14] || - || WikiTeam  

Revision as of 01:08, 1 October 2011

We save wikis, from Wikipedia to tiniest wikis
100 wikis saved to date
WikiTeam
WikiTeam, a set of tools for wiki preservation and a repository of wikis
WikiTeam, a set of tools for wiki preservation and a repository of wikis
URL http://code.google.com/p/wikiteam
Status Online!
Archiving status In progress...
Archiving type Unknown
IRC channel #wikiteam (on hackint)

Welcome to WikiTeam. A wiki is a website that allows the creation and editing of any number of interlinked web pages, generally used to store information on a specific subject or subjects. This is done with a day-to-day web browser using a simplified markup language (HTML as an example) or a WYSIWYG (what-you-see-is-what-you-get) text editor.

Examples of huge wikis:

Most of the wikis don't offer public backups. How bad!

Tools and source code


Wiki dumps

For a more detailed list, visit the download section on Google Code.

There is another site of MediaWiki dumps located here on Scott's Website.

TODO lists:

Wiki Wiki is online? Dumps available? (official or home-made) Comments/Details Saved by us? Who? Where?
Anarchopedias Yes Official: no. Home-made: Yes - idiolect
Archive Team Wiki Yes Official: no. Home-made: yes - WikiTeam
Bulbapedia Yes Official: no. Home-made: no - dr-spangle is working on it with a self-built PHP downloader
Citizendium Yes Official: daily (no full history). Home-made: yes, April 2011 No image dumps available -
EditThis Yes Official: no. Home-made: in progress - -
enciclopedia.us.es Yes Official: no. Home-made: no Sysop sent me page text sql tables emijrp
Encyclopedia Dramatica No Official: no. Home-made: partial WebEcology Project Article Dump (~9000 Articles)
Most of the Images probably Lost
-
Encyclopedia Dramatica.ch
(new ED)
Yes Official: ? Home-made: ? Slowly being rebuilt from old sources.
Should be up for a while but for who knows how long?
-
Gentoo wikis Yes Official: no. Home-made: yes - WikiTeam
GNUpedia No Official: no. Home-made: no No database. This "wiki encyclopedia" was only HTML pages. Only ~3 articles were sent to the mailing list. After that, the project was closed -
MeatBall Yes Official: no. Home-made: yes (mirror) No histories, no xml format SDBoyd
Metapedia Yes Official: ?. Home-made: no - -
Neoseeker aka Scout wikis Yes Official: ?. Home-made: no - -
Nupedia No Official: ?. Home-made: Yes, saved from IA - -
OmegaWiki Yes Official: daily - -
OpenStreetMap Yes Official: Yes. Home-made: no - -
OpenSUSE wikis Yes Official: no. Home-made: in progress - -
OSDev Yes Official: weekly - Not yet
TV Tropes Yes Official: No Unofficial: In progress No dump mechanism, using wget -nc -r -p -l 0 -np -w 45 -E -k -T 10 -nv -x "http://tvtropes.org" DoubleJ
Uncyclomedias - - - -
Wikanda Yes Official: no. Home-made: yes - emijrp
Wikia Yes Official: on demand No image dumps available Not yet
WikiFur Yes Official: yes No image dumps available Not yet
WikiHow - - - -
Wikimedia Commons Yes Official: periodically No image dumps available Not yet
Wikipedia Yes Official: periodically No image dumps available. English Wikipedia dump uses to be very old Not yet
Wiki-site.com - - - -
WikiTravel Yes Official: not yet. Home-made: yes, another of 2010-06-14 - WikiTeam
WikiWikiWeb Yes Home-made: yes - Ca7
(o:forum Yes No - Not yet, to figure out how
WikiWiki.de Yes No - Not yet, to figure out how
GruenderWiki Yes No - Not yet, to figure out how

Tips

Some tips:

  • When downloading Wikipedia/Wikimedia Commons dumps, pages-meta-history.xml.7z and pages-meta-history.xml.bz2 are the same, but 7z use to be smaller (better compress ratio), so use 7z.

BitTorrent downloads

A feed of BitTorrent downloads is available for the latest files posted to the WikiTeam Google Code Downloads.

Files under 1 MB are blocked on the service generating these torrents (Burnbit.com), so not every file is available as a torrent. There may be some delay after a file is uploaded before the torrent appears on the feed. You can subscribe to this feed in your BitTorrent client for automatic downloads (this has been tested successfully in µTorrent on Windows).

Closing/In danger

Offline wikis and wikifarms

elwiki.com

  • 2011
    • wik.is
  • 2010
  • 2009
  • 2008
    • Scribblewiki (wikifarm)

External links