SourceForge

From Archiveteam
Revision as of 22:20, 17 June 2015 by Start (talk | contribs) (sourceforge.jp is a completely different website)
Jump to navigation Jump to search
SourceForge
SourceForge.png
URL sourceforge.net[IAWcite.todayMemWeb]
Status Online!
Archiving status In progress...
Archiving type Unknown
Project source sourceforge-grab, sourceforge-grab-rsync
Project tracker sourceforge, sourceforgersync
IRC channel #coldstorage (on hackint)

SourceForge is a free software repository.

It's really old, ad supported, adware supported. And yet, it is still alive.

It hosts code migrated from BerliOS[1] which shut down.

Shutdown?

2015: Removal of FRS Area

Hello,
You have been identified as having saved files in you user FRS profile area (/home/pfs/<username>. We are planning on removing this
area for user accounts on March 17th 2015. We wanted to give you the opportunity to move your data to a new location before we
remove the data. Here is a link that should help you with moving your data:
https://sourceforge.net/p/forge/documentation/SFTP/
If you need any help please contact us.
Thanks
SourceForge.net Support
sfnet_ops@slashdotmedia.com
https://sourceforge.net/support

[2]

2015: Admins hijacking projects to add more adware

http://lwn.net/SubscriberLink/646118/f8f6483b64fdafb9/

Site Structure

Download files can be found on public ftp mirrors, priority on the rest of the site then download files last? e.g. http://www.mirrorservice.org/sites/ftp.sourceforge.net/

CVS/svn/git/hg/bzr repositories should be a priority; many projects do not have their source code on the ftp mirrors.

The main API is documented here: http://sourceforge.net/p/forge/documentation/Allura%20API/ and allows unauthenticated access to most services. It also can indicate what revision control system is used.

Appropriate tools, (such as git clone -m and svnrdump) can be used to backup, but SF suggests using rsync regardless of the actual revision control system used.

How can I help?

There are two projects: one that grabs the web content and a copy of the binaries, and another that grabs the sourcecode repositories via rsync.

For both, you can choose selecting the project in the Warrior appliance (only one of them), or set up and run the script(s) manually.

Web grab

Warrior: SourceForge

Script: http://github.com/ArchiveTeam/sourceforge-grab

Code rsync

Warrior: SourceForge Rsync

Script: http://github.com/ArchiveTeam/sourceforge-grab-rsync

IMPORTANT: in case of the rsync project, an item might be even tens (in rare cases, hundreds) of gigabytes in size! If you don't have very much free disk space, don't use high concurreny level!

General info for script runners

Read the instructions (README) of the corresponding repository.

Some additional information
Don't forget to replace YOURNICKHERE with your nickname.

The number after --concurrent determines how many threads run at the same time. You can increase this number if your resources (RAM, CPU, HDD, bandwidth) are sufficient. However, if you constantly see messages about rate limiting, there is no need to increase the concurrency.

If you want to stop the script, please do it gracefully if possible. To do so, create an empty file named STOP in the folder of the script (terminal command: touch STOP). The script finishes the current item(s) and stops only after that. (If you kill the script immediately, the items get broken, and they will need to be reassigned to another user.) – Before starting the script again, don't forget to remove the STOP file.

If you see "Project code is out of date", kill the script, go to its folder and issue git pull REPOSITORY, where REPOSITORY stands for the URL of either the sourceforge-grab or the sourceforge-grab-rsync repository, see above. After the updating has finished, re-launch the script.

Donating to the Internet Archive

Content downloaded by the ArchiveTeam will be uploaded to the Internet Archive, where it will be stored and be available – hopefully – forever. However, storing it costs thousands of dollars in the long run. So, if you can afford, please consider donating to the Internet Archive, so that this piece of history can be kept for us all. http://archive.org/donate

Do you like our cause?

If you want to help in other projects, want to learn more about ArchiveTeam, or even help in development in general, navigate to the Main Page of this wiki, from there you can reach a lot of information. The Team consists of volunteers working on the projects in their free time, so helping hands (and resources) are always welcome.

References

External links