Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.History is littered with hundreds of conflicts over the future of a community, group, location or business that were "resolved" when one of the parties stepped ahead and destroyed what was there. With the original point of contention destroyed, the debates would fall to the wayside. Archive Team believes that by duplicated condemned data, the conversation and debate can continue, as well as the richness and insight gained by keeping the materials. Our projects have ranged in size from a single volunteer downloading the data to a small-but-critical site, to over 100 volunteers stepping forward to acquire terabytes of user-created data to save for future generations.
The main site for Archive Team is atarchiveteam.org and contains up to the date information on various projects, manifestos, plans and walkthroughs.
This collection contains the output of many Archive Team projects, both ongoing and completed. Thanks to the generous providing of disk space by the Internet Archive, multi-terabyte datasets can be made available, as well as in use by theWayback Machine, providing a path back to lost websites and work.
Our collection has grown to the point of having sub-collections for the type of data we acquire. If you are seeking to browse the contents of these collections, the Wayback Machine is the best first stop. Otherwise, you are free to dig into the stacks to see what you may find.
The Archive Team Panic Downloads are full pulldowns of currently extant websites, meant to serve as emergency backups for needed sites that are in danger of closing, or which will be missed dearly if suddenly lost due to hard drive crashes or server failures.
To use ArchiveBot, drop by #archivebot on EFNet. To interact with ArchiveBot, you issue commands by typing it into the channel. Note you will need channel operator permissions in order to issue archiving jobs. The dashboard shows the sites being downloaded currently.
There is a dashboard running for the archivebot process athttp://www.archivebot.com.
ArchiveBot's source code can be found athttps://github.com/ArchiveTeam/ArchiveBot.

Comprehensive Perl Archive NetworkStop reinventing wheels, start building space rockets |
How to install CPAN modulesHere are some recommended approaches to installing modules from CPAN, as with much of Perl there are several alternatives. Some basicsMost Perl modules are written in Perl, some useXS (they are written inC) so require a Ccompiler (it's easy to get this setup - don't panic), see your OS of choice below to find out how to get the right compiler. Modules may have dependencies on other modules (almost always onCPAN) and cannot be installed without them (or without a specific version of them). It is worth throughly reading the documentation for the options below. Many modules on CPAN require a somewhat recent version of Perl (version 5.8 or above). Quick start Install cpan App::cpanminus Now install any module you canfind. cpanm Module::Name ToolsTo help you install and manage your modules: local::lib enables you to install modules into a specified directory, without requiring root or administrator access. See the bootstrapping technique for how to get started. You can create a directory per user/project/company and deploy to other servers, by copying the directory (as long as you are on the same operating system and perl version). cpanm fromApp::cpanminus is a script to get, unpack, build and install modules from CPAN. It's dependency free (can bootstrap itself) and requires zero configuration (install instructions). It automates the entire build process for the majority of modules on CPAN and works well withlocal::lib andperlbrew. Many experienced Perl developers use this as their tool of choice. Related tools:cpan-outdated,pm-uninstall,cpan-listchanges. perlbrew fromApp::perlbrew is useful if your system perl is too old to support modern CPAN modules, or if it's troublesome in other capacities (RedHat/CentOS are included in this list). perlbrew makes the process of installing a Perl in any directory much easier, so that you can work completely independently of any system Perl without needing root or administrator privileges. You can use multiple versions of Perl (maybe as you upgrade) across different projects. The separation from your system Perl makes server maintenance much easier and you more confident about how your project is setup. Currently Windows is not supported. cpan fromCPAN has been distributed with Perl since 1997 (5.004). It has many more options thancpanm, it is also much more verbose. cpanp fromCPANPLUS had been distributed with Perl since 5.10 (2007) until 5.20 (2014). This offers even more options thancpanm orcpan and can be installed just like cpanminus. Perl on Windows (Win32 and Win64)Strawberry Perl is an open source binary distribution of Perl for the Windows operating system. It includes a compiler and pre-installed modules that offer the ability to install XS CPAN modules directly from CPAN. It also comes with lots of modules pre-installed, includingcpanm. ActiveState provide a binary distribution of Perl (for many platforms), as well as their ownperl package manager (ppm). Some modules are not available as ppm's or have reported errors on the ppm build system, this does not mean they do not work. You can use thecpan script to build modules from CPAN against ActiveState Perl. Perl on Mac OSXOSX comes with Perl pre-installed. in order to build and install your own modules you will need to install the "Command Line Tools for XCode" or "XCode" package - details on our ports page. Once you have done this you can use all of the tools mentioned above. Perl on other Unix like OSsInstall 'make' through your package manager. You can then use all of the tools mentioned above. Other toolsCPAN::Mini can provide you with a minimal mirror ofCPAN (just the latest version of all modules). This makes working offline easy. CPAN::Mini::Inject allows you to add your own modules to your local CPAN::Mini mirror of CPAN. So you can install and deploy your own modules through the same tools you use for CPAN modules. Which modules should I use?Task::Kensho lists suggested best practice modules for a wide range of tasks.https://metacpan.org/ will let you search CPAN. You could also get involved with thecommunity, ask on amailing list or find your nearestPerl Mongers group. |
Yours Eclectically, The Self-Appointed Master Librarians (OOK!) of the CPAN. |