| HTCondor | |
|---|---|
| Developer | University of Wisconsin–Madison |
| Stable release | 24.0.12 / September 23, 2025; 2 months ago (2025-09-23) |
| Preview release | 24.12.4 / September 23, 2025; 2 months ago (2025-09-23) |
| Repository | |
| Written in | C++,Python,Perl |
| Operating system | Microsoft Windows,Mac OS X,Linux,FreeBSD |
| Type | High-Throughput Computing |
| License | Apache License 2.0 |
| Website | htcondor |
HTCondor is anopen-sourcehigh-throughput computing software framework for coarse-grained distributed parallelization of computationally intensive tasks.[1]It can be used to manage workload on a dedicatedcluster of computers, or to farm out work to idle desktop computers – so-calledcycle scavenging. HTCondor runs onLinux,Unix,Mac OS X,FreeBSD, andMicrosoft Windowsoperating systems. HTCondor can integrate both dedicated resources (rack-mounted clusters) and non-dedicated desktop machines (cycle scavenging) into one computing environment.
HTCondor is developed by the HTCondor team at theUniversity of Wisconsin–Madison and is freely available for use. HTCondor follows anopen-source philosophy and is licensed under theApache License 2.0.[2]
While HTCondor makes use of unused computing time, leaving computers turned on for use with HTCondor will increase energy consumption and associated costs. Starting from version 7.1.1, HTCondor can hibernate and wake machines based on user-specified policies, a feature previously available only via third-party software.
The development of HTCondor started in 1988.
HTCondor was formerly known as Condor; the name was changed in October 2012 to resolve a trademark lawsuit.[3]
HTCondor was the scheduler software used to distribute jobs for the first draft assembly of the Human Genome.
TheNASA Advanced Supercomputing facility (NAS) HTCondor pool consists of approximately 350SGI andSun workstations purchased and used for software development, visualization, email, document preparation, and other tasks. Each workstation runs adaemon that watches userI/O and CPU load. When a workstation has been idle for two hours, a job from the batch queue is assigned to the workstation and will run until the daemon detects a keystroke, mouse motion, or high non-HTCondor CPU usage. At that point, the job will be removed from the workstation and placed back on the batch queue.
HTCondor can run both sequential and parallel jobs. Sequential jobs can be run in several different "universes", including "vanilla" which provides the ability to run most "batch ready" programs, and "standard universe" in which the target application is re-linked with the HTCondor I/O library which provides for remote job I/O and job checkpointing. HTCondor also provides a "local universe" which allows jobs to run on the "submit host".
In the world of parallel jobs, HTCondor supports the standardMessage Passing Interface andParallel Virtual Machine (Goux, et al. 2000) in addition to its own Master Worker "MW" library for extremely parallel tasks.
HTCondor-G allows HTCondor jobs to use resources not under its direct control.It is mostly used to talk togrid andcloud resources, like pre-WS and WS Globus,Nordugrid ARC,UNICORE andAmazon Elastic Compute Cloud.But it can also be used to talk to other batch systems, likeTorque/PBS andLSF. Support forSun Grid Engine is currently under development as part of theEGEE project.[citation needed]
Other HTCondor features include "DAGMan" which provides a mechanism to describe job dependencies.
