High Throughput, High Performance Computing

Our building has its own compute cluster, which utilizes the HTCondor queuing software. Cluster documentation on running and submitting jobs can be found at: https://kb.wisc.edu/discovery/page.php?id=56602.

CHTC also provides How To’s on running condor jobs at: https://chtc.cs.wisc.edu/uw-research-computing/how-tos.html

Condor jobs to the Discovery Condor Pool should be started from submit1.wid.wisc.edu. Add the following line to your submit file to get the highest priority for your job:

+group = “WID”

Research Software

DiscoverIT staff encourage users to install and compile their desired software (and version) within their project directory. This allows specific, consistent, on-demand, version-locked software packages to be available for all types of research. If you would like help with installing software for your use on the Discovery Compute Cluster, email support@discovery.wisc.edu.

Some software packages, like Matlab, are installed centrally if they require a license or are particularly difficult to install. See
https://kb.wisc.edu/discovery/130167 for more information on Modules.

Optimization Cluster Software

Email support@discovery.wisc.edu if you need additional software installed.

Local Python Libraries: Cython, Ipython, numexpr, scipy, pytables, matplotlib
Licensed Software in /progs: ampl, CPLEX, Gams, Gurobi, MATLAB
NOTE: Additional software is available in /mnt/ws/progs

CPLEX Environment Variables:

export ILOG_LICENSE_FILE=/progs/CPLEX_Studio/access.ilm
PATH=${PATH}:/progs/CPLEX_Studio/cplex/bin/x86-64_sles10_4.1

Gurobi Environment Variables:

(Gurobi is currently (12/15/15) at v6.5)

export GUROBI_HOME="/progs/gurobi/linux64"
export PATH="${PATH}:${GUROBI_HOME}/bin"
export LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:${GUROBI_HOME}/lib"
export GRB_LICENSE_FILE="/progs/gurobi/gurobi.lic"

For increased priority running HTCondor jobs on the Optimization Cluster, add the following line to your submit file:

+WIDsTheme = "Optimization"

If you need to utilize all the resources on an optimization machine, you are able to turn off condor by running:

/usr/sbin/condor_off -peaceful

. If you need to stop all currently running condor jobs NOW, you can leave off -peaceful but that may kill very long running jobs. Once you are done with your work, please remember to run:

/usr/sbin/condor_on