CCTools 5.0.0 released

The Cooperative Computing Lab is pleased to announce the release of version 5.0.0 of the Cooperative Computing Tools including Parrot, Chirp, Makeflow, WorkQueue, SAND, All-Pairs, Weaver, and other software.
The software may be downloaded here: CCTools download
This is a major release that incorporates the preview of three new tools:

  • [Confuga] An active storage cluster file system built on top of Chirp. It is used as a collaborative distributed file system and as a platform for execution of scientific workflows with full data locality for all job dependencies. (Patrick Donnelly)
  • [Umbrella] A tool for specifying and materializing comprehensive execution environments. Once a task is specified, Umbrella determines the minimum mechanism necessary to run it such as, direct execution, a system container, a local virtual machine, or submission to a cloud or grid environment. (Haiyan Meng).
  • [Prune] A system for executing and precisely preserving scientific workflows. Collaborators can verify research results and easily extend them at a granularity determined by the user. (Peter Ivie)

This release adds several features and several bug fixes. Among them:

  • [AllPairs] Support for symmetric matrices. (Haiyan Meng)
  • [Chirp] Perl and python bindings. (Ben Tovar)
  • [Chirp] Improvements to the job interface. (Patrick Donnelly)
  • [Makeflow] Improved Graphviz's dot output. (Nate Kremer-Herman)
  • [Makeflow] Support for command wrappers. (Douglas Thain)
  • [Parrot] Several bug fixes for CVMFS-based applications. (Jakob Blomer, Patrick Donnelly)
  • [Parrot] Valgrind support. (Patrick Donnelly)
  • [Resource Monitor] Library for polling resources. (Ben Tovar)
  • [WorkQueue] Signal handling bug fixes. (Andrey Tovchigrechko)
  • [WorkQueue] Log visualizer. (Ryan Boccabella)
  • [WorkQueue] work_queue_worker support for Docker. (Charles Zheng)
  • [WorkQueue] Improvements to perl bindings. (Ben Tovar)
  • [WorkQueue] Support to blacklist workers. (Nick Hazekamp)

Incompatibility warnings: Workers from 5.0 do not work with masters pre 5.0.
Thanks goes to the contributors for many features and bug fixes:

Matthew Astley, Jakob Blomer, Ryan Boccabella, Peter Bui, Patrick Donnelly, Nathaniel Kremer-Herman, Victor Hawley, Nicholas Hazekamp, Peter Ivie, Kangkang Li, Haiyan Meng, Douglas Thain, Ben Tovar, Andrey Tovchigrechko, and Charles Zheng.
Please send any feedback to the CCTools discussion mailing list: mailing list
Enjoy!




Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • Scaling SADE (Safety Aware Drone Ecosystem): A Hybrid UAV Simulation System for High-Fidelity Research
  • Wrangling Massive Tasks Graphs with Dynamic Hierarchical Composition
  • TaskVine Insights - Storage Management: Disk Load Shifting
  • Simulating Digital Agriculture in Near Real-Time with xGFabric
  • Undergraduate Researcher Showcases PLEDGE Project at APANAC 2025 in Panama