REU Project: Coffea + Work Queue

This spring, undergraduate researchers Zoe Surma and Emily Strout worked to integrate the Coffea data analysis framework for high energy physics with the Work Queue distributed execution framework from the CCL.  Zoe presented initial results from testing at the Coffea user's meeting last week.  We are seeing some good scaling behavior, but there is still some tuning needed to go to large scale.  Many thanks to Lindsay Grey and the Coffea team for help and support.  The next step is to get this up and running on the CMS HTCondor cluster at Notre Dame!




Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • Scaling SADE (Safety Aware Drone Ecosystem): A Hybrid UAV Simulation System for High-Fidelity Research
  • Wrangling Massive Tasks Graphs with Dynamic Hierarchical Composition
  • TaskVine Insights - Storage Management: Disk Load Shifting
  • Simulating Digital Agriculture in Near Real-Time with xGFabric
  • Undergraduate Researcher Showcases PLEDGE Project at APANAC 2025 in Panama