BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:America/Denver
X-LIC-LOCATION:America/Denver
BEGIN:DAYLIGHT
TZOFFSETFROM:-0700
TZOFFSETTO:-0600
TZNAME:MDT
DTSTART:19700308T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0600
TZOFFSETTO:-0700
TZNAME:MST
DTSTART:19701101T020000
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20260422T000711Z
LOCATION:503-504
DTSTART;TZID=America/Denver:20231117T105500
DTEND;TZID=America/Denver:20231117T112000
UID:submissions.supercomputing.org_SC23_sess464_ws_hpct108@linklings.com
SUMMARY:Toward Collaborative Continuous Benchmarking for HPC
DESCRIPTION:Olga Pearce (Lawrence Livermore National Laboratory (LLNL), Te
 xas A&M University); Alec Scott, Gregory Becker, Riyaz Haque, Nathan Hanfo
 rd, and Stephanie Brink (Lawrence Livermore National Laboratory (LLNL)); D
 oug Jacobsen (Google LLC); Heidi Poxon (Amazon); Jens Domke (RIKEN); and T
 odd Gamblin (Lawrence Livermore National Laboratory (LLNL))\n\nBenchmarkin
 g is integral to procurement of HPC systems, communicating HPC center work
 loads to HPC vendors, and verifying performance of the delivered HPC syste
 ms. Currently, HPC bench- marking is manual and challenging at every step,
  posing a high barrier to entry, and hampering reproducibility of the benc
 hmarks across different HPC systems. We propose collaborative continuous b
 enchmarking to enable functional reproducibility, automation, and communit
 y collaboration in HPC benchmarking. We define the minimal requirements fo
 r collaborative continuous benchmarking and develop a common language to s
 treamline the interactions between HPC centers, vendors, and researchers. 
 We demonstrate the initial implementation of collaborative continuous benc
 hmarking, and introduce an open source continuous bench-marking repository
 , Benchpark, for community collaboration. We believe collaborative continu
 ous benchmarking will help overcome the human bottleneck in HPC benchmarki
 ng, enabling better evaluation of our systems and enabling a more producti
 ve collaboration within the HPC community.\n\nTag: Applications, Exascale,
  Heterogeneous Computing, Programming Frameworks and System Software, Stat
 e of the Practice\n\nRegistration Category: Workshop Reg Pass\n\nSession C
 hairs: Bilel Hadri (King Abdullah University of Science and Technology (KA
 UST)), Vasileios Karakasis (NVIDIA Corporation), and Verónica G. Melesse V
 ergara (Oak Ridge National Laboratory (ORNL))\n\n
END:VEVENT
END:VCALENDAR