Skip to main content

8 posts tagged with "HPC"

View All Tags

Powering CIROH DevCon 2026: How CIROH and 2i2c Ran Cloud Computing at Scale

· 9 min read
Arpita Patel
Assistant Director, IT and DevOpsAlabama Water Institute
April Johnson
Community and People Lead2i2c
Benjamin Lee
Development Operations EngineerAlabama Water Institute
Nia Minor
Graduate Research AssistantAlabama Water Institute
Harsha Vemula
DevOps EngineerAlabama Water Institute

At the 2026 CIROH Developers Conference (University of Utah, May 27–29) participants used a variety of tools and models on cloud infrastructure they'd never had to install, configure, or even think about. To enable that seamless experience, our Research Cyberinfrastructure team provisioned cloud resources for 15 hands-on workshops across three days in close collaboration with our partners at 2i2c. Here's what we ran, and how.

What we provisioned, by the numbers

Running an event of this scale requires more than just a single cloud context, as each workshop posed its own computing and data access requirements. CIROH Cyberinfrastructure met this challenge via a coordinated stack spanning multiple cloud providers and services. Across the 15 workshops that needed infrastructure (14 requests), the R2OHC cloud provisioned the following:

ProviderWorkshopsWhat it carried
2i2c JupyterHub on GCP12A mix of Small, Medium, Large, and GPU servers; 9 workshops ran on custom-built images
AWS3NRDS, HydroServer, TEEHR
Google NWM BigQuery API2Input data for Flood Inundation Mapping (multi-source DB / HAND visualization) and Hydroinformatics (Essential Geospatial Skills)
NSF Access1GPU-powered VMs for the "Talk to NRDS" LLM workshop

For 12 of these workshops, their backbone was the CIROH–2i2c JupyterHub, a managed JupyterHub environment that 2i2c operates on Google Cloud. For the conference, we provisioned a dedicated Workshop Hub: an ephemeral environment that lives only for the duration of the event and then spins back down.

The work that happens before anyone logs in: custom images

Nine of the twelve JupyterHub workshops needed a custom software image to support their unique computing needs. Sessions covering topics like the Community Asset Computation Hub (CCNH), Foundations of Machine Learning, CUAHSI Hydroinformatics, HydroServer, INFLECT-based Flood Inundation Mapping, Satellite Data Projection, Machine-Learned Model Emulators, and Water Quality Modeling from Hillslope to Watershed Scales each had distinct dependency stacks.

That's a coordination problem, and it was solved weeks before the conference. Workshop leads told us what their sessions needed, we defined those environments in our public awi-ciroh-image repository on GitHub, and 2i2c deployed them. By the time attendees arrived, the right libraries were already in place, all but eliminating the usual loop of haggling with installations and configurations that “work on my machine”. Instead, there were reproducible environments, ready and consistent on day one, demonstrating clear evidence of how tightly the CIROH and 2i2c teams work together.

A line graph showing usage of CIROH-2i2c JupyterHub environments over time. A spike in usage occurs on May 27th, peaking on the 27th at 132 workshop users, before leveling back off to near-zero levels after the conference's end on June 1st.
During DevCon, as many as 132 participants were logged into CIROH-2i2c JupyterHub per day.

CCNH: Instant Access to NextGen in JupyterHub

Two of the twelve workshops also marked the first appearance of the CIROH Community NextGen Hub (CCNH) at a DevCon event! This JupyterHub image contains all of the dependencies required to run the NextGen Framework, bypassing the framework's notorious complexity. CCNH represents a new paradigm where the NextGen framework can be run entirely from the comfort of a web browser, further extending its accessibility and expanding the potential for research and development with the framework.

DevCon 2026 workshops using CIROH Cyberinfrastructure

HydroShare integration: from a resource to a running notebook

Many workshop materials were published as HydroShare resources and launched straight into the Workshop Hub via a single link, pulling notebooks and data into the user's environment automatically. What might otherwise have been an onerous process of managing cluttered Downloads folders and local directory structures was instead compressed into a single click.

Why the 2i2c partnership matters

2i2c's significance in this process went far beyond just hosting the JupyterHub. 2i2c specializes in open-source cloud infrastructure for research, and that shared commitment shaped our collaboration. Our entire stack — JupyterHub, the container images, the HydroShare connector — is open source and lives in public repositories. Another institution could easily read our Dockerfiles or dependency configurations to launch similar environments.

The operational model matters too. 2i2c manages JupyterHubs for many science communities, and what they learn from one community gets shared quickly with others. Our pre-conference testing and prep was informed by dashboards 2i2c built for EarthScope's computing-intense workshops, and the temporary storage approach 2i2c and CIROH used at DevCon is now being re-used with other communities (including EarthScope).

Lessons we're carrying forward

Pre-event automation is everything. Nine custom images don't build themselves on the morning of a workshop. Front-loading that work meant we could focus on people, not infrastructure, during the event.

Treat infrastructure as tracked engineering. Thirteen GitHub issues turned a sprawling set of requests into an auditable plan — and a head start on next year.

Reproducibility scales. Version-controlled environment images are the difference between 15 consistent workshops and 15 individual troubleshooting sessions — and they let any of these workshops be re-run on the mainline (NM2.1) 2i2c JupyterHub environment.

Open-source, public-private partnerships work. Corporate cloud providers (AWS/Google Cloud), an NSF-funded computing resource, a mission-driven infrastructure partner with 2i2c, and a university research institute (CIROH) all contributed aspects of the DevCon experience. The result was a unified experience across every workshop. That's the model we want to keep building on.

To our partners at 2i2c, and to the providers and resources that backed DevCon 2026: thank you. To our DevCon networking sponsors — Lynker, Google Cloud, Civil and Environmental Engineering at The University of Utah — thank you.

And to everyone who logged in, ran the notebooks, and pushed their work forward — that's exactly what this infrastructure is for.

Interested in CIROH's cloud resources? Learn more at hub.ciroh.org/docs/services/intro or reach the CIROH Cyberinfrastructure team at ciroh-it-support@ua.edu.

DevCon 2025: A DevOps and Cyberinfrastructure Success Story

· 3 min read
Arpita Patel
DevOps Manager and Enterprise ArchitectAlabama Water Institute

The recent DevCon 2025 event showcased not just cutting-edge development practices, but also demonstrated how modern DevOps principles and cloud infrastructure can seamlessly support large-scale technical workshops. Our team had the privilege of providing IT infrastructure and support for over 200 attendees, creating a robust learning environment through an exemplary public-private partnership.

Image of CIROH's Research Cyberinfrastructure and DevOps team. On the left, two graphs are shown depicting usage for the Google Cloud-2i2c and Jetstream2 environments.

CIROH's Research Cyberinfrastructure and DevOps team.
Left to right, top to bottom:
Manjila Singh, Arpita Patel, Nia Minor, Trupesh Patel, James Halgren; Benjamin Lee.

δHBV2.0: How NGIAB and Wukong HPC Streamlined Advanced Hydrologic Modeling

· 2 min read
Yalan Song
Research Assistant ProfessorPennsylvania State University
Leo Lonzarich
Graduate ResearcherPennsylvania State University
Arpita Patel
DevOps Manager and Enterprise ArchitectAlabama Water Institute
James Halgren
Assistant Director of ScienceAlabama Water Institute

Image of graphical outputs from the δHBV2.0 model

Predicting water flow with precision across the vast U.S. landscape is a complex challenge. That's why Song et al. 2024 developed δHBV2.0, a cutting-edge hydrologic model. It’s built with high-resolution modeling of physics to deliver seamless, highly accurate streamflow simulations, even down to individual sub-basins. It's already proven to be a major improvement, performing better than older tools at about 4,000 measurement sites. We also provide a comprehensive 40-year water dataset for ~180,000 river reaches to support this.

Penn State research group pushed δHBV2.0 further, training it with even more detailed river data and integrating other trusted models, aiming to make it a key part of the NextGen national water modeling system (as a potential NWM3.0 successor). But here’s a common hurdle: making powerful scientific tools like this easy and reliable for everyone to use within a larger framework can be tough. Setup issues, runtime errors, and inconsistent results can frustrate users.

NGIAB stepped in to solve exactly this problem. Team has taken the complexity out of using the operations-ready models within NextGen by creating one unified, reliable package. Thanks to NGIAB, users don't have to worry about tricky setups or whether the model will run correctly. NGIAB ensures that our models are compatible everywhere and, most importantly, that they run exactly as designed, consistently and faithfully, every single time, no babysitting required. This means users get the full power of our advanced modeling, without the headaches.

Pennsylvania State University Researchers Leverage CIROH Cyberinfrastructure for Advanced Hydrological Modeling

· 3 min read
Arpita Patel
DevOps Manager and Enterprise ArchitectAlabama Water Institute
Yalan Song
Research Assistant ProfessorPennsylvania State University
Tadd Bindas
Graduate ResearcherPennsylvania State University

Pennsylvania State University (PSU) researchers have been leveraging CIROH Cyberinfrastructure to tackle complex hydrological modeling challenges. This post highlights their innovative approach using the Wukong computing platform in conjunction with Amazon S3 bucket storage to efficiently process and analyze large-scale environmental datasets. 🚀

Community NextGen Updates

· 3 min read
Arpita Patel
DevOps Manager and Enterprise ArchitectAlabama Water Institute

The Community NextGen framework has seen significant advancements in November 2024, with major updates across multiple components and exciting new resources for users. Let's dive into the key developments that are making hydrologic modeling more accessible and powerful than ever.

CIROH Cloud User Success Story

· 3 min read
Arpita Patel
DevOps Manager and Enterprise ArchitectAlabama Water Institute

This month, we are excited to showcase two case studies that utilized our cyberinfrastructure tools and services. These case studies demonstrate how CIROH's cyberinfrastructure is being utilized to support hydrological research and operational advancements.

1. ngen-datastream and NGIAB

ngen-datastream image

Monthly News Update - March 2024

· 2 min read
Arpita Patel
DevOps Manager and Enterprise ArchitectAlabama Water Institute
Accelerating Innovation: CIROH's March 2024 Update

The CIROH team has been diligently accelerating research cyberinfrastructure capabilities this month. We're thrilled to share key milestones achieved in enhancing the Community NextGen project and our cloud/on-premises platforms.

NextGen Monthly News Update - January 2024

· 2 min read
Arpita Patel
DevOps Manager and Enterprise ArchitectAlabama Water Institute

Welcome to the January edition of the CIROH Hub blog, where we share the latest updates and news about the Community NextGen project monthly. NextGen is a cutting-edge hydrologic modeling framework that aims to advance the science and practice of hydrology and water resources management. In this month's blog, we will highlight some of the recent achievements and developments of the Community NextGen team.