HPC UH Information Technology Services

Information Technology Center Building: A new $41M, 74K square foot state of the art Information Technology Center opened in December 2013. This six-story Information Technology Center houses enterprise information and communications technology systems and services that support modern teaching, administration and research for all ten UH campuses and students throughout the state of Hawai‘i. The building features an energy-efficient disaster-hardened, 8,000-square-foot data center for enterprise servers, storage and communications, high-quality space for faculty to develop digital content, meeting and training rooms with teleconferencing capabilities and an emergency situation room to support UH disaster response. The sustainable building design meets LEED Silver certification standards and will house the UH Information Technology Services (ITS) support staff.

Campus, Statewide, National and International Networking: The UH GigaPOP provides connectivity to national and international Research and Education networks for the entire state of Hawai‘i. The University has two 10Gbps circuits that connect directly back to the Pacific Northwest GigaPOP (PNWGP) in Seattle and the Corporation for Education Network Initiatives in California (CENIC) in Los Angeles. In addition, the University has two 10Gbps connections shared with the Australian Advanced Research Network (AARNet) as part of an NSF IRNC grant (OCI-0962931) that connect both to Australia and the U.S. West Coast (Seattle and LA). Planning is underway to upgrade these circuits to 40Gbps during 2014. The UH statewide network is composed of 10Gbps links on and between islands, extending to all of public higher education in Hawai‘i. This network is also being extended to major research facilities on all islands, including the Mauna Kea and Haleakala observatories. An interisland OC-3 microwave network provides interisland backup capacity.

Current Campus Network Topology: UH-Manoa campus network has evolved to a routed topology based on a three-tier distribution model – Core, Distribution Hubs and Buildings. With a few exceptions, 1Gbps connections are utilized from the core to the fiber distribution hubs and from the distribution hubs to almost all of the campus buildings. Most backup connections from buildings directly to the core are at 100 Mbps. The campus network core, along with the GigaPOP, is housed in the new UH Data Center where the UH IT Operations Center, which serves as a consolidated NOC and monitoring center for systems and services. With funding from the NSF CCNIE program (NSF ACI1340968) the campus network is being upgraded to 10gig for all major science buildings connecting to the UH Data Center. A science DMZ and perfSONAR monitoring tools insure friction free data transfers both on and off campus and unimpeded access to data stores and HPC resources. The campus network provides IPv4 and IPv6 connectivity to every building and room within the campus and IPv6 is fully supported on the wide area as well.

High Performance Computing Facility: A new $1.8M high performance compute cluster is available for researchers across the UH Sytem. The Cray CS300 cluster consists of two types of nodes: 178 standard nodes each with two Intel Xeon E5-2680v2 “Ivy Bridge” 10-core, 2.8GHz processors, a total of 20 cores, 6.7GBmemory/core and 128GB total memory. Six “high-memory nodes” have four E5-4640v2 “Ivy Bridge” 10-core, 2.2GHz processors, 40 cores total, 25GB per core, 1TB/node. The system has 3,600 processors and 22.7 TB memory. Raw performance is over 380 teraflops and 70 teraflops of LINPAC benchmark performance. Short term storage consist of a 600TB Lustre parallel file system with a 4.5 GB/s average of read and write performance.   The system has been designed with expansion capabilities to include both GPU nodes and accelerators. ITS Cyberinfrastructure (CI) staff manages systems administration, networking, security and access to these HPC resources.

Data storage: The new UH Data Center houses research data and computational assets for scientists throughout the UH System. Storage capacity in the data center has been sized to accommodate petabyte-scale data and capacity will scale to support exabytes in the future. The UH ITS has developed an initial data storage resource located in the UH Data Center. The current capacity of the storage resources in use currently is approximately 109TB of faster SAS/FC storage and 145TB of slower SATA storage.  In building out its new HPC capability, ITS will deploy an additional 600 terabytes of longer term data storage. Currently, ITS supports a virtual server (VMware) service to provision servers to meet researcher needs. Data storage services include bulk storage of research data, digital media, and other digital assets. This storage is handled by an on-campus storage cloud, which provides advanced RAID technology to ensure the safety, security, and integrity of the stored data. Back-ups of bulk storage occur nightly and are kept until the next backup occurs.

ITS-CI Professional Support Staff: The Division of Cyberinfrastructure in ITS (ITS-CI) has a staff of cyberinfrastructure research scientists with expertise in high performance computing, data analytics and management and computational sciences who provide support to researchers throughout the UH System. These individuals have a very different set of skills, compared to administrative IT staff, that allow them to maintain the CI research environment as well as provide expertise and support for faculty. Currently there are two professional staff scientists in the Division with plans to grow to five to seven scientists over time.  These staff scientists are members of a national cyberinfrastructure education consortium funded by NSF (NSF ACI-1341935) that includes Clemson, Harvard, UH, USC, UUtah and UWisconsin- Madison. ITS-CI scientists have access to the distributed expertise and best practices in use by the consortium. http://aciref.org

Back to Top