DUG has chosen leading Ethernet supplier Mellanox Technologies to supercharge our massive exascale-focused HPC facility.
Described as the world’s most powerful supercomputer, the facility will be 250 single-precision petaflops when fully installed. The vast, geophysically-configured machine, housed in a purpose-built exascale data centre, will have the power, room, and plans in hand to expand beyond an exaflop, as demand increases.
This level of compute power requires a high performance, reliable, and resilient network capable of delivering >10Gb/s of low-latency bandwidth per server to over 40,000 compute nodes.
To help accelerate the geophysics community’s research, development, and production, Mellanox is creating and deploying a unique “multi-host” adapter.
State of the Art
This state of the art technology, created exclusively for DUG, allows four servers to use a single 50Gb/s network connection, with each node able to burst to over 30Gb/s.
The sophisticated design uses Mellanox’s SN2700 32 port 100Gb/s Ethernet switches, achieving greater throughput while reducing overall switch count.
“DUG McCloud is a great example of how innovative design and out of the box thinking can drive a huge leap in supercomputer price/performance, compute efficiency, and power efficiency,” said Amir Prescher, senior vice president business development and end user sales, Mellanox Technologies.
“Utilizing multi-host technology achieved significant cost savings with the number of switches reduced by 50% and rack cabling reduced by 75%.
“The combination of powerful compute nodes, Mellanox best-in-class, end-to-end 100G Ethernet fabric and professional services, and DUG’s sophisticated models creates a truly world-class geophysical exploration platform.
“Best of all the cloud service delivery and consumption model allows customers to benefit from a truly world-leading super computer without the need for a super CAPEX budget.”
A Perfect Solution
DUG’s Managing Director, Dr Matthew Lamont, said “Mellanox’s multi-host NIC and high bandwidth fabric is a perfect solution for DUG’s network requirements.”
“The higher local bandwidth on offer greatly enhances DUG’s Full Waveform Inversion code, delivering to oil and gas clients refined, high-resolution velocity models for imaging and characterisation.
“The efficient fabric design of Mellanox’s components complements DUG’s drive to deliver the most cost-effective data centre ever created,” Dr Lamont said.
The reduced switch count, NICs, and cabling help deliver a power usage effectiveness (PUE) under 1.05 – without compromising on performance. This is significantly better than the PUE of recognised “green” data centres around the world.
An industry-recognised measure of energy efficiency, PUE is a ratio of the total amount of energy used by a data centre, compared to the energy used by equipment such as lighting or cooling. A PUE of 1.00 (100% useful work, 0% overhead) is ideal.
“We like to call DUG McCloud the greenest cloud service in the world,” says Dr Lamont.