The OSS-VOLTA16 is an HGX-2 platform with unprecedented compute power, bandwidth, and memory topology to train massive models, analyze datasets, and solve simulations faster and more efficiently than previously possible in a single server. The 16 Tesla V100 GPUs work as a single unified 2-petaFLOP accelerator with half a terabyte (TB) of total GPU memory, allowing it to handle the most computationally intensive workloads. GPU management and monitoring and software are preinstalled on the OSS-VOLTA16. The GPU accelerated server also includes dual high-performance Intel Scalable Architecture processors with a base configuration of 512GB of DDR4 memory scalable to 3TB. Sixteen PCIe Gen3 slots are available for expansion and scale out OSS-GPUltima clusters using IB or high speed Ethernet networking. The appliance also includes sixteen 2.5” front-removable NVMe drive bays for large model storage.