Menu

High Density GPUs & FPGAs in Edge Environments

August 23, 2022

High Density GPUs

By Tom Fries, Government/Defense Sales Manager

A June 4, 2020 congressional report, “Intelligence, Surveillance, and Reconnaissance Design for Great Power Competition”, reinforced the importance of the United States’ military continuing to develop ISR (intelligence, surveillance and reconnaissance) capabilities as threats grow around the world. The report states that the goal is to “make rapid sense of that data; securely deliver that data to weapons, weapon systems, and commanders; and possess a workforce that can execute its mission in competition and combat, at a pace greater than the enemy.”  

ISR applications can combine FPGAs and GPUs because they excel when working together in an environment requiring low latency, searching through real time data, providing immediate intelligence to military personnel. ISR equipment often sits in edge transportable tactical command centers near the battlefield. In these scenarios, the designers of the ISR equipment face multiple challenges:  Edge Environments Diagram

  • Optimizing the number of FPGAs and GPUs in limited space
  • Meeting the power requirements of GPUs, and potentially FPGAs with limited power availability
  • Installing high density GPUs and FPGAs behind CPUs with the limitations of server BIOS
  • Accomplishing the above goals with equipment that can meet the stress of an edge transportable environment 

In this post, I will review the unique products One Stop Systems (OSS) offers to meet these challenges. 

Designing the ISR system to allow the GPUs and FPGAs to communicate directly, and thus eliminating the CPU and reducing latency, is important to achieving critical response time requirements. Also, because edge transportable tactical command centers have limited rack space, valuable space can be saved by increasing the density of GPUs and FPGAs behind CPUs -- for example, 8 GPUs and 8 FPGAs behind a single CPU complex. This creates two challenges, however. The first is that most computer BIOS’ are not robust enough to support 16 or more PCIe devices from a CPU. The second challenge is finding a rugged server to support a large number of PCIe devices. 

Added to the above challenges are the mechanical and power requirements of GPUs like the NVIDIA A6000, which are popular in ISR applications. The A6000 is double-wide and requires 300 watts, taxing the thermal and power capabilities of many servers.  

OSS provides practical solutions to meet the challenges of edge transportable environments – limited rack space, robust power and thermal requirements, and rugged systems for harsh environments. Revisiting the requirement of 8 GPUs and 8 FPGAs behind CPUs, OSS offers a rugged short depth server – 3U SDS. This rugged server is only 20” deep, making it ideal for cramped environments. It offers the flexibility of either Intel or AMD CPU Gen4 CPUs, and features two removable canisters that each hold eight 2.5” SATA or NVMe drives. 

3U SDS Server

                         

To address the requirement of putting 8 GPUs and 8 FPGAs behind the CPU, OSS’s 4UP PCIe Gen4 expansion system can be connected to the server via x16 Gen4 links (both copper and fiber cable options). The 3U SDS and 4UP expansion system are a powerful combination.  

The 3U SDS motherboards use a custom OSS BIOS that supports in excess of 120 PCIe devices. So, in our above use case, two 4UPs can be attached to the 3U SDS server, one with 8 GPUs, and the other with 8 FPGAs. This could be taken a step further, with two additional 4UPs providing for 16 GPUs, and 16 FPGAs supported from a single CPU complex. Like the 3U SDS, the 4UP is rugged to handle harsh environments. The 4UP expansion system also has a variant with I/O slots on the front of the chassis, for situations where quick access to PCIe cards from the front of a rack is needed. 

4UP Expansion System


Another strength of the 3U SDS and 4UP expansion system is their versatility in configuring to the requirements of the ISR application. The 3U SDS can stand alone as a powerful compute node with multiple GPUs and/or FPGAs installed in it. Or, multiple 4UP expansion systems can be attached to the 3U SDS. OSS has designed and built compute node configurations with over 20 GPUs and 30 FPGAs connected to one server. 

OSS remains the leader in leading edge PCIe products. Later in 2022, both the 3U SDS and 4UP expansion system will be available as PCIe Gen5.

Sign up for our newsletter, at the bottom of this page, to stay up-to-date with news from OSS!
  

Click the buttons below to share this blog post!

Return to the main Blog page




Leave a comment

Comments will be approved before showing up.


Also in One Stop Systems Blog

One Stop Systems' Annual Report
The Plan

January 31, 2023

The beginning of the year at a public company is inundated with a myriad of tasks which require a significant amount of time. The first task is writing annual performance reviews for each employee. This includes a review and assessment of achievement of goals from the previous year, and the establishing of goals for the new year. These are required to be written in SMART goal format; Specific, Measurable, Achievable, Relevant and Time based. 

Continue Reading

Which Cooling Method is Best for AI Transportables?
Which Cooling Method is Best for AI Transportables?

January 24, 2023

The most powerful artificial intelligence computing hardware is designed to thrive in a datacenter environment where there is uncapped clean power, near limitless cooling capacity, and a vibration-free environment. The growth of AI use cases in vehicles including automated crop management, autonomous long-haul freight, and military ISR aircraft necessitates the use of datacenter-oriented hardware in vehicles – particularly for initial developments while more customized size, weight, and power (SWaP) optimized embedded platforms are developed. 

Continue Reading

Features and Benefits of Centauri Rugged High-Speed Storage
[VIDEO] Features and Benefits of Centauri Rugged High-Speed Storage

January 17, 2023

In this video, Jaan Mannik, Director of Commercial Sales at OSS, does a quick walkthrough of Centauri Storage Expansion. Centauri offers rugged high-speed storage in a compact chassis. Built as a modular storage expansion to the OSS 3U SDS, Centauri can store up to 256 TB of NVMe storage in its 8-drive canister. These canisters allow for tool-less bulk or individual drive removal and can be hot-swapped for ease of use in fast-paced environments. The system is compatible with 2.5" NVMe drives, and its PCIe Gen4 hardware facilitates high-speed storage throughput. 

Continue Reading

You are now leaving the OSS website