Menu

Scale-out I/O Solutions in a PCIe Gen5 World

February 21, 2023 1 Comment

Scale-out I/O Solutions in a PCIe Gen5 World

By Jeff Sigua, Product Manager

As the world is on the brink of a tech refresh, scale-out solutions will get a significant boost in both TDP and PCIe transfer speeds. Our CPUs jump from 250w up to 400w in Gen5. Our PCIe lane architecture increases from ~32 GB/s to ~64 GB/s - in each direction. The extra watts will push the boundary of I/O solutions and speeds. Scale out I/O is expanding capacity of new hardware resources instead of increased capacity of old hardware. 

Over the past two decades, One Stop Systems has been specializing in cable PCIe expansion using passive PCB routing expertise, or switch architecture, to drive the tech roadmaps into the future. Recently, we have developed PCIe5 Host Interface Boards (HIB) to work up to 2 meters over copper cables and connecting to the latest Gen5 PCIe expansion backplanes or rack mount enclosures. 

As next Gen motherboards become available, it seems the common theme among them is fewer native x16 PCIe5 slots coming from the CPU chips. Those extra PCIe5 lanes from the CPU have been routed to internal network or storage options built into the PCIe5 motherboards and connectors. This highlights the importance of using PCIe5 over cable, to allow for more scaled-out array of I/O cards, such as NVIDIA’s H100 GPU and other high data capture card options in development from multiple third-party companies. At the hub of the scale-out will be One Stop Systems' new Gen5 Short Depth Server (SDS). This server appliance can host up to 16x NVMe U.2 storage with removeable drive canister feature + GPU node + PCIe5 cable expansion to our sister product, the 4U Pro or our Centauri storage expansion solution.

Scale-out Solutions

We’re seeing full scale-out I/O rack deployments running off One Stop Systems' SDS or EOS server. The SDS or EOS can handle up to 128 end point devices, with the help of custom motherboard BIOS optimized for PCIe enumeration. As we move into PCIe Gen5, the rate of the sensor and data ingestion doubles in speeds talking back to the host server to the scaled out I/O devices. These speeds become a critical path with AI on the Edge and/or machine learning software packet sizes. NVIDIA talks about the increased tensor cores AI benefits here, as it also gets a power bump to 350w TDP per PCIe5 GPU. 

Scale-out I/O with Gen5 opens the tech boundaries for our future as a society by doubling its performance. We should see a rapid growth in autonomous cars/trucks/machines and in our infrastructure around use with smart city. Increasing the edge technologies of radar, lidar, 4k/8k camera capture systems with enough processing speeds to get near real time results using machine learning.  

Click the buttons below to share this blog post!

Return to the main Blog page




1 Response

Chana Small
Chana Small

March 03, 2023

Dear onestopsystems.com admin, Your posts are always well-supported by facts and figures.

Leave a comment

Comments will be approved before showing up.


Also in One Stop Systems Blog

Edge Computing
The Four Types of Edge Computing

April 17, 2024

“Edge Computing” is a term which has been widely adopted by the tech sector. Dominant leaders in accelerated computing have designated “Edge” as one of their fastest-growing segments, with FY24 revenue projected to be nearly $100 billion. The boom in the market for Edge Computing has become so significant that it is increasingly common to see companies create their own edge-related spinoff terms such as ‘Rugged Edge’, ‘Edge AI’, ‘Extreme Edge’, and a whole slew of other new buzzwords. 

Continue Reading

Datalogging in Autonomous Military
Unveiling the Strategic Edge: Datalogging in Autonomous Military Vehicles

March 11, 2024

The landscape of modern warfare is undergoing a profound transformation with the integration of cutting-edge technologies, and at the forefront of this evolution are autonomous military vehicles. Datalogging, a seemingly inconspicuous yet indispensable technology, plays a pivotal role in shaping the capabilities and effectiveness of these autonomous marvels. In this blog post, we delve into the critical role of datalogging in autonomous military vehicles and its impact on the future of defense strategies.

Continue Reading

Redundancy and Management of Rugged Edge Servers
Redundancy and Management of Rugged Edge Servers

February 13, 2024 2 Comments

Computer server redundancy, including backup power supplies, RAID storage devices and applications that automatically fail-over, keeps critical systems up and running longer than non-redundant systems. Similarly, effective system monitoring can provide early warning of failures and allow system managers to remotely manage these systems, further improving application uptime. While the concepts of computer system redundancy and system management are well-established in all levels of computing, from the personal computer to the largest hyperscale datacenters, the unique challenges of placing datacenter-class computing elements performing AI applications in mobile edge environments, like aircraft, ships, and land vehicles, brings unique challenges to system redundancy and management. 

Continue Reading

You are now leaving the OSS website