The mere mention of artificial intelligence, AI, brings forth images of large, dimly-lit rows of high performance power hungry equipment racks in a data center. At the same time, "the edge" evokes the idea of constrained embedded systems operating in harsh forward locations enduring all types of environmental conditions. All the while taking in data, processing it, and reacting in real-time. As this "edge" becomes ever more demanding and complex, it increases the need for AI levels of performance like that in the data centers but now to be available and useable on the spot and in systems that are transportable at the edge—a big challenge that has been addressed by One Stop Systems.
In the real world, the goal of putting more power into less space has been thwarted by heat dissipation since the first steam engines. In 1999 the Porsche car company was faced with getting more horsepower out of their air-cooled, 3-liter engine. Acknowledging that heat was their issue, Porsche moved from an air-cooled solution to a water-cooled solution, in concert with a dry oil sump injection system. This allowed Porsche to have extremely high performance for the engine size, with a nimble car that continues to have a power-to-weight ratio that still beats all comers in the market.
PCIe Gen 5 is a key technology for driving transportable or edge AI systems to higher performance, especially those with demanding space, environmental or cooling needs. But AI program managers should evaluate their technology suppliers’ Gen 5 implementations to ensure they fully realize the technology’s benefits.