// TOM'S HARDWARE US — HARDWARE & GADGET
EV charging company plans to deploy 100,000 Nvidia GPUs in pods at its roadside sites across the US
We hope charging location security will be adequate with up to 48 Nvidia Hopper or Blackwell Ultra GPUs worth roughly $2M+ in each pod.
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
EV charging firm Xeal plans to use its existing U.S. network to deploy the “world’s first edge inference compute network using idle EV charging capacity.” The big idea is that it already has 1,600+ locations and 200MW of permitted, installed electrical infrastructure, so it aims to “deploy over 100,000 NVIDIA GPUs” at these sites. Thus it has developed Latient Pods (pictured), with each containing up to 48 Nvidia Hopper or Blackwell Ultra GPUs. We hope charging location security will be adequate to keep thieves away from these cabinets, as they are probably worth $2M+ each.
Nikhil Bharadwaj, co-founder and CEO of Xeal, explained that Latient Pods can deliver inference compute today while new data centers are still being built. “Latient is the fastest way to bring new compute online, tapping already permitted and grid-connected, yet idle energy capacity, located right where it's needed for ultra-low latency, with no water hookup requirements,” highlighted the exec. Grid interconnect is said to be one of the trickiest things for those looking to bring new compute online, but Xeal’s EV charging sites, which “typically operate at less than 10% of permitted capacity,” can deliver processing power via a distributed network across a metropolitan area.
An Nvidia rep also praised the upcoming Latient Pod network for being an innovative way to bring low-latency inference closer to users while making better use of infrastructure that has already been built.
In the rendered image from Xeal, a Latient Pod looks quite a lot like a broadband fiber cabinet that you might have on your street. A pod will boast the following specs/features:
If Xeal has 1,600+ locations, and one Latient Pod has up to 48 GPUs, its touted purchasing target of 100,000 Nvidia GPUs suggests some sites will have more than a single pod at the location. Or perhaps it intends to build more EV sites, up to nearly 2,100 in total.
It claims that the location of its pods around metro areas, a feature dubbed Metro Edge, offers sub-20ms latency, a significant speedup over inference located in a distant data center.
We’ve previously reported on EVs and distributed computing, but in a slightly different context. Last year we discussed Elon Musk’s proposal to make use of the untapped asset of the millions of Tesla cars out there. He called it “100 gigawatts of inference” that could be used when the vehicles are “bored.”
Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.