A Signal65 TCO study, presented with CoreWeave, examining the fully loaded economics of AI training and inference. It covers hidden costs such as storage fees, support, and reliability, how performance compounds with price to set cost per million tokens, and how serverless and dedicated inference models differ on useful-token economics.
Philip Johnston, co-founder and CEO of StarCloud, discusses their pioneering efforts to build data centers in space to address AI's energy demands and terrestrial constraints. He details StarCloud-1's groundbreaking mission, which launched an Nvidia H100 GPU into orbit, and the engineering challenges overcome, such as thermal management and radiation hardening. The conversation covers their ambitious plan for a 88,000-satellite constellation, the shift in investor sentiment towards hard tech, and key advice for deep tech founders.
Starcloud launched the first NVIDIA H100 GPU into orbit, a first step towards building massive AI data centers in space. Their vision is to leverage continuous solar power and zero-water cooling to overcome Earth's energy and resource limitations for large-scale compute.