Tokenless

Ai inference

AWS is Too Expensive: Here is the Open Source Alternative

AWS is Too Expensive: Here is the Open Source Alternative

Umur Cubukcu, co-founder of Ubicloud, explains the principles of an "open cloud," centered on an open-source control plane, portability, and freedom from data lock-in. He details Ubicloud's strategy to compete with hyperscalers by offering superior price-performance on core services like PostgreSQL and compute, particularly for startups and enterprises seeking control and data sovereignty.

Inference at Scale:Breaking the Memory Wall

Inference at Scale:Breaking the Memory Wall

Sid Sheth, CEO of d-matrix, details their memory-centric approach to AI inference hardware, focusing on their Digital In-Memory Compute (DIMC) architecture. He explains how DIMC, an augmented SRAM technology, minimizes data movement to solve the memory bottleneck, delivering significant gains in latency and energy efficiency, particularly for the 'decode' phase of large language models.