In this conversation at theCUBE + NYSE Wired: AI Factories – Data Centers of the Future, theCUBE’s John Furrier sits down with Vipul Prakash, co-founder and CEO of Together AI, to explore how AI factories are redefining enterprise infrastructure. Prakash details the breakneck growth of AI-native applications – where usage that once took SaaS nine months to double is now happening in nine days – and why this demand is forcing a rethink of compute, storage and networking. He explains how leading apps segment traffic across closed APIs and fine-tuned open-source models, and why efficiency, scale and low latency make AI factories the new unit of value in the enterprise stack. The discussion highlights the critical role of data adjacency (fabric-connected, parallel storage placed next to models), continuous testing for gen AI (from entropy checks to A/B rollouts and ECC/network reliability), and the organizational advantage of appointing a chief AI officer to cut through policy and security inertia. Prakash also shares how Together AI is addressing real-world constraints, most notably power, and reveals progress building new AI factories in Maryland and Memphis, with more on the way.
The interview further dives into AI-scale architecture trends (transformer evolution, sharded attention/experts) and enterprise use cases, from digital-native builders to regulated sectors. Prakash outlines Together AI’s end-to-end model: from energized data centers and GPU-dense infrastructure to developer experience, sovereignty and security, aimed at producing more tokens from the same footprint. He closes with a look at unifying training and inference on shared infrastructure to smooth peak/average loads and improve economics, plus customer momentum ranging from Zoom to VFS (visa processing with 156 governments). It’s a pragmatic blueprint for how AI factories are becoming the cornerstone of digital strategy – and the most profound infrastructure shift since the dawn of the internet.
Forgot Password
Almost there!
We just sent you a verification email. Please verify your account to gain access to
. If you don’t think you received an email check your
spam folder.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open this link to automatically sign into the site.
Register For Cube365 Events Platform
Please fill out the information below. You will recieve an email with a verification link confirming your registration. Click the link to automatically sign into the site.
I want my badge and interests to be visible to all attendees.
Checking this box will display your presense on the attendees list, view your profile and allow other attendees to contact you via 1-1 chat. Read the Privacy Policy. At any time, you can choose to disable this preference.
Select your Interests!
add
Upload your photo
Uploading..
OR
Connect via Twitter
Connect via Linkedin
EDIT PASSWORD
You are already logged into TheCUBE Network as
Share
Share clip
The clip will play by default when shared. The entire video and transcript is also accessible via the link.