In this conversation at theCUBE + NYSE Wired: AI Factories – Data Centers of the Future, theCUBE’s John Furrier sits down with Vipul Prakash, co-founder and CEO of Together AI, to explore how AI factories are redefining enterprise infrastructure. Prakash details the breakneck growth of AI-native applications – where usage that once took SaaS nine months to double is now happening in nine days – and why this demand is forcing a rethink of compute, storage and networking. He explains how leading apps segment traffic across closed APIs and fine-tuned open-source models, and why efficiency, scale and low latency make AI factories the new unit of value in the enterprise stack. The discussion highlights the critical role of data adjacency (fabric-connected, parallel storage placed next to models), continuous testing for gen AI (from entropy checks to A/B rollouts and ECC/network reliability), and the organizational advantage of appointing a chief AI officer to cut through policy and security inertia. Prakash also shares how Together AI is addressing real-world constraints, most notably power, and reveals progress building new AI factories in Maryland and Memphis, with more on the way.
The interview further dives into AI-scale architecture trends (transformer evolution, sharded attention/experts) and enterprise use cases, from digital-native builders to regulated sectors. Prakash outlines Together AI’s end-to-end model: from energized data centers and GPU-dense infrastructure to developer experience, sovereignty and security, aimed at producing more tokens from the same footprint. He closes with a look at unifying training and inference on shared infrastructure to smooth peak/average loads and improve economics, plus customer momentum ranging from Zoom to VFS (visa processing with 156 governments). It’s a pragmatic blueprint for how AI factories are becoming the cornerstone of digital strategy – and the most profound infrastructure shift since the dawn of the internet.
Forgot Password
Almost there!
We just sent you a verification email. Please verify your account to gain access to
theCUBE + NYSE Wired: The AI Factory - Data Center of the Future. If you don’t think you received an email check your
spam folder.
Sign in to AI Factories - Data Centers of the Future.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open the link to automatically sign into the site.
Register for AI Factories - Data Centers of the Future
Please fill out the information below. You will receive an email with a verification link confirming your registration. Click the link to automatically sign into the site.
You’re almost there!
We just sent you a verification email. Please click the verification button in the email. Once your email address is verified, you will have full access to all event content for AI Factories - Data Centers of the Future.
I want my badge and interests to be visible to all attendees.
Checking this box will display your presense on the attendees list, view your profile and allow other attendees to contact you via 1-1 chat. Read the Privacy Policy. At any time, you can choose to disable this preference.
Select your Interests!
add
Upload your photo
Uploading..
OR
Connect via Twitter
Connect via Linkedin
EDIT PASSWORD
Share
Forgot Password
Almost there!
We just sent you a verification email. Please verify your account to gain access to
theCUBE + NYSE Wired: The AI Factory - Data Center of the Future. If you don’t think you received an email check your
spam folder.
Sign in to AI Factories - Data Centers of the Future.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open the link to automatically sign into the site.
Sign in to gain access to theCUBE + NYSE Wired: The AI Factory - Data Center of the Future
Please sign in with LinkedIn to continue to theCUBE + NYSE Wired: The AI Factory - Data Center of the Future. Signing in with LinkedIn ensures a professional environment.
Are you sure you want to remove access rights for this user?
Details
Manage Access
email address
Community Invitation
Sid Sheth, Founder, d-Matrix
In this conversation at theCUBE + NYSE Wired: AI Factories – Data Centers of the Future, theCUBE’s John Furrier sits down with Vipul Prakash, co-founder and CEO of Together AI, to explore how AI factories are redefining enterprise infrastructure. Prakash details the breakneck growth of AI-native applications – where usage that once took SaaS nine months to double is now happening in nine days – and why this demand is forcing a rethink of compute, storage and networking. He explains how leading apps segment traffic across closed APIs and fine-tuned open-source models, and why efficiency, scale and low latency make AI factories the new unit of value in the enterprise stack. The discussion highlights the critical role of data adjacency (fabric-connected, parallel storage placed next to models), continuous testing for gen AI (from entropy checks to A/B rollouts and ECC/network reliability), and the organizational advantage of appointing a chief AI officer to cut through policy and security inertia. Prakash also shares how Together AI is addressing real-world constraints, most notably power, and reveals progress building new AI factories in Maryland and Memphis, with more on the way.
The interview further dives into AI-scale architecture trends (transformer evolution, sharded attention/experts) and enterprise use cases, from digital-native builders to regulated sectors. Prakash outlines Together AI’s end-to-end model: from energized data centers and GPU-dense infrastructure to developer experience, sovereignty and security, aimed at producing more tokens from the same footprint. He closes with a look at unifying training and inference on shared infrastructure to smooth peak/average loads and improve economics, plus customer momentum ranging from Zoom to VFS (visa processing with 156 governments). It’s a pragmatic blueprint for how AI factories are becoming the cornerstone of digital strategy – and the most profound infrastructure shift since the dawn of the internet.
In this theCUBE + NYSE Wired: AI Factories – Data Centers of the Future segment, theCUBE’s Dave Vellante sits down with Sid Sheth, Founder, President and CEO of d-Matrix, to unpack why 2025 marks the “age of inference.” Sheth explains how the DeepSeek moment (January 2025) catalyzed a shift from training to deployment at scale – where efficiency, performance per watt and cost now define the winners. He breaks down how AI factories are becoming the decision layer of enterprise infrastructure, with inferencing demand projected to outpace training by 10–100x. Th...Read more