Emilio Andere of Wafer joins theCUBE Research with host John Furrier of theCUBE to discuss agent-driven optimization for large language models, LLMs and inference on modern hardware. Andere explains Wafer's approach to inference optimization. They describe using artificial intelligence, AI agents as forward-deployed performance engineers to tune kernels orchestrate heterogeneous hardware such as graphics processing units, GPUs and tensor processing units, TPUs and generate customized software stacks for open-source and frontier models.
The conversation addresses platform strategy, verticalization, neo-cloud partnerships and the complexities of disaggregated serving. Andere details kernel-level tuning token-based performance models and continual inference optimization that learns traffic patterns and adjusts software stacks and serving engines over time.
Key takeaways include Wafer's token-based performance model and continual inference optimization. Andere reports customers often realize 30–50% performance gains after several months as agents optimize kernels and serving engines. Host John Furrier of theCUBE notes this agent-as-engineer method enables enterprises without GPU expertise to deploy faster while meeting strict latency and budget constraints.
Almost there!
We just sent you a verification email. Please verify your account to gain access to
Mixture of Experts Series. If you don’t think you received an email check your
spam folder.
Sign in to theCUBE + NYSE Wired: Mixture of Experts Series.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open this link to automatically sign into the site.
Register for theCUBE + NYSE Wired: Mixture of Experts Series
Please fill out the information below. You will receive an email with a verification link confirming your registration. Click the link to automatically sign into the site.
You’re almost there!
We just sent you a verification email. Please click the verification button in the email. Once your email address is verified, you will have full access to all event content for theCUBE + NYSE Wired: Mixture of Experts Series.
I want my badge and interests to be visible to all attendees.
Checking this box will display your presense on the attendees list, view your profile and allow other attendees to contact you via 1-1 chat. Read the Privacy Policy. At any time, you can choose to disable this preference.
Are you sure you want to remove access rights for this user?
Details
Manage Access
email address
Community Invitation
Emilio Andere, Wafer
Emilio Andere of Wafer joins theCUBE Research with host John Furrier of theCUBE to discuss agent-driven optimization for large language models, LLMs and inference on modern hardware. Andere explains Wafer's approach to inference optimization. They describe using artificial intelligence, AI agents as forward-deployed performance engineers to tune kernels orchestrate heterogeneous hardware such as graphics processing units, GPUs and tensor processing units, TPUs and generate customized software stacks for open-source and frontier models.
The conversation addresses platform strategy, verticalization, neo-cloud partnerships and the complexities of disaggregated serving. Andere details kernel-level tuning token-based performance models and continual inference optimization that learns traffic patterns and adjusts software stacks and serving engines over time.
Key takeaways include Wafer's token-based performance model and continual inference optimization. Andere reports customers often realize 30–50% performance gains after several months as agents optimize kernels and serving engines. Host John Furrier of theCUBE notes this agent-as-engineer method enables enterprises without GPU expertise to deploy faster while meeting strict latency and budget constraints.