Generative AI has driven tech and business changes. Enterprises are shifting from exploring AI to implementing it for real-world applications to boost ROI and utilize data sets. Key AI trends for 2025: AI inference, secure language models, and preparing for an exascale future. Mainstream enterprises focus on AI inference over training large language models. Traditional large enterprises adopt AI projects by adjusting pre-trained models with data sources. RAG deployment can be complex. Shimon Ben-David discusses scaling infrastructure challenges in exascale environments. WEKA addresses issues through software optimization. Jonathan Martin stresses AI sustainability to reduce power consumption. WEKA’s software approach cuts hardware, optimizes power usage, and enables scaling in cloud environments. WEKA and GPU servers create a zero-footprint, highly scalable environment. Supercomputing event in Atlanta showcases WEKA’s initiatives for inferencing, exascale solutions, and power optimization.

Chad Dunn from Dell discussed key themes and trends at the post SuperCompute '24 event, focusing on generative AI and enterprise spending. Shift from pilot projects to ROI is noted. Data preparation, governance, and software complexity challenges are highlighted. Dell's AI factory is growing with new platforms and partnerships to support generative AI environments. The importance of partnerships for growth and use cases providing ROI is emphasized. RAG and agentic AI are emerging trends. Data governance and prep, supported by technology, are essential for successful implementation. Code generation is a significant use case improving efficiency. The outlook for AI in 2025 includes agentic workflows, smaller models, and enterprise inferencing. Dell is positioned to drive innovation in the AI space.

In a conversation as part of post-event #SC24 coverage from theCUBE, Chief Analyst Dave Vellante talks with Chad Dunn, VP of product management at Dell Technologies. They discuss the evolution of modern enterprise AI with faster, more scalable and performant infrastructural underpinnings. They also touch on the persisting data dilemma for AI enterprises.

Find out more about SiliconANGLE and theCUBE’s coverage of the latest tech events and news https://siliconangle.com/events/

They also talk about how frameworks, such as Llama Stack, Semantic Kernel, and LangChain, are abstracting the intricacies of AI applications, enabling companies to adopt and operate these technologies more easily.

Check out the full article https://siliconangle.com/2024/12/23/ai-strategies-abstracting-complexity-sc24/

Follow theCUBE's wall-to-wall coverage as the roving news desk for SiliconANGLE reports live from tech's top events https://siliconangle.com/category/cube-event-coverage/

Catch up on all episodes of SC24 https://www.youtube.com/playlist?list=PLenh213llmcaXIodD2IlNFz6spbu4As4w

#SC24 #theCUBE #theCUBEResearch #AI #AIhardware #GenerativeAI

Supercomputing 2024 in Atlanta, Georgia has begun, with a focus on AI transformation in various industries. Major players like NVIDIA, AWS, and Cerebras are present, showcasing new technologies. The show highlights the collaboration between government, academia, and enterprise, with a keen interest in open science and data sharing. There is a shift towards AI hardware infrastructure and the emergence of new system builders in the industry. Discussions also revolve around cooling technologies, sustainability, and the future of quantum computing. The show emphasizes the importance of high-performance computing in driving innovation across multiple sectors, from healthcare to finance to climate research. Stay tuned for more insights from the event.

At SuperComputing 2024, Lauren and Mitchell from Omni Services discuss their division Cool Flow and its support for companies like CoolIT. CoolIT specializes in direct liquid cooling for chips and data centers. Mitchell showcases a copper cold plate for Intel Sapphire Rapid processors. They emphasize the importance of tubing meeting specific standards for leak-free connections and the need for robust solutions in cooling systems. They discuss challenges in cooling high-power AI systems and the importance of industry standardization. The conversation concludes with a mention of a panel discussion on direct liquid cooling. Lauren and Mitchell express hopes for future innovations and collaboration in the industry. They reflect on the show's highlights and anticipate future developments in cooling technology.

The panelists discuss the WARRP reference architecture created by WEKA for AI inferencing using Run:ai and NVIDIA's software frameworks. The goal is to help customers understand and implement AI in production environments. They also touch on the importance of deploying AI models in real-time for maximum impact. The discussion highlights the evolution of AI adoption in enterprises and the role of open-source models in controlling data and reducing costs. The panelists stress the need for efficient GPU utilization as AI models become more prominent. They also talk about the challenges in scaling and orchestrating AI applications, emphasizing the importance of token economics in measuring ROI on AI investments. Overall, the panelists hope to see more energy and excitement around AI applications in the enterprise space at future SuperComputing events.