SAS Innovate 2024 | Bryan Harris | SAS

Clips
News
More from SAS Innovate 2024

Integrating quantum computing with AI for enterprise solutions

The landscape of enterprise computing is evolving when it comes to artificial intelligence, particularly in the integration of quantum computing and its implications for solving complex problems across various sectors.Industry leaders converged at SAS Innovate this week to discuss the technological advancements driving AI, business models, workflows and data utilization, including the cutting-edge advancements driving AI and quantum computing.“I think with quantum computing, I think it’s going to take the same path as GPUs,” said Bryan Harris (pictured), chief technology officer of SAS Institute Inc. “Our ability to leverage quantum will be really the GPU for optimization problems

play_circle_outline Introduction to quantum computing and its potential applications

play_circle_outline Comparison of quantum computing to GPUs and traditional computing

play_circle_outline Addressing Encryption and Security Concerns in the Quantum Era: SAS's Strategic Approach

play_circle_outline SAS's expertise in quantitative analysis and reasoning.

play_circle_outline SAS as a trusted company in AI with a focus on execution and support

Info

Bryan Harris | SAS

search

>> Welcome back everyone to the live CUBE coverage here in Las Vegas for SAS Innovate 2024. I'm John Furrier, host of theCUBE. My cohost Dave Vellante, heads up Cube Research, also co-founder, of course, here with me, founder of theCUBE. Bryan Harris is here. CTO SAS. Multiple times. Second time on this event. We're coming back to go do a deeper dive on some of the tech and really what's driving the AI is the technology, but also the business model, workflows, and data. And the three things we talked about last today was product productivity, performance and trust.

>> Yes.

>> Great to see you.

>> Good to see you, John. Good to see you, David. Always a pleasure.

>> Hey Bryan.

>> So for the folks that are watching, you might not have seen yesterday, you did the hot wings, what was it called?

>> Hot ones.

>> Hot ones. You down-

>> Sean Evans and start from one wing to 10 with a progressive heat going on. It was insane. One of the greatest experiences in my life. Amazing.

>> They showed the replay today. The keynote. You were dripping was a tomato. I there.

>> Had a body experience.Under

>> duress.So

>> good.As I said, a lot of hot takes going on there, here So we want into it. So I want to get into the AI impact. We're going a little bit, but we to talk about performance. So the big theme with AI is you need more horsepower. I mean, generalizing AI has XPUs, which is GPUs, to call it. And in the mix there. You brought up your keynote. And so you're starting to hear Quantum in the same conversations now when you talk about these advanced AI demos and presentations, because there's a performance angle there.you mean by quantum? When you bring it up on the keynote and with all the goodness you guys are announcing, a lot of accomplishments, a lot of tech customers with their AI stacks, why quantum?

>> Well, I think that when we Because obviously generative AI is getting a lot of the headlines these days, but it really doesn't have a strong story in the quantitative space. It's really around reasoning of facts. And obviously they can do things with multimedia, you get that. But when you about dealing with numbers, it's actually very, very weak. And so you got to start asking yourself, well, where are we going to start seeing acceleration on quantitative reasoning? That's really what I would look at it, right? And so when you start looking at that, obviously quantum because of its architecture and ability to have the superposition allows you to have multiple states at once, which means you can do some really incredible, almost futuristic things. So one of the big problems that we see is you got to find the right problem with quantum first. It's not for every problem. I mean, GPUs exist because they're great at doing linear algebra and multi-threaded linear algebra for deep learning. But there are optimization problems that require combinatorial trial and error type scenarios. And these are some of the hardest problems in the world, and they're very impactful for four industries, life sciences, banking in the government space as well as you think like I've mentioned, life sciences, but pharmaceutical industry, insurance. And so if you can find ways to compute these really, really hard combinatorial problems faster, you can really drive the cost of compute down and solve problems that were unsolvable before. The basic example is this traveling salesperson problem. Which is like for instance, you got a salesperson in a city center, they have to visit a bunch of cities and only visit one of those cities once and get back to home. And they got to do that in a way that minimizes distance. And there's no algorithm to do this. You just have to try them all out, evaluate the distance and then pick the right one. Well, in real world problems, that becomes exponentially complicated. And so quantum allows us to search that entire space of combinations and get to the right solutions faster.

>> I think it was you in your keynote yesterday. a great keynote-

>> You said within a year and a half, two years, your Quantum is going to have its gen AI moment.

>> That's correct. I believe it. The market is showing a lot of progression on it. So I think it's like 35 billion as the market size right now, but it's projected to go to a trillion dollars by 2030. So got to imagine what's happening in the next six years. The leaps we're going to make in this. And one of the big things that's happening in quantum is this idea of, well qubits, and this is very analogous to what was going on with traditional computing. We had 8-bit computers, 16-bit computers, 32-bit computers, 64-bit computing. So scalability of arithmetic is the big issue with quantum right now. So as we go through the qubits, scaling up on that, we'll be able to scale into more sophisticated problems in the market. And I think that when you look at what the demand of complexity of problems that in the financial world, the hyper-connectivity of all these financial systems right now is creating combinatorial problems that need to be explored differently and quantum can help solve these things.

>> So I really hadn't paid much attention to quantum until recently. It looks like it's finally starting to-

>> It's heating up....

>> get real, and there's a lot of different techniques you could scale, but then the qubits aren't stable or you can get the qubits stable, but it's really slow, which defeats the purpose of quantum. From a technology standpoint. Correct me if I'm wrong, but it seems like we're solving those problems. Do you have sort of line on site on maybe which of those techniques or have you chosen a path that

>> There's two approaches that quantum computers are approaching. And again, we're not in the business of building them. We're in there just to leverage them, but there's quantum annealing, and these strategies are really about... Quantum annealing allows to maintain state of a one or a zero, or in the case of quantum, you this kind of idea of a superposition where you can actually be in two different states at once, which is incredible power.

>> It's like mind-bending.

>> Yes. And so, when you think of that though, the other one is quantum gates, which is where they're trying to mimic the traditional semiconductor like in transistor. And so those are the two big areas where people are pushing and research onto those. And those different quantum computers have different problems they're good at solving. I think there's a pursuit right now quantum gates that we could just approach traditional problems one for one because it looks like what a semiconductor would do or transistors and things like that. Whereas quantum annealing I think actually really stable right now many areas of optimization problems, which I said is there is no algorithmic efficiency for that.

>> So just one more follow up. When you talked about 64, when we went to 64, you had to make some application changes to take advantage of it, and that's what you do with quantum, right? So you're in the process of doing that, or I mean, yes, there's going to be part of that, a lot of these, when we leverage them, we're just sending them off as APIs to these things. And that's all hidden behind the scenes. It's just a matter of scale of how much can a process of one time based on and then what's the efficiency of doing that. But we see that's just a natural progression in that industry. That be solved. And when it's solved, SAS wants to be ready to be leveraging these things. And what we're doing is we're putting them in this hybrid architecture of traditional computing and quantum. And I would say this, GPUs didn't take you over the CPU. They're just a specialized class of XPU as you called it, right?

>> Mm-hmm.

>> And I think Quantum's going to have its space, right? So when you're talking about GPUs, it's great for linear algebra and matrix multiplication, and going to be great at search space optimization for how do I discover solutions in a very complicated problem. Now, that be presented as compute in the cloud or as a service to a quantum computing company. And you're just going to leverage that service into your existing data and AI life cycle and leverage incredible outcomes with it.

>> I have to You mentioned that you're not building quantum, but you're leveraging prevention. Again, how are you leveraging it specifically? Is it in research stage right now or you moving the needle on product integration? Talk about what you're doing with that from a leverage standpoint where you see it being leveraged for the benefit of the customers. And then what the customer benefit?

>> If you look at, like I said, mentioned that traveling sales person problem, where you have to try all the combinations. If you were to run that in traditional cloud computing, it could take you days, maybe months to run those trial and error scenarios and then finally get a best solution. And that is expensive, especially in the cloud. What quantum will give you the abilities to instantaneously search that entire space, because of its unique characteristics and qualities, and then find the best solutions that be put back into traditional computing. And then it's almost like shortcuts to good enough answers that can be put back into traditional computing, which means all that cloud spend collapses to a much shorter amount of time.

>> So you see it leveraging customers where they have use cases where unattainable outcomes or ideas or unknown thoughts about leverage

>> Like drug discovery, I mean there's a lot of things like molecular compounds, there's chemistry. Understanding the physics and the interactions of molecules at the lowest level is a very complicated task, exhaustive computationally. And you can imagine every drug company out there, pharmaceutical company wants to build a killer pipeline so they can get ahead of the FDA submissions. And that's one of the key areas that Quantum have a huge help in.

>> So I'm going to play the skeptic.

>> Sure.

>> Bryan. hey, I hear you in all this. Quantum is a science project. I know if they're smoking in those labs, entanglements, qubits, whatever. HPC and AI are going to solve this problem. High point computers is already there. They do a molecule stuff on cloud, they're slow, but HPC and AI, GPU clouds, they're the rage. Is that just a longer distance?

>> I appreciate that perspective and I think you got to be careful with the hammer or nail scenario. If someone's making GPUs, look like GPU should solve it, right? Someone's making CPUs CPU. I think something that SAS does well is that we're looking at all the technology market to out what's the right use of technology for the problem. And that's why, that's the area of research we're doing. We're doing things like what are the classifications of problems? What are the industries this to have an impact in? It just so happens it coincides with our top four strategic industries, banking, insurance, life sciences, and government, right? There's a lot there. Security is a big deal, right? The whole shop 256, right? Everyone's worried about Bitcoin being un-cracked open because quantum can basically try all the ways to go and identify a key, a private key and then unlock wallets. So there needs to be a lot of research here. So to answer your question, it's not just research for us. We are actually looking and working with customers who want to solve problems, and we're exploring that.use cases specifically like the crypto hacking or cracking the wallet as a realistic possibility?

>> Yeah. This is a known concern. That's why there's now quantum proof encryption out there, because this is emerging at a point where people are concerned about this. So I think for us, we are a company that always wants to deliver results, not hype. We cut through the hype and look at how we can apply our technology in ways that is groundbreaking but pragmatic for businesses. So what we're doing is when we interact with quantum computers, we bring it back into our SAS Viya ecosystem, and then they get all the governance and transparency. We get it. It's no different If we were to leverage a GPU for deep learning model in our model studio. So it's us, we see it as normalizing the way we integrate it into our stack, and then the customer benefits from that and they don't have to change their workflow with our software.

>> So I mean, quantum computers, they're huge. They're bigger than, and they're all liquid cooled and then they're loud.

>> High CapEx investment.

>> So where are these things going to live? Obviously all the cloud guys are doing it. Satya showed it, et cetera, so they're going to be in the cloud. But you see all these specialized GPU clouds popping up all over place, which is kind of interesting. Some people are doing their AI on-prem. Where are these things going to live?

>> I think with quantum computing, I mean it's clear that I think it's going to take the same path as GPUs. So just like let's say NVIDIA is a provider to the cloud providers. You've got super micro, these are all supply chains to the cloud providers. I think to see the same thing. I think to see the emerging quantum computing companies become just supply chains to the other cloud providers, and then they'll present those things. The cloud providers will present that as scale up, scale up down compute for your environment. That's why I said, really we expect Quantum... Our ability to leverage Quantum will be really the GPU for optimization problems. Back to your original question, when we have problems that make sense for quantum, we're going to leverage that to accelerate our compute just like GPU does.

>> And some of your customers might build their own quantum data centers or no?

>> I think, well, the government could get there, but I don't think-

>> The banks aren't going to do.

>> that there's too much capital. It's not core to their business. And I think that honestly, there is so much still progression needs to happen on that space that you got to be focused on that.

>> Again, you guys have been very loud and clear about use cases here, pragmatic, but also high-impact performance.

>> And real quick too on this. We are a numbers company, so if there's any company in the world that should be an expert in this, we should be. Because we have been from the beginning, a statistics company, now an AI company. But so all that is fun. Foundational to all that is our ability to do quantitative reasoning and quantitative analysis. So quantum is just an extension of us doing that better and faster.

>> So we shouldn't think that quantum computers are going to replace traditional computers or should we? Just like now Jensen would say that GPUs going to replace... Every workload's going to be accelerated, so there's really no need for... He implies there's no need for traditional CPUs, but we know he's going to be-

>> That's the hammer and nail.

>> Right. Exactly. We know there's going to be a lot of diversity out there, but help us understand that. Help the audience understand that we're not talking about a wholesale replacement of traditional computing Von Neumann architectures, or are we?

>> The GPU came about because we had the offload graphics off of CPU, right? so once we could do that, then we realize the same math that's in GPUs can be applied for AI, for gaming, can be done for AI

>> And crypto mining.

>> And crypto mining. And so I think you're just going to have the same thing here. I think the difference with Quantum is because it's so, so big and so nebulous in a sense that people don't feel it as finite as GPU is. We can all put a GPU card in our computer, but Quantum is just to see that quantum computer as just another GPU your opportunity.

>> I mean SAS, your model is just I'll leverage whatever computer XPUs I can get for much horsepower for the use case that it needs. some cases you need Monster and Quantum and with AI could work too. By the way, Dave, HPC and AI, over the past two years, we've been going to super computing for the past couple years with theCUBE. I mean, that's the show that's been around since I graduated college in 1988. They haven't moved the needle. It's like inch by inch high proportion piece. This niche thing. They're doing stuff high performance now like wing construction for Boeing that takes literally minutes now. It used to take hours and hours of compute. So there's advancements on HPC, but that's not Quantum.

>> No.

>> That's a huge difference Viya, something called the cloud analytics service, which is our in-memory analytic engine. And we can actually run a multi-node, very large scale, and we have one of the top semiconductor companies in the world. Runs a whole automated model tournament using Viya's in-memory compute that behaves very much like HPC. It's holding data in memory and then doing multi-pass calls against it at high, high rates. And they can run thousands of model scenarios to then optimize their yield of their semiconductors. So we do this today, and I mean this is incredibly important to their business because that's how they improve their entire yield, which improves their margins and quality.

>> They're not huge data sets, are they? But they're quantitative data sets.

>> 20 terabytes in size. You're holding 20 terabytes in memory.

>> Right. It's not terabytes quantitative data sets that terabytes.

>> Yeah, I mean, I think some point you have to allow data to sit on disc because it gets so all in memory.

>> So one of the highlights yesterday, the demo was Dr. Goodnight was on stage doing a demo and a couple comments jumped out at me. Obviously I'd like to admire the entrepreneur companies doing this for decades. He made a comment, We're not an interpreter. We actually compile our code.Because he was referencing the performance.

>> That's correct.

>> Okay, so performance is huge. Let's riff a little bit here. Put you on the spot. You presented yesterday. Performance is huge. LLMs. got people who will use AI, they'll build their own, they'll subscribe to models. Will all this overhead that will come out of the opportunity to make that go faster, compiling LLM... Not compiling, literally you have to start putting this stuff together. Data's involved. You guys have good experience with data and making it high performance. Where's the work need to get done on the LLM Foundation models on the performance side? Is it integration? Is it mashing up models? Are going to have a mashup culture soon or is it already here? Where's the pressure point? What's the constraints, besides power and chip at the software layer, where's the

>> work?Let's talk about post-model training into the scoring side, which we used to call scoring. But I think one big things at LLMs is the latency. Customers want to put these things into scenarios where there has to be sub-second latency or maybe a second latency. And that if you can't approach those responses on that, takes it out of the entire possibility of being used for workflow.

>> It's

>> not adequate. It's not inside the decision window. And you heard with some of the work we did with Georgia Pacific, they had half a second latency to make decisions on these things. So I think that there's just latency is a concern. And then when you think latency, because the latency's due to a couple of reasons. These RAG architectures, while cool, it's just a lot of orchestration across, okay, going to ask an LLM a question. Before I do that, I'm going to go query my internal knowledge into a vector data store. And that's been basically chunked out. So they got to do this massive similarity search, bring that data back, present it back to the LLM and say, here's a few shot examples, now reason over this. And then by the way, I need to call an enterprise system over here to go get some real numbers because LLMs can't deal with that. Well, let's pull that stuff back in and put it in present the result back. So there's a huge opportunity for the performance of that orchestration.

>> That sounds like an operating system to me. You're linking, you're scheduling, you're loading.

>> That's a great point.

>> I mean, you're basically runtime, because generative AI generating. It's a net category. You don't know what you're going to get until the prompt or thing happens.

>> That's correct. I mean, it's a non-deterministic model. So as a result, we got to react to it.

>> Are we going to have an AI operating system that's going to not look like Linux or anything else? It's going to be some other knowledge graph, neural networks.

>> I think as in any technology, any transformative phase of technology, once the design pattern emerges, then people optimize the execution of it. You see that, like I said, CPU, how do we offload the CPU to do graphics work? Let's build a GPU, right? And so you can imagine there's probably similar strategies going to emerge in rag architectures and LLM interactions that going to see. look, at Apple's system on a chip, I mean the whole point of system on a chip is that they lowered the power needs and the cooling needs because they've got everything integrated in the same silicon. And that's amazing

>> With a big share at SRAM. It is amazing.

>> Yeah.

>> AI great opportunity for your company. The last question as we wrap up. For the folks that are customers and prospects, what is AI doing for your company and where do you see that going? What's it going to turn SAS into? With all that install base, all those assets you have, you're bringing to the table, what does SAS transform into with this industry shift?

>> I think for me, I think people should see us as one of the most trusted companies to deal with AI, to cut through the hype and deliver real results of AI. I mean, at the end of the day, as you know, you go to many conferences, you meet with many customers, all the words are being said, right? There's only so many words we can all say. So what does it come down to? It comes down to execution of how well do you execute and how well do you perform? How well does the software perform and how well does the project execute for that customer? And then there's the post-sale experience, how good is your support? I heard two customers, two banks say SAS communities is unbelievable. They said that to me directly, unsolicited. And so that's part of the experience, the brand experience of SAS. So for me, we are excellent with AI and we have the most experience in the world. We've been doing neural networks in production for 25 years. We've talked about that before. People don't know that. But we've been doing it. We've been writing some of the books on these things. We're going to continue to be us, be thoughtful, cut the hype, deliver real results, and ultimately execute flawlessly with customers.

>> And if you hit those marks, the revenue is just the result of that execution.

>> That's the lagging indicator.

>> You guys are good at hard math and stuff like that too. But I got to ask Bryan about our bet. Did you see my Twitter poll?

>> I did.

>> Okay. So I got to ask you about AGI, where you stand on this. So John and I made a bet yesterday.

>> Don't tell him what

>> I'm not

>> Don't lead the witness.

>> And we bet dinner. Loser buys dinner, John said, As long as a robot makes it.Is funny. the question is in the poll, when do you think we'll see machines display broadly adaptable intelligence similar to human cognition? By 2030, many decades from now, centuries from now or never? How do you see it?

>> I want to say never. I think this is, as we said, there's a lot of power being used and compute being used just to predict the next word right And I know that the attention strategies we've got with transformers are very powerful, but the reality is that humans draw from so many data points in their experiences in life to make a decision. And what we're really asking is for computers to help scale that. Just like your social media has been an extension of your memory bank, your pictures, your friends, your networks. We can scale our network of people because I can keep in touch with them in different ways, but that doesn't replace the human experience. And so I believe this movement towards AGI just... I think it's like guys, to what reason here? To what extent are we trying to do this here? There are a lot of problems we need to solve right now. I think there's reasons to do that to say we should pursue it, but I think we should be reasonable that that's acitodic, I think you don't really ever get there. You just improve the way to scale human reasoning and decision making.

>> Walking halfway to this. So you're a human optimist.

>> Yeah.

>> I like it. Okay. I got to ask you a follow-up question then. Where are you on FSD, Full Self Driving? Are you a similar-

>> I have a real problem actually with some of this. I actually think that there's a whole perspective in the past where you build bridges. There's like 11 people that die when you build a bridge. And people just accepted that that should happen. My issue is that where's the transparency to make sure that when people are driving on a road that they are aware there are full self-driving vehicles on the road completely on that. And without that, I don't think we've been transparent enough with society to really make sure that could be done effectively. As we know, software has bugs. We all know that. Anyone says there's no bugs is ridiculous. And when someone's loved one is killed by an FSD car, they're not going to care about the stats that someone says like, well, full self-driving is basically 60better at avoiding accidents. It doesn't matter when your loved one is in even the small minority percentage of people. They're upset that their loved one was injured or hurt. And I think that we have to remember that no one's going to care about the aggregate statistics when your loved one is injured. So we really have to be careful and transparent with this type of technology.

>> I like to ask technologists. That's a good answer, and I agree with not really a technical issue you have. It's more like the regulators don't know who's accountable for this stuff.

>> Well, that's the thing. I mean, you're have lawyers packed. I mean, the courtrooms will be packed with technologists over the next decade, because the people are all to be trying to figure out who's responsible and who's suing who.

>> And Reggie Townsend on your team, he was on stage. Kara Swisher and was on there. This is going to have to be transparent, and because there's a lot of work to do. And as they pointed out and we did on yesterday, there's a lot of good work going on with AI right now, and that's got to get done and the foundation's got to be built.

>> Yeah, I mean, that's the work we all got to do. I mean, that's why I said I am a human optimist because I believe that we are building AI for us. It's not the other way around. I mean, we're building it for our benefit. And so we should be thinking about how we're going to use it for ultimately how we want better society.

>> Are you happy with the event so far?

>> Oh, this has been unbelievable. The customers, I mean it's packed. The action-

>> The vibe.

>> It's so great. The work that my RD team has done is incredible. The work that the events team has done is incredible support. Dr. Goodnight, getting on stage and just-so cool....

>> still coding, does it every day. It's just the

>> As like I said on my tweet, Shannon and your team retweeted the sizzle and the steak, and we were at explore. You said, This is we're going to do.And you guys delivered. So when you see production workloads, that's what we said last year going into this year, that's going to be the benchmark for AI reality in the enterprise.

>> That's right.

>> Show me production workloads. You guys had them on stage. Congratulations.

>> We had one analyst say to us, All killer, no filler.That's what we do.

>> Bryan, thanks. Appreciate.

>> Thank you.

>> I'm John Furrier with Dave Vellante. right back. Into the short break.

Bryan Harris | SAS

search

>> Welcome back everyone to the live CUBE coverage here in Las Vegas for SAS Innovate 2024. I'm John Furrier, host of theCUBE. My cohost Dave Vellante, heads up Cube Research, also co-founder, of course, here with me, founder of theCUBE. Bryan Harris is here. CTO SAS. Multiple times. Second time on this event. We're coming back to go do a deeper dive on some of the tech and really what's driving the AI is the technology, but also the business model, workflows, and data. And the three things we talked about last today was product productivity, performance and trust.

>> Yes.

>> Great to see you.

>> Good to see you, John. Good to see you, David. Always a pleasure.

>> Hey Bryan.

>> So for the folks that are watching, you might not have seen yesterday, you did the hot wings, what was it called?

>> Hot ones.

>> Hot ones. You down-

>> Sean Evans and start from one wing to 10 with a progressive heat going on. It was insane. One of the greatest experiences in my life. Amazing.

>> They showed the replay today. The keynote. You were dripping was a tomato. I there.

>> Had a body experience.Under

>> duress.So

>> good.As I said, a lot of hot takes going on there, here So we want into it. So I want to get into the AI impact. We're going a little bit, but we to talk about performance. So the big theme with AI is you need more horsepower. I mean, generalizing AI has XPUs, which is GPUs, to call it. And in the mix there. You brought up your keynote. And so you're starting to hear Quantum in the same conversations now when you talk about these advanced AI demos and presentations, because there's a performance angle there.you mean by quantum? When you bring it up on the keynote and with all the goodness you guys are announcing, a lot of accomplishments, a lot of tech customers with their AI stacks, why quantum?

>> Well, I think that when we Because obviously generative AI is getting a lot of the headlines these days, but it really doesn't have a strong story in the quantitative space. It's really around reasoning of facts. And obviously they can do things with multimedia, you get that. But when you about dealing with numbers, it's actually very, very weak. And so you got to start asking yourself, well, where are we going to start seeing acceleration on quantitative reasoning? That's really what I would look at it, right? And so when you start looking at that, obviously quantum because of its architecture and ability to have the superposition allows you to have multiple states at once, which means you can do some really incredible, almost futuristic things. So one of the big problems that we see is you got to find the right problem with quantum first. It's not for every problem. I mean, GPUs exist because they're great at doing linear algebra and multi-threaded linear algebra for deep learning. But there are optimization problems that require combinatorial trial and error type scenarios. And these are some of the hardest problems in the world, and they're very impactful for four industries, life sciences, banking in the government space as well as you think like I've mentioned, life sciences, but pharmaceutical industry, insurance. And so if you can find ways to compute these really, really hard combinatorial problems faster, you can really drive the cost of compute down and solve problems that were unsolvable before. The basic example is this traveling salesperson problem. Which is like for instance, you got a salesperson in a city center, they have to visit a bunch of cities and only visit one of those cities once and get back to home. And they got to do that in a way that minimizes distance. And there's no algorithm to do this. You just have to try them all out, evaluate the distance and then pick the right one. Well, in real world problems, that becomes exponentially complicated. And so quantum allows us to search that entire space of combinations and get to the right solutions faster.

>> I think it was you in your keynote yesterday. a great keynote-

>> You said within a year and a half, two years, your Quantum is going to have its gen AI moment.

>> That's correct. I believe it. The market is showing a lot of progression on it. So I think it's like 35 billion as the market size right now, but it's projected to go to a trillion dollars by 2030. So got to imagine what's happening in the next six years. The leaps we're going to make in this. And one of the big things that's happening in quantum is this idea of, well qubits, and this is very analogous to what was going on with traditional computing. We had 8-bit computers, 16-bit computers, 32-bit computers, 64-bit computing. So scalability of arithmetic is the big issue with quantum right now. So as we go through the qubits, scaling up on that, we'll be able to scale into more sophisticated problems in the market. And I think that when you look at what the demand of complexity of problems that in the financial world, the hyper-connectivity of all these financial systems right now is creating combinatorial problems that need to be explored differently and quantum can help solve these things.

>> So I really hadn't paid much attention to quantum until recently. It looks like it's finally starting to-

>> It's heating up....

>> get real, and there's a lot of different techniques you could scale, but then the qubits aren't stable or you can get the qubits stable, but it's really slow, which defeats the purpose of quantum. From a technology standpoint. Correct me if I'm wrong, but it seems like we're solving those problems. Do you have sort of line on site on maybe which of those techniques or have you chosen a path that

>> There's two approaches that quantum computers are approaching. And again, we're not in the business of building them. We're in there just to leverage them, but there's quantum annealing, and these strategies are really about... Quantum annealing allows to maintain state of a one or a zero, or in the case of quantum, you this kind of idea of a superposition where you can actually be in two different states at once, which is incredible power.

>> It's like mind-bending.

>> Yes. And so, when you think of that though, the other one is quantum gates, which is where they're trying to mimic the traditional semiconductor like in transistor. And so those are the two big areas where people are pushing and research onto those. And those different quantum computers have different problems they're good at solving. I think there's a pursuit right now quantum gates that we could just approach traditional problems one for one because it looks like what a semiconductor would do or transistors and things like that. Whereas quantum annealing I think actually really stable right now many areas of optimization problems, which I said is there is no algorithmic efficiency for that.

>> So just one more follow up. When you talked about 64, when we went to 64, you had to make some application changes to take advantage of it, and that's what you do with quantum, right? So you're in the process of doing that, or I mean, yes, there's going to be part of that, a lot of these, when we leverage them, we're just sending them off as APIs to these things. And that's all hidden behind the scenes. It's just a matter of scale of how much can a process of one time based on and then what's the efficiency of doing that. But we see that's just a natural progression in that industry. That be solved. And when it's solved, SAS wants to be ready to be leveraging these things. And what we're doing is we're putting them in this hybrid architecture of traditional computing and quantum. And I would say this, GPUs didn't take you over the CPU. They're just a specialized class of XPU as you called it, right?

>> Mm-hmm.

>> And I think Quantum's going to have its space, right? So when you're talking about GPUs, it's great for linear algebra and matrix multiplication, and going to be great at search space optimization for how do I discover solutions in a very complicated problem. Now, that be presented as compute in the cloud or as a service to a quantum computing company. And you're just going to leverage that service into your existing data and AI life cycle and leverage incredible outcomes with it.

>> I have to You mentioned that you're not building quantum, but you're leveraging prevention. Again, how are you leveraging it specifically? Is it in research stage right now or you moving the needle on product integration? Talk about what you're doing with that from a leverage standpoint where you see it being leveraged for the benefit of the customers. And then what the customer benefit?

>> If you look at, like I said, mentioned that traveling sales person problem, where you have to try all the combinations. If you were to run that in traditional cloud computing, it could take you days, maybe months to run those trial and error scenarios and then finally get a best solution. And that is expensive, especially in the cloud. What quantum will give you the abilities to instantaneously search that entire space, because of its unique characteristics and qualities, and then find the best solutions that be put back into traditional computing. And then it's almost like shortcuts to good enough answers that can be put back into traditional computing, which means all that cloud spend collapses to a much shorter amount of time.

>> So you see it leveraging customers where they have use cases where unattainable outcomes or ideas or unknown thoughts about leverage

>> Like drug discovery, I mean there's a lot of things like molecular compounds, there's chemistry. Understanding the physics and the interactions of molecules at the lowest level is a very complicated task, exhaustive computationally. And you can imagine every drug company out there, pharmaceutical company wants to build a killer pipeline so they can get ahead of the FDA submissions. And that's one of the key areas that Quantum have a huge help in.

>> So I'm going to play the skeptic.

>> Sure.

>> Bryan. hey, I hear you in all this. Quantum is a science project. I know if they're smoking in those labs, entanglements, qubits, whatever. HPC and AI are going to solve this problem. High point computers is already there. They do a molecule stuff on cloud, they're slow, but HPC and AI, GPU clouds, they're the rage. Is that just a longer distance?

>> I appreciate that perspective and I think you got to be careful with the hammer or nail scenario. If someone's making GPUs, look like GPU should solve it, right? Someone's making CPUs CPU. I think something that SAS does well is that we're looking at all the technology market to out what's the right use of technology for the problem. And that's why, that's the area of research we're doing. We're doing things like what are the classifications of problems? What are the industries this to have an impact in? It just so happens it coincides with our top four strategic industries, banking, insurance, life sciences, and government, right? There's a lot there. Security is a big deal, right? The whole shop 256, right? Everyone's worried about Bitcoin being un-cracked open because quantum can basically try all the ways to go and identify a key, a private key and then unlock wallets. So there needs to be a lot of research here. So to answer your question, it's not just research for us. We are actually looking and working with customers who want to solve problems, and we're exploring that.use cases specifically like the crypto hacking or cracking the wallet as a realistic possibility?

>> Yeah. This is a known concern. That's why there's now quantum proof encryption out there, because this is emerging at a point where people are concerned about this. So I think for us, we are a company that always wants to deliver results, not hype. We cut through the hype and look at how we can apply our technology in ways that is groundbreaking but pragmatic for businesses. So what we're doing is when we interact with quantum computers, we bring it back into our SAS Viya ecosystem, and then they get all the governance and transparency. We get it. It's no different If we were to leverage a GPU for deep learning model in our model studio. So it's us, we see it as normalizing the way we integrate it into our stack, and then the customer benefits from that and they don't have to change their workflow with our software.

>> So I mean, quantum computers, they're huge. They're bigger than, and they're all liquid cooled and then they're loud.

>> High CapEx investment.

>> So where are these things going to live? Obviously all the cloud guys are doing it. Satya showed it, et cetera, so they're going to be in the cloud. But you see all these specialized GPU clouds popping up all over place, which is kind of interesting. Some people are doing their AI on-prem. Where are these things going to live?

>> I think with quantum computing, I mean it's clear that I think it's going to take the same path as GPUs. So just like let's say NVIDIA is a provider to the cloud providers. You've got super micro, these are all supply chains to the cloud providers. I think to see the same thing. I think to see the emerging quantum computing companies become just supply chains to the other cloud providers, and then they'll present those things. The cloud providers will present that as scale up, scale up down compute for your environment. That's why I said, really we expect Quantum... Our ability to leverage Quantum will be really the GPU for optimization problems. Back to your original question, when we have problems that make sense for quantum, we're going to leverage that to accelerate our compute just like GPU does.

>> And some of your customers might build their own quantum data centers or no?

>> I think, well, the government could get there, but I don't think-

>> The banks aren't going to do.

>> that there's too much capital. It's not core to their business. And I think that honestly, there is so much still progression needs to happen on that space that you got to be focused on that.

>> Again, you guys have been very loud and clear about use cases here, pragmatic, but also high-impact performance.

>> And real quick too on this. We are a numbers company, so if there's any company in the world that should be an expert in this, we should be. Because we have been from the beginning, a statistics company, now an AI company. But so all that is fun. Foundational to all that is our ability to do quantitative reasoning and quantitative analysis. So quantum is just an extension of us doing that better and faster.

>> So we shouldn't think that quantum computers are going to replace traditional computers or should we? Just like now Jensen would say that GPUs going to replace... Every workload's going to be accelerated, so there's really no need for... He implies there's no need for traditional CPUs, but we know he's going to be-

>> That's the hammer and nail.

>> Right. Exactly. We know there's going to be a lot of diversity out there, but help us understand that. Help the audience understand that we're not talking about a wholesale replacement of traditional computing Von Neumann architectures, or are we?

>> The GPU came about because we had the offload graphics off of CPU, right? so once we could do that, then we realize the same math that's in GPUs can be applied for AI, for gaming, can be done for AI

>> And crypto mining.

>> And crypto mining. And so I think you're just going to have the same thing here. I think the difference with Quantum is because it's so, so big and so nebulous in a sense that people don't feel it as finite as GPU is. We can all put a GPU card in our computer, but Quantum is just to see that quantum computer as just another GPU your opportunity.

>> I mean SAS, your model is just I'll leverage whatever computer XPUs I can get for much horsepower for the use case that it needs. some cases you need Monster and Quantum and with AI could work too. By the way, Dave, HPC and AI, over the past two years, we've been going to super computing for the past couple years with theCUBE. I mean, that's the show that's been around since I graduated college in 1988. They haven't moved the needle. It's like inch by inch high proportion piece. This niche thing. They're doing stuff high performance now like wing construction for Boeing that takes literally minutes now. It used to take hours and hours of compute. So there's advancements on HPC, but that's not Quantum.

>> No.

>> That's a huge difference Viya, something called the cloud analytics service, which is our in-memory analytic engine. And we can actually run a multi-node, very large scale, and we have one of the top semiconductor companies in the world. Runs a whole automated model tournament using Viya's in-memory compute that behaves very much like HPC. It's holding data in memory and then doing multi-pass calls against it at high, high rates. And they can run thousands of model scenarios to then optimize their yield of their semiconductors. So we do this today, and I mean this is incredibly important to their business because that's how they improve their entire yield, which improves their margins and quality.

>> They're not huge data sets, are they? But they're quantitative data sets.

>> 20 terabytes in size. You're holding 20 terabytes in memory.

>> Right. It's not terabytes quantitative data sets that terabytes.

>> Yeah, I mean, I think some point you have to allow data to sit on disc because it gets so all in memory.

>> So one of the highlights yesterday, the demo was Dr. Goodnight was on stage doing a demo and a couple comments jumped out at me. Obviously I'd like to admire the entrepreneur companies doing this for decades. He made a comment, We're not an interpreter. We actually compile our code.Because he was referencing the performance.

>> That's correct.

>> Okay, so performance is huge. Let's riff a little bit here. Put you on the spot. You presented yesterday. Performance is huge. LLMs. got people who will use AI, they'll build their own, they'll subscribe to models. Will all this overhead that will come out of the opportunity to make that go faster, compiling LLM... Not compiling, literally you have to start putting this stuff together. Data's involved. You guys have good experience with data and making it high performance. Where's the work need to get done on the LLM Foundation models on the performance side? Is it integration? Is it mashing up models? Are going to have a mashup culture soon or is it already here? Where's the pressure point? What's the constraints, besides power and chip at the software layer, where's the

>> work?Let's talk about post-model training into the scoring side, which we used to call scoring. But I think one big things at LLMs is the latency. Customers want to put these things into scenarios where there has to be sub-second latency or maybe a second latency. And that if you can't approach those responses on that, takes it out of the entire possibility of being used for workflow.

>> It's

>> not adequate. It's not inside the decision window. And you heard with some of the work we did with Georgia Pacific, they had half a second latency to make decisions on these things. So I think that there's just latency is a concern. And then when you think latency, because the latency's due to a couple of reasons. These RAG architectures, while cool, it's just a lot of orchestration across, okay, going to ask an LLM a question. Before I do that, I'm going to go query my internal knowledge into a vector data store. And that's been basically chunked out. So they got to do this massive similarity search, bring that data back, present it back to the LLM and say, here's a few shot examples, now reason over this. And then by the way, I need to call an enterprise system over here to go get some real numbers because LLMs can't deal with that. Well, let's pull that stuff back in and put it in present the result back. So there's a huge opportunity for the performance of that orchestration.

>> That sounds like an operating system to me. You're linking, you're scheduling, you're loading.

>> That's a great point.

>> I mean, you're basically runtime, because generative AI generating. It's a net category. You don't know what you're going to get until the prompt or thing happens.

>> That's correct. I mean, it's a non-deterministic model. So as a result, we got to react to it.

>> Are we going to have an AI operating system that's going to not look like Linux or anything else? It's going to be some other knowledge graph, neural networks.

>> I think as in any technology, any transformative phase of technology, once the design pattern emerges, then people optimize the execution of it. You see that, like I said, CPU, how do we offload the CPU to do graphics work? Let's build a GPU, right? And so you can imagine there's probably similar strategies going to emerge in rag architectures and LLM interactions that going to see. look, at Apple's system on a chip, I mean the whole point of system on a chip is that they lowered the power needs and the cooling needs because they've got everything integrated in the same silicon. And that's amazing

>> With a big share at SRAM. It is amazing.

>> Yeah.

>> AI great opportunity for your company. The last question as we wrap up. For the folks that are customers and prospects, what is AI doing for your company and where do you see that going? What's it going to turn SAS into? With all that install base, all those assets you have, you're bringing to the table, what does SAS transform into with this industry shift?

>> I think for me, I think people should see us as one of the most trusted companies to deal with AI, to cut through the hype and deliver real results of AI. I mean, at the end of the day, as you know, you go to many conferences, you meet with many customers, all the words are being said, right? There's only so many words we can all say. So what does it come down to? It comes down to execution of how well do you execute and how well do you perform? How well does the software perform and how well does the project execute for that customer? And then there's the post-sale experience, how good is your support? I heard two customers, two banks say SAS communities is unbelievable. They said that to me directly, unsolicited. And so that's part of the experience, the brand experience of SAS. So for me, we are excellent with AI and we have the most experience in the world. We've been doing neural networks in production for 25 years. We've talked about that before. People don't know that. But we've been doing it. We've been writing some of the books on these things. We're going to continue to be us, be thoughtful, cut the hype, deliver real results, and ultimately execute flawlessly with customers.

>> And if you hit those marks, the revenue is just the result of that execution.

>> That's the lagging indicator.

>> You guys are good at hard math and stuff like that too. But I got to ask Bryan about our bet. Did you see my Twitter poll?

>> I did.

>> Okay. So I got to ask you about AGI, where you stand on this. So John and I made a bet yesterday.

>> Don't tell him what

>> I'm not

>> Don't lead the witness.

>> And we bet dinner. Loser buys dinner, John said, As long as a robot makes it.Is funny. the question is in the poll, when do you think we'll see machines display broadly adaptable intelligence similar to human cognition? By 2030, many decades from now, centuries from now or never? How do you see it?

>> I want to say never. I think this is, as we said, there's a lot of power being used and compute being used just to predict the next word right And I know that the attention strategies we've got with transformers are very powerful, but the reality is that humans draw from so many data points in their experiences in life to make a decision. And what we're really asking is for computers to help scale that. Just like your social media has been an extension of your memory bank, your pictures, your friends, your networks. We can scale our network of people because I can keep in touch with them in different ways, but that doesn't replace the human experience. And so I believe this movement towards AGI just... I think it's like guys, to what reason here? To what extent are we trying to do this here? There are a lot of problems we need to solve right now. I think there's reasons to do that to say we should pursue it, but I think we should be reasonable that that's acitodic, I think you don't really ever get there. You just improve the way to scale human reasoning and decision making.

>> Walking halfway to this. So you're a human optimist.

>> Yeah.

>> I like it. Okay. I got to ask you a follow-up question then. Where are you on FSD, Full Self Driving? Are you a similar-

>> I have a real problem actually with some of this. I actually think that there's a whole perspective in the past where you build bridges. There's like 11 people that die when you build a bridge. And people just accepted that that should happen. My issue is that where's the transparency to make sure that when people are driving on a road that they are aware there are full self-driving vehicles on the road completely on that. And without that, I don't think we've been transparent enough with society to really make sure that could be done effectively. As we know, software has bugs. We all know that. Anyone says there's no bugs is ridiculous. And when someone's loved one is killed by an FSD car, they're not going to care about the stats that someone says like, well, full self-driving is basically 60better at avoiding accidents. It doesn't matter when your loved one is in even the small minority percentage of people. They're upset that their loved one was injured or hurt. And I think that we have to remember that no one's going to care about the aggregate statistics when your loved one is injured. So we really have to be careful and transparent with this type of technology.

>> I like to ask technologists. That's a good answer, and I agree with not really a technical issue you have. It's more like the regulators don't know who's accountable for this stuff.

>> Well, that's the thing. I mean, you're have lawyers packed. I mean, the courtrooms will be packed with technologists over the next decade, because the people are all to be trying to figure out who's responsible and who's suing who.

>> And Reggie Townsend on your team, he was on stage. Kara Swisher and was on there. This is going to have to be transparent, and because there's a lot of work to do. And as they pointed out and we did on yesterday, there's a lot of good work going on with AI right now, and that's got to get done and the foundation's got to be built.

>> Yeah, I mean, that's the work we all got to do. I mean, that's why I said I am a human optimist because I believe that we are building AI for us. It's not the other way around. I mean, we're building it for our benefit. And so we should be thinking about how we're going to use it for ultimately how we want better society.

>> Are you happy with the event so far?

>> Oh, this has been unbelievable. The customers, I mean it's packed. The action-

>> The vibe.

>> It's so great. The work that my RD team has done is incredible. The work that the events team has done is incredible support. Dr. Goodnight, getting on stage and just-so cool....

>> still coding, does it every day. It's just the

>> As like I said on my tweet, Shannon and your team retweeted the sizzle and the steak, and we were at explore. You said, This is we're going to do.And you guys delivered. So when you see production workloads, that's what we said last year going into this year, that's going to be the benchmark for AI reality in the enterprise.

>> That's right.

>> Show me production workloads. You guys had them on stage. Congratulations.

>> We had one analyst say to us, All killer, no filler.That's what we do.

>> Bryan, thanks. Appreciate.

>> Thank you.

>> I'm John Furrier with Dave Vellante. right back. Into the short break.