Persistent Partner Series | Pandurang Kamat | Persistent Systems & Sudhir Hasbe | Neo4j

Clips
News
More from Persistent Partner Series

Sudhir Hasbe

Chief Product Officer

Neo4j

Pandurang Kamat

CTO

Persistent Systems

Persistent Systems and Neo4j collaborate on knowledge graph initiatives for AI

The rise of generative artificial intelligence has sparked renewed interest in knowledge graphs, and this has become a major opportunity for Persistent Systems Ltd. and Neo4j Inc.Knowledge graphs use graph-structured data models to describe entities and their relationships, an important factor in enabling large language models to provide the correct level of insight in generative AI applications. Persistent Systems and Neo4j are collaborating on a set of initiatives surrounding graph databases and their use in enterprise AI to leverage large data stores

play_circle_outline Exploring the Synergy: Knowledge Graphs, Vector Databases, and GenAI in Advancing AI Infrastructure and Breaking Data Silos

play_circle_outline Exploring the Synergies: Leveraging Vector Databases and Knowledge Graphs for Transparent and Accurate AI Solutions

play_circle_outline Partnership between Neo4j and Persistent Systems in enabling customers to build knowledge graphs.

play_circle_outline Exploring the Impacts of Horizontal Scalability and Vector Integration in Knowledge Graphs for Enhanced Search and Retrieval

play_circle_outline Collaboration between Persistent and Neo4j in developing tools and aperture for knowledge graphs

play_circle_outline Importance of ontologies and their scaling with knowledge graphs and generative AI

play_circle_outline Mission of driving intelligence in the enterprise and ensuring trust, accuracy, and explainability.

Info

Pandurang Kamat | Persistent Systems & Sudhir Hasbe | Neo4j

Sudhir Hasbe

Chief Product Officer Neo4j

Pandurang Kamat

CTO Persistent Systems

search

>> Hello and welcome to this special Cube Conversation. I'm John Furrier, host of the Cube. Here in our Palo Alto Studios, we've got two Cube alumni technologists here to talk about a great topic, empowering data intelligence. We're going to explore the intersection of knowledge graphs, vector databases, and GenAI with Neo4j and Persistent. We've got Pandurang Kamat, who's the chief technology office research and innovation with Persistent Systems. And we got Sudhir Hasbe, chief product officer at Neo4j. Gentlemen, great to see you. Thanks for coming back on the Cube. Appreciate seeing you.

>> Good to be here.

>> Good to be here, John.

>> So two technologists on one topic that's got a... We could probably talk for an hour. Knowledge graphs have been around for a while. Neural networks is talked a lot about in AI. Knowledge graphs, knowledge management, knowledge systems. GenAI is the perfect storm on this here. Talk about this piece because Neo4j set the standard for graph databases. Okay? This becomes a very key part of this new infrastructure that everyone's building on, and it's not the static web, siloed web we used to. It's got to be adaptive, it's got to have flexibility, it's got to be responsive, but the data's different in this. Take us through the technology perspective of how the graph databases are powering the intersection of all the great stuff.

>> No, absolutely, John. I think you're absolutely right. There has been an evolution of, in the industry, especially with generative AI, large language models, the kind applications people are thinking about. And within enterprises mainly, knowledge graphs have been there being deployed on top of Neo4j for a pretty long time. But most of that information was structured, and most of the use cases were enabling set of specific use cases, like fraud management or fraud detection, anti-money laundering, supply chain visibility. But the opportunity for enterprises now is as large language models are coming in and generative AI technology is coming in, to break the data silos within organizations. Now, you have tons of databases, hundreds of thousands of them in large organizations, trapping the data between them. And then when you want to go ahead and have an intelligent application that can answer questions that span across all this information, it's super hard to do that. And I think having this knowledge graph that can represent the knowledge out of all these system into a single framework, helps LLMs get the right information to give you the right answers to your questions and the problems. So I think we are seeing this interest in knowledge graphs to be the backbone for a lot of generative AI applications that people want to build. And that's where I think there is, you see this new interest and new sets of use cases that enterprises are looking at.

>> Pan, you guys are doing a lot of R&D, you guys groundbreaking AI work. We've been covering it out for over a year and a half at Persistent. The title Empowering Data Intelligence, we need more data Intelligence. Hallucinations is a big topic that comes up a lot with LLMs. The size of the models, small language models. In Vogue, we put out a power law with Cube Research, showing that models can coexist together but yet be separate. So what does empowering data intelligence mean to you?

>> Sure. So first of all, it's a real pleasure to be here with Sudhir, discussing this topic. We have been an avid user as a technology company of graph databases and Neo4j in particular over the years. Even building solutions around tax research, around fraud detection like you talked about and so forth. So it's a special opportunity that in today we are not only working with their technology, but with them and for them in actually moving the needle forward on how graph databases and generative AI can drive intelligence. So fundamentally, John, as you are well aware, the retrieval augmented generation and the internal reasoning of large language models has certain limitations to how far it can infer topics. And particularly, it struggles when trying to bring together relationships across very disparate datasets, both structured and unstructured, is not inherently built for that. So you have to augment it. And we typically augment it with vector databases by vectorizing information. But what graph databases and knowledge graphs bring to the table is they allow us to, like Sudhir said, pull in data from disparate data sources within enterprise, build out those relationships so that you can pull a deeper context and insight to give to the LLM, to synthesize its output on. And so that's the one biggest advantage that we see with knowledge graphs. And the other is overall finding themes and reasoning across datasets and volumes of data, that's inherently, again, harder for an LLM to do by itself. And that's where graph databases and knowledge graph have been a big boon in driving up the quality, accuracy, and contextual relevance of the answers that we are giving with these AI services.

>> Sudhir, talk about the data aspect here. Because data is critical, the knowledge graph, okay, the knowledge system, however, we're going to look at this, AI infrastructure is developing. The data has to be available, it can't be siloed. Talk about the importance of the shift that's happening now on how people are thinking about their data, and then how that's going to integrate as LLMs and foundation models become the standard for how applications will interact with data.

>> I think, let me go a little deeper on the large language model side a bit, and then we'll come back with the enterprise data. Large language models were built to basically enable you to go create, generate new information based on existing information. That's what the technology is about. It's mostly predicting what should be the next word, based on historically what it has learned from. Now, it's a great technology for generating language, but when we were in school, we went to the English class and we went to the math class and science class. English allowed you to be more creative. Math and science allowed you to be accurate about the information. I think the challenge with large language models is it can only be as accurate as the information it has learned from, but also it's a generative technology. It's the English class, so it will generate information, sometimes we call it hallucination, but I call it like, hey, it's a generative technology. It's doing the job it's supposed to do. Now, in enterprises, there are two sets of use cases. I actually have some information. Let's say, for example, I had a customer case where if something went wrong, I need to send them an email. And I know exactly what the issue happened and I want to take that information, give it to a large language model and say, "Hey, can you please create a really good-looking email to customer, John, whose order was misplaced and we were able to find it?" Create an email. Of course, large language model is going to be great at doing that because it knows how to write good email, because it's learned from the web what good English looks like. Take the same scenario, same infrastructure, and look at second use case where I'm an enterprise, I have the whole enterprise knowledge, I have an engine, I have parts in it. I want to go ahead and figure out, hey, I've just seen an engine oil light has come up. I need to go ahead and figure out what the technician should do to go ahead and solve that problem. Now, this requires you to know for that engine, what does the light mean? What are the parts that are required? What are the quantities you need to have? It needs the whole knowledge set that's only available, in many cases, in the enterprise. The large language models were never trained for it. So how do you take all that data? And then in this scenario, you also have the unstructured parts manuals along with the engine and its build of material. So think about bringing all that information, converting into knowledge into a single system, not like five databases and seven systems that the data is distributed, and all the parts manuals in some object store somewhere sitting around. To convert all of that into a knowledge graph that can then be accessed and you get real facts from there. And then you still use large language model for explaining the answer to the technician, but the facts have to come from the knowledge graph. So using large language models for the English or the language benefits, but using knowledge graphs for the accuracy of information, combine both of them, and you get the best of both worlds. So you now are more accurate. You can explain the answer because in the knowledge graph it came from this engine, these parts, these documents, you can completely be explainable. And that's how you can build the best generative AI solutions. So that's how this whole world comes together between structured, unstructured, vector information as part of your knowledge graph, and answering that question, using large language, natural language from there, but using the facts from knowledge graph.

>> Just to add one point on that. This is very beautifully put actually. The last part that he mentioned, which is large language models, given that they're neural-network-based and so forth, they're inherently little less explainable than where the industry has been trying to go with building explainability into the inference AI provides. So knowledge graphs provide that traceability, the visibility that you can give even to the end user depending on the user experience you're creating, to build further trust into the system. So it's not only about getting the accuracy right, but also about bringing trust and traceability to a system that when it went off the gate, was very opaque in that sense. So that's

>> a great pointAnd I think that's the key thing there you brought up is that right now everyone's talking about hallucinations, don't trust the data. And what they're really talking about is not generative AI, they're talking about the large language models. Because they play with OpenAI and they say, "That's not accurate, I wasn't involved in that, but it says I am." So they see the error and go, "I don't trust it." What you're getting at is you can have your knowledge graph, have proprietary data that's known to the company, working with the LLMs together to get the accuracy.

>> Yes.And

>> even further, because those knowledge graphs were driving customer experiences, other applications that were pre-GenAI. Now you bring knowledge graphs in with generative AI to create a new generative solution, which is the fusion of the data with the right mix. Am I getting that right? Is that the kind of way to think about it?

>> You nailed it, John. I think absolutely right. People think about ChatGPT, they try it now or barred and they're like, "Oh, I asked that question. It was wrong about this one." But what they are looking at is the large language model that was trained on complete web data. And you mentioned and Pandurang was talking about RAG and how retrieval-augmented generation is a pattern, a technology pattern that allows you to merge your large language model for English, and then knowledge graph for facts, information, and make better decisions. So I think now you're seeing these innovative patterns like RAG, that allow you to blend both of these technologies, large language models and knowledge graph to build generative AI applications for enterprises. And I think that's very exciting space. We're seeing tons of customers across different verticals building different kinds of solutions based on that.

>> We might have to do a part two, because you brought up a very important point that's part of the title, which is empowering data intelligence, exploring knowledge graphs and vector databases and GenAI. The vector database movement, having vector embeds is a key part of the RAG, retrieval augmentation generation. This is a way, a technique to use data in a new generative way, to get data together. It's evolving in its most popular application right now in most of the enterprises. These people are doing RAG because they have data in a knowledge graph. They want to map it up against a large language model like OpenAI or Entropik or Cohere. So you start to see the tinkering and the experimentation, the development where RAG, the RAG retrieval piece has to lean on the vector databases. So can you guys explain this power dynamic? Because this is a new thing, the vector database.

>> Pandurang, you want

>> to go first then I will go after that?Sure. Yeah.So

>> really, vector databases were or are a way in which you will bring structured information, put it in a mathematically representative form that makes it easier for your application to retrieve and bring the right context for the LLM to reason on it. Knowledge graphs provide a much richer relationship between the various key entities and how they tie to each other and allow you to infer second order, third order, fourth order insights that are not intuitively captured in a vector database. And one of the most exciting trends, and I don't want to speak on behalf of Sudhir, but the vision that Sudhir and team have laid out is about why do you need to do these two things separately? They can be much richer together when existing together in a single stack. And our entire mission is about helping customers make that easier to build these vector databases, to build the ontology that is relevant to their business. And then from that ontology, build a very rich knowledge graph that can actually augment your vector databases and give that much more larger and, not just larger, but actually more precise context for the LLM to reason on. And that's how we see this two exciting technologies come together to drive better intelligence than just vector DBs by themselves.

>> That's a great point.

>> Yeah. And just to add a little bit to that. I think we have seen a lot of people experiment with vectors and vector databases, as well as knowledge graphs and all. The initial starting use case that most customers or users start with is, "I have a bunch of PDF documents, unstructured data. I will give it to the LLM embedding model or embedding call, convert it into vectors, store it into a vector database and run a similarity search." So vector databases are, or vector solutions or stores are great at similarity searches based on vector embeddings. That's what they're really good at. So one use case, one thing. Now, it's powerful in some cases where you have a lot of PDF documents, you want to do search through them, you can do chunking of that data convert into vectors and all. But when you go ahead and think about a large enterprise, unstructured data or PDF documents are only one piece of the puzzle. They also have a lot of structured data which is like, "Hey, I'm bill of material for all of my product graph, or I have supply chain and in the supply chain I have all the entities that are connected and which suppliers provide me which products and all." So that whole structured information is also there. And so today, what you can do with technologies like Neo4j building a knowledge graph is just blend both worlds of what is possible with a vector database, which is then unstructured data converted into a vectorized information for similarity search, and also structured notion of what you can look at from a bill of material for your product or your supply chain or your customer 360, which is your relationship with customer, product, and all. And all the unstructured documents, the feedback the customer has given, that becomes a vectorized information in the knowledge graph. And you can do similarity searches based on unstructured data. You can do a search based on find me all the users or customers that look similar to this. You can do a blend of all of these use cases. So what we are seeing is in enterprises, the use cases are a lot more nuanced than just searching based on unstructured data. They require you to understand everything around it, and this is where knowledge graphs are a great way of representing that information that is structured, like many cases hierarchical and then also vectorized information for your unstructured data.

>> Yeah. It brings two worlds together and it actually scales it up faster. Let's get into the implementation. Can you guys share the implementation of these GenAI solutions at Neo4j? How are you harnessing the data for insights? Could you take us through the examples that you guys are working together on?

>> Yeah. Maybe I'll take a stab at it first.

>> Sure.

>> So one example is we are building a lot of solutions traditionally in the healthcare life sciences space, in the banking, financial services, and insurance space. So what we saw was an opportunity to bring these two together to drive innovation there. So to give you an example, we built certain proactive accelerators that allow us to search and sift through tons of biological data, whether it is drug molecule data, genetic, the genes express themselves and databases that show relationships between various genes and how they express, and unstructured data, which is research documentation from within an enterprise that talk about how drug-to-drug interaction or which molecules are targeting which disease molecules and so forth. Bringing all of this together and adding a layer that is powered by both vector databases and knowledge graphs, makes it easier for researchers who are pursuing new therapies to do their job by finding out relationships that may not be intuitive, unless they're writing very specific queries. So giving them a natural language aperture through which they can ask questions, follow-up questions on the data that they receive and so forth, just chatting with a large language model. But here, it's bringing these disparate pieces of information where you would typically have to write separate queries, separate data sources, and then synthesize it manually. We are able to do that through single aperture. Just to think of another use case in the legal business. Imagine if you're trying to figure out, show me all contracts that are expiring next week or next month, and have a certain types of payment pattern. This query is really challenging just for an LLM by itself or even an RAG pattern, because it can span across systems, span across data sources that are of different types, and then synthesize the right answer. When you combine knowledge graphs and vector databases, it makes it easier because the knowledge graphs bring you all those relationships that are inherent in this question, and then the LLM is able to synthesize the answer much more accurately for you.

>> Yeah. And the places where we are partnering, I think we realized the value of vector-vector searches. So we basically made sure sometime last year, I think it was August, we announced ability to have all the capabilities of vector database has directly in Neo4j as part of the knowledge graph. So this partnership basically allowed customers to go ahead and bring unstructured and structured in the single knowledge graph. The other area that we are working together on enabling our customers jointly on technology side is one big challenge for customers is building the knowledge graph themselves. How do you get started? How do you get all these structured data within an organization siloed across everything, bringing it and making it in one single knowledge graph, but more importantly, bringing the unstructured documents and adding to it? And then simplification of that is super valuable for our customers. And so one of the things we are working with Persistent is how do you make that unstructured data addition to knowledge graph super simple? We're working on tools that will be accessible to our customers, that just you can take existing knowledge graph or build new knowledge graph from unstructured data, and we can automatically reduce the time to value significantly for customers for any kind of use case they want to enable.

>> It's a fascinating topic. And if you think about knowledge graphs of the previous generations, it's been purpose built for use cases were specific. They're well-formed, well-identified use cases. Now with generative AI, knowledge graphs offer the horizontal scalability of the data, meaning you don't have to replicate the data, it can be shared. So a search and retrieval, a discovery feature is available now across the organizations for companies. So it's a huge concept. Can you guys explain that phenomenon? And then, what are the roadblocks and considerations to implement say a knowledge graph with vectors? Because to me this is becoming now the standard infrastructure aspect of data management that will power the applications. Because think about the leverage you get on data reuse, data availability, data intelligence, data context, the behavior of the data. So this knowledge graph intersection with vector brings a new kind of retrieval feature we see, but there's more there. Can you guys explain the importance of this? And what are some of the roadblocks and consideration companies should take when architecting their enterprise?

>> Yeah. I think, let me get started and I can ask Pandurang to jump in too. I think my biggest thing is your information or knowledge... Or let me put it this way. The data in companies is completely siloed, so converting that into insights is step one. Can we bring it together in some form? And then converting that into knowledge allows you to go ahead and build intelligent applications and all. So you're absolutely right, John. Looking at knowledge graphs as a mechanism to be powering those intelligent applications is the most important thing for enterprises as they think about generating AI applications. Now, this is a challenge for organizations when we work with them, their data is siloed in lot of different systems. And when they create knowledge graphs, how do you actually structure that knowledge graph? How do you add semantics and context to it is an important thing. We are building tooling to make it super simple for people to go build these knowledge graphs from structured, unstructured data. But I think the big thing there is starting small, identifying the use case that you can get the biggest value for your intelligent application from, and then modeling only those aspects in the knowledge graph, and be additive to it. Because one of the beauties of the technology we have built over the last 10, 12 years in Neo4j, is you're not stuck to a fixed schema. Your knowledge cannot be limited to a schema in a table with end columns and why things. And every time a schema changes, it blows up. I think it is a ever-growing model for us. And so therefore, you can start with set of use cases, make sure there's value, and then you can keep adding more data and information to grow the knowledge graph over a set of use cases for you to enable. And then of course, powering that with all your RAG-based applications powered by that, just can become the enterprise infrastructure for you over time. I think that's my point of view on this. Pandurang, what do you think?

>> Yeah. I detour to that. What I want to add is, look, we at Persistent had been already using Neo4j for a lot of the work we were doing even before. And when we started combining it in our Gen.AI solutions, what we realized was we needed certain tooling to accelerate our own engineering teams in going from the unstructured data to an ontology to actual building of the knowledge graph. So we built some accelerators ourselves for that. And then we realized that hey, some of the business users to see value, what if we gave them natural language aperture so they don't have to write these Cypher queries, which is the query language used by Neo4j. And we combined LLMs and our vector database knowledge to build that aperture. It is very fortunate that we are on the same mission. So last year, when we intersected and figured out that, look, this is a shared mission, we don't have to build it on our own. In fact, coupling together actually makes us stronger. So that's where we started doing this together with Neo4j, and for them. So that's been a great journey. And I think if we do these things right, we are not only going to enable enterprises to get to that foundation layer faster, but we can make it more easier for not just the technical users, but the business users to access the data stored in these knowledge graphs, with the help of all these layers we're adding.

>> Yeah. And you mentioned ontologies. I love that word. I haven't heard that since college back in the '80s. But think about what knowledge graphs and gen AI and vectors do around scaling ontologies, making them more available and more adaptive. And I remember interviewing Adam Selesky at Reinvent last year. He said the number one thing about generative AI is to be adaptive, and being adaptive means being flexible. And neural network's a graph. So you've got neural networks, you've got knowledge graphs, vector database, structured data, all that's got to run together. And so it's a great solution you guys have together. I guess, my final question for you guys, what's next with Persistent and Neo4j? What's coming down the pike? What's happening?

>> I think my focus always in few things. I think the world is only going to get more connected, more complex, and much bigger. And so if you think about another seven, eight years down the line, I expect everything to be hyper personalized. Everything, the scale of data is only going to grow bigger and bigger in organizations. The organizations themselves are going to be way more connected and way more complex. And if you think about digital twins powering personalization to supply chains to everything, it is a connected world that we are living in and it will get more and more connected. So building technology that allows you to represent that complexity in form of knowledge graphs powered by Neo4j is a big focus. Bringing structured and unstructured data in the same space by bringing the better capability to scale, unlimited scale that customers need, that is a big focus. And then from generative AI side, I think making sure that... We are on mile one of 26-mile race. I love running marathons and half-marathons. So in mile one, we've seen so much innovation. So on technology side, we are making sure we are integrated with all the platforms. So we have integrated with Azure OpenAI, Bedrock, as well as Vertex AI. At Google, we are integrated with LlamaIndex and LangChain and any new frameworks that are coming in. So we want to make sure the technology is well integrated, you have ability to go ahead and solve complex problems with it. And so that's what my focus is at Neo4j. And then Pandurang?

>> Yeah. And that's very well put, Sudhir. So, John, our mission, particularly with AI and generative AI always has been cutting through the hype, how do we bring enterprises the ability to deploy enterprise grade, enterprise scale solutions that give predictable, consistent, accurate responses that can drive real value? This requires bringing in ability to ground what foundation models are doing. And there is no better tool right now than knowledge graphs to augment everything else we have been doing, in bringing that grounding to life. Our mission, and we are very excited about this collaboration, is to work closely in making knowledge graphs centerpiece of driving intelligence in the enterprise and making adoption of GenAI that much more smoother and faster to see value.

>> And trust and accuracy are huge factors here. Trust, accuracy, scale, and also the intelligence and the output is at the end of the day the-

>> And also explainability. I think the only other word I would add is explainability of when you get an answer, how did I get it? That is super valuable and critical for customers.

>> Yeah. Well, gentlemen, I'm really impressed with the technology chops. You guys have, obviously great work together, Persistent, Neo4j. Great time to be a technologist right now, a lot of action, but the risk-reward ratio is there, but if you don't get it right, you can have the same effect. So there's a huge upside potential right now in this market, as knowledge graphs and neural networks, generative AI, new infrastructure is coming to the table. And again, take advantage of it. It's a win. If you miss it, you'll be on the wrong side of history. So thanks so much for sharing the perspective and empowering the data intelligence series here. Thanks for coming on.

>> Thank you for having us.

>> Thank you, John. Thanks for having us.

>> I'm John Furrier with the Cube. We're here in Palo Alto. Thanks for watching Empowering Data Intelligence.

Pandurang Kamat | Persistent Systems & Sudhir Hasbe | Neo4j

search

>> Hello and welcome to this special Cube Conversation. I'm John Furrier, host of the Cube. Here in our Palo Alto Studios, we've got two Cube alumni technologists here to talk about a great topic, empowering data intelligence. We're going to explore the intersection of knowledge graphs, vector databases, and GenAI with Neo4j and Persistent. We've got Pandurang Kamat, who's the chief technology office research and innovation with Persistent Systems. And we got Sudhir Hasbe, chief product officer at Neo4j. Gentlemen, great to see you. Thanks for coming back on the Cube. Appreciate seeing you.

>> Good to be here.

>> Good to be here, John.

>> So two technologists on one topic that's got a... We could probably talk for an hour. Knowledge graphs have been around for a while. Neural networks is talked a lot about in AI. Knowledge graphs, knowledge management, knowledge systems. GenAI is the perfect storm on this here. Talk about this piece because Neo4j set the standard for graph databases. Okay? This becomes a very key part of this new infrastructure that everyone's building on, and it's not the static web, siloed web we used to. It's got to be adaptive, it's got to have flexibility, it's got to be responsive, but the data's different in this. Take us through the technology perspective of how the graph databases are powering the intersection of all the great stuff.

>> No, absolutely, John. I think you're absolutely right. There has been an evolution of, in the industry, especially with generative AI, large language models, the kind applications people are thinking about. And within enterprises mainly, knowledge graphs have been there being deployed on top of Neo4j for a pretty long time. But most of that information was structured, and most of the use cases were enabling set of specific use cases, like fraud management or fraud detection, anti-money laundering, supply chain visibility. But the opportunity for enterprises now is as large language models are coming in and generative AI technology is coming in, to break the data silos within organizations. Now, you have tons of databases, hundreds of thousands of them in large organizations, trapping the data between them. And then when you want to go ahead and have an intelligent application that can answer questions that span across all this information, it's super hard to do that. And I think having this knowledge graph that can represent the knowledge out of all these system into a single framework, helps LLMs get the right information to give you the right answers to your questions and the problems. So I think we are seeing this interest in knowledge graphs to be the backbone for a lot of generative AI applications that people want to build. And that's where I think there is, you see this new interest and new sets of use cases that enterprises are looking at.

>> Pan, you guys are doing a lot of R&D, you guys groundbreaking AI work. We've been covering it out for over a year and a half at Persistent. The title Empowering Data Intelligence, we need more data Intelligence. Hallucinations is a big topic that comes up a lot with LLMs. The size of the models, small language models. In Vogue, we put out a power law with Cube Research, showing that models can coexist together but yet be separate. So what does empowering data intelligence mean to you?

>> Sure. So first of all, it's a real pleasure to be here with Sudhir, discussing this topic. We have been an avid user as a technology company of graph databases and Neo4j in particular over the years. Even building solutions around tax research, around fraud detection like you talked about and so forth. So it's a special opportunity that in today we are not only working with their technology, but with them and for them in actually moving the needle forward on how graph databases and generative AI can drive intelligence. So fundamentally, John, as you are well aware, the retrieval augmented generation and the internal reasoning of large language models has certain limitations to how far it can infer topics. And particularly, it struggles when trying to bring together relationships across very disparate datasets, both structured and unstructured, is not inherently built for that. So you have to augment it. And we typically augment it with vector databases by vectorizing information. But what graph databases and knowledge graphs bring to the table is they allow us to, like Sudhir said, pull in data from disparate data sources within enterprise, build out those relationships so that you can pull a deeper context and insight to give to the LLM, to synthesize its output on. And so that's the one biggest advantage that we see with knowledge graphs. And the other is overall finding themes and reasoning across datasets and volumes of data, that's inherently, again, harder for an LLM to do by itself. And that's where graph databases and knowledge graph have been a big boon in driving up the quality, accuracy, and contextual relevance of the answers that we are giving with these AI services.

>> Sudhir, talk about the data aspect here. Because data is critical, the knowledge graph, okay, the knowledge system, however, we're going to look at this, AI infrastructure is developing. The data has to be available, it can't be siloed. Talk about the importance of the shift that's happening now on how people are thinking about their data, and then how that's going to integrate as LLMs and foundation models become the standard for how applications will interact with data.

>> I think, let me go a little deeper on the large language model side a bit, and then we'll come back with the enterprise data. Large language models were built to basically enable you to go create, generate new information based on existing information. That's what the technology is about. It's mostly predicting what should be the next word, based on historically what it has learned from. Now, it's a great technology for generating language, but when we were in school, we went to the English class and we went to the math class and science class. English allowed you to be more creative. Math and science allowed you to be accurate about the information. I think the challenge with large language models is it can only be as accurate as the information it has learned from, but also it's a generative technology. It's the English class, so it will generate information, sometimes we call it hallucination, but I call it like, hey, it's a generative technology. It's doing the job it's supposed to do. Now, in enterprises, there are two sets of use cases. I actually have some information. Let's say, for example, I had a customer case where if something went wrong, I need to send them an email. And I know exactly what the issue happened and I want to take that information, give it to a large language model and say, "Hey, can you please create a really good-looking email to customer, John, whose order was misplaced and we were able to find it?" Create an email. Of course, large language model is going to be great at doing that because it knows how to write good email, because it's learned from the web what good English looks like. Take the same scenario, same infrastructure, and look at second use case where I'm an enterprise, I have the whole enterprise knowledge, I have an engine, I have parts in it. I want to go ahead and figure out, hey, I've just seen an engine oil light has come up. I need to go ahead and figure out what the technician should do to go ahead and solve that problem. Now, this requires you to know for that engine, what does the light mean? What are the parts that are required? What are the quantities you need to have? It needs the whole knowledge set that's only available, in many cases, in the enterprise. The large language models were never trained for it. So how do you take all that data? And then in this scenario, you also have the unstructured parts manuals along with the engine and its build of material. So think about bringing all that information, converting into knowledge into a single system, not like five databases and seven systems that the data is distributed, and all the parts manuals in some object store somewhere sitting around. To convert all of that into a knowledge graph that can then be accessed and you get real facts from there. And then you still use large language model for explaining the answer to the technician, but the facts have to come from the knowledge graph. So using large language models for the English or the language benefits, but using knowledge graphs for the accuracy of information, combine both of them, and you get the best of both worlds. So you now are more accurate. You can explain the answer because in the knowledge graph it came from this engine, these parts, these documents, you can completely be explainable. And that's how you can build the best generative AI solutions. So that's how this whole world comes together between structured, unstructured, vector information as part of your knowledge graph, and answering that question, using large language, natural language from there, but using the facts from knowledge graph.

>> Just to add one point on that. This is very beautifully put actually. The last part that he mentioned, which is large language models, given that they're neural-network-based and so forth, they're inherently little less explainable than where the industry has been trying to go with building explainability into the inference AI provides. So knowledge graphs provide that traceability, the visibility that you can give even to the end user depending on the user experience you're creating, to build further trust into the system. So it's not only about getting the accuracy right, but also about bringing trust and traceability to a system that when it went off the gate, was very opaque in that sense. So that's

>> a great pointAnd I think that's the key thing there you brought up is that right now everyone's talking about hallucinations, don't trust the data. And what they're really talking about is not generative AI, they're talking about the large language models. Because they play with OpenAI and they say, "That's not accurate, I wasn't involved in that, but it says I am." So they see the error and go, "I don't trust it." What you're getting at is you can have your knowledge graph, have proprietary data that's known to the company, working with the LLMs together to get the accuracy.

>> Yes.And

>> even further, because those knowledge graphs were driving customer experiences, other applications that were pre-GenAI. Now you bring knowledge graphs in with generative AI to create a new generative solution, which is the fusion of the data with the right mix. Am I getting that right? Is that the kind of way to think about it?

>> You nailed it, John. I think absolutely right. People think about ChatGPT, they try it now or barred and they're like, "Oh, I asked that question. It was wrong about this one." But what they are looking at is the large language model that was trained on complete web data. And you mentioned and Pandurang was talking about RAG and how retrieval-augmented generation is a pattern, a technology pattern that allows you to merge your large language model for English, and then knowledge graph for facts, information, and make better decisions. So I think now you're seeing these innovative patterns like RAG, that allow you to blend both of these technologies, large language models and knowledge graph to build generative AI applications for enterprises. And I think that's very exciting space. We're seeing tons of customers across different verticals building different kinds of solutions based on that.

>> We might have to do a part two, because you brought up a very important point that's part of the title, which is empowering data intelligence, exploring knowledge graphs and vector databases and GenAI. The vector database movement, having vector embeds is a key part of the RAG, retrieval augmentation generation. This is a way, a technique to use data in a new generative way, to get data together. It's evolving in its most popular application right now in most of the enterprises. These people are doing RAG because they have data in a knowledge graph. They want to map it up against a large language model like OpenAI or Entropik or Cohere. So you start to see the tinkering and the experimentation, the development where RAG, the RAG retrieval piece has to lean on the vector databases. So can you guys explain this power dynamic? Because this is a new thing, the vector database.

>> Pandurang, you want

>> to go first then I will go after that?Sure. Yeah.So

>> really, vector databases were or are a way in which you will bring structured information, put it in a mathematically representative form that makes it easier for your application to retrieve and bring the right context for the LLM to reason on it. Knowledge graphs provide a much richer relationship between the various key entities and how they tie to each other and allow you to infer second order, third order, fourth order insights that are not intuitively captured in a vector database. And one of the most exciting trends, and I don't want to speak on behalf of Sudhir, but the vision that Sudhir and team have laid out is about why do you need to do these two things separately? They can be much richer together when existing together in a single stack. And our entire mission is about helping customers make that easier to build these vector databases, to build the ontology that is relevant to their business. And then from that ontology, build a very rich knowledge graph that can actually augment your vector databases and give that much more larger and, not just larger, but actually more precise context for the LLM to reason on. And that's how we see this two exciting technologies come together to drive better intelligence than just vector DBs by themselves.

>> That's a great point.

>> Yeah. And just to add a little bit to that. I think we have seen a lot of people experiment with vectors and vector databases, as well as knowledge graphs and all. The initial starting use case that most customers or users start with is, "I have a bunch of PDF documents, unstructured data. I will give it to the LLM embedding model or embedding call, convert it into vectors, store it into a vector database and run a similarity search." So vector databases are, or vector solutions or stores are great at similarity searches based on vector embeddings. That's what they're really good at. So one use case, one thing. Now, it's powerful in some cases where you have a lot of PDF documents, you want to do search through them, you can do chunking of that data convert into vectors and all. But when you go ahead and think about a large enterprise, unstructured data or PDF documents are only one piece of the puzzle. They also have a lot of structured data which is like, "Hey, I'm bill of material for all of my product graph, or I have supply chain and in the supply chain I have all the entities that are connected and which suppliers provide me which products and all." So that whole structured information is also there. And so today, what you can do with technologies like Neo4j building a knowledge graph is just blend both worlds of what is possible with a vector database, which is then unstructured data converted into a vectorized information for similarity search, and also structured notion of what you can look at from a bill of material for your product or your supply chain or your customer 360, which is your relationship with customer, product, and all. And all the unstructured documents, the feedback the customer has given, that becomes a vectorized information in the knowledge graph. And you can do similarity searches based on unstructured data. You can do a search based on find me all the users or customers that look similar to this. You can do a blend of all of these use cases. So what we are seeing is in enterprises, the use cases are a lot more nuanced than just searching based on unstructured data. They require you to understand everything around it, and this is where knowledge graphs are a great way of representing that information that is structured, like many cases hierarchical and then also vectorized information for your unstructured data.

>> Yeah. It brings two worlds together and it actually scales it up faster. Let's get into the implementation. Can you guys share the implementation of these GenAI solutions at Neo4j? How are you harnessing the data for insights? Could you take us through the examples that you guys are working together on?

>> Yeah. Maybe I'll take a stab at it first.

>> Sure.

>> So one example is we are building a lot of solutions traditionally in the healthcare life sciences space, in the banking, financial services, and insurance space. So what we saw was an opportunity to bring these two together to drive innovation there. So to give you an example, we built certain proactive accelerators that allow us to search and sift through tons of biological data, whether it is drug molecule data, genetic, the genes express themselves and databases that show relationships between various genes and how they express, and unstructured data, which is research documentation from within an enterprise that talk about how drug-to-drug interaction or which molecules are targeting which disease molecules and so forth. Bringing all of this together and adding a layer that is powered by both vector databases and knowledge graphs, makes it easier for researchers who are pursuing new therapies to do their job by finding out relationships that may not be intuitive, unless they're writing very specific queries. So giving them a natural language aperture through which they can ask questions, follow-up questions on the data that they receive and so forth, just chatting with a large language model. But here, it's bringing these disparate pieces of information where you would typically have to write separate queries, separate data sources, and then synthesize it manually. We are able to do that through single aperture. Just to think of another use case in the legal business. Imagine if you're trying to figure out, show me all contracts that are expiring next week or next month, and have a certain types of payment pattern. This query is really challenging just for an LLM by itself or even an RAG pattern, because it can span across systems, span across data sources that are of different types, and then synthesize the right answer. When you combine knowledge graphs and vector databases, it makes it easier because the knowledge graphs bring you all those relationships that are inherent in this question, and then the LLM is able to synthesize the answer much more accurately for you.

>> Yeah. And the places where we are partnering, I think we realized the value of vector-vector searches. So we basically made sure sometime last year, I think it was August, we announced ability to have all the capabilities of vector database has directly in Neo4j as part of the knowledge graph. So this partnership basically allowed customers to go ahead and bring unstructured and structured in the single knowledge graph. The other area that we are working together on enabling our customers jointly on technology side is one big challenge for customers is building the knowledge graph themselves. How do you get started? How do you get all these structured data within an organization siloed across everything, bringing it and making it in one single knowledge graph, but more importantly, bringing the unstructured documents and adding to it? And then simplification of that is super valuable for our customers. And so one of the things we are working with Persistent is how do you make that unstructured data addition to knowledge graph super simple? We're working on tools that will be accessible to our customers, that just you can take existing knowledge graph or build new knowledge graph from unstructured data, and we can automatically reduce the time to value significantly for customers for any kind of use case they want to enable.

>> It's a fascinating topic. And if you think about knowledge graphs of the previous generations, it's been purpose built for use cases were specific. They're well-formed, well-identified use cases. Now with generative AI, knowledge graphs offer the horizontal scalability of the data, meaning you don't have to replicate the data, it can be shared. So a search and retrieval, a discovery feature is available now across the organizations for companies. So it's a huge concept. Can you guys explain that phenomenon? And then, what are the roadblocks and considerations to implement say a knowledge graph with vectors? Because to me this is becoming now the standard infrastructure aspect of data management that will power the applications. Because think about the leverage you get on data reuse, data availability, data intelligence, data context, the behavior of the data. So this knowledge graph intersection with vector brings a new kind of retrieval feature we see, but there's more there. Can you guys explain the importance of this? And what are some of the roadblocks and consideration companies should take when architecting their enterprise?

>> Yeah. I think, let me get started and I can ask Pandurang to jump in too. I think my biggest thing is your information or knowledge... Or let me put it this way. The data in companies is completely siloed, so converting that into insights is step one. Can we bring it together in some form? And then converting that into knowledge allows you to go ahead and build intelligent applications and all. So you're absolutely right, John. Looking at knowledge graphs as a mechanism to be powering those intelligent applications is the most important thing for enterprises as they think about generating AI applications. Now, this is a challenge for organizations when we work with them, their data is siloed in lot of different systems. And when they create knowledge graphs, how do you actually structure that knowledge graph? How do you add semantics and context to it is an important thing. We are building tooling to make it super simple for people to go build these knowledge graphs from structured, unstructured data. But I think the big thing there is starting small, identifying the use case that you can get the biggest value for your intelligent application from, and then modeling only those aspects in the knowledge graph, and be additive to it. Because one of the beauties of the technology we have built over the last 10, 12 years in Neo4j, is you're not stuck to a fixed schema. Your knowledge cannot be limited to a schema in a table with end columns and why things. And every time a schema changes, it blows up. I think it is a ever-growing model for us. And so therefore, you can start with set of use cases, make sure there's value, and then you can keep adding more data and information to grow the knowledge graph over a set of use cases for you to enable. And then of course, powering that with all your RAG-based applications powered by that, just can become the enterprise infrastructure for you over time. I think that's my point of view on this. Pandurang, what do you think?

>> Yeah. I detour to that. What I want to add is, look, we at Persistent had been already using Neo4j for a lot of the work we were doing even before. And when we started combining it in our Gen.AI solutions, what we realized was we needed certain tooling to accelerate our own engineering teams in going from the unstructured data to an ontology to actual building of the knowledge graph. So we built some accelerators ourselves for that. And then we realized that hey, some of the business users to see value, what if we gave them natural language aperture so they don't have to write these Cypher queries, which is the query language used by Neo4j. And we combined LLMs and our vector database knowledge to build that aperture. It is very fortunate that we are on the same mission. So last year, when we intersected and figured out that, look, this is a shared mission, we don't have to build it on our own. In fact, coupling together actually makes us stronger. So that's where we started doing this together with Neo4j, and for them. So that's been a great journey. And I think if we do these things right, we are not only going to enable enterprises to get to that foundation layer faster, but we can make it more easier for not just the technical users, but the business users to access the data stored in these knowledge graphs, with the help of all these layers we're adding.

>> Yeah. And you mentioned ontologies. I love that word. I haven't heard that since college back in the '80s. But think about what knowledge graphs and gen AI and vectors do around scaling ontologies, making them more available and more adaptive. And I remember interviewing Adam Selesky at Reinvent last year. He said the number one thing about generative AI is to be adaptive, and being adaptive means being flexible. And neural network's a graph. So you've got neural networks, you've got knowledge graphs, vector database, structured data, all that's got to run together. And so it's a great solution you guys have together. I guess, my final question for you guys, what's next with Persistent and Neo4j? What's coming down the pike? What's happening?

>> I think my focus always in few things. I think the world is only going to get more connected, more complex, and much bigger. And so if you think about another seven, eight years down the line, I expect everything to be hyper personalized. Everything, the scale of data is only going to grow bigger and bigger in organizations. The organizations themselves are going to be way more connected and way more complex. And if you think about digital twins powering personalization to supply chains to everything, it is a connected world that we are living in and it will get more and more connected. So building technology that allows you to represent that complexity in form of knowledge graphs powered by Neo4j is a big focus. Bringing structured and unstructured data in the same space by bringing the better capability to scale, unlimited scale that customers need, that is a big focus. And then from generative AI side, I think making sure that... We are on mile one of 26-mile race. I love running marathons and half-marathons. So in mile one, we've seen so much innovation. So on technology side, we are making sure we are integrated with all the platforms. So we have integrated with Azure OpenAI, Bedrock, as well as Vertex AI. At Google, we are integrated with LlamaIndex and LangChain and any new frameworks that are coming in. So we want to make sure the technology is well integrated, you have ability to go ahead and solve complex problems with it. And so that's what my focus is at Neo4j. And then Pandurang?

>> Yeah. And that's very well put, Sudhir. So, John, our mission, particularly with AI and generative AI always has been cutting through the hype, how do we bring enterprises the ability to deploy enterprise grade, enterprise scale solutions that give predictable, consistent, accurate responses that can drive real value? This requires bringing in ability to ground what foundation models are doing. And there is no better tool right now than knowledge graphs to augment everything else we have been doing, in bringing that grounding to life. Our mission, and we are very excited about this collaboration, is to work closely in making knowledge graphs centerpiece of driving intelligence in the enterprise and making adoption of GenAI that much more smoother and faster to see value.

>> And trust and accuracy are huge factors here. Trust, accuracy, scale, and also the intelligence and the output is at the end of the day the-

>> And also explainability. I think the only other word I would add is explainability of when you get an answer, how did I get it? That is super valuable and critical for customers.

>> Yeah. Well, gentlemen, I'm really impressed with the technology chops. You guys have, obviously great work together, Persistent, Neo4j. Great time to be a technologist right now, a lot of action, but the risk-reward ratio is there, but if you don't get it right, you can have the same effect. So there's a huge upside potential right now in this market, as knowledge graphs and neural networks, generative AI, new infrastructure is coming to the table. And again, take advantage of it. It's a win. If you miss it, you'll be on the wrong side of history. So thanks so much for sharing the perspective and empowering the data intelligence series here. Thanks for coming on.

>> Thank you for having us.

>> Thank you, John. Thanks for having us.

>> I'm John Furrier with the Cube. We're here in Palo Alto. Thanks for watching Empowering Data Intelligence.