01. Doug Cutting, Cloudera, visits #theCUBE!. (00:18) 02. Spark for the Long-Term. (01:55) 03. Providing a Coherent Security Story at Cloudera. (04:23) 04. MapReduce in and Out of Spark. (06:28) 05. Seeing Convergence Around Storage. (08:40) 06. "Intelligence" and Application Development. (10:01) 07. A Long Road to the Consumer End User. (11:16) 08. Choices from Lockin to Open in the New Space. (12:48) 09. Overall Thoughts About Spark Summit 2016. (16:32) Track List created with http://www.vinjavideo.com. --- --- The data evolution: Spark as a universal platform | #SparkSummit by Zoe Bernard | Jun 8, 2016 Evolution is a process that takes time — and this is especially true when it comes to the development of new data structures. As Doug Cutting, chief architect at Cloudera, Inc., puts it, “To make something that’s widely used, you have to cross several thresholds, and sometimes that can take quite awhile.” Cutting hopes to integrate Spark as a universal platform but expects this switchover to be slower going than most technological breakthroughs. His time-frame estimate? Almost a decade. Turns out that it’s difficult to teach an old dog new tricks even when it comes to software: “People learn new systems, they adopt them and embrace them,” Cutting explained to John Walls and George Gilbert (@ggilbert41), cohosts of theCUBE, from the SiliconANGLE Media team, during Spark Summit 2016 in downtown San Francisco. “It’s difficult to give up these technologies lightly,” Cutting continued. “You want to pick up things that will last.” Planes, trains and automobiles And while adopting Spark in more and more verticals may take time, creating a product with longevity is more important than reinventing the system overnight. “We’re using data to accomplish more than ever before,” said Cutting. It’s a big change that’s currently altering several industries — from financial institutions fighting fraud to pharmaceutical companies better understanding medications and farmers improving crop management “It’s planes, trains and automobiles,” said Cutting, “It’s everywhere.” And even if the process takes time, Cutting said it’s to be expected: “These big institutions are bigger ships. It’ll take some time to turn them over.”