George Chow, Technology Fellow, Simba Technologies joined George Gilbert ar DataWorks Summit 2017.
#DataWorks #theCUBE
https://siliconangle.com/2017/06/22/does-counting-milliseconds-in-streaming-data-make-a-difference-in-business-dws17/
Does counting milliseconds in streaming data make a difference in business?
Counting milliseconds in streaming data latency may not seem thrilling at first, but software developers ought to pay attention to the use cases ‘event-by-event streaming’ enables, according to George Chow (pictured), senior director of technology at Simba Technologies Inc., a Magnitude Software Inc. company.
“Hitting that new threshold, the millisecond, is actually a very important milestone,” Chow said during an interview at DataWorks Summit in San Jose, California. “What caught my attention is actually how much manufacturing has really … [gone into] streaming data.” Chow said.
The automobile industry has begun experimenting with streaming data to fine-tune production, Chow told George Gilbert (@ggilbert41), host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio. (* Disclosure below.)
Just recently, “Both Volkswagen and Audi actually had case studies for how they are actually using streaming data,” Chow said.
Painting a vehicle is a costly step in manufacturing; Audi is building a streaming data model to monitor environmental conditions that may contribute to defects in the process, Chow explained. And Ford Motor Company is also working on streaming data models to improve production.
The closing millisecond window
A second area where super-fast streaming data can make the difference between a sale or a loss is online advertising, Chow added.
“… When you look at a typical scenario, let’s say with AdTech where you’re serving ads, you really only have, maybe, on the order of about 100 or maybe 200 millisecond max to actually turn around,” Chow said.
That includes network transfer-time, which means that in the actual budget the allowance is under 10 to 20 milliseconds for compute and all, he explained.
Apache Spark 2.2 or another event-by-event streaming engine that cuts latency to one millisecond or less can allow advertisers to execute within that tiny window, Chow concluded.
Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s independent editorial coverage of DataWorks Summit. (* Disclosure: Hortonworks Inc. sponsored this DataWorks Summit segment on SiliconANGLE Media’s theCUBE. Neither Hortonworks nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Forgot Password
Almost there!
We just sent you a verification email. Please verify your account to gain access to
DataWorks Summit 2017 | San Jose. If you don’t think you received an email check your
spam folder.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open this link to automatically sign into the site.
Register For DataWorks Summit 2017 | San Jose
Please fill out the information below. You will recieve an email with a verification link confirming your registration. Click the link to automatically sign into the site.
You’re almost there!
We just sent you a verification email. Please click the verification button in the email. Once your email address is verified, you will have full access to all event content for DataWorks Summit 2017 | San Jose.
I want my badge and interests to be visible to all attendees.
Checking this box will display your presense on the attendees list, view your profile and allow other attendees to contact you via 1-1 chat. Read the Privacy Policy. At any time, you can choose to disable this preference.
Select your Interests!
add
Upload your photo
Uploading..
OR
Connect via Twitter
Connect via Linkedin
EDIT PASSWORD
Share
Forgot Password
Almost there!
We just sent you a verification email. Please verify your account to gain access to
DataWorks Summit 2017 | San Jose. If you don’t think you received an email check your
spam folder.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open this link to automatically sign into the site.
Sign in to gain access to DataWorks Summit 2017 | San Jose
Please sign in with LinkedIn to continue to DataWorks Summit 2017 | San Jose. Signing in with LinkedIn ensures a professional environment.
Are you sure you want to remove access rights for this user?
Details
Manage Access
email address
Community Invitation
George Chow, Simba Technologies | DataWorks Summit 2017
George Chow, Technology Fellow, Simba Technologies joined George Gilbert ar DataWorks Summit 2017.
#DataWorks #theCUBE
https://siliconangle.com/2017/06/22/does-counting-milliseconds-in-streaming-data-make-a-difference-in-business-dws17/
Does counting milliseconds in streaming data make a difference in business?
Counting milliseconds in streaming data latency may not seem thrilling at first, but software developers ought to pay attention to the use cases ‘event-by-event streaming’ enables, according to George Chow (pictured), senior director of technology at Simba Technologies Inc., a Magnitude Software Inc. company.
“Hitting that new threshold, the millisecond, is actually a very important milestone,” Chow said during an interview at DataWorks Summit in San Jose, California. “What caught my attention is actually how much manufacturing has really … [gone into] streaming data.” Chow said.
The automobile industry has begun experimenting with streaming data to fine-tune production, Chow told George Gilbert (@ggilbert41), host of theCUBE, SiliconANGLE Media’s mobile livestreaming studio. (* Disclosure below.)
Just recently, “Both Volkswagen and Audi actually had case studies for how they are actually using streaming data,” Chow said.
Painting a vehicle is a costly step in manufacturing; Audi is building a streaming data model to monitor environmental conditions that may contribute to defects in the process, Chow explained. And Ford Motor Company is also working on streaming data models to improve production.
The closing millisecond window
A second area where super-fast streaming data can make the difference between a sale or a loss is online advertising, Chow added.
“… When you look at a typical scenario, let’s say with AdTech where you’re serving ads, you really only have, maybe, on the order of about 100 or maybe 200 millisecond max to actually turn around,” Chow said.
That includes network transfer-time, which means that in the actual budget the allowance is under 10 to 20 milliseconds for compute and all, he explained.
Apache Spark 2.2 or another event-by-event streaming engine that cuts latency to one millisecond or less can allow advertisers to execute within that tiny window, Chow concluded.
Watch the complete video interview below, and be sure to check out more of SiliconANGLE’s and theCUBE’s independent editorial coverage of DataWorks Summit. (* Disclosure: Hortonworks Inc. sponsored this DataWorks Summit segment on SiliconANGLE Media’s theCUBE. Neither Hortonworks nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
