Jim Walker, Hortonworks, James Campigli, WANDicso, at Big Data NYC with John Furrier
@thecube
#BigDataNYC
For Hadoop to become commercially viable as a Big Data operating system, it will have to drive rapid insights from dynamic information streams and address enterprise reliability standards and compliance requirements. Hortonworks and WANdisco are bringing this vision closer to reality with an integrated solution that marries active-active replication and unified analytics to facilitate the deployment of multi-purpose clusters in globally distributed environments.
Hortonworks' Jim Walker and WANdisco Chief Marketing Officer James Campigli dropped by theCUBE during SiliconANGLE's recently concluded Big Data New York 2013 summit to give us a rundown of the technology behind continuously-available Hadoop.
According to Campigli, his company's software enables use cases that were previously impossible by providing near-real time read and write access to data across multiple locations. This functionality is achieved by configuring Hadoop clusters with as many as seven NameNodes, or metadata servers, that function as fully synchronized mirrors of each other.
Portable metadata
"At the data node level, Hadoop already does a great job of replicating the data, but the metadata -- the NameNode that instructs all the client applications, the MapReduce jobs [and] where to find the data in the cluster -- is effectively a single point of failure," Campigli says.
"What we do is we use our patented NonStop technology to replicate that NameNode, so the NameNode can be clustered and clients can access multiple active NameNodes at the same time. You don't have the single threaded situation where if that one NameNode goes down everything stops," he explains.
Chiming in, Walker comments that Hadoop is "coming of age" in a time when organizations are exploring new processing models and embracing disruptive technologies such as YARN. WANdisco's active-active replication solution makes it easier for multinational enterprises to join the fray and share insights on a company-wide scale.
Forgot Password
Almost there!
We just sent you a verification email. Please verify your account to gain access to
BigData NYC 2013 | New York. If you don’t think you received an email check your
spam folder.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open this link to automatically sign into the site.
Register For BigData NYC 2013 | New York
Please fill out the information below. You will recieve an email with a verification link confirming your registration. Click the link to automatically sign into the site.
You’re almost there!
We just sent you a verification email. Please click the verification button in the email. Once your email address is verified, you will have full access to all event content for BigData NYC 2013 | New York.
I want my badge and interests to be visible to all attendees.
Checking this box will display your presense on the attendees list, view your profile and allow other attendees to contact you via 1-1 chat. Read the Privacy Policy. At any time, you can choose to disable this preference.
Select your Interests!
add
Upload your photo
Uploading..
OR
Connect via Twitter
Connect via Linkedin
EDIT PASSWORD
Share
Forgot Password
Almost there!
We just sent you a verification email. Please verify your account to gain access to
BigData NYC 2013 | New York. If you don’t think you received an email check your
spam folder.
In order to sign in, enter the email address you used to registered for the event. Once completed, you will receive an email with a verification link. Open this link to automatically sign into the site.
Sign in to gain access to BigData NYC 2013 | New York
Please sign in with LinkedIn to continue to BigData NYC 2013 | New York. Signing in with LinkedIn ensures a professional environment.
Are you sure you want to remove access rights for this user?
Details
Manage Access
email address
Community Invitation
Jim Walker & James Campigli - BigDataNYC 2013 - theCUBE - #BigDataNYC
Jim Walker, Hortonworks, James Campigli, WANDicso, at Big Data NYC with John Furrier
@thecube
#BigDataNYC
For Hadoop to become commercially viable as a Big Data operating system, it will have to drive rapid insights from dynamic information streams and address enterprise reliability standards and compliance requirements. Hortonworks and WANdisco are bringing this vision closer to reality with an integrated solution that marries active-active replication and unified analytics to facilitate the deployment of multi-purpose clusters in globally distributed environments.
Hortonworks' Jim Walker and WANdisco Chief Marketing Officer James Campigli dropped by theCUBE during SiliconANGLE's recently concluded Big Data New York 2013 summit to give us a rundown of the technology behind continuously-available Hadoop.
According to Campigli, his company's software enables use cases that were previously impossible by providing near-real time read and write access to data across multiple locations. This functionality is achieved by configuring Hadoop clusters with as many as seven NameNodes, or metadata servers, that function as fully synchronized mirrors of each other.
Portable metadata
"At the data node level, Hadoop already does a great job of replicating the data, but the metadata -- the NameNode that instructs all the client applications, the MapReduce jobs [and] where to find the data in the cluster -- is effectively a single point of failure," Campigli says.
"What we do is we use our patented NonStop technology to replicate that NameNode, so the NameNode can be clustered and clients can access multiple active NameNodes at the same time. You don't have the single threaded situation where if that one NameNode goes down everything stops," he explains.
Chiming in, Walker comments that Hadoop is "coming of age" in a time when organizations are exploring new processing models and embracing disruptive technologies such as YARN. WANdisco's active-active replication solution makes it easier for multinational enterprises to join the fray and share insights on a company-wide scale.
