Jordan Sanders, Director of Business and Operations, Phantom Auto, talks with Jeff Frick at Phantom Auto's Headquarters in Mountain View, California #InnovationSeries #theCUBE https://siliconangle.com/2018/01/30/the-human-drivers-behind-autonomous-cars-phantom-auto-races-towards-the-future-phantomautoinnovationday/ Solving the latency issue Using cameras mounted in the vehicle, an operator in Phantom Auto’s Silicon Valley headquarters can visually see the road ahead and maneuver the car using a steering wheel attached to a computer console. A remote operator can also verbally communicate with passengers inside the car. The tricky problem of being able to gauge how much pressure to apply for braking remotely is solved through the use of sensors and accelerometers. For now, at least, the company uses largely off-the-shelf components, such as high-end Logitech International SA’s game controllers and control pedals. Indeed, each control module looks like an advanced video game or simulator in which the remote driver sits, watching five screens that include front and side views from the car’s perspective as well as data on latency and other functions. The biggest technological hurdles for Phantom Auto involved latency and reliability. Remote control of a moving car depends on a reliable, strong cell signal and real-time response. The company’s solution was to use multiple wireless carriers at the same time, combining signals from Verizon and AT&T with T-Mobile and Sprint. A machine learning algorithm directs connectivity across networks in case one signal suddenly gets throttled or degrades. That latency solution, Magzimof said, is the company’s “secret sauce.” It uses multiple cell connections in each car to provide more reliable connections, automatically choosing the fastest connection in the “bonded” setup. Some data, such as a signal from the brake as well as the video stream, get priority for lower latency. The system proved to work far better in real time than the company expected. Magzimof said that when the company tried to fix a network glitch while operating from a Las Vegas hotel during demos at the Consumer Electronics, it found that the system worked perfectly from Mountain View, 400 miles away. “It changed the business model of the company,” he said, partly because the fact that it works over such great distances means drivers could be located in lower-cost areas. Security can also be a concern. Phantom Auto has addressed that by working with a variety of cybersecurity firms to ensure system protection across multiple vectors. “As we get closer to deployment of [fully autonomous] robo-taxis, there’s a need for remote assistance, and we think we have the best solution on the market,” Sanders said. Here’s the complete video interview with Sanders: