At Embedded World, Xilinx, Inc. on March 14, 2017, announced expansion into a wide range of vision guided machine learning applications with the Xilinx reVISION stack. This announcement complements the recent Reconfigurable Acceleration Stack, significantly broadening the deployment of machine learning applications with Xilinx technology from the edge to the cloud.
The new reVISION stack enables a much broader set of software and systems engineers, with little or no hardware design expertise to develop intelligent vision-guided systems easier and faster. These engineers can now realize significant advantages when combining machine learning, computer vision, sensor fusion, and connectivity.
reVISION is enabling a fast growing set of applications in markets where differentiation is critical, systems must be extremely responsive, and the latest algorithms and sensors need to be quickly deployed. This includes approximately two-thirds of the applications for vision focused semiconductors. Applications span a number of markets such as high-end consumer, automotive, industrial, medical, and aerospace & defense. Next generation applications include collaborative robots or ‘cobots’, ‘sense and avoid’ drones, augmented reality, autonomous vehicles, automated surveillance and medical diagnostics.
reVISION enables the fastest path to the most responsive vision systems, with up to 6x better images/second/watt in machine learning inference, 40x better frames/second/watt of computer vision processing, and 1/5th the latency over competing embedded GPUs and typical SoCs. Developers with limited hardware expertise can use a C/C++/OpenCL development flow with industry-standard frameworks and libraries like Caffe and OpenCV to develop embedded vision applications on a single Zynq SoC or MPSoC.
Leveraging the unique advantages of reconfigurability and any-to-any connectivity, developers can use the stack to rapidly develop and deploy upgrades. Reconfigurability is critical to ‘future proof’ intelligent vision-based systems as neural networks, algorithms, sensor technologies and interface standards continue to evolve at an accelerated pace.
The Xilinx reVISION stack includes a broad range of development resources for platform, algorithm and application development. This includes support for the most popular neural networks including AlexNet, GoogLeNet, SqueezeNet, SSD, and FCN. Additionally, the stack provides library elements including pre-defined and optimized implementations for CNN network layers, required to build custom neural networks (DNN/CNN). The machine learning elements are complemented by a broad set of acceleration-ready OpenCV functions for computer vision processing. For application level development, Xilinx supports industry-standard frameworks including Caffe for machine learning and OpenVX for computer vision. The reVISION stack also includes development platforms from Xilinx and third parties, including various types of sensors.
“Our eye tracking technology has greatly benefited individuals suffering from ALS or other forms of paralysis, powered by the Zynq SoCs for high-resolution vision based analytics,” said Robert Chappell, CEO and Founder, Eyetech Digital Systems. “The new reVISION stack offers new opportunities for algorithm development by leveraging the power of machine learning. This can enable us to expand our offering of human interaction hardware as well as improving our core eye tracking products.”
“The embedded market is an evolving application space where changes in algorithms, neural networks and sensors require reconfigurability of the target platforms,” said Lakshmi Mandyam, senior director of segment marketing, ARM. “ARM-based Zynq technology from Xilinx will enable these applications to be deployed efficiently while accelerating the adoption of innovative machine learning applications from the edge to the cloud.”
“We are seeing tremendous interest in machine learning from the edge to the cloud, and believe that our ongoing investment in development stacks will accelerate mainstream adoption.” said Steve Glaser, SVP of Corporate Strategy at Xilinx. “Today, hundreds of embedded vision customers have realized greater than 10x performance and latency advantages with Xilinx technology. With the addition of reVISION, those same advantages will now become available to thousands of customers.”
Availability
The reVISION stack will be available in the second quarter of 2017. To learn more and join the reVISION community visit at www.xilinx.com/revision.
