Blog

[Tech Update] AI Performance Benchmarks with Hailo-8™ AI Modules on UP

AI Performance Benchmarks with Hailo-8™ AI Modules on UP 
UP aims to bridge the gap for your AI needs. Leveraging a wide range of platforms based on Intel technology alongside extensive AI partners, UP offers solutions to power artificial intelligence and edge computing. We are happy to announce our next generation of AI capabilities using the Hailo-8™ M.2 AI Acceleration Module together with UP platforms. Check below for more details.

Hailo AI module 
The latest Hailo-8 M.2 AI module delivers unprecedented AI performance for UP edge devices with high power efficiency Hailo-8™ AI Processor. Power your AI solutions to meet next-generation demands and step up your UP Squared Pro/ UP Squared 6000/ UP Xtreme i11 performance with best-in-class AI processor in a module. Execute in real-time and with low-power deep neural network inferencing for a broad range of market segments.
 
Form Factor M.2 2280 B+M key
AI Processor Hailo-8™ M.2 AI processor with up to 26 TOPS and best-in-class power efficiency
Dimensions 22 x 80mm via breakable extensions
Interface PCIe Gen-3.0, 2 lanes (up to 16Gbs)
Supported Frameworks TensorFlow and ONNX
Supported OS Linux, Windows
Certification CEE, FCC

See below benchmarks for details on performance and power-efficiency data of Hailo-8™ AI Processor. 
  • Xavier NX results are using batch=8 (while Hailo-8 and Jetson Nano are using batch=1) and that Jetson Nano is limited to FP16 (while Hailo-8 and Xavier NX are INT8). NVIDIA results for batch=1 and INT8, respectively, are expected to be lower.


* MobileNet_v3 – the benchmarked model flavor is MobileNet_v3 Large Minimalistic
** Figure for processing 8 simultaneous video streams
NOTE: Check the link for the latest benchmark results from Hailo.

Supported UP Products 
The Hailo-8 M.2 2280 B+M key AI Acceleration module is compatible with UP Squared Pro, UP Squared 6000, and UP Xtreme i11  which are powerful computing platforms built for industrial applications to scale the Industry Edge Solution.
  • UP Squared Pro features the Intel Atom® Series processors (formerly Apollo Lake), which run at speeds up to 2.5 GHz.
  • UP Squared 6000 comes with the latest Intel Atom® Series processors (formerly Elkhart Lake) which offer up to 1.7x better performance and twice the performance for 3D graphics compared with the previous generation UP Squared Pro (formerly Apollo Lake).
  • UP Xtreme i11 is powered by the latest 11th Generation Intel® Core™ Processors, which can clock up to 4.4 GHz with only 28 watts TDP and 15 watts cTDP. For the even more power-efficient performance at the edge. 
 
UP Products UP Squared Pro UP Squared 6000 UP Xtreme i11
Dimension 101.6mm x 101.6mm 101.6mm x 101.6mm 120 mm x 122mm
CPU Intel® Celeron® N3350 (up to 2.4 GHz)
Intel® Pentium® N4200 (up to 2.5 GHz)
Intel Atom® x7-E3950 (up to 2.0 GHz)		 Intel® Celeron® N6210 (up to 2.6 GHz)
Intel® Pentium® J6426 (up to 3.0 GHz)
Intel Atom® x6413E (up to 3.0 GHz)
Intel Atom® x6425RE (up to 1.9 GHz)		 Intel® Core™ i7-1185GRE (up to 4.4 GHz)
Intel® Core™ i5-1145GRE (up to 4.1 GHz)
Intel® Core™ i3-1115GRE (up to 3.9 GHz)
Intel® Celeron® 6305E (up to 1.8 GHz)
RAM 2GB, 4GB, 8GB LPDDR4 2GB, 4GB, 8GB LPDDR4 2x DDR4 2 channel SO-DIMM VERTICAL MAX 64GB @ 3200MT/s
Storage eMMC 32 GB / 64 GB eMMC 32 GB / 64 GB via 1x SATA 3.0 connector with power connector
Expansion slot used for Hailo module 1x M.2 M key 2280 (PCIe Gen-2.0, 1 lane) 1x M.2 M key 2280 (PCIe Gen-3.0, 2 lanes) 1x M.2 M key 2280 (PCIe Gen-3.0, 2 lanes)
Supported OS Ubuntu 20.04 host OS, Hailo software via Ubuntu container Ubuntu 20.04 host OS, Hailo software via Ubuntu container Ubuntu 20.04 host OS, Hailo software via Ubuntu container
  This table is also available on our wiki.  


Hailo 8 Getting Started Guide on UP series
 



Watch our step-by-step getting started guide video now!

For more questions, you are welcome to join https://www.up-community.org/, where technical experts can help!

Warm regards,
UP Team