Radar Cube Streaming for AI based processing
As a standard, smartmicro’s automotive sensors deliver a Point Cloud output. This is a set of data points, representing the presence and position of detected objects. While our Point Cloud output generates very precise targets, we also offer Radar Cube Streaming firmware providing a real-time radar cube data interface without any information being filtered out. This can be used for more advanced applications where machine learning algorithms are used.
smartmicro sensors use high range and Doppler resolution to provide impressive details of the received energy of the radar reflection for different road elements in a Range Doppler Matrix. For example, if a person is walking away from the sensor, you can clearly see a constant speed of the person’s torso and its increasing distance to the radar. More than that the reflected energy clearly shows zero speed for the standing leg as well as higher negative or positive speeds of legs and arms swinging in opposite directions, allowing conclusions about the shape of the object.
Every receiving antenna [..., Z] outputs a Range Doppler Matrix [X, Y, ...], resulting in a Radar Cube for estimating the azimuth and elevation angle and for extracting additional features of an object.
While smartmicro’s Point Cloud firmware generates targets whenever the reflected energy exceeds the energy of the surroundings and a defined threshold of what is considered noise, the Radar Cube Streaming firmware can, for example, be used to apply AI-based experiments. Advanced AI algorithms can be applied to look for more targets and higher accuracy in extremely challenging scenarios, improving the unavoidable tradeoffs involved with using thresholds.
This can be particularly beneficial for improving the sensor's ability to operate in a very challenging environment with lots of noise—in areas with lots of reflections—where the adaptive detection threshold needs to be selected carefully to get more targets from the detected energy using AI algorithms. Also, given the other extreme, it can improve the detection in scenarios with only very small targets where the threshold needs to be set very low.
smartmicro’s Radar Cube Streaming can be used for:
Better target detection
More accurate targets
Enhanced classification
Our Radar Cube Streaming firmware is available for the complete Automotive product portfolio, and for all operation modes - from ultra-short- to ultra-long range.
Player not visible? Open the video directly on YouTube (here).