“TinyML is proof that good things come in small packages”, or so does ARM describe it, as it promises with TinyML to change a different approach, by running optimized machine learning models on small and efficient microcontroller-based endpoint devices, instead of bulky, power-hungry computers located in the cloud. Supported by ARM and the industry-leaders Google, Qualcomm, and others, it has the potential to change the way we deal with the data gathered by the IoT devices, which already have taken over in almost every industry we can imagine.
But why would we use TinyML in microcontrollers? Well, that is simple. They are everywhere! Families such as the ARM Cortex-M are very efficient and reliable, guaranteeing decent computing performance, when we consider their size, fitting them anywhere and being able to leave them there and just forget about it. Moreover, they are really cheap. Machine learning on microcontrollers enables us to take care of the data created on our IoT devices directly and perform more sophisticated and refined operations. But it does not stop there. Giving these capabilities to the microcontroller allows for more independent endpoint devices, that do not require an internet connection to trade data back and forth with the cloud, which leads to reduced latency, less energy consumption and extra security, since the data is not leaving the microcontroller as often, leaving it less exposed to attacks.
In order to bring the ML algorithms to the small boards, the complexity of the mathematical operations involved needed to be reduced. Data scientists accomplished this by applying different techniques, such as replacing floating-point operations with simpler 8-bit operations. The changes resulted in models adapted to the platform, targeting lower memory resources and processing, making them work more efficiently without compromising too much accuracy. Of course, they cannot replace completely the cloud models, but its suits for many use cases. Besides that, the hardware is being designed by ARM to accelerate the inference, which will uplift the already impressive performance we are getting.
Read more: TINYML ENABLES AI IN SMALLEST ENDPOINT DEVICES
About The Author
Muhammad Bilal
I am a highly skilled and motivated individual with a Master's degree in Computer Science. I have extensive experience in technical writing and a deep understanding of SEO practices.