A Toronto-based startup, smartARM, is harnessing artificial intelligence to revolutionize bionic prosthetics. The company is creating a prototype of a bionic arm that focuses on vision-first technology, using open-source software. This development aims to provide more intuitive control for individuals with limb differences. The advanced prosthetic can also incorporate Meta AI glasses for enhanced functionality.
Traditional prosthetic hands often require users to manually adjust grip patterns for various objects, which can be cumbersome when handling everyday items. Tasks like picking up a glass or a spoon can become complex, multi-step processes. smartARM tackles this issue by employing AI hardware and software capable of understanding the surrounding environment. This technology automatically selects the appropriate grip for each object, enabling users to seamlessly transition between tasks.
The smartARM prosthetic is equipped with a camera in its palm, allowing it to ‘see’ objects. By utilizing DINOv2, an open-source vision model from Meta, the arm can recognize common items using just a few reference images. This capability enhances the grip-selection software by enabling the device to handle objects based on direct visual analysis, without requiring extensive pre-programming. The arm can swiftly adapt to new objects, a process that previously could take weeks.
To expand and refine object recognition, smartARM integrates Meta AI Glasses and the Meta Wearables Device Access Toolkit. These tools provide additional data from the unique perspective of the glasses, offering the prosthetic arm better contextual understanding of user interactions. Additionally, users can add new objects via a smartphone app, allowing them to customize their prosthetic to suit their individual daily needs.
The impact for users is profound, offering a bionic arm that functions effectively from the outset without any training. Shaquem Griffin, a long-time user and former NFL player, highlighted the significance, saying that the scalability and accessibility of the technology are what make it the future of consumer prosthetics.
Hamayal Choudhry, Founder and CEO of smartARM, stated, “Building a capable hand is only part of the challenge. Making it intuitive to use matters just as much.” Choudhry emphasized that by enabling the arm to recognize everyday objects and choose suitable grips, the focus is shifted towards what users want to achieve, rather than how to operate their prosthetic.
