![]()
by
Claudio Castellini, Frontiers in Neurorobotics
Health & Medicine
Learn
August 17, 2016
Picture the scene: one day you wake up in a hospital with no memory of what happened and you discover in horror that your left hand is no longer there. The doctors say you’ve been in a car accident and from that moment on, you are a “trans-radial mono-lateral amputated person.” After a slow and painful recovery from the wound, you start looking for solutions to at least partially restore the daily living functions you have lost as you’ve quickly learned that 99% of what is around us was designed to be operated by hands. There must be a way, you say to yourself, in which robotics and rehabilitation medicine can help you.
Upon the suggestion of a friend, you venture into the nearest rehabilitation clinic, are enlisted in a state-supported free program for the upper-limb disabled, and fitted with a mechatronic hand/wrist prosthesis. The prosthesis seamlessly and unobtrusively connects to your body, does exactly what you want it to do whenever you want it to do it, and can happily be worn every morning anew. Well, not exactly: sometimes at the beginning of the program, it will fail, to say, to make a fist the way you wanted. In that case, you would close your fist and your prosthesis would learn in one shot how a fist should look like. After three months of practice, you have essentially forgotten this is a prosthesis. It feels it like a part of your body, and you are socially accepted exactly as before the accident.
And now, for the sad reality.
Every year 1,900 new upper-limb amputations occur in Europe, maintaining a population of such disabled persons hovering around 90,000[1]. What can assistive robotics, rehabilitation science and engineerings do for these people? At the time of writing this article, very little.
While multi-fingered hand prostheses appeared on the clinical market about eight years ago, there is little hope to have a control system which will enable the patients do the things I sketched above. The situation becomes even harder in case of a proximal amputation, for instance, if you have lost the whole arm including the shoulder, not to mention bilateral amputations – losing both upper limbs. Only the most advanced laboratories in the world, and indeed those which have access to very large funding schemas, can try to solve the problem. Currently, there is only one fully-fledged motorized prosthetic arm, the DEKA arm, which has recently received FDA approval in the USA. What it can do in controlled conditions is spectacular; nevertheless, the clinical practice is still far from this, mainly because amputees can hardly control such complex artefacts [2].
At our Institution, we’ve been concentrating on this issue for around ten years, and that is how to enforce reliable, natural and dexterous control of an upper-limb prosthesis. The human-machine interface involved must detect the subject’s “intent” to perform a certain action; it must do it reliably and stably; and it must convert this knowledge, in real time, into proper control commands, exploiting all the mechatronic capabilities of the prosthesis.
The challenges are formidable and include how to connect the prosthesis to the patient’s body, how to collect the required amount information from it, how to ensure that the system will do what the patient wants, and how to avoid disastrous error by the control system. We have strived to contribute to these open issues by connecting with hospitals and clinics in an effort to understand the real needs of this specific population of patients.
The main bottleneck we have identified is that current prostheses work like industrial robots. They are calibrated upon a specific subject in the beginning, and are then supposed to work seamlessly for the rest of the patient’s life. Due to the variability of signals gathered from human subjects, this is essentially an impossible task.
We need to have a prosthetic artefact – including the socket, the sensors, the control electronics and the prosthesis itself – which connects to the patient more and more tightly day by day. This really is a two-way learning process: on one hand, control systems based upon machine learning can be used in an „incremental“ fashion, periodically adapting to new situations [3]; but on the other hand, our patients naturally learn how to use the prosthesis as time goes by and they produce signals which drift and change during weeks and months [4].
It’s like learning to drive a new motorbike. You need to master the power of the engine, the stability of the steering mechanism, the ability to brake without slipping; you even need to exploit its weaknesses – and this can only happen as you drive it more and more, a little more every day. After an initial training phase, it will bring you exactly where you want, respecting your driving style. Novel situations can occur, in which case a new, small adaptation will happen. In the long run, it will feel like an extension to your body, and will be ready to seamlessly serve to you to its purpose, every single day of your life.
We use incremental machine learning exactly in order to foster and exploit this “reciprocal adaptation” effect. Incremental machine learning methods allow for the continual updating of their own model of the world. In this case, it is the predictive algorithm which turns bodily signals (denoting the subject’s intent) into control commands for the prosthesis. Whenever the subject deems that the control has become unreliable, for instance because she is under stress and her muscle activation is different from what it was beforehand, such a system just needs to be shown the signal pattern corresponding to the desired command in this particular novel situation. This new knowledge is then seamlessly incorporated in the old model and, from this point on, whenever a similar situation or a reasonably similar one occurs, the control will be stable.
This characteristic can actually seem marginal, but it is indeed crucial. There is an essentially unlimited variety of different situations in which the subject might want to, for instance, steadily hold a power grasp. Imagine a shopping afternoon in a mall: the shopping bag must be held at all times while our patient walks, stands, squats; it must be reliably released when she decides to sit down and rest for a while; and the grasp must be stable with respect to all possible wrist, elbow and shoulder rotations and displacement. We claim that no sensible calibration strategy can be put into effect, which will enable the control system to predict all these situations once at the beginning of the rehabilitation program. Rather, it seems to us more natural to let the subject “teach” the prosthesis each time she feels that it required – even to learn completely novel actions [5].
Incremental learning of the control system leads to interaction with the subject, which we consider the practical enforcement to put the patient at the center of the therapy. Additionally, no quick test in laboratory-controlled conditions can ever be enough to check that such an approach works. We need to devise a specific experimental protocol taking into account the particularity of the subject / socket / control system / prosthesis complex, and we need to build apt setups in our labs, enabling our pioneer amputees test these systems in daily-life conditions. This means that we engineers, mathematicians and roboticists must definitely transfer our expertise to the clinics, learn how to interact with end-users and physicians, and start testing mechatronic artifacts on the field since the start [6].
With the advent of sockets composed of adaptive biocompatible material and embedding multi-modal sensors, incremental learning could be the key to improving the acceptance of mechatronic prostheses among amputees. The current abandonment rates are astonishingly high and there is no established rehabilitation program in the world as the one we described at the beginning of this article.
In the medium and long term, we shall be able to sell prostheses that work like a motorbike: accompanied by a short instruction manual, they will never cease to adapt to the patient and will push them to obtain an optimal synergy, with minimal supervision by the medical advisors – except for maybe a routine check every now and then. Only in this way will we be able to justify the huge amount of effort that the scientific community puts in this field, and actually improve the life of the large population of disabled persons that we target.
For more information see the original research papers:
Upper-Limb Prosthetic Myocontrol: Two Recommendations http://journal.frontiersin.org/article/10.3389/fnins.2015.00496/full
Stable myoelectric control of a hand prosthesis using non-linear incremental learning http://journal.frontiersin.org/article/10.3389/fnbot.2014.00008/full
References
[1] Silvestro Micera, Jacopo Carpaneto and Staniša Raspopovic, Control of hand prostheses using peripheral information. IEEE Reviews in Biomedical Engineering, 3:48–68, 2010.
[2] Jiang, N., Dosen, S., Müller, K.-R., and Farina, D., Myoelectric control of artificial limbs: is there the need for a change of focus? IEEE Signal Processing Magazine, 29(5):149–152, 2012.
[3] Gijsberts, A., Bohra, R., Sierra González, D., Werner, A., Nowak, M., Caputo, B., Roa, M., and Castellini, C., Stable myoelectric control of a hand prosthesis using non-linear incremental learning. Frontiers in Neurorobotics, 8(8), 2014.
[4] Powell, M. A. and Thakor, N. V. A training strategy for learning pattern recognition control for myoelectric prostheses. Journal of Prosthetics and Orthotics, 25(1):30–41, 2013.
[5] Castellini C., Incremental learning of muscle synergies: from calibrating a prosthesis to interacting with it, in Human and Robot Hands – Sensorimotor Synergies to Bridge the Gap between Neuroscience and Robotics, eds Moscatelli A., Bianchi M., editors. (Springer Netherlands; ). Springer series on Touch and Haptic Systems, 2015.
[6] Castellini, C., Bongers, R. M., Nowak, M., and van der Sluis, C. K., Upper-limb prosthetic myocontrol: two recommendations. Frontiers in Neuroscience, 9(496), 2015.
If you enjoyed this article, you may also like:
Towards building brain-like cognition and control for robots
Creating a synthetic “second skin” with soft pneumatic actuators
A helping hand for high-tech firms
Putting humanoid robots in contact with their environment
Teaching a brain-controlled robotic prosthetic to learn from its mistakes
OpenBionics prosthetic hands: Open source, affordable, lightweight, anthropomorphic
This robotic prosthetic hand can be made for just $1000
See all the latest robotics news on Robohub, or sign up for our weekly newsletter.
Claudio Castellini is a researcher at the Institute of Robotics and Mechatronics of the German Aerospace Center (DLR).. read more
Frontiers in Neurorobotics is devoted to leading edge research in the science and technology of embodied autonomous neural systems... read more
LUKE arm robotic prosthetics
Research & Innovation
Business & Finance
Health & Medicine
Politics, Law & Society
Arts & Entertainment
Education & DIY
Events
Military & Defense
Exploration & Mining
Mapping & Surveillance
Enviro. & Agriculture
Aerial
Automotive
Industrial Automation
Consumer & Household
Space
latest posts popular reported elsewhere
Talking Machines: Generative art and Hamiltonian Monte Carlo, with Doug Eck
by
Talking Machines
IDC awards 5 warehouse robotics innovators
by
Frank Tobe
Robohub roundtable: Why do robotics crowdfunding projects fail?
by
Robohub Editors
Everything you need to know about drone racing
by
Center for the Study of the Drone at Bard College
What coachmen from the 1920s can tell us about robots and jobs
by
Vincenzo Spiezia
The Drone Center’s Weekly Roundup: 8/15/16
by
Center for the Study of the Drone at Bard College
Designing our home service robot from the ground up
by
Bernt Øivind Børnich, Phuong Nguyen
Will robocars be heaven or hell for our cities?
by
Brad Templeton, Robocars.com
Last call for startups – Robot Launch 2016
by
Andra Keay, Silicon Valley Robotics
Survey: Evaluate ethics of health related privacy with care robots
by
Dieter Vanderelst, Jurgen Willems
latest posts popular reported elsewhere
The dark side of ethical robotsDesigning our home service robot from the ground upFlying Ring robot can fly on its sideSweep: a low cost LiDAR sensor for smart consumer productsExoskeletons: From helping people walk to controlling robots in spaceNAO Next Gen now available for a wider audienceRobohub roundtable: Why do robotics crowdfunding projects fail?ROS 101: Intro to the Robot Operating SystemEuropean Robotics League posts first major tournament resultsBiohybrid robots built from living tissue start to take shape
latest posts popular reported elsewhere
Robotics Can Get Girls Into STEM, but Some Still Need Convincing
China’s Factories Count on Robots as Workforce Shrinks
Ford Promises Fleets of Driverless Cars Within Five Years
Toyota funds A.I., robotics research at Michigan campus
How Rethink Robotics Sees The Future Of Collaborative Robots
Can Singapore’s labor crunch spark a robot revolution?
How agribusiness can avoid the mistakes of clean tech | SSIR
Di-Wheel Concept | Australian Centre for Field Robotics
Uh-oh! Crowdfunded social robot Jibo won’t now ship outside North America
Think Amazon’s Drone Delivery Idea Is a Gimmick? Think Again
Latest to Quit Google’s Self-Driving Car Unit: Top Roboticist
Prospector-1—first commercial interplanetary mining mission
Robotic gait training for kids with CP – it’s cool but does it work? – Faculty of Rehabilitation Medicine – University of Alberta
How will robots shape our future? (infographic)
The Washington Post will use robots to write stories about the Rio Olympics
The Rio Olympics will have some of the smartest sports cameras ever
Welcome to the Cyborg Olympics
Major Drone Maker Implements No-Fly Zones For Rio Olympics
Hackers Fool Tesla S’s Autopilot to Hide and Spoof Obstacles
MIT and DARPA Pack Lidar Sensor onto Single Chip
Micro and nano robotics
October 2, 2015
A dedicated jobs board for the global robotics community.
Robohub Science Communication Internship - RobohubSenior Researcher in UAV Communications and Coordination - Lakeside Labs GmbHSenior Research Engineer - ConSol PartnersLead Mechanical Engineer – Robotics - Sealed Air Corporation - Intellibot RoboticsElectrical Engineering Manager – Robotics - Sealed Air Corporation - Intellibot Robotics
