This article has Open Peer Review reports available.
The Argus II prosthesis facilitates reaching and grasping tasks: a case series
© Kotecha et al.; licensee BioMed Central Ltd. 2014
Received: 28 January 2014
Accepted: 19 May 2014
Published: 23 May 2014
To evaluate the reach-to-grasp performance of patients fitted with an epiretinal artifical retina device.
This was a hospital-based case series consisting of six patients fitted with the Argus II (Second Sight Medical Products Inc, California, USA) retinal prosthesis. Participants were asked to reach out and pick up a high-contrast cuboid object with the prosthesis in the ‘On’, ‘Off’ or ‘Scrambled’ setting presented in a randomised order. The ‘Scrambled’ setting consisted of a random, scattered signal presented to the prosthesis. The session was repeated after a 4–6 week period. Hand movements were measured using motion detection cameras. The number of successful object grasps was calculated.
The number of successful grasps was greater with the prosthesis in the ‘On’ setting (visit 1: median [interquartile range] percentage success: ‘Off’ = 0 [0 to 50]%, ‘On’ = 69 [67 to 95]%, ‘Scrambled’ = 59 [42 to 95]%; Friedman Chi-squared test statistic 6.5, p = 0.04; visit 2 median [IQR] percentage success: ‘Off’ = 0 [0 to 25]%, ‘On’ = 69 [53 to 100]%, ‘Scrambled’ = 28 [13 to 63]%; Friedman Chi-squared test statistic 8.4, p = 0.02).
The use of an electronic retinal prosthesis facilitates reach-and-grasp performance. Further work should explore how performance can be improved with targeted rehabilitation.
Retinitis pigmentosa (RP) is the most common of the inherited retinal diseases with a prevalence of approximately 1 in 4000 . The condition results in a progressive degeneration of the photoreceptive layer of the retina that can lead to a complete loss of vision , and is responsible for ~3% of all blindness registrations in the UK . Post-mortem studies suggest that although the disease damages the photoreceptor layer, there is moderate preservation of the inner nuclear layer, and relative sparing of the ganglion cell layer [4, 5], with evidence of significant changes in interconnectivity between cells of different layers . Studies on human subjects with RP have shown that electrical stimulation of localised retinal areas elicits visual percepts (‘phosphenes’) in spatially correlated areas [7–9]. These findings have led to the development of long-term implantation of retinal prostheses that aim to stimulate the residual inner retina .
Retinal prostheses have been shown to facilitate an improvement in letter identification [10, 11], and improve the performance of both spatiomotor ‘pointing’ tasks  and motion detection . As such, they have become a potential treatment option for patients with RP.
The Argus II retinal prosthesis, developed by Second Sight (Second Sight Medical Products Inc, California, USA), is the first retinal prosthesis to receive regulatory approval, obtaining a European CE mark in June 2011 and US Food and Drug Administration approval in February 2013. Visual information is captured by a spectacle-mounted video camera, and a video processing unit converts the information into a digital signal that stimulates the implanted electrode array.
Patients implanted with the device are trained to develop ‘camera-to-hand’ co-ordination, such that they are able to detect an object and accurately point to its position in space . However, the ability to perform reaching to grasp tasks has not yet been reported. The act of reaching to grasp an object is a basic task performed many times a day and is facilitated by vision. Information about the object’s spatial location is necessary for fast and accurate reaching, whilst an assessment of the object’s intrinsic properties, such as its size, shape and weight, is required to both pre-shape the grasp posture and select the most appropriate contact points to ensure a stable grip [14, 15]. Reach and grasp movements are a useful indicator of functional performance in patients with visual impairment and have been previously evaluated in patients with ocular disease [16–18].
The purpose of this study was to evaluate the reach-to-grasp movements of a subset of patients implanted with the Argus II electronic prosthesis.
The Argus II epiretinal prosthesis consists of a 60 electrode microarray covering a 20 degree area of the central visual field. An external video camera mounted on a pair of spectacles wirelessly delivers information to the microelectrode array via an inductive radio frequency coil link embedded in the superotemporal sclera. Safety data for all patients participating in the multi-centre international trial of the device have been reported [19, 20], and suggest that the device has a good safety profile. For this exploratory study, patients recruited from the Moorfields Eye Hospital NHS Foundation Trust site in London, UK, participated. The Argus™ II Retinal Simulation System Feasibility study had local research ethics committee approval (Moorfields and Whittington local research ethics committee). Informed consent, according to the Tenets of the Declaration of Helsinki, was given to all patients prior to participation in the trial.
Demographics of patients implanted with Argus II prosthesis at the Moorfields Eye Hospital NHS Foundation Trust centre
Date of implantation
Age at implantation (years)
VA at time of implantation (logMAR)
RP aged early 20s
RP aged 16 years
RP aged 19 years
RP aged 7 years
Choroideraemia aged 46 years
RP aged 28 years
RP aged 11 years
Participants were required to reach out and grasp a high contrast cuboid object, dimensions 30 mm by 30 mm by 60 mm made of white Lego®, positioned near (250 mm) or far (450 mm) at 20 degrees from the start position in either the ipsilateral or contralateral hemispace relative to the reaching hand ( 4 positions in total). These positions were chosen to allow for as natural a movement as possible, such that the participant did not have to overstretch their arm in order to reach the object, and because we did not wish for the object to be in the video camera’s ‘line of sight’ at the start of the movement.
Exploration of reach-to-grasp ability
Prior to the start of the experimental procedure, participants were given standardised instructions for the task requirement. With the prosthesis switched off, participants were first asked to feel across the table with their hands to establish the dimensions and edges of the workspace, after which they were required to handle the object to familiarise themselves with the size, shape and weight. The participants were advised of the colour of the table and object. The retinal prosthesis was then switched on and the object was placed in the line of ‘sight’ of the video camera for the participant to establish the appearance of the object as imaged by the device. The object was then placed at the edges of the table for the participant to establish the maximum limits of head/camera movement required for the test procedure. Participants were advised that during the test procedure, the prosthesis would be set to one of 3 settings: ‘On’, where the prosthesis was set to standard function, ‘Off’, where it was switched off completely and ‘Scrambled’ where the microelectrode array was fully functioning but the signal input would result in the electrodes being stimulated in a random, scattered pattern. The prosthesis settings would be presented in a randomised order to which the participant would be masked. The participant was advised that they would undertake the test procedure under one of 2 eye conditions, eyes ‘patched’ where both eyes would be taped closed or ‘unpatched’, and that they would be given a time frame of 30 seconds in which to find the object, reach out and bring it to the start position. Participants were advised that the object would be placed in one of 4 positions on the table. The purpose of ‘patching’ the eye was to eliminate the use of any residual vision. The 30 second recording window was chosen arbitrarily to try and maximise the participants’ chances of completing the task, without being so excessive as to result in fatigue over the course of the experimental procedure.
Participants were instructed to locate the object, pick it up and bring it to the start position. Prosthesis setting, eye condition and object position were presented in a randomised order (list generated by http://www.randomizer.org prior to the start of the test procedure), with participants masked to object placement at the start of each recording. Participants were given an audible instruction as to when to start locating the object (‘start now’) and were advised when the 30 second recorded period terminated. Participants performed 48 ‘reach-and-grasp’ movements in total, (3 prosthesis settings: On, Off, Scrambled; 2 eye settings: Patched, Unpatched; 8 repetitions: 4 in the ‘near’ and 4 in the ‘far’ locations) in total. All tests were performed by a single observer (AK).
Each patient was retested after a period of 4–6 weeks to examine the repeatability of movements. The study was performed between October 2011 and October 2012, determined by the availability of the patients.
Definitions of data quantified
Movement onset (MO; seconds)
Time at which wrist speed exceeded 50 mm/s
Object contact (seconds)
When object movement ≥ 1 mm from original position
Time to object contact (TTC; seconds)
Time between movement onset and object displacement ≥ 1 mm
Path deviation ratio
Deviation of the movement trajectory from a straight route between the starting and object contact wrist positions
The percentage of completed movements, defined as a successful reach and grasp of object within the 30 second trial period against the number of trials undertaken, was calculated for each participant.
The data followed a non-normal distribution and thus the non-parametric Friedmann and Wilcoxon tests were used to evaluate differences in reach and grasp movements.
At the first visit, there were significant differences in success rate under the 3 different settings (patched and unpatched data pooled median [interquartile range] percentage success: ‘Off’ = 0 [0 to 50]%, ‘On’ = 69 [67 to 95]%, ‘Scrambled’ = 59 [42 to 95]%; Friedman Chi-squared test statistic 6.5, p = 0.04). This was maintained at the second visit (‘Off’ = 0 [0 to 25]%, ‘On’ = 69 [53 to 100]%, ‘Scrambled’ = 28 [13 to 63]%; Friedman Chi-squared test statistic 8.4, p = 0.02). Wilcoxon test analyses showed that success rates between ‘Off’ and ‘On’ were significant (‘Off’ v ‘On’ visit 1: Z statistic = −2.0, p = 0.046; visit 2: Z statistic = −2.0, p = 0.042; ‘Scrambled’ v ‘On’ visit 1: Z statistic = −0.7, p = 0.5; visit 2: Z statistic = −1.8, p = 0.08).
Quantification of kinematic parameters
The results of this study show that the ability of individuals with profound loss of vision to reach and grasp a table top object is facilitated with an artificial retinal prosthesis. With the prosthesis in the ‘On’ position, there were more successful grasps and a greater accuracy of reaching movements compared with when the prosthesis was in the ‘Off’ setting, suggesting that use of the prosthesis may facilitate reaching and grasping movements.
Two participants (51001 and 51007) made successful reaches with the prosthesis in the ‘Off’ setting. Participant 51007 exhibited larger path deviation ratios and longer times to object contact under this setting, suggesting a less efficient movement overall. This may be explained by the ‘search’ tactic used by this participant when reaching for the object with the prosthesis ‘Off’; the participant used his hand to ‘scan’ across the table until the object was found. In contrast, his reaches made with the prosthesis in the ‘On’ setting had shorter time to contact and path deviation ratios, indicating that he made a more efficient movement towards the object in this setting. However, participant 51001 displayed very variable movements in all prosthesis settings. This participant is known to have specific difficulties when using the prosthesis, in that he suffers a loss of connection between the implanted radio frequency coil and head mounted camera, thought to be related to an acquired, intermittent onset, exotropia.
Under the ‘On’ and ‘Scrambled’ settings movement onset time occurred after a delay of over 10 seconds after recording started, and is likely to reflect an attempt by the participant to detect the object position using the prosthesis prior to attempting the reach. This represents a considerable delay when compared with reaching behaviour studies of patients with acquired loss of central [18, 22] and peripheral  vision.
For 2 participants (51007 and 51009) the path deviation ratio was slightly longer and more variable under ‘Scrambled’ setting, suggesting that in spite of having knowledge that an object was present on the table, there was insufficient information to make a precise movement towards it. However, this was not the case with the remaining participants, and suggests that for this study, use of the prosthesis was primarily to detect the location of the object to facilitate the reach. Under the ‘Scrambled’ setting, when the video camera detects an object on the table, it sends a random signal to the microarray, and therefore will not give full information of the ‘form’ of the object, just an indication that an object is present. The primary aim of the study was to investigate whether use of the prosthesis facilitated reaching to a table-top object; greater differences between the ‘On’ and ‘Scrambled’ settings may occur if participants are required to differentiate between forms of objects in their reach. Previous work evaluating letter recognition tasks clearly show that form recognition is superior with the prosthesis in the ‘On’ setting over the ‘Scrambled’ setting .
Once the movement was initiated, time to object contact was achieved within 1.5 to 3 seconds. Castiello  studied the reach and grasp movements of congenitally blind patients and found that the time to object contact was approximately 1 second. However, a key difference between his and the present study is that his subjects were informed of the location of the object prior to recording movements. Castiello wished to evaluate whether there was a decoupling of the reaching and grasping components in blind subjects, whilst the present study aimed to look at reach efficiency using the prosthesis; to achieve this aim no prior knowledge of the object’s position was made available, thus it is difficult to directly compare the findings of these studies. In their study of patients with bilateral central scotomas from age-related macular degeneration, Timberlake et al.  found time to object contact durations to be between ~ 0.7 and 1.2 seconds, and similar times to contact have been found in other studies of patients with macular disease [22, 24]. The times to object contact in the present study were longer by comparison and may reflect either a lack of confidence in using the prosthesis and the possible difficulties in achieving ‘camera-hand’ co-ordination, or perhaps illustrate the detrimental effect of the lack of visual feedback of hand position to facilitate online control of movement, leading to a more tentative reach movement. In studies of normally sighted individuals where the view of the reaching limb was obscured, other observers have noted longer movement durations . It is thought that without visual information of the hand and arm in space, one is unable to control a ‘reach’ movement precisely . An efficient reach requires information of the hand’s position relative to the object, [25, 27] and online control of reaching movements has been found to be deficient in artificially [15, 28] and pathologically  restricted fields of view. However, in his study of congenitally blind subjects Castiello  found that visual feedback was not necessary for transporting the hand to an object, but was important for the scaling of grip aperture. It may be that late-blind participants in this study had already developed strategies to compensate for their lack of visual feedback to function in their every-day life  and thus the lack of hand visualisation did not completely prevent them from making an accurate reach. Furthermore, there is some evidence to suggest that it is not so much vision per se, but direction of gaze and head position that augments proprioceptive feedback in reaching tasks . Thus, once the object had been located by the prosthesis, the reach was made based on the head and eye position. However, this is speculation and further studies with patients implanted with retinal prostheses should explore this topic further.
Limitations to this study include the laboratory environment and choice of high contrast object; how our findings translate to ‘real-world’ environment remains to be elucidated. Furthermore, the cohort only consisted of the 6 UK participants of the international trial. However, the aim of this study was to evaluate whether reach-to-grasp movements might be used to assess the functional performance of the artificial retina, and the results of this study suggest it may be a useful tool. Future work will evaluate reaching movements to multiple objects to evaluate both object discrimination and the effects of crowding on reach accuracy.
In conclusion, this study shows that the Argus II retinal prosthesis facilitates reaching and grasping movements in blind persons.
Finally, the most pertinent observation from this pilot study was the delay in actual movement onset. This suggests that whilst use of the prosthesis facilitates reaching for a table top object, movements are not initiated swiftly. It is clear that this should be addressed when considering the rehabilitation strategies for prosthesis usage in this patient group. Future research directions should focus on rehabilitation and use of prosthesis for every-day tasks.
Dr. Kotecha receives a proportion of her funding from the Department of Health’s National Institute for Health Research Biomedical Research Centre for Ophthalmology at Moorfields Eye Hospital NHS Foundation Trust and the UCL Institute of Ophthalmology.
- Boughman JA, Conneally PM, Nance WE: Population genetic studies of retinitis pigmentosa. Am J Hum Genet. 1980, 32 (2): 223-235.PubMedPubMed CentralGoogle Scholar
- Hartong DT, Berson EL, Dryja TP: Retinitis pigmentosa. Lancet. 2006, 368 (9549): 1795-1809. 10.1016/S0140-6736(06)69740-7.View ArticlePubMedGoogle Scholar
- Bunce C, Wormald R: Leading causes of certification for blindness and partial sight in England & Wales. BMC Public Health. 2006, 6: 58-10.1186/1471-2458-6-58.View ArticlePubMedPubMed CentralGoogle Scholar
- Santos A, Humayun MS, De Juan E, Greenburg RJ, Marsh MJ, Klock IB, Milam AH: Preservation of the inner retina in retinitis pigmentosa. A morphometric analysis. Arch Ophthalmol. 1997, 115 (4): 511-515. 10.1001/archopht.1997.01100150513011.View ArticlePubMedGoogle Scholar
- Humayun MS, Prince M, De Juan E, Barron Y, Moskowitz M, Klock IB, Milam AH: Morphometric analysis of the extramacular retina from postmortem eyes with retinitis pigmentosa. Invest Ophthalmol Vis Sci. 1999, 40 (1): 143-148.PubMedGoogle Scholar
- Milam AH, Li ZY, Fariss RN: Histopathology of the human retina in retinitis pigmentosa. Prog Retin Eye Res. 1998, 17 (2): 175-205. 10.1016/S1350-9462(97)00012-8.View ArticlePubMedGoogle Scholar
- Humayun MS, De Juan E, Dagnelie G, Greenberg RJ, Propst RH, Phillips DH: Visual perception elicited by electrical stimulation of retina in blind humans. Arch Ophthalmol. 1996, 114 (1): 40-46. 10.1001/archopht.1996.01100130038006.View ArticlePubMedGoogle Scholar
- Rizzo JF, Wyatt J, Loewenstein J, Kelly S, Shire D: Perceptual efficacy of electrical stimulation of human retina with a microelectrode array during short-term surgical trials. Invest Ophthalmol Vis Sci. 2003, 44 (12): 5362-5369. 10.1167/iovs.02-0817.View ArticlePubMedGoogle Scholar
- de Balthasar C, Patel S, Roy A, Freda R, Greenwald S, Horsager A, Mahadevappa M, Yanai D, McMahon MJ, Humayun MS, Greenberg RJ, Weiland JD, Fine I: Factors affecting perceptual thresholds in epiretinal prostheses. Invest Ophthalmol Vis Sci. 2008, 49 (6): 2303-2314. 10.1167/iovs.07-0696.View ArticlePubMedPubMed CentralGoogle Scholar
- Weiland JD, Cho AK, Humayun MS: Retinal prostheses: current clinical results and future needs. Ophthalmology. 2011, 118 (11): 2227-2237. 10.1016/j.ophtha.2011.08.042.View ArticlePubMedGoogle Scholar
- da Cruz L, Coley BF, Dorn J, Merlini F, Filley E, Christopher P, Chen FK, Wuyyuru V, Sahel J, Stanga P, Humayun M, Greenberg RJ, Dagnelie G, Argus II Study Group: The Argus II epiretinal prosthesis system allows letter and word reading and long-term function in patients with profound vision loss. Br J Ophthalmol. 2013, 97 (5): 632-636. 10.1136/bjophthalmol-2012-301525.View ArticlePubMedPubMed CentralGoogle Scholar
- Ahuja AK, Dorn JD, Caspi A, McMahon MJ, Dagnelie G, Dacruz L, Stanga P, Humayun MS, Greenberg RJ: Blind subjects implanted with the Argus II retinal prosthesis are able to improve performance in a spatial-motor task. Br J Ophthalmol. 2011, 95 (4): 539-543. 10.1136/bjo.2010.179622.View ArticlePubMedGoogle Scholar
- Dorn JD, Ahuja AK, Caspi A, Da Cruz L, Dagnelie G, Sahel JA, Greenberg RJ, McMahon MJ, Argus II Study Group: The Detection of Motion by Blind Subjects With the Epiretinal 60-Electrode (Argus II) Retinal Prosthesis. JAMA Ophthalmol. 2013, 131 (2): 183-189. 10.1001/2013.jamaophthalmol.221.View ArticlePubMedPubMed CentralGoogle Scholar
- Jeannerod M: Mechanisms of visuomotor coordination: a study in normal and brain-damaged subjects. Neuropsychologia. 1986, 24 (1): 41-78. 10.1016/0028-3932(86)90042-4.View ArticlePubMedGoogle Scholar
- Sivak B, MacKenzie CL: Integration of visual information and motor output in reaching and grasping: the contributions of peripheral and central vision. Neuropsychologia. 1990, 28 (10): 1095-1116. 10.1016/0028-3932(90)90143-C.View ArticlePubMedGoogle Scholar
- Grant S, Melmoth DR, Morgan MJ, Finlay AL: Prehension deficits in amblyopia. Invest Ophthalmol Vis Sci. 2007, 48 (3): 1139-1148. 10.1167/iovs.06-0976.View ArticlePubMedGoogle Scholar
- Kotecha A, O'Leary N, Melmoth D, Grant S, Crabb DP: The functional consequences of glaucoma for eye-hand coordination. Invest Ophthalmol Vis Sci. 2009, 50 (1): 203-213.View ArticlePubMedGoogle Scholar
- Timberlake GT, Omoscharka E, Quaney BM, Grose SA, Maino JH: Effect of bilateral macular scotomas from age-related macular degeneration on reach-to-grasp hand movement. Invest Ophthalmol Vis Sci. 2011, 52 (5): 2540-2550. 10.1167/iovs.10-6062.View ArticlePubMedGoogle Scholar
- Humayun MS, Dorn JD, Ahuja AK, Caspi A, Filley E, Dagnelie G, Salzmann J, Santos A, Duncan J, da Cruz L, Mohand-Said S, Eliott D, McMahon MJ, Greenberg RJ: Preliminary 6 month results from the Argus II epiretinal prosthesis feasibility study. Conf Proc IEEE Eng Med Biol Soc. 2009, 2009: 4566-4568.PubMedPubMed CentralGoogle Scholar
- Humayun MS, Dorn JD, da Cruz L, Dagnelie G, Sahel JA, Stanga PE, Cideciyan AV, Duncan JL, Eliott D, Filley E, Ho AC, Santos A, Safran AB, Arditi A, Del Priore LV, Greenberg RJ, Argus II Study Group: Interim results from the international trial of Second Sight's visual prosthesis. Ophthalmology. 2012, 119 (4): 779-788. 10.1016/j.ophtha.2011.09.028.View ArticlePubMedPubMed CentralGoogle Scholar
- Oldfield RC: The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971, 9 (1): 97-113. 10.1016/0028-3932(71)90067-4.View ArticlePubMedGoogle Scholar
- Pardhan S, Gonzalez-Alvarez C, Subramanian A: How does the presence and duration of central visual impairment affect reaching and grasping movements?. Ophthalmic Physiol Opt. 2011, 31 (3): 233-239. 10.1111/j.1475-1313.2010.00819.x.View ArticlePubMedGoogle Scholar
- Castiello U, Bennett KM, Mucignat C: The reach to grasp movement of blind subjects. Exp Brain Res. 1993, 96 (1): 152-162.View ArticlePubMedGoogle Scholar
- Pardhan S, Gonzalez-Alvarez C, Subramanian A: Target contrast affects reaching and grasping in the visually impaired subjects. Optom Vis Sci. 2012, 89 (4): 426-434. 10.1097/OPX.0b013e31824c1b89.View ArticlePubMedGoogle Scholar
- Connolly JD, Goodale MA: The role of visual feedback of hand position in the control of manual prehension. Exp Brain Res. 1999, 125 (3): 281-286. 10.1007/s002210050684.View ArticlePubMedGoogle Scholar
- Loftus A, Murphy S, McKenna I, Mon-Williams M: Reduced fields of view are neither necessary nor sufficient for distance underestimation but reduce precision and may cause calibration problems. Exp Brain Res. 2004, 158 (3): 328-335.PubMedGoogle Scholar
- Loftus A, Servos P, Goodale MA, Mendarozqueta N, Mon-Williams M: When two eyes are better than one in prehension: monocular viewing and end-point variance. Exp Brain Res. 2004, 158 (3): 317-327.PubMedGoogle Scholar
- Watt SJ, Bradshaw MF, Rushton SK: Field of view affects reaching, not grasping. Exp Brain Res. 2000, 135 (3): 411-416. 10.1007/s002210000545.View ArticlePubMedGoogle Scholar
- Merabet LB, Pascual-Leone A: Neural reorganization following sensory loss: the opportunity of change. Nat Rev Neurosci. 2010, 11 (1): 44-52. 10.1038/nrn2758.View ArticlePubMedGoogle Scholar
- Reuschel J, Rosler F, Henriques DY, Fiehler K: Spatial updating depends on gaze direction even after loss of vision. J Neurosci Off J Soc Neurosci. 2012, 32 (7): 2422-2429. 10.1523/JNEUROSCI.2714-11.2012.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2415/14/71/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.