Evaluation of a combined index of optic nerve structure and function for glaucoma diagnosis
© Boland and Quigley; licensee BioMed Central Ltd. 2011
Received: 21 June 2010
Accepted: 11 February 2011
Published: 11 February 2011
The definitive diagnosis of glaucoma is currently based on congruent damage to both optic nerve structure and function. Given widespread quantitative assessment of both structure (imaging) and function (automated perimetry) in glaucoma, it should be possible to combine these quantitative data to diagnose disease. We have therefore defined and tested a new approach to glaucoma diagnosis by combining imaging and visual field data, using the anatomical organization of retinal ganglion cells.
Data from 1499 eyes of glaucoma suspects and 895 eyes with glaucoma were identified at a single glaucoma center. Each underwent Heidelberg Retinal Tomograph (HRT) imaging and standard automated perimetry. A new measure combining these two tests, the structure function index (SFI), was defined in 3 steps: 1) calculate the probability that each visual field point is abnormal, 2) calculate the probability of abnormality for each of the six HRT optic disc sectors, and 3) combine those probabilities with the probability that a field point and disc sector are linked by ganglion cell anatomy. The SFI was compared to the HRT and visual field using receiver operating characteristic (ROC) analysis.
The SFI produced an area under the ROC curve (0.78) that was similar to that for both visual field mean deviation (0.78) and pattern standard deviation (0.80) and larger than that for a normalized measure of HRT rim area (0.66). The cases classified as glaucoma by the various tests were significantly non-overlapping. Based on the distribution of test values in the population with mild disease, the SFI may be better able to stratify this group while still clearly identifying those with severe disease.
The SFI reflects the traditional clinical diagnosis of glaucoma by combining optic nerve structure and function. In doing so, it identifies a different subset of patients than either visual field testing or optic nerve head imaging alone. Analysis of prospective data will allow us to determine whether the combined index of structure and function can provide an improved standard for glaucoma diagnosis.
For decades, ophthalmologists have recognized a relationship between the structure of the optic nerve and its function in patients with glaucoma[1–4]. Glaucoma causes death of retinal ganglion cells and their axons, along with a deformation of the connective tissues of the optic nerve head. Thus, its structural effects can be measured both by loss of thickness of the retina in the ganglion cell and nerve fiber layers and by topographical changes of the nerve head. The alterations as measured at the nerve head combine both loss of axons and connective tissue deformation .
Glaucomatous functional deficits similarly result from ganglion cell loss, with defects in visual sensitivity found in the receptive fields of the damaged neurons. This relationship between optic nerve head topography and visual function is so fundamental to our understanding of the disease that it is used clinically to differentiate damage due to glaucoma from other diseases of the optic nerve head. In fact, one or both of these measures have been used as inclusion criteria and primary outcome measures in the major clinical trials of glaucoma [6–9] and in a consensus definition of glaucomatous optic neuropathy proposed for use in prevalence surveys.
It is logical that the two approaches, structural and functional, should give information that is highly correlated, since both depend on atrophy of retinal ganglion cells whose anatomical and physiological features are known. On the other hand, data from clinical trials have failed to confirm a strong concordance between changes in optic nerve and visual field criteria. In the Ocular Hypertension Treatment Study, for example, treated subjects met both field and optic nerve criteria for change only 8% of the time, while 42% reached the visual field end point alone and 50% reached the optic disc end point alone. The lack of perfect correlation between structural and functional diagnostic criteria may have one or more explanations. For example, it is known that the variability in testing differs between the two methods, which could by itself produce poor clinical correlation. Alternatively, the two approaches might contain different types of information about the presence or absence of glaucoma, which, while correlated by the anatomy of the visual system, nonetheless are expressed in different ways with different timing from individual to individual. Thus, using either of these two measures alone as a "gold standard" for glaucoma diagnosis may be a flawed approach.
Hence, the merging of the two sets of data could provide important corroboration that true abnormality had developed or was progressing. This has not been previously done in optimal fashion for a variety of reasons. First, there has been no attempt to combine quantitatively structural and functional deficits using continuous probabilities of abnormality for each measure. Rather, specific cut-off criteria at extreme probability levels are given in current imaging or field analysis. These values have been chosen to maximize the specificity of each test, though at the cost of sensitivity. Second, there has been no consensus regarding a map between the position of a field deficit and corresponding structural changes to the NFL thickness or optic nerve head topography. Some proposed models for matching structure and function used probabilistic approaches that produced findings inconsistent with known anatomic facts--linking superior visual field defects to superior optic disc abnormality, for instance[12–16]. Third, it is possible that there is temporal dissociation in structural and functional abnormality development. While NFL photographs showed abnormality in many cases earlier than manual visual fields, it has recently been proposed that much of the apparently earlier change in structure derives from greater variability in field test data. Regardless of the actual nature of temporal discontinuity in changes to structure and function, use of both together better reflects the fact that glaucomatous optic neuropathy displays changes in both structure and function.
We believe a single measure combining these elements is an improvement for 4 reasons. First, quantitative measures of optic nerve structure and function are increasingly available and improving in quality. Second, the discordance between simultaneous progression suggests that both structure and function contain complementary information. Third, a reliable mapping of visual field points to the optic nerve head and nerve fiber layer is available. Finally, modulation of the variability of structural and functional tests by emphasizing those that are anatomically related will reduce the overall variability of the system. To test the hypothesis that a combined measure of optic nerve structure and function might be able to detect glaucoma, we designed the Structure Function Index (SFI) as a model unifying retinal ganglion cell structure and function. The link between the two was created using our knowledge of retinal nerve fiber layer anatomy. We then analyzed the characteristics of the model and compared it to tests of structure and function alone in terms of distinguishing eyes with glaucoma from eyes of glaucoma suspects.
This work was approved by the institutional review board of the Johns Hopkins University School of Medicine and adhered to the tenets of the Declaration of Helsinki.
Evaluation of the SFI required three groups of subjects: 1) A reference group of glaucoma suspects to define "normal" values of tests, 2) a separate but identically defined group of glaucoma suspects and 3) a group with glaucoma. The latter two groups were used to compare the SFI to current diagnostic methods.
We identified subjects for the reference and suspect groups using billing data to select patients seen by the Glaucoma Service of the Wilmer Eye Institute between 1999 and 2007 with a diagnosis of glaucoma suspect (ICD-9 code 365.0x). The criteria for diagnosis of glaucoma suspect and glaucoma were based on the clinical judgment of glaucoma specialists using medical history, past records, and a comprehensive clinical evaluation including visual field testing and optic nerve examination. We further refined this list to include those subjects who, on the same day, had both visual field testing (SITA-Standard 24-2) classified as 'Reliable' by the Humphrey Field Analyzer (HFA, Carl Zeiss Meditec, Dublin, CA) and optic nerve imaging using the Heidelberg Retina Tomograph (HRT, Heidelberg Engineering, Vista, CA) with image quality that was at least 'Acceptable' according to the HRT software. These tests were chosen because they were most commonly used by the Wilmer Glaucoma Service during this time period. Subjects were also excluded if they ever had a diagnosis of glaucoma (ICD-9 codes 365.[1-9]x) in our database. Finally, the group identified as glaucoma suspects was required to achieve a stage of 0 or 1 on the Glaucoma Staging System. This search returned 1558 eyes. Data from right and left eyes were analyzed separately so a given patient was allowed to contribute both eyes to the reference group. Rather than treating tests from right and left eyes merely as mirror images, we kept them separate in order to account for any differences based on laterality, due to testing order for example. One thousand of these subjects were randomly selected as our reference population and the remaining 558 were placed in the suspect population to be used in evaluating the SFI.
Similarly, glaucoma cases were identified as those subjects with a diagnosis of open angle glaucoma (ICD-9 365.11), a 'Reliable' visual field and at least 'Acceptable' quality HRT on the same day.
In cases where both eyes were available for a particular subject in the suspect or glaucoma groups, the eye with the worse HFA mean deviation was used in the analysis described below. This was done since clinicians would likely classify a subject as glaucoma if one eye were affected, and we did not wish to include fellow eyes with lesser or no damage in the glaucoma group. After this selection process, we had 499 eyes from suspects and 895 eyes with glaucoma.
To validate the diagnoses obtained using billing data, we randomly selected the clinical chart records of 100 subjects identified as glaucoma suspects and 103 subjects identified as having open angle glaucoma. Of the 100 records reviewed for glaucoma suspects, 97 supported the billing diagnosis based on the clinician's written assessment of the patient. Of the remaining three, one had angle closure glaucoma, one had no glaucoma diagnosis in the chart, and one had neurological disease. Of 103 records reviewed from those subjects with billing codes for open angle glaucoma, 99 had glaucoma (one angle closure), 3 were suspects and 1 had non-glaucomatous optic nerve disease. Based on this review, we can therefore estimate that only about 4% of billing codes do not accurately reflect the clinician's assessment. Furthermore, the number of misclassified individuals is similar in each group (suspect and glaucoma) so there should be no net bias of the classifier performance.
Defining the Structure Function Index
In brief, the SFI is calculated in three steps: 1) calculate a probability of abnormality for each point in the visual field, 2) calculate a probability of abnormality for each sector of the optic disc, and 3) combine those probabilities with the probability that a visual field point and optic disc sector are linked by retinal nerve fiber layer anatomy. As defined, the SFI produces one probability of structure-function abnormality for each point tested in the visual field. To allow the SFI to be compared to current diagnostic criteria, we analyzed these individual pointwise SFI values in a manner similar to the Glaucoma Hemifield Test.
Definition of Reference Values
To calculate the probability of abnormality for each visual field point, we require reference data for each of those points. The probabilities of abnormality reported by the standard output of the HFA include only a small number of discrete cutoffs near the far end of the probability distribution function (p = 5%, 2%, 1%, 0.5%). They therefore contain no information about probabilities of abnormality less than 95% and are based on reliable tests of persons with a normal eye examination. To generate a continuous probability of abnormality at each point, we created empiric distributions for the HFA Total Deviation at each point in the 24-2 visual field for right and left eyes separately. These distributions were created using pointwise values from 500 right and 500 left eyes in the reference group defined above. Total Deviation values were used because they include correction for age-related decline in visual sensitivity. We chose not to use Pattern Deviation values as they include a correction for diffuse loss that we believe will be unnecessary with the SFI because diffuse field loss not associated with corresponding nerve damage will be discounted to a large degree in the SFI calculation.
Linking Points in the Visual Field to Points on the Optic Disc
Quantitative Combination of Structure and Function
Where P(field) is the probability that the visual field point is abnormal (one minus the cumulative probability value defined above), P(sector) is the probability that an HRT sector is abnormal (using the cumulative probability function defined above), and P(anatomy) is the probability that the visual field point is linked to that sector of the nerve. Using this formula, the SFI will be close to 0 in cases where the probabilities of abnormality for the field and disc are small or when the two are unlikely to be linked by RNFL anatomy. It is also the case that when there is a modest probability of a defect in function and a modest probability of a defect in structure, the fact that the two are in linked by RNFL anatomy increases the value of the SFI compared to when they are not linked.
The SFI Hemifield Test
As the SFI values within a region become closer to 1 (100% probability of abnormality), the value of the region score increases. The formula above is derived directly from that used for calculating region scores in the GHT. Because this value can reach very high levels as the SFI value becomes very small, we limited the score for any one point to a maximum of 100 (SFI value of 99.9%). The maximum score for a given region depends on the number of points included (3 to 6) and can therefore range from 300 for region 1 to 600 for region 4. The difference in the score between paired superior and inferior regions was then used to identify defects that might be due to glaucoma.
To define a reference distribution for the difference in hemifield score for each cluster pair, we again used the 1000 subjects in the reference population defined above. We calculated the SFI at each point in the visual field, calculated the region scores, and then calculated the differences between corresponding superior and inferior region pairs. Recognizing that upper to lower differences disappear when damage is severe in both hemifields, we also calculated the sum of all SFI-HT region scores. This value was included in the analysis to account for eyes with damage too diffuse to produce a significant superior-inferior difference in scores. Based on the 500 right and 500 left eyes, we were able to generate empiric distributions for the five differences in hemifield region scores and for the sum of region scores. When subsequently analyzing the glaucoma suspect and glaucoma subjects, we determined which of these six values was most statistically abnormal by comparing each to the corresponding empiric distribution from the reference population. To allow for receiver operating characteristic (ROC) analysis to be performed, each subject was summarized with the single largest probability of abnormality among its five regional score differences (Figure 4) and sum of all 10 individual region scores (5 upper and 5 lower in Figure 4). The output of the SFI-HT is therefore a value between 0 (no chance of being abnormal) and 1 (100% chance of being abnormal).
The demographics of the glaucoma and glaucoma suspect groups were compared using the t-test for age, Fisher's exact test for sex, and the chi-square test for racial background. The data for race are based on self-report as recorded in the Johns Hopkins Hospital patient registration system.
The SFI and the SFI-HT were calculated for each eye in the glaucoma group and for those eyes in the glaucoma suspect group that were not used as the reference population. Receiver operating characteristic analysis was then performed to characterize the ability of the SFI to distinguish eyes with glaucoma from eyes of glaucoma suspects. The probability of the most abnormal difference in SFI-HT region scores or of the sum of all SFI values was used as the summary statistic for the SFI with the clinical diagnosis serving as the "true" classification. To compare the SFI-HT to existing diagnostic criteria that rely on structure or function alone, we performed ROC analysis using the HFA mean deviation (MD) and the difference between actual and predicted rim area from the HRT. We also calculated the sensitivity and specificity of the HFA GHT and the categorical HRT Moorfields classification (MFC). The results of these two tests were considered positive for glaucoma when they were reported as "Outside Normal Limits". Areas under the ROC curves were compared using the method of Hanley and McNeil and confidence intervals for sensitivity and specificity were calculated using the method described by Ross. The "optimal" operating point of the SFI ROC curve was chosen as that value of the SFI-HT that produced the point closest to 100% sensitivity and 100% specificity.
Visual field and HRT data were analyzed using Matlab (version 7.11.0, The Mathworks, Inc., Natick, MA) and statistical analyses were performed using Matlab, and R version 2.11.1 with packages Hmisc and ROCR.
Characteristics of the glaucoma suspect and glaucoma patient groups.
(n = 499)
(n = 895)
Sex (% female)
HFA MD (dB)
HFA PSD (dB)
As part of the review of clinical records for 100 of the glaucoma suspects, we determined that 48% were suspects based on the appearance of their optic nerve, 23% based on a history of elevated intraocular pressure, 11% based on family history, 6% based on the appearance of their anterior chamber angle, 4% based on their visual field, and 8% for other reasons. A cup-disc ratio was recorded for 189 eyes from these 100 suspects and the mean of these values was 0.49 with a standard deviation of 0.17. For comparison, a documented cup-disc ratio was found for 184 eyes of the 103 subjects reviewed in the glaucoma group and the mean was 0.76 with a standard deviation of 0.20.
These results characterize a potentially new approach to the diagnosis of glaucoma. Whereas the clinical diagnosis of glaucoma requires that defects in optic nerve structure and function should be found together, there is currently no test available to quantitatively combine measures of both structure and function. We propose the SFI as such a test. We have explicitly defined it to overcome some of the limitations of current testing. First of all, it utilizes continuous probabilities of abnormality rather than relying on the highly specific "abnormal" determinations of each device. The use of continuous probabilities has also been proposed for analysis of visual field data. Relying on this feature alone might make the SFI prone to false positive results, however. To overcome this, the SFI explicitly modulates defects in structure and function by requiring an anatomic relationship between the two, thereby augmenting defects that would not reach statistical significance on either test alone.
The results presented above show some desirable characteristics of the SFI. We see that the values of the SFI in the reference population are heavily skewed toward the expected (lower) values (Figure 3A). At the same time, the values for the glaucoma population are more spread out between low and high values (Figure 3B). Since Figure 3 depicts data for a single visual field location, one would expect such a distribution in the glaucoma group, as a particular location may not be affected in some individuals. A similar comment can be made about Figure 8. The fact that the SFI values are widely distributed for subjects with "mild" disease (based on visual field) is expected as this group contains both normal subjects and those with varying degrees of early damage. We are now investigating through the use of longitudinal data whether those with higher levels of SFI will show more rapid progression, thereby validating the index. This finding would not be as significant if the subjects with more severe field loss were also widely distributed in terms of the SFI. The fact that they are not suggests that the SFI is not simply a random number generator.
The ROC data also suggest that the SFI is a useful synthesis of structure and function. First of all, while the total area under the curve is not significantly different from those of MD and PSD, it does show higher sensitivity at the highest specificity values. The Venn diagram in Figure 10 showing the classification of subjects by each test also helps with the interpretation of the ROC curves. While all tests are highly correlated in severe disease (data not shown), there is significant disagreement for those with the mildest disease shown in the figure. In other words, each test is classifying (or misclassifying) different subjects on the right side of the ROC plot, the zone containing those with mild disease. As always, the lack of an accurate test for glaucoma makes it difficult to compare new to existing methods. A determination of which diagnostic test (including the clinician) is correct is not possible using data from a single point in time. The ultimate evaluation of the SFI (or any glaucoma test) will be longitudinal studies, now ongoing, in which development of initial injury will be compared among all diagnostic tests.
The areas under our ROC curves are lower than some prior studies using other patient populations and other diagnostic tests. This is likely due to the fact that we purposefully studied a challenging classification problem by attempting to distinguish a group of glaucoma suspects from those classified as glaucoma. Studies that evaluate the ability to discriminate between eyes with glaucoma and normals would be expected to find more striking differences, though this comparison does not duplicate the problem encountered by clinicians. To that end, we chose to use glaucoma suspects to define our normal values since they are, in fact, the group that clinicians are most often forced to differentiate from patients with early glaucoma. It is seldom a dilemma in clinical practice to distinguish a patient with low glaucoma risk (no family history of glaucoma, normal optic nerve appearance, normal visual field, normal IOP) from someone with manifest disc or field change. On the other hand, it is a frequently encountered problem to determine which patients with clear risk factors (strong family history, "suspicious" discs, non-specific field changes, elevated IOP) have disease and which do not. By choosing to use suspects as our reference group, we are therefore making the classification problem more difficult, but also more applicable to clinical practice.
Previous research on combining measures of structure and function used regression models that included variables from various optic nerve analyses and from automated perimetry. Subsequently, investigators applied machine learning techniques to combined structural and functional data[34–37]. While some of these studies reported an improvement of one kind or another in the detection of glaucoma, none included the steps of explicitly combining the structural and functional data using knowledge of nerve fiber layer topography or the superior-inferior difference in glaucoma damage. It may also be possible for a machine learning classifier to "learn" nerve fiber layer anatomy given enough training data. However, training a system in this way will always be hampered by the fact that empiric data contain correlations between structural and functional defects that are not due to a cause and effect relationship. For example, when significant damage has occurred, correlations between disc rim loss and decreased field test sensitivity will occur simply because all points are functionally depressed and not necessarily because the two are linked by ganglion cell anatomy. In other words, when the disc and field are both severely, rather than focally damaged, one will be able to find correlations between disconnected areas like superior field points and superior optic nerve parameters. Furthermore, most machine learning classifiers represent "black boxes" that model knowledge in ways that are not easily understandable. By explicitly including our knowledge of the anatomic basis for structure-function correlations in glaucoma, we avoid the need to "teach" classifiers how structure and function are related by anatomy in glaucoma. On the other hand, machine-learning approaches may provide the benefit of discovering alternative relationships between structure and function in glaucoma, though this benefit remains to be seen.
Another area of investigation that has some relationship to what we present here is the modeling of structural and functional changes in glaucoma. Starting with the assumption that changes in sensitivity at a particular point in the visual field should correlate closely with changes in nerve fiber layer thickness or the number of ganglion cells, both Harwerth et al. and Hood et al. have proposed linear models of this relationship. Both have shown significant correlation between structural and functional measures in both animals and humans and support the concept that glaucoma produces changes in both. While these models are useful for understanding local relationships between loss of ganglion cells and loss of visual sensitivity, they have not yet been shown to have application to diagnosis of disease. Furthermore, the variability in the data used to create the models and the subsequent uncertainty in the models themselves suggests that it will be difficult to apply them to individual patients. By emphasizing anatomically meaningful relationships, the SFI may therefore be a useful tool to bridge the gap between work on local correlations between structure and function and the significant variability that exists within each test alone.
Analysis of our study is clearly limited by the fact that it was carried out retrospectively. Specifically, the diagnostic criteria used by the clinicians as expressed in the billing code data were not standardized, so there is potential variability in diagnostic classification. We confirmed the validity of our diagnostic coding by reviewing a subset of charts, revealing a small error rate compared to the documented clinical impression and no evidence for bias in misdiagnosis favoring either group. Any study of glaucoma faces the difficulty that diagnostic criteria are either objective or subjective. When specific imaging and field criteria are chosen, there is the possibility that expert clinicians would differ on those criteria. When subjective expert judgment is the defining rule, one must be concerned that the result is not reproducible by some other group of experts. Clinician diagnostic biases may therefore be embedded in the characteristics of the two groups in this study and only through application of the method to other databases, collected prospectively, and with a variety of diagnostic criteria, will the ultimate value of the method be demonstrated.
A related issue with the glaucoma subjects used to test the SFI is that a significant portion of them has a visual field mean deviation with a value greater than 0 (Figure 5). This would imply that the clinicians making the diagnosis of glaucoma were likely using optic disc or retinal nerve fiber layer examination to define the presence of glaucoma. This group of glaucoma patients with above average field sensitivity could be explained either by the fact that optic disc change can precede visual field loss or by mis-diagnosis by the examining clinician. The latter option again points out the ambiguity caused by relying on "expert" clinicians to define the presence or absence of a disease and is something the SFI might help overcome.
Given the widespread availability of quantitative measures of optic nerve structure and function, clinicians now must combine those measures in a subjective manner. We believe there is a compelling need to develop computational models that unify visual field and optic nerve imaging data, based on known anatomy, to improve glaucoma diagnosis. The features of the SFI were intended to explicitly model our understanding of changes in optic nerve structure and function in glaucoma. Furthermore, the approach we have defined is not restricted to the testing modalities used here. The SFI could just as easily be calculated using other tests of visual function (frequency doubling perimetry, short wavelength perimetry, etc.) and other tests of optic nerve structure (optical coherence tomography, scanning laser polarimetry). Use of spectral domain OCT is particularly promising as it may be possible to image the nerve fiber layer in each retinal region corresponding to a visual field location. Relating structure and function in this way would avoid the use of the field-to-disc maps discussed above.
Based on the characteristics of the SFI in eyes with glaucoma and those merely suspected of having disease, we believe further work is warranted and that this approach, or one like it, might provide a new standard for diagnosing glaucoma.
This work was supported by grants EY015025, and EY001765 from the National Eye Institute, Bethesda, MD, by William T. Forrester, and by a grant to the Wilmer Eye Institute from Research to Prevent Blindness, New York, NY.
- Shutt HK, Boyd TA, Salter AB: The relationship of visual fields, optic disc appearances and age in non-glaucomatous and glaucomatous eyes. Can J Ophthalmol. 1967, 2 (2): 83-90.PubMed
- Armaly MF: The correlation between appearance of the optic cup and visual function. Trans Am Acad Ophthalmol Otolaryngol. 1969, 73 (5): 898-913.PubMed
- Douglas GR, Drance SM, Schulzer M: A correlation of fields and discs in open angle glaucoma. Can J Ophthalmol. 1974, 9 (4): 391-398.PubMed
- Drance SM: Editorial: The optic disc and visual field in glaucoma. Can J Ophthalmol. 1974, 9 (4): 389-390.PubMed
- Burgoyne CF, Quigley HA, Thompson HW, Vitale S, Varma R: Early changes in optic disc compliance and surface position in experimental glaucoma. Ophthalmology. 1995, 102 (12): 1800-1809.View ArticlePubMed
- Anonymous: The Advanced Glaucoma Intervention Study (AGIS): 1. Study design and methods and baseline characteristics of study patients. Control Clin Trials. 1994, 15 (4): 299-325. 10.1016/0197-2456(94)90046-9.View Article
- Leske MC, Heijl A, Hyman L, Bengtsson B: Early Manifest Glaucoma Trial: design and baseline data. Ophthalmology. 1999, 106 (11): 2144-2153. 10.1016/S0161-6420(99)90497-9.View ArticlePubMed
- Musch DC, Lichter PR, Guire KE, Standardi CL: The Collaborative Initial Glaucoma Treatment Study: study design, methods, and baseline characteristics of enrolled patients. Ophthalmology. 1999, 106 (4): 653-662. 10.1016/S0161-6420(99)90147-1.View ArticlePubMed
- Gordon MO, Kass MA: The Ocular Hypertension Treatment Study: design and baseline description of the participants. Arch Ophthalmol. 1999, 117 (5): 573-583.View ArticlePubMed
- Foster PJ, Buhrmann R, Quigley HA, Johnson GJ: The definition and classification of glaucoma in prevalence surveys. Br J Ophthalmol. 2002, 86 (2): 238-242. 10.1136/bjo.86.2.238.PubMed CentralView ArticlePubMed
- Kass MA, Heuer DK, Higginbotham EJ, Johnson CA, Keltner JL, Miller JP, Parrish RK, Wilson MR, Gordon MO: The Ocular Hypertension Treatment Study: a randomized trial determines that topical ocular hypotensive medication delays or prevents the onset of primary open-angle glaucoma. Arch Ophthalmol. 2002, 120 (6): 701-13. discussion 829-30View ArticlePubMed
- Weber J, Ulrich H: A perimetric nerve fiber bundle map. Int Ophthalmol. 1991, 15 (3): 193-200. 10.1007/BF00153928.View ArticlePubMed
- Yamagishi N, Anton A, Sample PA, Zangwill L, Lopez A, Weinreb RN: Mapping structural damage of the optic disk to visual field defect in glaucoma. Am J Ophthalmol. 1997, 123 (5): 667-676.View ArticlePubMed
- Schlottmann PG, De Cilla S, Greenfield DS, Caprioli J, Garway-Heath DF: Relationship between visual field sensitivity and retinal nerve fiber layer thickness as measured by scanning laser polarimetry. Invest Ophthalmol Vis Sci. 2004, 45 (6): 1823-1829. 10.1167/iovs.03-0692.View ArticlePubMed
- Gardiner SK, Johnson CA, Cioffi GA: Evaluation of the structure-function relationship in glaucoma. Invest Ophthalmol Vis Sci. 2005, 46 (10): 3712-3717. 10.1167/iovs.05-0266.View ArticlePubMed
- Ferreras A, Pablo LE, Garway-Heath DF, Fogagnolo P, Garcia-Feijoo J: Mapping standard automated perimetry to the peripapillary retinal nerve fiber layer in glaucoma. Invest Ophthalmol Vis Sci. 2008, 49 (7): 3018-3025. 10.1167/iovs.08-1775.View ArticlePubMed
- Sommer A, Katz J, Quigley HA, Miller NR, Robin AL, Richter RC, Witt KA: Clinically detectable nerve fiber atrophy precedes the onset of glaucomatous field loss. Arch Ophthalmol. 1991, 109 (1): 77-83.View ArticlePubMed
- Harwerth RS, Quigley HA: Visual field defects and retinal ganglion cell losses in patients with glaucoma. Arch Ophthalmol. 2006, 124 (6): 853-859. 10.1001/archopht.124.6.853.PubMed CentralView ArticlePubMed
- Mills RP, Budenz DL, Lee PP, Noecker RJ, Walt JG, Siegartel LR, Evans SJ, Doyle JJ: Categorizing the stage of glaucoma from pre-diagnosis to end-stage disease. Am J Ophthalmol. 2006, 141 (1): 24-30. 10.1016/j.ajo.2005.07.044.View ArticlePubMed
- Asman P, Heijl A: Glaucoma Hemifield Test. Automated visual field evaluation. Arch Ophthalmol. 1992, 110 (6): 812-819.View ArticlePubMed
- Mills RP, Heijl A, (Eds): Proceedings of the Perimetry Update 1990/1991. 1991, New York, NY: Kugler & Ghedini
- Wollstein G, Garway-Heath DF, Hitchings RA: Identification of early glaucoma cases with the scanning laser ophthalmoscope. Ophthalmology. 1998, 105 (8): 1557-1563. 10.1016/S0161-6420(98)98047-2.View ArticlePubMed
- Burgansky-Eliash Z, Wollstein G, Bilonick RA, Ishikawa H, Kagemann L, Schuman JS: Glaucoma detection with the Heidelberg retina tomograph 3. Ophthalmology. 2007, 114 (3): 466-471. 10.1016/j.ophtha.2006.08.022.PubMed CentralView ArticlePubMed
- Garway-Heath DF, Poinoosawmy D, Fitzke FW, Hitchings RA: Mapping the visual field to the optic disc in normal tension glaucoma eyes. Ophthalmology. 2000, 107 (10): 1809-1815. 10.1016/S0161-6420(00)00284-0.View ArticlePubMed
- Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143 (1): 29-36.View ArticlePubMed
- Ross TD: Accurate confidence intervals for binomial proportion and Poisson rate estimation. Comput Biol Med. 2003, 33 (6): 509-531. 10.1016/S0010-4825(03)00019-2.View ArticlePubMed
- R Development Core Team: R: A Language and Environment for Statistical Computing. 2009, Vienna, Austria: R Foundation for Statistical Computing
- Harrell FE, with contributions from many other users: Hmisc: Harrell Miscellaneous. 2009
- Sing T, Sander O, Beerenwinkel N, Lengauer T: ROCR: Visualizing the performance of scoring classifiers. 2007
- Brett KM, Burt CW: Utilization of Ambulatory Medical Care by Women: United States, 1997-98. 2001, 13 (149):
- Varma R, Tielsch JM, Quigley HA, Hilton SC, Katz J, Spaeth GL, Sommer A: Race-, age-, gender-, and refractive error-related differences in the normal optic disc. Arch Ophthalmol. 1994, 112 (8): 1068-1076.View ArticlePubMed
- Wall M, Johnson CA, Kardon RH, Crabb DP: Use of a Continuous Probability Scale to Display Visual Field Damage. Arch Ophthalmol. 2009, 127 (6): 749-756. 10.1001/archophthalmol.2009.111.View ArticlePubMed
- Caprioli J: Discrimination between normal and glaucomatous eyes. Invest Ophthalmol Vis Sci. 1992, 33 (1): 153-159.PubMed
- Brigatti L, Hoffman D, Caprioli J: Neural networks to identify glaucoma with structural and functional measurements. Am J Ophthalmol. 1996, 121 (5): 511-521.View ArticlePubMed
- Shah NN, Bowd C, Medeiros FA, Weinreb RN, Sample PA, Hoffmann EM, Zangwill LM: Combining Structural and Functional Testing for Detection of Glaucoma. Ophthalmology. 2006, 113 (9): 1593-1602. 10.1016/j.ophtha.2006.06.004.View ArticlePubMed
- Mardin CY, Peters A, Horn F, Junemann AG, Lausen B: Improving Glaucoma Diagnosis by the Combination of Perimetry and HRT Measurements. J Glaucoma. 2006, 15 (4): 299-305. 10.1097/01.ijg.0000212232.03664.ee.View ArticlePubMed
- Bowd C, Hao J, Tavares IM, Medeiros FA, Zangwill LM, Lee TW, Sample PA, Weinreb RN, Goldbaum MH: Bayesian machine learning classifiers for combining structural and functional measurements to classify healthy and glaucomatous eyes. Invest Ophthalmol Vis Sci. 2008, 49 (3): 945-953. 10.1167/iovs.07-1083.View ArticlePubMed
- Harwerth RS, Vilupuru AS, Rangaswamy NV, Smith EL: The relationship between nerve fiber layer and perimetry measurements. Invest Ophthalmol Vis Sci. 2007, 48 (2): 763-773. 10.1167/iovs.06-0688.View ArticlePubMed
- Hood DC, Anderson SC, Wall M, Kardon RH: Structure versus function in glaucoma: an application of a linear model. Invest Ophthalmol Vis Sci. 2007, 48 (8): 3662-3668. 10.1167/iovs.06-1401.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2415/11/6/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.