Predictive models of long-term anatomic outcome in age-related macular degeneration treated with as-needed Ranibizumab

Abstract

Background

To analyze predictors and develop predictive models of anatomic outcome in neovascular age-related macular degeneration (AMD) treated with as-needed ranibizumab after 4 years of follow-up.

Methods

A multicenter consecutive case series non-interventional study was performed. Clinical, funduscopic and OCT characteristics of 194 treatment-naïve patients with AMD treated with as-needed ranibizumab for at least 2 years and up to 4 years were analyzed at baseline, 3 months and each year until the end of the follow-up. Baseline demographic and angiographic characteristics were also evaluated. R Statistical Software was used for statistical analysis. Main outcome measure was final anatomic status.

Results

Factors associated with less probability of preserved macula were diagnosis in 2009, older age, worse vision, presence of atrophy/fibrosis, pigment epithelium detachment, and geographic atrophy/fibrotic scar/neovascular AMD in the fellow eye. Factors associated with higher probability of GA were presence of atrophy and greater number of injections, whereas male sex, worse vision, lesser change in central macular thickness and presence of fibrosis were associated with less probability of GA as final macular status. Predictive model of preserved macula vs. GA/fibrotic scar showed sensibility of 77.78% and specificity of 69.09%. Predictive model of GA vs. fibrotic scar showed sensibility of 68.89% and specificity of 72.22%.

Conclusions

We identified predictors of final macular status, and developed two predictive models. Predictive models that we propose are based on easily harvested variables, and, if validated, could be a useful tool for individual patient management and clinical research studies.

Background

Age-related macular degeneration (AMD) is the major cause of visual impairment in developed countries in people over 60 years [1]. Currently, almost every patient showing active neovascular AMD undergoes treatment with drugs targeting vascular endothelial growth factor (VEGF), as these drugs can slow progression of this form of the disease [2]. Ranibizumab, an anti-VEGF agent, is widely used for the management of choroidal neovascularization (CNV) secondary to AMD. Anti-VEGF agents have shown rare complications associated to its use, nevertheless, recent reports describe vision-threatening events noted during follow-up of eyes receiving these treatments [3]. These events include development of geographic atrophy (GA) [4] and fibrotic scar formation [5].

The area of a CNV lesion often develops retinal pigment epithelium (RPE) and choriocapillary atrophy. These atrophic lesions are clinically indistinguishable from de novo GA [6]. Fibrotic scar formation within the retina or the subretinal space occurs in the natural course of neovascular AMD [7], and has been identified as an important cause of visual loss after treatment with anti-VEGF agents [3]. However, factors associated with GA and fibrotic scar formation after treatment with ranibizumab remain to be elucidated.

Our study aims to investigate predictive factors associated to long-term anatomic outcome in patients with AMD after as-needed treatment with ranibizumab, including data collected from seven centres in the Spanish region of Castilla & León. The identification of these factors may provide helpful information to predict final macular status of patients with AMD receiving this regimen of ranibizumab. Additionally, basing on these variables, we propose predictive models of anatomic outcome.

Methods

We performed an observational consecutive case series study in seven centres in Castilla & León, Spain. A systematic review of medical charts of patients with AMD treated with ranibizumab (Lucentis, Genentech, Inc., South San Francisco, CA), collected in our database was done. The study was designed to survey longstanding funduscopic outcome. Descriptive results of the whole sample have already been published [8].

Protocol was approved by the ethical committee of the coordinating centre (Research and Ethics Commission of IOBA Eye Institute, University of Valladolid, Valladolid, Spain) and of each participant institution. The study was conducted in compliance with the guidelines in the Declaration of Helsinki. Written informed consent was obtained from all participants.

Patients

The study included treatment-naïve neovascular AMD patients who started treatment between January 1, 2008 and December 31, 2012, following as-needed regimen of injections, with at least 2-years of follow-up. Only one eye of each patient was enrolled; when both eyes met inclusion criteria, the eye with longer follow-up was enrolled, and selection was made randomly if both had the same follow-up period. Patients suffering any other associated sight-threatening pathology (except for cataract), late baseline AMD, patients who did not complete at least 24 months of follow-up, those who discontinued treatment for any reason during follow-up, and those who showed no response to treatment (no morphologic nor functional improvement after 3 ranibizumab injections) were excluded.

Variables

Baseline characteristics recorded are shown in Table 1. Total time of follow-up was also noted. Snellen distance best-corrected visual acuity (BCVA), OCT assessment, presence of macular-associated lesions and number of visits and injections were recorded at baseline, 3 months and at 1, 2, 3 and 4 years of follow-up.

Table 1 Baseline characteristics of patients

Macular associated lesions were assessed by colour fundus photographs, fluorescein angiography (FA), fundus autofluorescence and OCT. These lesions were identified as bleeding >50%, presence of pigment epithelium detachment (PED), RPE tear, retinal angiomatous proliferation (RAP), polypoidal vasculopathy and presence of a minimum area of fibrosis or atrophy. These two latter lesions never involved fovea and were not the main component of lesion. Snellen distance BCVA was transformed into the logarithm of the minimum angle of resolution (logMAR), using a validated procedure [9]. OCT morphology data (presence or absence of subretinal fluid and/or thickening >100 μm compared to the previous visit, (both or none) was also gathered. Central macular thickness change was evaluated following a procedure previously described [8].

Final funduscopic status of the studied eye was classified as active, inactive with predominantly fibrotic disciform scar, inactive with predominantly atrophic scar and inactive well-preserved macula, and the rest were excluded of the study. To assess predictive factors and models of anatomic outcome, only eyes with final fibrotic scar, atrophy or well-preserved macula at the end of the study were analysed. To classify funduscopic results of contralateral eye, International ARM classification was used [10].

Statistical analysis

Quantitative characteristics were expressed as mean ± standard deviation (SD), and qualitative variables were described in percentages. Statistical analysis was performed using R Statistical Software (R Core Team; Vienna, Austria) [11]. To avoid influence of missing data we used the Copy Mean method [12], implemented at the Package Longitudinal Data of R (Longitudinal Data. R package version 2.2).

Depending on the main variable assessed, the statistical analysis was divided in two sections. First, probability of macular preservation was compared to probability of either GA or fibrotic scar. For the second part of the assessment, eyes showing well-preserved macula as final anatomic status were excluded, and probability of GA at the end of the follow-up was compared to probability of fibrotic scar.

A binary logistic regression model was fitted to identify potential predictors of functional outcome between collected variables. Estimated odds ratio (OR) was used to quantify the importance of each potential predictor. Variables with a univariate p value lower than 0.1 were identified as relevant predictors. Then, we performed a multivariate logistic regression model based on the best set of relevant predictors according to Akaike Information Criteria [13]. The bestglm package [14] was used to enumerate and evaluate all possible models. Inter-correlation between the finally selected predictors was evaluated using the Variance Inflation Factor implemented in the car package [15]. A Variance Inflation Factor value higher than 5 indicated presence of multicollinearity.

In order to assess the performance of prediction model, a leave-one-out cross-validation process was used for internal validation. Three aspects were evaluated: precision, calibration and discrimination ability.

The Brier Score was used as global measure of the precision [16]. This score is based upon individual differences between predicted risks in terms of likelihood and observed final outcomes. The Brier score ranges, from 0 for a perfect degree of agreement to 1 for the worst possible degree of agreement.

To evaluate the calibration of the model, two measures were used: the calibration-in-the large, that, in a perfectly calibrated model will be 0, and the Calibration Slope that in such model will be 1. We also used the Hosmer-Lemeshow test, which is significant for badly calibrated models [17].

Receiver Operating Characteristic (ROC) curve analysis was used to assess the discrimination ability of the fitted models. They were evaluated and compared according to the area under the ROC curve (AUC). In addition, the sensitivity and specificity for the ROC curve was obtained by setting an optimal threshold using the pROC package [18].

Results

Notes from 1236 patients treated with anti-VEGF drugs at seven hospitals were evaluated, and 314 eyes were identified as eligible [8]. Nevertheless, for this part of the study 61 eyes that had discontinued treatment were excluded, and so were those with active or unclassifiable macular anatomic status, thus, 194 eyes (194 patients, 112 women and 82 men) were analysed. Baseline characteristics of the sample appear in Table 1.

First, to study predictive factors and models of probability of well-preserved macula, data from 194 eyes presenting late AMD were used, from which 153 showed either GA/fibrotic scar and 41 showed well-preserved macula. Afterwards, a second study was performed with a sample of 153 eyes, those 153 with GA/scar, from which 72 showed GA and 81 fibrotic scar.

Preserved vs. GA/fibrotic scar

To determine factors associated to anatomic preservation versus developing GA or fibrotic scar, a subset of 194 eyes from 194 patients (116 women, 78 men) were included. Mean age was 78.01 years (range 55–93; SD 7.55). Mean follow-up was 98.03 months (range 24.3–161.5; SD 28.08; median 98.25). After 4 years of follow-up, 41 eyes presented preserved macular anatomy (21.13%) and 153 presented GA or fibrotic scar (78.87%).

Results of univariate analysis appear in Table 2. Statistically significant higher probability of preserved macular anatomy was found among patients with transparent lens. Contrarily, negative predictors of preserved macular anatomy, were diagnosis in 2009, older age, worse BCVA in all visits, PED at 1 and 2 years, small area of atrophy (not involving the fovea nor being the main component of lesion) at 1 and 4 years of follow-up, small area of fibrosis (not involving the fovea nor being the main component of lesion) at 2, 3 and 4 years, atrophic AMD in the fellow eye at baseline and at the end of the follow-up, neovascular AMD in the fellow eye at the end of the follow-up, and fibrotic scar in the fellow eye at the end of the follow-up.

Table 2 Univariate analysis for preserved vs. geographic atrophy/fibrotic scar

Then, multivariate analysis (Fig. 1) to find the best predictive model was performed using those previous variables with p < 0.1 and measurements recorded after the first year of follow-up were excluded, as they would have low predictive value. Thus, diagnosis in 2009, age, baseline BCVA, PED at baseline, number of injections at 3 months and presence of atrophy within the fellow eye at baseline were considered.

Fig. 1

Multivariate analysis and predictive model Receiver Operating Characteristic (ROC) curve of preserved macula vs. geographic atrophy/fibrotic scar. The upper chart shows results of multivariate analysis. The figure below shows ROC curve of the predictive model. The area under the curve reveals that this model has a good reliability in the prediction of final macular anatomic status. The greyish area indicates where the model loses its reliability. Besides, on the right internal validation data is shown. CI: confidence interval, AUC: area under the curve, CL: calibration in the large, CS: calibration slope

The best-fitted model found (Fig. 1) included 3 variables: age, baseline BCVA and number of injections at 3 months.

Geographic atrophy vs. fibrotic scar

A subset of 153 eyes from 153 patients (89 women, 62 men) was analysed for this purpose. Mean age was 78.68 years (range 55–93; SD 7.19). Mean follow-up was 97.24 months (range 24.3–161.5; SD 27.3; median 98). After 4 years of follow-up, 72 eyes presented GA (47.06%) whereas 81 eyes presented fibrotic scar (52.94%). Results of univariate analysis are shown in Table 3.

Table 3 Univariate analysis for geographic atrophy vs. fibrotic scar

Regarding univariate analysis results, statistically significant factors associated with higher probability of GA were: small area of atrophy (not involving the fovea nor being the main component of lesion) at 2 and 3 years of follow-up, and the greater number of injections at 3 months, 3 and 4 years. On the other hand, negative predictors of GA, were male sex, lower vision at 2, 3 and 4 years of follow-up, the lower change in central macular thickness at 2, 3 and 4 years, and presence of a small area of fibrosis (not involving the fovea nor being the main component of lesion) at 3 months, 1 and 2 years of follow-up.

Multivariate analysis (Fig. 2) to find the best predictive model was performed using those previous variables with p < 0.1. Measurements after the first year of follow-up were excluded, as they would have low predictive value. As a result, sex, diagnosis in 2009, presence of a small area of fibrosis at 3 months, and number of injections at 3 months were chosen, and the best-fitted model (Fig. 2) included the 4 of them.

Fig. 2

Multivariate analysis and predictive model Receiver Operating Characteristic (ROC) curve of geographic atrophy vs. fibrotic scar. The upper chart shows results of multivariate analysis. The figure below shows ROC curve of the predictive model. The area under the curve reveals that this model has moderate reliability in the prediction of final macular anatomic status. The greyish area indicates where the model loses its reliability. Besides, on the right internal validation data is shown. CI: confidence interval, AUC: area under the curve, CL: calibration in the large, CS: calibration slope

Discussion

In this study, we identify potential predictors and introduce new predictive models of final anatomic outcome in neovascular AMD treated with as-needed ranibizumab. Previous models aim to identify patients at early or intermediate stages at high risk of advanced AMD, and many of them include a combination of demographic, clinical, genetic and environmental variables [19,20,21]. We propose two predictive models of anatomic outcome based on selected demographic and clinical features easily harvested in the daily clinical routine. Descriptive results of this sample have been previously published [8].

We assessed presence of GA by analysing colour fundus photographs, fundus autofluorescence and OCT. In our sample, 37.11% of patients with inactive macular status showed GA at the end of the follow-up. Comparison of Age-Related Macular Degeneration Treatments Trials (CATT) study reported new GA lesions in 12.9–25.8% of patients with no GA at enrolment after 2 years of follow-up, in patients randomly assigned to injections of ranibizumab or bevacizumab and to a 2-year dosing regimen of monthly or PRN or to monthly for 1 year and PRN the following year [6]. Independent baseline risk factors found in CATT for GA development included poor BCVA, RAP, foveal intraretinal fluid, monthly dosing, and treatment with ranibizumab [6]. Thus, anti-VEGF therapy was suggested to play a role in GA development.

In the present study, we included patients who showed a small area of atrophy at baseline, not involving the fovea nor being the main component of lesion, but we did not find baseline atrophy associated with further development of GA. However, presence of atrophy at 2 and 3 years of follow-up was associated with higher probability of GA as final macular status. Also, the greater number of injections was associated with GA, and this fact reinforces the association of GA with anti-VEGF therapy previously proposed. Interestingly, GA development has only been observed during the treatment of AMD, in which GA is part of the natural history of the disease, and has not been observed during the course of other diseases managed by multiple injections of anti-VEGF drugs. Furthermore, the study of growth of GA performed by CATT showed that eyes with GA farther from the fovea, which we included in the present study, had higher growth rates by 0.14 mm/year for every millimetre farther from the fovea [22]. This could explain the fact that, in our sample, we found a significant association between macular atrophy and final GA, and may represent the evolution of the disease.

Another recent study, in which RPE atrophy was monitored using polarization-sensitive OCT, revealed an increase in atrophic RPE features and GA dimension on 61% of patients at 2 years of follow-up following a similar regimen of injections with ranibizumab [23]. Additionally, Tanaka et al. in a retrospective study, observed GA developing outside CNV margin only in those eyes that showed GA outside the lesion at baseline, suggesting that atrophic scars that mimic GA could emerge within the area originally occupied with a CNV [3]. In this study we included atrophic scars in the term GA, and they are referred to as GA throughout this report.

SEVEN-UP study enrolled patients from the ANCHOR and MARINA trials, that had received 2 years of monthly ranibizumab followed by an additional 2 years of as-needed ranibizumab treatment in the HORIZON protocol, and were recalled for evaluation at 7 to 8 years after their enrolment. In this study they detected macular atrophy by fundus autofluorescence analysis in 98% of study eyes, and 90% showed decreased autofluorescence involving the fovea at the end of the follow-up [24]. Predictors found to be associated with final atrophy at SEVEN-UP were baseline area of atrophy and baseline area of leaking CNV [25]. As evolution to atrophy can limit the result of treatment with anti-angiogenic drugs, further studies aiming to avoid this evolution will be needed. Our predictive models could help to selecting patients to be enrolled in such studies.

CATT study analysed the risk of scar development in a recent report [5]. Scars were classified as fibrotic and nonfibrotic attending to their characteristics observed at colour fundus photographs and FA. Fibrotic scars are relatively easy to recognize at ophthalmoscopy. On the contrary, as nonfibrotic scars are funduscopically identical to de novo GA, they were distinguished by FA [5]. As mentioned before, we included atrophic scars in the term GA, because, as this is an observational study and we didn’t perform FA at the end of the follow-up. CATT study reported 45.3% of scar development after 2 years of follow-up, and predictors for scar formation (either fibrotic or nonfibrotic) included classic CNV, blocked fluorescence on FA, increased retinal thickness, foveal subretinal fluid and dome-shaped subretinal hyperreflective material [5].

SEVEN-UP study reported 61.4% of the study eyes showing macular subretinal fibrosis and 38.6% of the eyes presenting fibrosis involving the foveal centre [24]. Given the absence of fibrotic scar in almost 40% of study eyes, it was hypothesized that anti-VEGF therapy may alter the natural course of neovascular AMD by prolonging the active phase of the disease by preserving outer retina and RPE [24]. In our sample, 41.75% of the eyes with inactive AMD at the end of the follow-up showed fibrotic scar, although follow-up period was shorter. Based on our clinical experience, fibrosis is a complication that appears earlier than atrophy, which explains that in our study we found similar percentages of fibrosis compared with SEVEN-UP, with longer follow-up.

We found transparent lens associated to preserved macular anatomy at the end of the follow-up, however, we rejected this as a valid predictor due to the fact that only 3 out of 131 studied eyes for this variable showed this condition.

Both predictive models showed AUC values significantly different from 0.5 and, consequently, are considered appropriate. Predictive model for GA vs. fibrotic scar showed an AUC = 0.635 and included diagnosis in 2009, presence of fibrosis at 3 months and number of injections at 3 months. Curiously, in the year 2009, we observed inappropriately low mean number of visits (5.37) and injections (0.86), so we decided investigate the year of diagnosis as a variable. As a result, diagnosis in 2009 was associated with less probability of preserved macula, although number of visits and number of injections were not identified as predictors of preserved macula at any time point. In this year, pro re nata treatment basis were being established [26, 27], and this fact may justify the low number of visits and injections, and may have interfered with our results. Furthermore, patients enrolled in this study showed better outcomes from the year 2010 on.

The predictive model of preserved macula vs. GA/fibrotic scar showed a greater AUC (0.76). Therefore, it was considered a more suitable model than the other, and included age, baseline BCVA, and number of injections at 3 months. This highlights these factors as important predictors of final macular status, and, according to our results, young patients, those with good baseline vision and those who receive a correct loading dose would have greater probability of well-preserved macula as final anatomic status. Besides, these anatomic predictors have been previously identified as visual predictors [28].

In the current study we find some limitations. First, as data were collected from medical charts, they might not contain all the information needed. Also, daily clinical routine does not allow a strict regimen of visits and treatment as performed in clinical trials, so that, variability could exist at this point. For this reason, we identified number of injections at 3 months (90 days) as a predictor, but this number should be the same (3) for all patients according to as-needed treatment protocol. All patients enrolled in our study had received loading dose in a reasonable period of time, however, as this study was performed on a daily clinical practice basis, the interval between injections was not as strict as in clinical trials (30 days), and this resulted in a mean number of injections at 3 months of 2.54 instead of 3. Besides, reproducibility of this study may be limited due to the characteristics of the design. Another important limitation was the high number of dropouts, mainly due to the fact that we excluded those patients who had not completed the follow-up period. Moreover, we excluded patients who did not respond to treatment, and this could have interfered with final outcomes. We did not exclude patients presenting a small area of atrophy or fibrosis at baseline, and development of GA or fibrotic scar could represent the progression of the disease. Finally, our predictive models are based on easily harvested clinical and demographic risk factors, and could be attractive and practical to apply in the clinical routine. However, the addition of other variables, such as genetic factors, which are more difficult to obtain, could increase the sensitivity and specificity of the models.

Conclusions

We have identified predictors of final macular status, and additionally, based on these predictors we propose two predictive models. Predictive model of preserved macula should be validated in a prospective study with a different cohort of patients to be considered as a useful tool for individual patient management and clinical research studies.