Skip to main content
Download PDF

Systematic review and mixed treatment comparison of intravitreal aflibercept with other therapies for diabetic macular edema (DME)

BMC Ophthalmology volume 15, Article number: 52 (2015) Cite this article

Abstract

Background

This was an indirect comparison of the effectiveness of intravitreal aflibercept (IVT-AFL) 2 mg every 8 weeks after 5 initial monthly doses (or if different periods, after an initial monthly dosing period) (2q8) and other diabetic macular edema (DME) therapies at doses licensed outside the USA.

Methods

A comprehensive search was undertaken to source relevant studies. Feasibility networks were prepared to identify viable comparisons of 12-month outcomes between IVT-AFL 2q8 and therapies licensed outside the USA, which were assessed for clinical and statistical homogeneity. Pooled effect sizes (mean difference [MD] and relative risk/risk ratio [RR]) were calculated using fixed- and random-effects models. Indirect comparisons were performed using Bucher analysis. If at least one ‘head-to-head’ study was found then a mixed treatment comparison (MTC) was performed using Bayesian methods. Two 12-month comparisons could be undertaken based on indirect analyses: IVT-AFL 2q8 versus intravitreal ranibizumab (IVR) 0.5 mg as needed (PRN) (10 studies) and IVT-AFL 2q8 versus dexamethasone 0.7 mg implants (three studies).

Results

There was an increase in mean best-corrected visual acuity (BCVA) with IVT-AFL 2q8 over IVR 0.5 mg PRN by 4.67 letters [95% credible interval (CrI): 2.45–6.87] in the fixed-effect MTC model (10 studies) and by 4.82 letters [95% confidence interval (CI): 2.52–7.11] in the Bucher indirect analysis (four studies). IVT-AFL 2q8 doubled the proportion of patients gaining ≥ 10 Early Treatment Diabetic Retinopathy Study letters at 12 months compared with dexamethasone 0.7 mg implants (RR = 2.10 [95% CI: 1.29–3.40]) in the fixed-effect model. There were no significant differences in safety outcomes between IVT-AFL 2q8 and IVR 0.5 mg PRN or dexamethasone 0.7 mg implants.

Conclusions

Studies of IVT-AFL 2q8 showed improved 12-month visual acuity measures compared with studies of IVR 0.5 mg PRN and dexamethasone 0.7 mg implants based on indirect comparisons. These analyses are subject to a number of limitations which are inherent in indirect data comparisons.

Peer Review reports

Background

Severe retinopathy and presence of diabetic macular edema (DME) are associated with vision loss in patients with diabetes [1]. Although focal laser photocoagulation has been the standard of care for DME [2] it can only slow progression and its ability to reverse vision loss is low [3]. Awareness of the role of vascular endothelial growth factors (VEGF and placental growth factor [PIGF]) and inflammatory mediators in stimulating retinal vasculogenesis and angiogenesis [4] has led to the development and widespread use of anti-VEGF agents that can target these pathways [5,6].

Intravitreal aflibercept (IVT-AFL), which is composed of extracellular domains from human VEGF receptors 1 and 2 fused to the Fc portion of human immunoglobulin-G1 (IgG1), is a VEGF-A and PIGF inhibitor that blocks retinal cell migration and proliferation. Preclinical studies have shown that it has a longer duration of action than other anti-VEGF agents, and has 100-fold greater binding affinity to VEGF-A than intravitreal ranibizumab (IVR) (a recombinant humanized monoclonal antibody that inhibits VEGF-A) [7-10]. Clinical studies have demonstrated the efficacy and safety of these anti-VEGF agents compared with laser in DME patients [11-16]. The IVT-AFL studies have supported its European license (i.e., five 2 mg injections every 4 weeks followed by 2 mg injections every 8 weeks [2q8]; with no requirement for monitoring between injections; after the first 12 months of treatment with IVT-AFL, the treatment interval may be extended based on visual and anatomic outcomes; the schedule for monitoring should be determined by the treating physician).

Meta-analyses have been undertaken to compare anti-VEGF agents, based on a lack of direct comparisons prior to the recent publication of the Protocol T study [17-20]. However, some analyses have pooled IVR studies regardless of the posology or the nature of the comparator, and comparisons involving IVT-AFL have been based on only the DA VINCI study, which differs in design from the more recent phase III VIVID-DME and VISTA-DME studies in many aspects, including loading phase (DA VINCI included three initial loading doses in some arms compared with five in VIVID-DME and VISTA-DME) [11,13]. In addition, the meta-analysis by Virgili et al. [18] contained a limited and exploratory indirect comparison of differences in efficacy among anti-VEGF agents (3-line gains only).

The aims of this study were to systematically identify and review studies informing the clinical effectiveness of IVT-AFL 2q8 in relation to comparator treatments and regimens licensed outside of the USA for the management of DME through mixed treatment and indirect comparison methods. The comparators of interest were: IVR 0.5 mg as needed (PRN), and implants of dexamethasone 0.7 mg or fluocinolone acetate 0.2 μg/day. Unlike the meta-analysis by Virgili et al. [18], this study will consider a broader range of outcomes (including reporting of best-corrected visual acuity [BCVA] based on letters, which is used in most studies, rather than logarithm of the minimal angle of resolution) and will focus on a comparison of licensed anti-VEGF agents. The need for such an approach was supported by the limited outcome of the Virgili et al. meta-analysis [18].

Methods

Search strategy

A comprehensive search was undertaken to identify relevant studies. To reduce the risk of bias and error, the database selection, systematic literature search and review adhered to guidelines for the Institut fur Qualitat und Wirtschaftlichkeit im Gesundheitswesen (IQWiG) methods guide (Version 4.0), the Cochrane Collaboration and Centre for Review and Dissemination (York, UK) [21-23].

Search strategies were developed specifically for each database and used a variety of synonyms for DME. The following databases were searched from inception: Medline (1946–2013/10); Medline In-Process Citations and Daily Update (up to 2013/10/13); Embase (1974–2013/10); Cochrane Central Register of Controlled Trials (up to 2013/10/15). The main search strategy for Embase is listed in Additional file 1: Appendix 1. A number of other searches were also undertaken, including other databases (rapid appraisal), websites, and congress abstracts, which are listed in Additional file 1: Appendix 2. The bibliographies of identified research and review articles were also checked for studies. In addition, the final included papers were checked on PubMed for retractions and errata. Additional data (including abstracts for any unpublished studies at the time of literature review) were provided by Bayer HealthCare (Berlin, Germany).

Inclusion criteria

Studies were included if they met the PICOS criteria (populations, interventions, comparators, outcomes and study design) and prespecified requirements for inclusion in indirect and mixed treatment analyses (Table 1). The additional criteria for study selection exclude studies that cannot inform mixed treatment comparisons of IVT-AFL 2q8 versus comparators of interest (IVR 0.5 mg PRN, and implants of dexamethasone 0.7 mg or fluocinolone acetonide 0.2 μg/day) for outcomes at 12 months. The population criterion (‘patients with DME’) was deliberately inclusive, irrespective at this stage of features such as central involvement, prior treatments used or baseline visual acuity. This systematic review included studies that were compliant with the Declaration of Helsinki, had protocols approved by relevant country- and study-specific Institutional Review Boards/independent ethics committees, and enrolled patients that provided informed consent to participate in them.

Table 1 An overview of the PICOS and other criteria used for study inclusion and exclusion
Full size table

Data extraction and quality assessment

Titles and abstracts identified through the search strategies described were independently screened by two reviewers, and any references which did not meet the inclusion criteria listed previously were excluded. During the screening of conference abstracts, only studies which specifically mentioned randomization and which reported extractable outcome data (or baseline or subgroup data) were included. Full paper copies were obtained for the remaining references, which were examined in detail to determine whether they met the inclusion criteria. All papers excluded at this second stage of the screening process were documented along with the reasons for exclusion. Any discrepancies between reviewers were resolved through discussion or the intervention of a third reviewer. A similar approach was undertaken for data extraction and quality assessment.

Data extraction forms were designed and piloted by reviewers. To avoid duplication of data where studies (or study populations) had multiple publications, the most recent and complete report was used as the main reference, but additional details were extracted from the other publications as necessary.

The quality of each individual study was assessed to identify any potential sources of bias using the Cochrane Risk of Bias Tool for randomized controlled trials [22]. In brief, bias was graded as low risk, high risk or unclear in several domains (selection, performance, detection, attrition, reporting, and other).

Statistical analyses

The analysis approach was predefined in the study protocol. Based on the descriptive summary of all of the included studies, a feasibility assessment was undertaken to determine which comparisons and outcomes could be included. Studies could not be included in indirect analyses if: they were connected by one arm only and did not form a closed network, unless they included comparators of interest; formed loops but did not lie along the path between IVT-AFL 2q8 and comparators of interest (IVR 0.5 mg PRN, and implants of dexamethasone 0.7 mg or fluocinolone acetonide 0.2 μg/day); or did not report 12-month outcomes. For any direct ‘head-to-head’ comparisons between two treatments, studies were pooled using meta-analysis, following methods recommended by the Cochrane Handbook [22]. Forest plots of effect sizes were prepared for each of the outcomes. Dichotomous outcomes were reported as relative risks/risk ratios (RR) and odds ratios (OR) with 95% confidence intervals (CI) and continuous outcomes were reported as mean differences (MD) with 95% CI.

Both clinical and statistical homogeneity were addressed in accordance with published methods [24,25]. Statistical homogeneity was assessed for the direct comparisons with the I2 statistic [24]. Studies were only considered to be sufficiently similar and suitable for meta-analysis if I2 < 75% based on the following categorization of heterogeneity: low (0–25%), moderate (26–75%) and high (> 75%) [24]. The judgment of clinical homogeneity was based on study design, risk of bias, inclusion/exclusion criteria, baseline participant characteristics and treatment regimen.

Data were pooled where studies were considered to be clinically and statistically homogeneous, and pooled effect sizes (RR, OR, MD) and 95% CIs were calculated using both fixed-effect and random-effects models using inverse variance or Mantel-Haenszel methods. If there was a connected network of three or more studies, then indirect treatment comparisons and mixed treatment comparisons (MTC) were performed. The underlying assumptions of homogeneity, similarity and consistency in the network were evaluated, as reported in Song et al. [25]. All indirect comparisons and MTC methods followed the guidance of the International Society for Pharmacoeconomic and Outcomes Research (ISPOR) taskforce recommendations for the conduct of indirect and MTC meta-analysis [26]. Indirect comparisons were performed according to the method developed by Bucher et al. [27]. Where feasible, an indirect estimate of the effect size was calculated from the results of the corresponding direct meta-analyses. If at least one ‘head-to-head’ study was found, then an MTC (using a network of both ‘head-to-head’ and indirect comparisons) was performed using Bayesian methods. MDs, RRs and ORs (with 95% credible interval [CrI]) were calculated for each outcome and available treatment comparison using both fixed- and random-effects models. Model fit was assessed and compared between fixed- and random-effects models using the deviance information criterion (DIC) [28]. MTC analyses were performed using WinBUGS version 1.4.3 and the direct meta-analyses were performed using Cochrane Review Manager Version 5.2 (RevMan 5.2). Sensitivity analysis was used to investigate any studies which might not fulfill the assumptions of similarity or homogeneity.

Results

Feasibility assessments

A flow chart illustrating the results of the search strategy is shown in Figure 1. The systematic review identified 75 studies that satisfied the PICOS criteria. These studies are summarized in Additional file 1: Appendix 3. Of these, 11 studies could be included since they provided data that could inform the indirect analyses of interest (Figure 2) [13,15,16,29-36]. The RISE/RIDE [37] studies did not inform the indirect analyses because they do not provide evidence of IVR 0.5 mg PRN, dexamethasone 0.7 mg implants or IVT-AFL 2q8, and did not lie along the path between IVT-AFL 2q8 and comparators of interest. No network could be formed to provide a comparative assessment with fluocinolone acetate, so this indirect comparison was also not possible. Data for two studies were based on an abstract and unpublished clinical study reports at the time of review; however, these studies are now published in full [13].

Figure 1
figure 1

Flow chart of the literature search.

Full size image
Figure 2
figure 2

Final feasibility network at 12 months, showing direct comparisons by drug, comparator and dose. IVB, intravitreal bevacizumab; IVR, intravitreal ranibizumab; IVT-AFL, intravitreal aflibercept; IVTA, intravitreal triamcinolone acetonide.

Full size image

Two analyses were performed. Firstly, IVT-AFL 2q8 versus IVR 0.5 mg PRN using indirect analyses (Bucher and MTC) based on the defined efficacy outcomes (mean change from baseline in BCVA based on Early Treatment Diabetic Retinopathy Study [ETDRS] score; gain of ≥ 10 or ≥ 15 letters; and loss of ≥ 10 or ≥ 15 letters) and safety outcomes (all adverse events [AEs]; all serious AEs; all ocular AEs; all serious ocular AEs; all non-ocular AEs; all serious non-ocular AEs; eye pain; cataract; hypertension and all causes of mortality). Mean change in BCVA was also adjusted for baseline visual acuity score by including a treatment interaction effect common across interventions in the MTC model [38]. Secondly, IVT-AFL 2q8 versus dexamethasone 0.7 mg implants using an indirect analysis (Bucher) with defined efficacy (gain ≥ 10 letters) and safety (macular edema, reduced visual acuity, vitreous hemorrhage, eye pain, increased intraocular pressure, and cataract) outcomes.

Efficacy outcomes: IVT-AFL 2q8 versus IVR 0.5 mg PRN

The assessment of clinical similarity showed that all studies were randomized, and the majority had similar designs (i.e., multicenter, double-blinded). With respect to the inclusion/exclusion criteria, patients with macular edema were classified by a range of anatomical and functional measures. The main inclusion criteria included significant DME [29], DME [30,31], focal or diffuse DME [15,16,36], DME secondary to diabetes involving the center of the macula [13], retinal thickening due to DME [32-34] or clinically significant macula edema in patients with diabetic retinopathy [35]. The visual acuity at baseline is summarized in Table 2; studies reported that visual acuity had to be 20/40 or worse [13,29] or 20/32 or worse [15,16], or patients had to have a BCVA letter score of 34–70 [36], 39–78 at 4 meters [15,16], 24–73/78 [13,32,33] or 55–79 at 1 meter [34]. It was difficult to compare baseline characteristics, due to lack of consistency in reporting these items and absence of these data, particularly in studies published only in abstract form. Three studies were most dissimilar in this regard [29,34,35].

Table 2 An overview of the studies (n = 11) included in the final analyses
Full size table

Treatment interventions are listed in Table 2, and treatment regimens are described in detail in Additional file 1: Appendix 4. Most studies employed a laser control arm (as described in Table 2). The need for additional treatment or retreatment was assessed on an as-needed basis in studies with an active as-needed treatment arm, and on a fixed-term basis in studies with a fixed-dose active treatment arm; control arms (which were largely laser) were suitable for retreatment after an appropriate timeframe. In the VIVID-DME and VISTA-DME studies, additional/rescue treatment with laser was permitted in the IVT-AFL groups, and anti-VEGF treatment was permitted in the laser arms [13]. The decision for retreatment with injections was guided by optical coherence tomography (OCT) or vision stability in most studies and retreatment with laser was usually guided by ETDRS guidelines. The studies varied regarding the risk of bias. Six studies [13,15,29,33,35] all had a high risk of bias for at least one domain, but four studies [16,30-32,34] did not have high risk of bias in any domain (Additional file 1: Appendix 5). Based on clinical assessments, the 10 studies included (particularly the four studies included in the Bucher analysis) were considered sufficiently similar for fixed-effect analysis.

Direct and indirect analyses

IVT-AFL 2q8 and IVR 0.5 mg PRN could be directly compared via a common comparator of laser (plus sham injection) in four studies (Figure 3) [13,15,16]. These comparisons showed that treatment with IVT-AFL 2q8 resulted in a significantly greater improvement in BCVA mean change from baseline compared with laser (MD = 10.01 [95% CI: 8.32–11.69]). IVR 0.5 mg PRN also showed a significant improvement compared with laser (MD = 5.19 [95% CI: 3.63–6.75]). Only two studies were included in each comparison but their results were statistically homogeneous (I2 = 0%). Results of additional direct comparisons are summarized in Additional file 1: Appendix 6.

Figure 3
figure 3

Direct comparison of IVT-AFL 2q8 (plus sham laser) or IVR 0.5 mg PRN (plus sham laser) versus laser (plus sham injection) for mean BCVA change from baseline in key studies. Indirect comparison (IVT-AFL 2q8 vs IVR 0.5 mg PRN) (Bucher analysis) also shown. BCVA, best-corrected visual acuity; CI, confidence interval; IVR, intravitreal ranibizumab; IVT-AFL, intravitreal aflibercept; PRN, as-needed; VEGF, vascular endothelial growth factor.

Full size image

The results from the indirect and MTC analyses showed that IVT-AFL 2q8 improved the mean BCVA change from baseline to a greater extent than IVR 0.5 mg PRN. The MD estimates from the fixed-effect models were 4.67 [95% CrI: 2.45–6.87] (MTC; 10 studies) (Table 3A) and 4.82 [95% CI: 2.52–7.11] (Bucher; four studies) (Table 3B). This effect remained after adjustment for baseline visual acuity score (the MD estimate from the MTC fixed-effect model was 4.12 [95% Crl: 1.47–6.81]) (Additional file 1: Appendix 7). IVT-AFL 2q8 significantly reduced the loss of ≥ 10 ETDRS letters at 12 months using MTC (RR = 0.27 [95% CrI: 0.07–0.90]) (six studies) but not Bucher analysis (RR = 0.31 [95% CI: 0.09–1.04]) (four studies) (Table 3). This effect remained after adjustment for baseline visual acuity score using MTC (RR = 0.11 [95% CrI: 0.02–0.46]) (Additional file 1: Appendix 7). There was no significant difference between IVT-AFL 2q8 and IVR 0.5 mg PRN treatments for gain of ≥ 10 ETDRS letters, gain of ≥ 15 ETDRS letters or loss of ≥ 15 ETDRS letters in either MTC or Bucher analyses, with or without adjustment for baseline visual acuity (Table 3, Additional file 1: Appendix 7). One study included in the analysis was conducted in a regional population group (China, Hong Kong, Japan, South Korea, Singapore and Taiwan) raising a question about the effects of an Asian subpopulation effect on the main analysis. When this study (Ohji et al. [16]) was excluded, the overall effect remained similar; the difference in mean BCVA change from baseline was 4.11 [95% CI: 0.99–7.22] by Bucher analysis.

Table 3 Indirect comparisons of the effects of IVT-AFL 2q8 versus IVR 0.5 mg PRN on 12-month visual outcomes using (A) MTC and (B) Bucher analyses
Full size table

Efficacy outcomes: IVT-AFL 2q8 versus dexamethasone 0.7 mg implants

Two studies [13] reported data to allow a direct analysis between IVT-AFL 2q8 (plus sham laser) versus laser (plus sham injection) for the outcome ‘gain of ≥ 10 ETDRS letters’, with an RR = 2.50 [95% CI: 1.97–3.17]. This analysis showed moderate heterogeneity (I2 = 56%). Only one study [36] reported a gain of ≥ 10 ETDRS letters for the comparison of dexamethasone 0.7 mg (plus laser) versus laser (plus sham implant); therefore, no direct meta-analysis was possible. This study reported an RR = 1.18 [95% CI: 0.77–1.79]. Indirect analyses of these three studies showed that IVT-AFL 2q8 improved the proportion of patients gaining ≥ 10 ETDRS letters at 12 months compared with dexamethasone 0.7 mg implants (RR = 2.10 [95% CI: 1.29–3.40], fixed-effect model) (Table 4). Analyses of other efficacy outcomes were not feasible.

Table 4 Indirect comparison (Bucher analysis) of the effects of IVT-AFL 2q8 versus dexamethasone 0.7 mg implants on 12-month visual outcomes
Full size table

Safety outcomes

There was moderate heterogeneity for comparisons between IVT-AFL 2q8 and laser (based on two studies) for all serious AEs (I2 = 55%), all AEs (I2 = 55%), all-serious non-ocular AEs (I2 = 52%) and all-causes of mortality (I2 = 47%); there was high heterogeneity for all non-ocular AEs (I2 = 86%). There was moderate heterogeneity for comparisons between IVR 0.5 mg PRN and laser for all serious ocular AEs (I2 = 67%; two studies) (Additional file 1: Appendix 8). None of these direct comparisons achieved statistical significance. The analyses were limited by differences in the precise definition for the safety outcomes. These definitions are listed in Additional file 1: Appendix 9. There were no significant differences in safety outcomes between IVT-AFL 2q8 and IVR 0.5 mg PRN in either the MTC (Table 5) or Bucher analyses (data not reported). However, there were few events reported in the studies, which resulted in wide CI intervals (summarized in Additional file 1: Appendix 8).

Table 5 Indirect comparison (MTC analysis) of IVT-AFL 2q8 versus IVR 0.5 mg PRN for 12-month safety outcomes
Full size table

Direct analyses showed that there was moderate heterogeneity between IVT-AFL 2q8 and laser for increased intraocular pressure (I2 = 73%) and vitreous hemorrhage (I2 = 60%), and low heterogeneity for cataract (I2 = 38%) (Additional file 1: Appendix 10). None of these direct comparisons achieved statistical significance. Indirect analyses showed that there were no significant differences between IVT-AFL 2q8 and dexamethasone 0.7 mg implants for the outcomes: macular edema, reduced visual acuity, vitreous hemorrhage, eye pain, increased intraocular pressure and cataracts; however, there was a trend toward fewer events with IVT-AFL 2q8 compared with dexamethasone 0.7 mg implants (Table 6).

Table 6 Indirect comparison (Bucher analysis) of IVT-AFL 2q8 versus dexamethasone 0.7 mg implants for 12-month safety outcomes
Full size table

Discussion

The aim of this systematic review was to identify and review studies informing the clinical effectiveness of IVT-AFL 2q8 in relation to other DME treatments, and to prepare where possible indirect comparisons of IVT-AFL 2q8 against other regimens licensed outside the USA at the time the analyses were conducted (i.e., IVR 0.5 mg PRN, dexamethasone 0.7 mg implants or fluocinolone acetate 0.2 μg/day implants). The evidence from these specific comparisons showed a benefit of IVT-AFL 2q8 over IVR 0.5 mg PRN for the improvement of mean change from baseline in BCVA (+4.67 letters before adjustment for baseline visual acuity and +4.12 after adjustment), the primary efficacy endpoint of VIVID-DME/VISTA-DME [13], and that approximately 70% fewer patients showed a loss of ≥ 10 ETDRS letters, an exploratory endpoint. These results were consistent in multiple analyses, including both MTC analyses (which included up to 10 studies and 3060 patients with DME) and in Bucher analyses (four studies of 1611 patients with DME), and remained consistent when one study in Asian patients [16] was included or excluded from the Bucher analysis. There were no significant differences between IVT-AL 2q8 and IVR 0.5 mg PRN in safety outcomes (for each of the safety outcomes where quantitative analysis was possible). However, the analysis was limited by differences in definitions of AEs between studies, and the total number of AEs in studies was low resulting in wide CIs.

The evidence also favored IVT-AFL 2q8 over dexamethasone in an indirect analysis of three studies with up to 1123 DME patients. More patients (approximately twice as many) receiving IVT-AFL 2q8 showed a gain of ≥ 10 ETDRS letters compared with those receiving dexamethasone. There were also fewer patients treated with IVT-AFL 2q8 who experienced increased intraocular pressure compared with dexamethasone 0.7 mg implants. There were an additional five safety outcomes (macular edema, reduced visual acuity, vitreous hemorrhage, eye pain and cataract) that showed a non-significant trend in favor of IVT-AFL 2q8. Dexamethasone was recently approved for the treatment of adults with visual impairment due to DME who are pseudophakic or insufficiently responsive/unsuitable for non-corticosteroid therapy. This is more restrictive than the population included in this review, and no data were identified to analyze this subgroup separately.

To date, four key systematic reviews for DME have included IVT-AFL 2q8 [17-19,39]. Based on an indirect analysis of 15 randomized studies and eight observational studies of anti-VEGF therapies (IVT-AFL, intravitreal bevacizumab [IVB], IVR and pegaptanib) by Ollendorf et al. [17], it was concluded that anti-VEGF therapy is associated with sustained visual improvements and reduced rescue laser, but there was insufficient evidence to distinguish between treatments [17]. However, this comparison was based on a less rigorous analysis (pairwise indirect comparisons) – without testing for bias or heterogeneity. The review by Ford et al. [40] included the DA VINCI study as the only source of data for IVT-AFL; as mentioned, DA VINCI has a different loading dose regimen to VIVID-DME and VISTA-DME, and there are only 221 patients in this study, divided over five treatment groups, compared with 406 in VIVID-DME and 466 in VISTA-DME [11,13]. Although the Cochrane review by Virgili et al. [18] included VIVID-DME and VISTA-DME, it focused on endpoints measured in logMAR rather than the more usual change in BCVA from baseline, which is included in this review.

In addition, our analysis did not pool data using different IVR dosing regimens (such as PRN or quarterly) and did not include data from heterogeneous IVR studies or time points, which has also been undertaken in earlier meta-analyses. The most recent review by Regnier et al. [39] included Bayesian network meta-analyses based on eight randomized controlled studies that evaluated IVR 0.5 mg PRN, IVT-AFL 2q8, laser photocoagulation or sham in 1978 patients, and reported 6- and 12-month outcomes. The IVT-AFL data included were from three studies (DA VINCI, VIVID-DME, and VISTA-DME) [11,13]. This review concluded that both IVR 0.5 mg PRN and IVT-AFL 2q8 were statistically superior to laser monotherapy (OR = 5.50 and OR = 3.45, respectively) and that the treatment effect of IVR was numerically, but not statistically, superior to IVT-AFL (OR = 1.59 [95% CrI 0.61–5.37]). However, the analyses relate to one secondary efficacy outcome (relative risk of ≥ 10 letter gain at 12 months), not the primary efficacy outcome in any pivotal phase III study of IVR or IVT-AFL (mean gain in BCVA at 12 months in VIVID-DME/VISTA-DME), and there was a lack of detail on the rationale for data inclusion and extraction, assessment of bias and statistical methods used for adjustment. The current review includes a broader range of interventions (including dexamethasone), and more than one outcome was analyzed. It also uses a rigorous, unbiased approach using validated methods. In terms of the single outcome included in the Regnier analysis (2014) [39], the current review finds also that differences between treatments are not statistically significant, but that the direction of effect favors IVT-AFL 2q8 (OR = 1.64 [95% CrI 0.97–2.78]). The difference in direction of point estimates between the studies appears largely attributable to the selection of studies and data rather than, for instance, choice of treatment effect measure (OR rather than RR) or any statistical adjustments applied by Regnier et al. [39].

Since we conducted the review and analysis presented here, the Diabetic Retinopathy Clinical Research Network (DRCRnet) has published first year results of the Protocol T study, which directly compared the 12-month outcomes of patients with DME randomized to either IVT-AFL (n = 224), IVR (n = 218) or IVB (n = 218) [20]. Study drugs were administered monthly according to a predefined protocol. The mean difference in BCVA (primary endpoint) at 12 months for IVT-AFL 2 mg versus ranibizumab 0.3 mg was +2.1 letters (P = 0.03) overall, and +4.7 letters (P = 0.003) in patients with baseline letter score < 69 letters. Prespecified ocular AEs and serious AEs, and Antiplatelet Trialists’ Collaboration-defined arterial thromboembolic events were not significantly different between the three anti-VEGF agents. These findings are comparable with those observed in this analysis where the difference between IVT-AFL and IVR was +4.67 letters (MTC analysis). In the Protocol T study, baseline visual acuity was predictive of outcome [20]. In the current analysis, the difference between IVT-AFL and IVR remained (+4.12 letters; MTC analysis) after adjustment for aggregate differences between studies and treatment arms in baseline visual acuity. While this may be an improvement on making no adjustment, incorporating head-to-head studies or individual patient data could provide further strength to the analysis. It must also be noted that Protocol T included IVR 0.3 mg dose and would, therefore, have been excluded from the current analysis of licensed doses (only IVR 0.5 mg would have been included).

The current review has a number of strengths that are inherent with a meta-analysis (including the use of combined data to increase the statistical power to detect an effect). Systematic reviews of high-quality evidence are also regarded at the higher end of the hierarchy of evidence [41]. This review adhered to international recommendations and guidelines in order to reduce bias in publication selection, including pre-specification of inclusion/exclusion criteria and pre-specification of indirect comparisons of interest. Extensive consideration was also given to clinical and statistical heterogeneity, and appropriate stratification of studies by intervention and posology was applied. Based on this, the network of 10 studies informing the IVT-AFL 2q8 versus IVR 0.5 mg PRN indirect comparison (particularly the four studies in the Bucher analysis) was considered sufficiently similar to employ a fixed-effect model in the analysis.

However, despite efforts to minimize bias and heterogeneity, these analyses do have a number of limitations, which are inherent in modeling approaches that use indirect data comparisons. Many studies had unclear or high risk of bias in at least one domain of the Cochrane risk of bias tool, and type 1/type 2 errors that already exist in published studies may also bias any meta-analysis extrapolating that hypothesis. The most common issue was inadequate masking (data not shown). Patient baseline characteristics differed, such as in the mean or range of BCVA of patients (Table 2), or were often poorly reported, which made it difficult to compare populations between studies. The findings are also based on a small number of studies and should be interpreted with caution. Tests of statistical significance are reported without adjustment for multiplicity of outcomes. This paper also included 12-month data only, which was based on availability at the time of the review. Some studies now have longer-term outcomes available. While the scope of the analysis (limited to licensed agents) ensures that the studies and datasets included are not excessively heterogeneous, there are important studies such as Protocol T and RISE/RIDE outside this scope which would be relevant in any broader assessment of comparative effectiveness of anti-VEGF agents.

It must be noted that the paper reports on selected safety outcomes, which were associated with the feasible networks, and did not compare systemic safety among different doses of DME therapies in detail. A meta-analysis of 11 studies (6596 patients) that compared systemic safety in relation to different regimens (doses and frequencies) of ranibizumab treatment (but for age-related macular degeneration [AMD]) identified a possible relationship associated with monthly versus as-needed dosing for cerebrovascular accidents [42]. Another meta-analysis of 21 studies (9557 patients) that compared systemic safety of anti-VEGF treatment in AMD, DME and retinal vein occlusion found no association between anti-VEGF and increased mortality or vascular events [43]. In our analysis, the selection of feasible networks only may have resulted in under-powering, and the introduction of type 2 errors; however, a complete comparison of systemic safety was out of scope.

Conclusions

This indirect comparison suggests that IVT-AFL 2q8 after a loading dose of 5 monthly injections improved visual acuity outcomes (‘BCVA mean change from baseline’ and ‘loss ≥ 10 ETDRS letters’) in eyes with center-involved DME to a greater extent than IVR 0.5 mg PRN, though VEGF inhibition with either IVT-AFL or IVR is efficacious and appears safe. IVT-AFL 2q8 is associated with a trend toward fewer ocular AEs compared with dexamethasone 0.7 mg implants. Although the study has a number of strengths, including the adherence to international guidelines for performing indirect analyses, inclusion of prespecified inclusion and exclusion criteria, and comprehensive assessment of clinical and statistical heterogeneity, it does have a number of limitations inherent with indirect analyses, the scope is narrow, and the conclusions must be interpreted with caution. Many studies had unclear or high risk of bias in at least one domain of the Cochrane risk of bias tool, and safety outcomes were limited by differences in definitions of events. The number of events reported across studies was low, and the CIs were wide. There is a need for more studies comparing the relative effects of licensed therapies for DME in order to select the best treatment options for our patients; however, the findings from this indirect analysis are comparable to those published in the Protocol T study, which directly compared IVT-AFL with other anti-VEGF agents in patients with DME.

References

  1. Klein R, Knudtson MD, Lee KE, Gangnon R, Klein BE. The Wisconsin epidemiologic study of diabetic retinopathy: XXII the twenty-five-year progression of retinopathy in persons with type 1 diabetes. Ophthalmology. 2008;115:1859–68.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Photocoagulation for diabetic macular edema. Early Treatment Diabetic Retinopathy Study report number 1. Early Treatment Diabetic Retinopathy Study research group. Arch Ophthalmol. 1985;103:1796–1806.

  3. Cheung N, Mitchell P, Wong TY. Diabetic retinopathy. Lancet. 2010;376:124–36.

    Article  PubMed  Google Scholar 

  4. Semenza GL. Vascular responses to hypoxia and ischemia. Arterioscler Thromb Vasc Biol. 2010;30:648–52.

    Article  CAS  PubMed  Google Scholar 

  5. Simo R, Sundstrom JM, Antonetti DA. Ocular anti-VEGF therapy for diabetic retinopathy: the role of VEGF in the pathogenesis of diabetic retinopathy. Diabetes Care. 2014;37:893–9.

    Article  CAS  PubMed  Google Scholar 

  6. Ciulla TA, Harris A, McIntyre N, Jonescu-Cuypers C. Treatment of diabetic macular edema with sustained-release glucocorticoids: intravitreal triamcinolone acetonide, dexamethasone implant, and fluocinolone acetonide implant. Expert Opin Pharmacother. 2014;15:953–9.

    Article  CAS  PubMed  Google Scholar 

  7. Moradi A, Sepah YJ, Sadiq MA, Nasir H, Kherani S, Sophie R, et al. Vascular endothelial growth factor trap-eye (Aflibercept) for the management of diabetic macular edema. World J Diabetes. 2013;4:303–9.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Stewart MW, Rosenfeld PJ. Predicted biological activity of intravitreal VEGF trap. Br J Ophthalmol. 2008;92:667–8.

    Article  CAS  PubMed  Google Scholar 

  9. Deissler HL, Lang GK, Lang GE. Capacity of aflibercept to counteract VEGF-stimulated abnormal behavior of retinal microvascular endothelial cells. Exp Eye Res. 2014;122:20–31.

    Article  CAS  PubMed  Google Scholar 

  10. Deissler HL, Deissler H, Lang GK, Lang GE. Ranibizumab efficiently blocks migration but not proliferation induced by growth factor combinations including VEGF in retinal endothelial cells. Graefes Arch Clin Exp Ophthalmol. 2013;251:2345–53.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Do DV, Schmidt-Erfurth U, Gonzalez VH, Gordon CM, Tolentino M, Berliner AJ, et al. The DA VINCI study: phase 2 primary results of VEGF Trap-Eye in patients with diabetic macular edema. Ophthalmology. 2011;118:1819–26.

    Article  PubMed  Google Scholar 

  12. Do DV, Nguyen QD, Boyer D, Schmidt-Erfurth U, Brown DM, Vitti R, et al. One-year outcomes of the da Vinci study of VEGF Trap-Eye in eyes with diabetic macular edema. Ophthalmology. 2012;119:1658–65.

    Article  PubMed  Google Scholar 

  13. Korobelnik JF, Do DV, Schmidt-Erfurth U, Boyer DS, Holz FG, Heier JS, et al. Intravitreal aflibercept for diabetic macular edema. Ophthalmology. 2014;121:2247–54.

    Article  PubMed  Google Scholar 

  14. Krispel C, Rodrigues M, Xin X, Sodhi A. Ranibizumab in diabetic macular edema. World J Diabetes. 2013;4:310–8.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Mitchell P, Bandello F, Schmidt-Erfurth U, Lang GE, Massin P, Schlingemann RO, et al. The RESTORE study: ranibizumab monotherapy or combined with laser versus laser monotherapy for diabetic macular edema. Ophthalmology. 2011;118:615–25.

    Article  PubMed  Google Scholar 

  16. Ohji M, Ishibashi T, REVEAL Study Group. Efficacy and safety of ranibizumab 0.5 mg as monotherapy or adjunctive to laser versus laser monotherapy in Asian patients with visual impairment due to diabetic macular edema: 12-month results of the REVEAL Study. Abstract 4664. Presented at: Annual Meeting of the Association for Research in Vision and Ophthalmology (ARVO), May, 6–9, 2012; Fort Lauderdale, FL.

  17. Ollendorf DA, Colby JA, Pearson SD. Comparative effectiveness of anti-VEGF agents for diabetic macular edema. Int J Technol Assess Health Care. 2013;29:392–401.

    Article  PubMed  Google Scholar 

  18. Virgili G, Parravano M, Menchini F, Evans JR. Anti-vascular endothelial growth factor for diabetic macular oedema. Cochrane Database Syst Rev. 2014;10:CD007419.

    PubMed  Google Scholar 

  19. Ford JA, Elders A, Shyangdan D, Royle P, Waugh N. The relative clinical effectiveness of ranibizumab and bevacizumab in diabetic macular oedema: an indirect comparison in a systematic review. BMJ. 2012;345:e5182.

    Article  PubMed  PubMed Central  Google Scholar 

  20. The Diabetic Retinopathy Clinical Research Network. Aflibercept, bevacizumab, or ranibizumab for diabetic macular edema. N Engl J Med. 2015;372:1193–203.

    Article  PubMed Central  Google Scholar 

  21. General Methods. Version 4.0 of 23.09.2011. [https://www.iqwig.de/download/General_Methods_4-0.pdf]

  22. Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. [http://www.cochrane-handbook.org/]

  23. Systematic Reviews: CRD’s guidance for undertaking reviews in health care. [http://www.york.ac.uk/inst/crd/SysRev/!SSL!/WebHelp/SysRev3.htm]

  24. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21:1539–58.

    Article  PubMed  Google Scholar 

  25. Song F, Loke YK, Walsh T, Glenny AM, Eastwood AJ, Altman DG. Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ. 2009;338:b1147.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Hoaglin DC, Hawkins N, Jansen JP, Scott DA, Itzler R, Cappelleri JC, et al. Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR task force on indirect treatment comparisons good research practices: part 2. Value Health. 2011;14:429–37.

    Article  PubMed  Google Scholar 

  27. Bucher HC, Guyatt GH, Griffith LE, Walter SD. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol. 1997;50:683–91.

    Article  CAS  PubMed  Google Scholar 

  28. Lu G, Ades AE. Assessing evidence inconsistency in mixed treatment comparisons. J Am Stat Assoc. 2014;101:447–59.

    Article  Google Scholar 

  29. Almeida FP, Katayama BY, Messias A, Fisher M, Paccola ML, Costa RA, et al. Macular laser photocoagulation combined with intravitreal bevacizumab or triamcinolone for diabetic macular edema. Abstract 1300. Presented at: 2011 Annual Meeting of the Association for Research in Vision and Ophthalmology (ARVO), May 1–5, 2011; Fort Lauderdale, FL.

  30. Ristau T, Voegeler J, Lang G, Liakopoulos S, RELATION Study Group. Relevance of inner versus outer retinal thickness in diabetic macular edema in the RELATION study. Abstract 2376. Presented at: 2013 Annual Meeting of the Association for Research in Vision and Ophthalmology (ARVO), May 5–9, 2013; Seattle, WA.

  31. Lohmann C, Voegeler J, Liakopoulos S, Wiedemann P, Spital G, Lang G, et al. Double-masked trial demonstrates superiority of combined ranibizumab plus laser versus laser in patients with diabetic macular edema with or without proliferative diabetic retinopathy. Abstract 1239. Presented at: 2013 Annual Meeting of the Association for Research in Vision and Ophthalmology (ARVO), May 5–9, 2013; Seattle, WA.

  32. Elman MJ, Aiello LP, Beck RW, Bressler NM, Bressler SB, Edwards AR, et al. Randomized trial evaluating ranibizumab plus prompt or deferred laser or triamcinolone plus prompt laser for diabetic macular edema. Ophthalmology. 2010;117:1064–77.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Googe J, Brucker AJ, Bressler NM, Qin H, Aiello LP, Antoszyk A, et al. Randomized trial evaluating short-term effects of intravitreal ranibizumab or triamcinolone acetonide on macular edema after focal/grid laser for diabetic macular edema in eyes also receiving panretinal photocoagulation. Retina. 2011;31:1009–27.

    Article  CAS  PubMed  Google Scholar 

  34. Comyn O, Peto T, Bunce C, Neveu M, Holder G, Patel P, et al. The LUCIDATE study: a randomized clinical trial to evaluate the long-term functional and anatomical effects of repeated ranibizumab therapy compared with laser in diabetic macular edema. Abstract 2390. Presented at: 2013 Annual Meeting of the Association for Research in Vision and Ophthalmology (ARVO), May 5–9, 2013; Seattle, WA.

  35. Maia OO Jr, Takahashi BS, Costa RA, Scott IU, Takahashi WY. Combined laser and intravitreal triamcinolone for proliferative diabetic retinopathy and macular edema: one-year results of a randomized clinical trial. Am J Ophthalmol. 2009;147:291–7.

    Article  CAS  PubMed  Google Scholar 

  36. Callanan DG, Gupta S, Boyer DS, Ciulla TA, Singer MA, Kuppermann BD, et al. Dexamethasone intravitreal implant in combination with laser photocoagulation for the treatment of diffuse diabetic macular edema. Ophthalmology. 2013;120:1843–51.

    Article  PubMed  Google Scholar 

  37. Brown DM, Nguyen QD, Marcus DM, Boyer DS, Patel S, Feiner L, et al. Long-term outcomes of ranibizumab therapy for diabetic macular edema: the 36-month results from two phase III trials: RISE and RIDE. Ophthalmology. 2013;120:2013–22.

    Article  PubMed  Google Scholar 

  38. Dias S, Sutton AJ, Welton NJ, Ades AE. Evidence synthesis for decision making 3: heterogeneity–subgroups, meta-regression, bias, and bias-adjustment. Med Decis Making. 2013;33:618–40.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Regnier S, Malcolm W, Allen F, Wright J, Bezlyak V. Efficacy of anti-VEGF and laser photocoagulation in the treatment of visual impairment due to diabetic macular edema: a systematic review and network meta-analysis. PLoS One. 2014;9:e102309.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Ford JA, Lois N, Royle P, Clar C, Shyangdan D, Waugh N. Current treatments in diabetic macular oedema: systematic review and meta-analysis. BMJ Open. 2013;3. doi: 10.1136/bmjopen-2012-002269.

  41. Harbour R, Miller J. A new system for grading recommendations in evidence based guidelines. BMJ. 2001;323:334–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Ueta T, Noda Y, Toyama T, Yamaguchi T, Amano S. Systemic vascular safety of ranibizumab for age-related macular degeneration: systematic review and meta-analysis of randomized trials. Ophthalmology. 2014;121:2193–203.

    Article  PubMed  Google Scholar 

  43. Thulliez M, Angoulvant D, Le Lez ML, Jonville-Bera AP, Pisella PJ, Gueyffier F, et al. Cardiovascular events and bleeding risk associated with intravitreal antivascular endothelial growth factor monoclonal antibodies: systematic review and meta-analysis. JAMA Ophthalmol. 2014;132:1317–26.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

Editorial assistance was provided by S Phillips of PAREXEL MMS, which was funded by Bayer Pharma AG.

Author information

Authors and Affiliations

  1. Université Bordeaux, ISPED, Centre INSERM U897-Epidemiologie-Biostatistique, F-33000 Bordeaux; Service d’Ophtalmologie, CHU de Bordeaux, Bordeaux, France

    Jean-Francois Korobelnik

  2. School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, Limburg, the Netherlands

    Jos Kleijnen

  3. Kleijnen Systematic Reviews Ltd., Escrick Business Park, Escrick, York, England, YO19 6FD, UK

    Shona H Lang, Richard Birnie, Regina M Leadley, Kate Misso & Gill Worthy

  4. Global Health Economics and Outcomes Research, Bayer HealthCare Pharmaceuticals Inc., 100 Bayer Boulevard, Whippany, New Jersey, 07981, USA

    Dominic Muston

  5. Truhlsen Eye Institute, University of Nebraska Medical Center, 985540 Nebraska Medical Center, Omaha, Nebraska, 68198-5540, USA

    Diana V Do

Authors
  1. Jean-Francois Korobelnik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jos Kleijnen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shona H Lang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Richard Birnie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Regina M Leadley
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kate Misso
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Gill Worthy
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Dominic Muston
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Diana V Do
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dominic Muston.

Additional information

Competing interests

The authors have the following financial competing interests to declare:

Jos Kleijnen, Shona H. Lang, Richard Birnie, Regina M. Leadley, Kate Misso and Gill Worthy are employees of Kleijnen Systematic Reviews, which was funded by Bayer Pharma AG to undertake the project on which this paper is based. Dominic Muston is an employee of Bayer. Jean-Francois Korobelnik is a consultant for Alcon, Allergan, Bayer, Novartis, Roche, Thea, and Zeiss. Diana V. Do is a consultant for Bayer, Genentech, Regeneron, and Allergan.

Authors’ contributions

JK, SHL, RB, RML, KM, GW and DM were involved in the design, analysis, interpretation of data and manuscript preparation. JFK and DVD were involved in the interpretation of data and manuscript preparation. All authors read and approved the final manuscript.

Additional file

Additional file 1:

Appendix 1. The search strategy for Embase (OvidSP) (1974-23.10.2013). Appendix 2 Additional database searches. Appendix 3 The overall network of all included studies, showing direct comparisons by drug, comparator and dose. Appendix 4 Treatment regimens of included studies. Appendix 5 Summary of the risk of bias. Appendix 6 Direct comparison of IVT-AFL 2q8 (plus sham laser) or dexamethasone 0.7 mg implants (plus laser) versus laser (plus sham injection) for gain ≥ 10 ETDRS letters in key studies. Appendix 7 Indirect comparisons of the effects of IVT-AFL 2q8 versus IVR 0.5 mg PRN on 12-month visual outcomes using MTC adjusted for baseline visual acuity score. Appendix 8 Direct comparison of IVT-AFL 2q8 (plus sham laser) or IVR 0.5 mg PRN (plus sham laser) versus laser (plus sham injection) for safety outcomes in key studies. Appendix 9 Safety outcome definitions. Appendix 10 Direct comparison of IVT-AFL 2q8 (plus sham laser) or dexamethasone 0.7 mg implants (plus laser) versus laser (plus sham laser or implant) for safety outcomes in key studies.

Rights and permissions

Open Access  This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Korobelnik, JF., Kleijnen, J., Lang, S.H. et al. Systematic review and mixed treatment comparison of intravitreal aflibercept with other therapies for diabetic macular edema (DME). BMC Ophthalmol 15, 52 (2015). https://doi.org/10.1186/s12886-015-0035-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12886-015-0035-x

Keywords

BMC Ophthalmology

ISSN: 1471-2415

Contact us