3 The manufacturer's submission

The Appraisal Committee (appendix A) considered evidence submitted by the manufacturer of bevacizumab and a review of its submission by the Evidence Review Group (ERG; appendix B). This appraisal will replace the terminated technology appraisal number 147, June 2008, 'Bevacizumab in combination with paclitaxel for the first-line treatment of metastatic breast cancer'.

The manufacturer's original submission focused on the combination of bevacizumab plus paclitaxel. The manufacturer did not submit evidence on the clinical or cost effectiveness of bevacizumab plus docetaxel in its original submission. The evidence from this submission is outlined from paragraphs 3.1 to 3.12. Following consultation on the appraisal consultation document, the manufacturer provided additional subgroup data on prior taxane-treated groups and groups with triple negative disease, as well as additional data from the AVADO and RIBBON-1 studies. The evidence from this additional submission is outlined from sections 3.21 to 3.33.

Clinical effectiveness

3.1 The manufacturer's original submission presented clinical-effectiveness data from one randomised, open-label, controlled trial (E2100). A total of 722 patients were randomised to either bevacizumab plus weekly paclitaxel (n = 368) or weekly paclitaxel alone (n = 354). The randomisation was stratified by disease-free interval (less than or equal to 24 months; greater than 24 months), number of metastatic sites (less than 3; greater than or equal to 3), prior receipt of adjuvant chemotherapy (yes; no) and oestrogen receptor status (positive; negative; and unknown). All patients were given intravenous weekly paclitaxel (90 mg/m2 over 1 hour) once a week for 3 weeks, with no treatment given at week 4. Patients in the bevacizumab plus weekly paclitaxel arm also received intravenous bevacizumab (10 mg/kg) every 2 weeks, until progression of disease or unacceptable toxicity occurred. There was no limit to the number of cycles of therapy allowed. The patients in the trial had locally recurrent or metastatic breast cancer and over 90% had HER2-negative breast cancer. The primary endpoint of the trial was duration of progression-free survival. Secondary endpoints were overall survival, objective response (complete response and partial response) rate, duration of response and health-related quality of life. Health-related quality of life was measured by the Functional Assessment of Cancer Therapy (FACT-B) questionnaire, which is a scale for measuring quality of life among breast cancer patients.

3.2 At the time of the manufacturer's interim analysis most patients had discontinued randomised therapy; for 360 patients (50%) this was because of disease progression, and 131 patients (18%) withdrew from the study because of unacceptable toxicity. The interim analyses consisted of a stratified log rank test where the stratification factors were disease-free interval and prior adjuvant chemotherapy. There was a statistically significant increase in median progression-free survival of 5.5 months, from 5.8 months in the paclitaxel alone arm to 11.3 months in the bevacizumab plus paclitaxel arm. The stratified hazard ratio for progression was 0.48 (95% confidence interval [CI] 0.39 to 0.61; p < 0.0001). The stratified hazard ratio for death was 0.87 (95% CI 0.72 to 1.05; p = 0.14), indicating a non-statistically significant improvement in median overall survival of 1.7 months, from 24.8 months with paclitaxel alone to 26.5 months with bevacizumab plus paclitaxel.

3.3 At baseline, 302 (87.3%) patients in the paclitaxel alone arm and 317 (88.8%) patients in the bevacizumab plus paclitaxel arm completed the FACT-B questionnaire. At week 33, 163 patients in the paclitaxel arm and 205 patients in the bevacizumab plus paclitaxel arm completed the questionnaire. If scores were missing at week 17 or week 33, the patient was not included in the analysis for that respective time point – except when disease progression or death was recorded earlier. For those patients who died or had disease progression, a value of zero (that is, the worst score) for each of the five subscales in the FACT-B questionnaire was imputed (rather than the patient being excluded from the analysis). When imputed values were used, the difference in total FACT-B score between the two treatment arms was statistically significant (p = 0.0046) in favour of the bevacizumab plus paclitaxel arm at week 33. There were no statistically significant differences between treatment arms at week 17, or at week 33 if imputed values were not used. The manufacturer stated that, taken together, these results demonstrated that the addition of bevacizumab to paclitaxel led to a relative improvement in health-related quality of life.

3.4 The safety analyses from the E2100 trial reported that the addition of bevacizumab to paclitaxel resulted in a 20% overall increase in the incidence of grade 3–5 adverse events. These included neuropathy (25.3%), hypertension (16%), arterial thromboembolic events (3.6%), proteinuria (3%), bleeding (2.2%) and congestive heart failure (2.2%). In addition, adverse event data from a non-randomised single-arm, open-label study (ATHENA, n = 2251) were presented. The most frequent serious adverse events (grade 3–5) were febrile neutropenia (5.1%), neutropenia (3.6%) and pyrexia (1.5%).

3.5 The manufacturer carried out indirect comparisons for bevacizumab plus weekly paclitaxel compared with docetaxel alone and gemcitabine plus 3-weekly paclitaxel. The comparisons were carried out by an indirect method using two comparators to link three trials. The manufacturer noted that studies conducted only in patients having first-line treatment for metastatic breast cancer were not always available, so the exclusion criteria specified that trials in which more than 60% of patients were receiving second or later lines of treatment would be excluded. The manufacturer noted that one study used a higher docetaxel dosage (100 mg/m2 3-weekly) and a longer duration of treatment (maximum 32 cycles) compared with standard UK practice (considered by the manufacturer to be 75 mg/m2 3-weekly; maximum 6–8 cycles). However, based on the similar populations, baseline characteristics and exclusion/inclusion criteria, the manufacturer assumed that heterogeneity would not be significant.

3.6 The hazard ratio for progression with bevacizumab plus weekly paclitaxel compared with docetaxel alone was estimated to be 0.56 (95% CI 0.39 to 0.78) and 0.46 (95% CI 0.34 to 0.64) compared with gemcitabine plus 3-weekly paclitaxel. For weekly paclitaxel compared with 3-weekly docetaxel the hazard ratio for progression was 1.15 (95% CI 0.89 to 1.48) and for weekly paclitaxel compared with gemcitabine plus 3-weekly paclitaxel the hazard ratio for progression was 0.96 (95% CI 0.76 to 1.21).

Cost effectiveness

3.7 The manufacturer's model was a 3-state Markov model with a cycle length of 1 month. Patients in the model received treatment with either bevacizumab plus weekly paclitaxel or the comparator treatment, that is:

  • weekly paclitaxel or

  • docetaxel or

  • gemcitabine plus 3-weekly paclitaxel.

    Although bevacizumab plus docetaxel was included in the scope it was not formally evaluated in the manufacturer's economic analysis.

3.8 Patients were assumed to be in one of three possible discrete health states at any given time: 'progression-free survival', 'progressed' or 'death'. It was assumed that patients would have the same risk of dying after disease progression regardless of the first-line treatment they had received. In addition, the model assumed that patients would have the same sequence of further treatment and resource use after disease progression, regardless of their initial treatment. The number of patients who died while in the 'progression-free survival' state was determined either by the maximum of background mortality or the monthly rate at which patients died (from any cause) while progression-free in the E2100 trial. In the base-case model, the progression-free mortality rates for weekly paclitaxel alone were used as a proxy for the mortality rates for docetaxel and gemcitabine plus paclitaxel.

3.9 The manufacturer provided two base-case analyses, both incorporating a 10-year time horizon:

  • The first used the list prices in accordance with the NICE reference case. The prices for bevacizumab (total average cost per patient, £25,929) and paclitaxel (total average cost per patient, £7720) were taken from the BNF, edition 58. Drug costs were calculated according to the recommended adult dose and duration of treatment was estimated from the E2100 trial. Dose reductions were not modelled.

  • The second used an average NHS cost for paclitaxel (total average cost per patient, £649) based on the average price paid by NHS trusts over a 4-month period, and a patient access scheme for bevacizumab whereby the NHS covers the cost of the first 10 g bevacizumab needed for each patient. Sensitivity analyses were only provided for this case. The patient access scheme (10-g cap) for bevacizumab was not approved by the Department of Health and was not considered by the Committee.

3.10 The base-case utility values were taken from one study that derived proxy utility values from oncology nurses, using the standard gamble technique. The values were 0.73 for progression-free survival (this was an average of values of 0.81 for response and 0.65 for stable disease), 0.45 for progressive disease, and −0.21 for disutility from febrile neutropenia and peripheral sensory neuropathy (both applied only in month 1 of experiencing the event). It was assumed that the remaining adverse events (hypersensitivity, infection and hypertension) would not have a notable impact on health-related quality of life.

3.11 The results based on the NHS list prices indicated incremental costs of £30,469, £31,416 and £27,358 and incremental quality-adjusted life years (QALYs) of 0.259, 0.273 and 0.259 for bevacizumab plus weekly paclitaxel therapy relative to weekly paclitaxel, docetaxel and gemcitabine plus paclitaxel therapy respectively. The cost per QALY was £117,803, £115,059 and £105,777 for bevacizumab plus weekly paclitaxel therapy relative to weekly paclitaxel, docetaxel and gemcitabine plus paclitaxel therapy respectively. The results based on average prices paid by NHS trusts over a 4-month period for paclitaxel and the patient access scheme (not approved by the Department of Health) for bevacizumab were provided and indicated a lower cost per QALY for bevacizumab plus weekly paclitaxel therapy relative to weekly paclitaxel, docetaxel and gemcitabine plus paclitaxel therapy respectively, though remaining above £57,000 per QALY gained. The manufacturer stated that it can be inferred from the high incremental cost-effectiveness ratios (ICERs) in the model that bevacizumab plus docetaxel (the more expensive taxane) is unlikely to provide a more cost-effective outcome than the analysis presented in the submission and, hence, a full economic analysis of bevacizumab plus docetaxel was not presented. The manufacturer carried out sensitivity analyses only on the second base-case scenario, in which the average price of paclitaxel paid by NHS trusts over a 4-month period and the patient access scheme for bevacizumab were used, and it was observed that using different parametric functions for time to progression and alternative assumptions on treatment duration had the largest impact on the ICERs.

3.12 The manufacturer conducted further analyses in response to points of clarification requested by the ERG, incorporating into the model a comparison of bevacizumab plus weekly paclitaxel with 3-weekly paclitaxel alone. The ICER for bevacizumab plus weekly paclitaxel compared with 3-weekly paclitaxel was £59,339 per QALY gained using average prices paid by NHS trusts for paclitaxel and incorporating the patient access scheme for bevacizumab. The manufacturer also incorporated the results of the evidence synthesis into the economic model as opposed to assuming that all comparators were equally effective. This was also based on the average price of paclitaxel paid by NHS trusts and the patient access scheme for bevacizumab. This resulted in an ICER for bevacizumab plus weekly paclitaxel compared with docetaxel and gemcitabine plus 3-weekly paclitaxel of £59,310 and £51,795 per QALY gained respectively.

ERG comments on the original manufacturer's submission

3.13 The ERG had several concerns about the selection and quality of the evidence presented in the manufacturer's original submission. The evaluation of the clinical effectiveness of bevacizumab was based primarily on a single trial comparing bevacizumab plus weekly paclitaxel with weekly paclitaxel alone. The ERG highlighted limitations in the methodological quality of the study: for example, lack of blinding and lack of data collection about treatments given after disease progression. The ERG noted concerns that, as the conclusions about health-related quality of life were based primarily on the analyses using extreme imputed values for patients who had died or whose disease had progressed, the significant improvement in the FACT-B score stated by the manufacturer may not be reliable. The ERG noted that the results reported in the manufacturer's submission were derived from interim analyses and suggested that more recent follow-up data would be valuable, particularly for survival outcomes. The ERG also noted that the E2100 trial suggested that overall survival was not statistically significantly different between the treatment arms. However, the ERG was unable to establish whether or not the lack of difference in overall survival was due to crossover between treatment groups or any other post-progression events, because these data were not collected in the trial.

3.14 The ERG noted that the manufacturer had not presented any data on the clinical effectiveness of bevacizumab plus docetaxel in its submission. The ERG noted that a trial of bevacizumab plus docetaxel compared with docetaxel plus placebo (the AVADO trial) had been excluded. In addition, the ERG also considered that data from the RIBBON-1 trial could potentially have been included. The RIBBON-1 trial was excluded by the manufacturer because of insufficient statistical power for the relevant docetaxel comparison. Data from both these studies were provided by the manufacturer in response to consultation on the appraisal consultation document (see sections 3.23 and 3.24).

3.15 The ERG also highlighted a number of concerns about the indirect comparison conducted by the manufacturer. The ERG noted that an additional study (the Will Weekly Win study comparing weekly paclitaxel with 3-weekly paclitaxel, for which there were some data reported in an abstract) had not been included by the manufacturer. The ERG noted that the inclusion criteria specified that studies could be included as long as fewer than 60% (rather than a strict majority of 50%) of patients were receiving second-line treatments for metastatic breast cancer. The ERG highlighted that the validity of the studies included in the indirect comparison had not been adequately assessed. The ERG also reported concerns about the methods of the indirect comparison, noting differences between patient populations and potentially important methodological limitations among the trials included in this comparison. Given these methodological limitations, the ERG did not consider the findings of the indirect comparison to be reliable.

3.16 The ERG had a number of concerns about the economic model submitted by the manufacturer. The ERG considered that the series of pair wise comparisons for bevacizumab plus paclitaxel relative to each separate comparator regimen were inappropriate. It stated that, to establish the correct estimate of the ICER for bevacizumab plus paclitaxel, a fully incremental analysis should have been conducted, comparing all the regimens simultaneously. In addition, the ERG noted that the model assumed that mortality after disease progression was independent of initial treatment. It assumed that the rate of death after progression was constant over time and the same for all initial treatments. This meant that the differences in mean progression-free survival between treatments were maintained in the estimates of mean overall survival. The ERG stated that this was likely to have led to overestimates of overall survival for bevacizumab plus paclitaxel versus paclitaxel alone compared with the results of the E2100 trial.

3.17 The ERG highlighted that the base-case model did not include the results from the indirect comparison and that the model made the assumption that all included comparators (docetaxel alone, paclitaxel alone and gemcitabine plus paclitaxel) were equally effective in terms of progression-free survival and overall survival. Additionally, in the second base case, the cost of bevacizumab was based on the NHS paying for a maximum dose of 10 g per patient, and this patient access scheme had not been agreed with the Department of Health. The cost of paclitaxel used in the second base case was based on the average price paid by NHS trusts over a 4-month period, whereas other proprietary prices were taken from the BNF 58. The ERG also reported that the utility values were taken from a non-systematic review of the literature. In addition, the ERG noted that the manufacturer had not attempted to map health-related quality of life data from the E2100 study (measured by the FACT-B instrument) to a preference-based measure or collate alternative values.

3.18 The ERG conducted two sets of exploratory incremental analyses, both including 3-weekly paclitaxel as a comparator. One was based on the revised results, that incorporated the indirect comparison undertaken by the manufacturer rather than assuming that all comparators were equally effective. The second analysis was based on the original approach employed by the manufacturer where all comparators were assumed to be equally effective. These analyses used the following drug acquisition costs:

  • Case 1 (ERG re-analysis) – NHS list prices from BNF 58 excluding the patient access scheme for bevacizumab.

  • Case 2 (manufacturer re-analysis) – average prices paid by NHS trusts over a 4-month period for paclitaxel including the patient access scheme for bevacizumab.

  • Case 3 (ERG re-analysis) – average prices paid by NHS trusts for paclitaxel over a 4-month period excluding the patient access scheme for bevacizumab.

    In both analyses, for Case 1 and Case 3 (excluding the patient access scheme), the ICER for bevacizumab plus paclitaxel versus the next best treatment exceeded £100,000 per QALY gained. .

3.19 The ERG agreed with the manufacturer's conclusion that bevacizumab plus paclitaxel and bevacizumab plus docetaxel would be expected to be of similar effectiveness. Therefore, the inclusion and exclusion of studies in the indirect comparison would not have a major effect. The analyses by the ERG found that the acquisition cost of docetaxel had very little effect on the ICER of bevacizumab plus paclitaxel compared with docetaxel.

3.20 The ERG conducted further exploratory analyses and calibrated the model to the E2100 trial results for overall survival. This was considered important to test the internal validity of the model by comparing the median progression-free survival and overall survival found by the E2100 trial with the model predictions. The pair wise ICER of bevacizumab plus paclitaxel versus weekly paclitaxel was £259,267 per QALY gained (incremental cost of £29,675 and incremental QALY of 0.114) in the exploratory analyses.

Extra analyses provided by the manufacturer

3.21 After consultation on the appraisal consultation document, the manufacturer provided summaries of the results from the AVADO and RIBBON-1 trials. In addition, new evidence for two subgroups was provided:

  • Patients who had previously received treatment with a taxane, and

  • Patients with disease that was triple negative (that is, oestrogen and progesterone receptor negative, and HER2 negative).

Clinical effectiveness

3.22 The manufacturer stated that these groups are likely to have poorer prognosis and may gain greater benefit from bevacizumab therapy than the full licensed population. In addition to the data from the E2100 trial the manufacturer also included data from the AVADO and RIBBON-1 trials as evidence to support the subgroups identified.

3.23 The AVADO trial (n = 736) was a randomised double blind trial that investigated the combination of bevacizumab with docetaxel in women with HER2 negative disease who had not previously received chemotherapy for metastatic disease. Patients were assigned to receive either docetaxel plus bevacizumab at 7.5mg/kg every 3 weeks, docetaxel plus bevacizumab at 15 mg/kg every 3 weeks or docetaxel plus placebo. Docetaxel was given at 100 mg/m2 on day 1 of each 3 week cycle for a maximum of 9 cycles. The primary endpoint was progression-free survival. The manufacturer presented results for the licensed dose of bevacizumab at 15 mg/kg every 3 weeks. Median progression-free survival for the intention-to-treat population was 8.2 months in the docetaxel plus placebo arm and 10.1 months in the docetaxel plus bevacizumab arm (unstratified HR 0.77, 95% CI 0.64 to 0.93). Median overall survival was 31.9 months in the placebo arm and 30.2 months in the bevacizumab arm (HR 1.03, 95% CI: 0.70, 1.33).

3.24 The RIBBON-1 trial (n = 1237) was a randomised double-blind placebo controlled trial of standard chemotherapy with or without bevacizumab. Three hundred and seven patients received taxane chemotherapy with or without bevacizumab. Results for progression-free survival were provided for the group of patients receiving either anthracycline or taxane chemotherapy (n = 622). Median progression-free survival increased from 8 months in the chemotherapy arm to 9.2 months in the bevacizumab plus chemotherapy arm (HR 0.66, 95% CI 0.54 to 0.81).

3.25 For the triple negative subgroup, results from the E2100 study (n = 232) indicated a statistically significant increase in median progression-free survival of 5.3 months, from 5.3 months in the paclitaxel alone arm to 10.6 months in the bevacizumab plus paclitaxel arm. The unstratified hazard ratio for progression was 0.49 (95% CI 0.34 to 0.70). The hazard ratio for death was 0.89 (95% CI 0.66 to 1.19), indicating a non-statistically significant improvement in median overall survival of 4.2 months, from 16.3 months in the paclitaxel alone arm to 20.5 months in the bevacizumab plus paclitaxel arm. Results from the AVADO study (n = 111) indicated that the unstratified hazard ratio for progression with bevacizumab plus docetaxel compared with docetaxel alone was estimated to be 0.68 (95% CI 0.46 to 0.99). The hazard ratio for death with bevacizumab plus docetaxel compared with docetaxel alone was estimated to be 0.82 (95% CI 0.51 to 1.32).

3.26 For the prior taxane-treated subgroup, results from the E2100 study (n = 140) indicated a statistically significant increase in median progression-free survival of 7.3 months, from 5.8 months in the paclitaxel alone arm to 13.1 months in the bevacizumab plus paclitaxel arm. The unstratified hazard ratio for progression was 0.33 (95% CI 0.20 to 0.54). There was a statistically significant increase in median overall survival of 8.7 months, from 17.6 months in the paclitaxel alone arm to 26.3 months in the bevacizumab plus paclitaxel arm. The hazard ratio for death was 0.67 (95% CI 0.45 to 0.99). Results from the AVADO study (n = 78) indicated a statistically significant increase in median progression-free survival of 3.6 months, from 6.7 months in the docetaxel alone arm to 10.3 months in the bevacizumab plus docetaxel arm. The unstratified hazard ratio for progression with bevacizumab plus docetaxel compared with docetaxel alone was estimated to be 0.53 (95% CI 0.33 to 0.85). There was a 9.3-month increase in median overall survival, from 22.3 months in the docetaxel alone arm to 31.6 months in the bevacizumab plus docetaxel arm. The hazard ratio for death was 0.58 (95% CI 0.31 to 1.08).

3.27 The manufacturer also provided meta-analyses based on individual patient data. One was a meta-analysis of progression-free survival and overall survival in 2447 patients from the E2100, AVADO and RIBBON-1 trials. In this pooled intention-to-treat analysis, there was a statistically significant increase in median progression-free survival of 2.5 months, from 6.7 months in the chemotherapy alone arm to 9.2 months in the bevacizumab plus chemotherapy arm. The hazard ratio for progression with bevacizumab plus chemotherapy compared with chemotherapy alone was estimated to be 0.64 (95% CI 0.58 to 0.71). The hazard ratio for death was 0.97 (95% CI 0.86 to 1.08), indicating a non-statistically significant difference in median overall survival of 0.3 months from 26.4 months in the chemotherapy alone arm to 26.7 months in the bevacizumab plus chemotherapy arm. The pooled dataset also included 621 patients with triple negative disease who were meta-analysed separately. Results were similar in this triple negative subgroup to the results from the overall population, with a hazard ratio for progression with bevacizumab plus chemotherapy compared with chemotherapy alone estimated to be 0.63 (95% CI 0.52 to 0.76). The hazard ratio for death with bevacizumab plus chemotherapy compared with chemotherapy alone was estimated to be 0.96 (95% CI 0.79 to 1.16). Median length of progression-free and overall survival for the triple negative subgroup were not provided. No data were provided for the group (n = 1826) that did not have triple negative disease.

3.28 Another meta-analysis was described as exploratory and focused on the prior taxane-treated subgroup. This analysis was restricted to the 1765 patients treated with taxanes, with or without bevacizumab, in the E2100, AVADO and RIBBON-1 trials. No data for the entire group of 1765 patients were provided. For the prior taxane-treated subgroup (n = 311), results indicated a statistically significant increase in median progression-free survival of 4.5 months, from 6.2 months in the taxane alone arm to 10.7 months in the bevacizumab plus taxane arm. The hazard ratio for progression was 0.47 (95% CI 0.35 to 0.62). There was a statistically significant increase in median overall survival of 5.6 months, from 21.3 months in the taxane alone arm to 26.9 months in the bevacizumab plus taxane arm. The hazard ratio for death was 0.73 (95% CI 0.55 to 0.97). No data were provided for the group (n = 1454) that had not received prior taxanes.

Cost-effectiveness

3.29 The manufacturer provided cost-effectiveness estimates for the two subgroups. The model that was used in the original submission was adapted to reflect the progression-free survival, overall survival, time to stopping treatment and adverse event rates of the subgroups. Overall survival curves for the relevant subgroups from the E2100 study were fitted with parametric functions. The analysis focused on the cost effectiveness of bevacizumab plus paclitaxel and did not consider the comparator of gemcitabine plus paclitaxel. The analysis assumed equal efficacy for weekly paclitaxel and 3-weekly docetaxel.

3.30 For both subgroups, a log-logistic model was selected as the best fit for progression-free survival and overall survival and the Weibull function was used for both treatments to reflect time to stopping treatment for each treatment arm. The base-case results were presented using both the average price of paclitaxel paid by NHS trusts and the list price. The patient access scheme for bevacizumab was excluded from the base case, although it was included in sensitivity analysis.

3.31 For the triple negative subgroup, the cost per QALY for bevacizumab plus paclitaxel compared with paclitaxel alone was £87,865 (with an incremental cost of £27,387 and an incremental QALY of 0.312) based on list prices for paclitaxel and £82,469 (with an incremental cost of £25,705 and an incremental QALY of 0.312) based on the average price paid by NHS trusts for paclitaxel. The cost per QALY for bevacizumab plus paclitaxel compared with docetaxel alone was £84,740 (with an incremental cost of £26,540 and an incremental QALY of 0.313) based on list prices for paclitaxel and £64,092 (with an incremental cost of £20,073 and an incremental QALY of 0.313) based on the average price paid by NHS trusts for paclitaxel.

3.32 For the prior taxane-treated subgroup, the cost per QALY for bevacizumab plus paclitaxel compared with paclitaxel alone was £74,640 (with an incremental cost of £37,358 and an incremental QALY of 0.501) based on list prices for paclitaxel and £67,714 (with an incremental cost of £33,892 and an incremental QALY of 0.501) based on the average price paid by NHS trusts for paclitaxel. The cost per QALY for bevacizumab plus paclitaxel compared with docetaxel alone was £73,605 (with an incremental cost of £36,951 and an incremental QALY of 0.502) based on list prices for paclitaxel and £57,416 (with an incremental cost of £28,824 and an incremental QALY of 0.502) based on the average price paid by NHS trusts for paclitaxel.

3.33 Sensitivity analysis was conducted on the prior taxane-treated subgroup assuming that variations in ICERs would be similarly reflected in the triple negative subgroup. The analysis indicated that there was considerable variation in the estimate of cost effectiveness depending on the function adopted. Probabilistic sensitivity analyses produced similar estimates of cost effectiveness, and the probability of bevacizumab being cost effective at £30,000 per QALY gained was 0% against both weekly paclitaxel and 3-weekly docetaxel.

ERG comments on the extra subgroup analysis

3.34 The ERG noted that 25% (615/2447) of all patients included in the intention-to-treat meta-analysis that was used to address the triple negative subgroup received bevacizumab plus capecitabine, a combination that is outside the scope of this appraisal. The ERG highlighted that the progression-free survival and overall survival hazard ratios for the intention-to-treat population and the triple negative subgroup were almost identical. Furthermore, the median progression-free survival, overall survival and 1-year survival data were not reported for this subgroup. It was noted that these data were not provided for the RIBBON-1 study.

3.35 The ERG noted that the meta-analysis addressing the prior taxane-treated subgroup was described as an exploratory meta-analysis. It stated that it included only a small number of patients from trials that individually were insufficiently powered to detect a difference in overall survival. Only one trial (AVADO) appeared to stratify for taxane pre-treatment and no interaction tests were conducted. Therefore, although the hazard ratios did show a trend towards being more favourable towards bevacizumab than in the intention-to-treat meta-analysis for both progression-free survival and overall survival, the ERG stated that the analysis cannot be considered as convincing evidence of a subgroup effect.

3.36 The ERG had a number of concerns about the economic modelling. The ERG highlighted that rather than using estimates from these subgroup meta-analyses in the subsequent economic model, only the subgroup data from the E2100 trial were used. The ERG noted that this approach may have yielded more favourable ICER estimates because the progression-free survival and overall survival values for E2100 were more favourable than those from the meta-analyses.

3.37 The ERG commented that, although the manufacturer selected the log-logistic model as the best fit, the difference in goodness of fit statistics was small, suggesting that the choice between different functions was marginal. However, there was subsequent variation in the ICER estimates based on the different survival functions. At the extreme ends, for the prior taxane-treated subgroup, the ICER using the log-logistic function (the manufacturer's base case), and incorporating the average price for paclitaxel paid by NHS trusts, was £67,714 per QALY gained, whereas if the Weibull function had been used this figure would have risen to £86,854 per QALY gained. When the NHS list prices for paclitaxel were incorporated, the ICERs ranged from £74,640 per QALY gained with the log-logistic function to £95,807 per QALY gained with the Weibull function. The ERG concluded that there was considerable uncertainty surrounding the choice of statistical function used in the cost-effectiveness analysis for the prior taxane-treated subgroup. Equivalent goodness of fit statistics were not reported for the triple negative subgroup so the ERG could not undertake a similar assessment for this subgroup.

3.38 The ERG undertook an exploratory analysis in the prior taxane-treated subgroup using the hazard ratio estimated from the individual patient data meta-analysis of the prior taxane-treated group presented by the manufacturer (HR = 0.738) and the Weibull function. The results demonstrated an increase in the ICER from £95,807 to £109,242 per QALY gained using the list prices for paclitaxel and from £86,854 to £98,834 per QALY gained using the average price for paclitaxel paid by NHS trusts.

3.39 The ERG noted that all the parametric functions investigated by the manufacturer assumed long-term sustained treatment effects for overall survival with bevacizumab plus paclitaxel. Consequently, the ERG undertook an exploratory analysis for both subgroups using the manufacturer's model. This analysis used the Kaplan-Meier survival estimates from the E2100 study up to about 3.2 years, assuming no difference in survival after that point, since the curves suggested that the difference in overall survival may not be sustained over a longer time horizon. For the prior taxane-treated subgroup, the ICERs increased from £74,640 per QALY gained when using the log-logistic function to £129,794 per QALY gained when using the Kaplan-Meier function, both incorporating the list prices for paclitaxel, and from £67,714 per QALY gained when using the log-logistic function to £117,587 per QALY gained when using the Kaplan-Meier function, both incorporating the average price for paclitaxel paid by NHS trusts. For the triple negative subgroup, the ICERs increased from £87,865 per QALY gained when using the log-logistic function to £187,339 per QALY gained when using the Kaplan-Meier function, incorporating the list prices for paclitaxel, and from £82,469 per QALY gained when using the log-logistic function to £175,575 per QALY gained when using the Kaplan-Meier function, incorporating the average price for paclitaxel paid by NHS trusts.

3.40 Full details of all the evidence are in the manufacturer's submission and the ERG report.