4 Consideration of the evidence

4.1 The Appraisal Committee reviewed the data available on the clinical and cost effectiveness of rituximab maintenance treatment for people with follicular non-Hodgkin's lymphoma that has responded to first-line induction therapy with rituximab in combination with chemotherapy, having considered evidence on the nature of follicular non-Hodgkin's lymphoma and the value placed on the benefits of rituximab by people with the condition, those who represent them, and clinical specialists. It also took into account the effective use of NHS resources and comments received during consultation on both appraisal consultation documents.

4.2 The Committee noted that the decision problem for this topic defines the population as 'adults with advanced follicular lymphoma that has responded to first-line chemotherapy', and that the population considered by the manufacturer was 'adults with advanced follicular lymphoma that has responded to first-line treatment with rituximab plus chemotherapy'. The manufacturer indicated that the population in its analysis was restricted to those who had high tumour burden (indicative of advanced disease) and who had received first-line treatment with rituximab plus chemotherapy because this reflected standard first-line treatment used in UK clinical practice. The Committee noted that the manufacturer assumed that rituximab maintenance would be given for a maximum period of 2 years or until disease progression, in line with the marketing authorisation. The Committee also noted that the manufacturer had not identified any clinical evidence to support the use of ibritumomab tiuxetan as a maintenance treatment for people who have received first-line treatment with rituximab in combination with chemotherapy, and that ibritumomab tiuxetan is infrequently used in the UK. For these reasons the manufacturer excluded ibritumomab tiuxetan from the list of the comparators originally specified in the decision problem. The Committee accepted the manufacturer's justifications for the changes to the decision problem.

4.3 The Committee was aware that rituximab in combination with chemotherapy is currently the standard of care in the UK for first‑line induction therapy of people with follicular non-Hodgkin's lymphoma. The Committee noted that 'Rituximab for the treatment of follicular lymphoma' (NICE technology appraisal guidance 110) recommends R-CVP for the first-line induction treatment of advanced follicular non-Hodgkin's lymphoma, but that other rituxmab-containing chemotherapeutic regimens (such as R-CHOP and R-FCM) are routinely used, but have not yet been appraised by NICE. The Committee noted that 'watchful waiting' (observation) is the current standard treatment for people with advanced follicular non-Hodgkin's lymphoma that has responded to first-line induction therapy. The Committee heard from the clinical specialists that current management aims to prolong remission, delay progression (and therefore delay the use of chemotherapy) and improve quality of life. The clinical specialists expressed the view that rituximab maintenance treatment after first-line induction therapy constituted optimal management for non-Hodgkin's lymphoma because it can offer people longer periods of remission and better quality of life. The Committee was also aware that rituximab is used in combination with chemotherapy for people whose disease has relapsed or did not respond to treatment, or as monotherapy for maintenance treatment after successful second‑line treatment of recurrent or refractory disease (in line with 'Rituximab for the treatment of relapsed or refractory stage III or IV follicular non-Hodgkin's lymphoma [review of technology appraisal guidance 37]' [NICE technology appraisal guidance 137]).

4.4 The Committee heard from patient experts that using rituximab maintenance treatment instead of watchful waiting may delay the need for eventual chemotherapy on relapse of the disease. The patient experts also expressed the view that chemotherapy is associated with more adverse events than rituximab, that it may cause symptoms worse than those caused by follicular non-Hodgkin's lymphoma itself, and that chemotherapy therefore has a substantial negative impact on an individual's quality of life. The patient experts stated that while on chemotherapy they experienced symptoms of weakness and fatigue and were not able to do simple routine tasks without the support of family and carers. However, they were aware that people who received rituximab maintenance treatment did not have adverse effects associated with chemotherapy and were able to continue with their normal daily routine.

Clinical effectiveness

4.5 The Committee considered the data presented by the manufacturer on the clinical effectiveness of rituximab maintenance treatment after first-line induction with rituximab plus chemotherapy. The Committee noted that the manufacturer derived data on efficacy primarily from the PRIMA trial that compared rituximab maintenance with observation in people whose disease had responded to first-line induction therapy. The Committee noted that the most recent data from this trial were available from the post‑study observational follow‑up period, which had a median follow-up of 38 months, and indicated that progression-free survival was statistically significantly improved in people who had been randomised to rituximab maintenance treatment compared with people who had been randomised to observation. The Committee was aware that the manufacturer could not estimate time to progression for patients randomised to rituximab, because too few people had progressed during the trial, and the manufacturer therefore had to extrapolate this value using a statistical distribution. The Committee noted the concerns of the ERG that because progression-free survival had been estimated from the period after the end of the trial, patients may have received other therapies, which in turn could have affected the chance of disease progression. The Committee also noted that despite following patients beyond the end of the trial, the manufacturer could not estimate the overall survival associated with rituximab maintenance treatment because of the small number of deaths during this period. The Committee was aware that the trial stopped earlier than originally planned on advice from a Data and Safety Monitoring Committee (section 3.3), and heard from the ERG that there is evidence suggesting that studies that have stopped earlier than planned often overestimate the clinical benefit. However, the Committee was satisfied, after advice from the clinical specialists, that progression-free survival for people treated with rituximab maintenance therapy in the PRIMA trial reflected the clinicians' observations from clinical practice. The Committee concluded that the available evidence shows that first‑line maintenance treatment with rituximab significantly improves progression-free survival compared with observation (36 months' median PFS: 74.9% vs 57.6% respectively; HR 0.55; p < 0.0001), but that the size of the overall survival benefit could not be determined.

4.6 The Committee was aware that the PRIMA trial was the only trial that directly addressed the decision problem, and included the relevant population, intervention, comparison and outcomes. The Committee heard from the clinical specialists that the results from the PRIMA trial inform clinical practice in the UK. The Committee learned from the manufacturer that another trial (ECOG 1496) demonstrated that rituximab maintenance led to longer progression-free survival compared with observation, but that this trial had been conducted in people who had not previously had first-line induction treatment with rituximab-containing chemotherapy. The Committee understood that another trial (SAKK 35/98) had observed a longer event-free survival for people randomised to rituximab maintenance compared with those who had been randomised to no treatment (observation), but that the participants of this trial had either not been treated before rituximab maintenance or had only received an induction regimen with rituximab monotherapy, not rituximab combined with chemotherapy.

4.7 The Committee considered the adverse-event profile of rituximab. It noted that the incidence of grade 3 or 4 adverse events was significantly higher in the rituximab maintenance arm than in the observation arm of the PRIMA trial (section 3.6). However, the Committee heard from the clinical specialists and patient experts that rituximab maintenance treatment is generally well tolerated and that adverse events are easily managed. The patient experts also considered the adverse effects associated with rituximab maintenance therapy to be less severe than those experienced with chemotherapy on relapse of disease. The Committee concluded that, overall, most adverse events associated with rituximab treatment are not severe, and that using rituximab to extend remission may delay the need for chemotherapy and, in turn, delay the associated adverse events.

Cost effectiveness

4.8 The Committee reviewed the original and revised economic analyses provided by the manufacturer and the exploratory sensitivity analyses performed by the ERG. It heard from the ERG that inconsistencies and errors were identified in the manufacturer's revised model, but that correcting them had only a small effect on the manufacturer's base-case results. The Committee noted that in the PRIMA trial the median age at randomisation was 57 years. However, it heard from the clinical specialists that the mean age at the start of first-line treatment in the UK is usually between 60 and 65 years. The Committee acknowledged that people in clinical trials tend to be younger and fitter than those in clinical practice, but it noted from sensitivity analyses conducted by the ERG that the ICER varied depending on the age assumed at the start of treatment. Therefore the Committee considered that the average age of people with advanced non-Hodgkin's lymphoma seen in UK clinical practice should be used in the analysis to provide a more accurate estimate. The Committee considered the revised base-case ICER from the manufacturer of £15,400 per QALY gained, which assumed that the mean age at induction was 62.5 years. The Committee heard from the ERG that the method that the manufacturer had used to adjust for age in its economic model did not reflect the prognostic importance of incident age. The Committee considered exploratory sensitivity analyses from the ERG in which the hazard ratios for progression-free survival were adjusted for specific patient ages to reflect a reduction in clinical effect with the increase of age. The Committee noted that age was not the only variable that had an impact on prognosis and, therefore considered that the ERG's adjustment of the hazard ratios for different age groups was not needed. The Committee was satisfied that the manufacturer's base-case analysis had appropriately adjusted for age and reflected the average patient population seen in UK clinical practice.

4.9 The Committee noted that the manufacturer had assumed in the base case that the clinical benefit of rituximab maintenance would last for 6 years (2 years of treatment and 4 years of sustained benefit once treatment was stopped). The Committee heard from the ERG that the manufacturer's extrapolation of the clinical benefit of rituximab beyond the period observed in the PRIMA trial assumed a proportional increase in survival with time, which may not reflect the true effect. The Committee also noted the ERG's concerns that patient-level data from the PRIMA trial indicated that the duration of effect from rituximab maintenance treatment appears to be 28 months, after which time patients treated with rituximab maintenance therapy experience a rate of progression no better or worse than that of patients not treated with rituximab maintenance therapy. The Committee heard from the clinical specialists that data from the PRIMA trial demonstrated that rituximab maintenance treatment is clinically effective to 36 months at least and without evidence that the effect diminishes over time; therefore, assuming a duration of benefit of only 28 months, as suggested by the ERG, may underestimate the actual effect of treatment. The Committee also heard from the clinical specialists that the period over which rituximab is likely to have an additional benefit over observation is probably 3 to 4 years (that is, 1 to 2 years beyond treatment). However, it further heard from the clinical specialists that it was not possible to predict a definite time period, and a duration of effect of up to 6 years, as seen in the EORTC 20981 study for second-line rituximab maintenance treatment, could be plausible. The Committee considered sensitivity analyses conducted by the manufacturer that assumed a duration of treatment effect of 28 months, 36 months and 48 months and noted that the ICERs ranged from £17,300 to £27,400 per QALY gained. The Committee noted that these estimates were lower than those calculated by the ERG for the same scenarios (range: £24,600 to £43,900 per QALY gained) but acknowledged that the manufacturer and the ERG had used different modelling approaches to calculate their results (section 3.29). The Committee considered that the duration of clinical benefit of rituximab maintenance was a key driver of cost effectiveness, but was satisfied that the manufacturer's sensitivity analyses presented the most plausible range of estimates for the treatment effect in line with clinical opinion and the available data.

4.10 The Committee noted that the manufacturer's revised base-case analysis assumed that most (89.2%) of the progression-free survival benefit translated to an overall survival gain in its model. The Committee heard from the clinical specialists that it was not possible to verify the specific conversion rate from progression-free survival to overall survival from the literature or clinical experience, but that they would expect a conversion rate of at least 70%. The Committee also heard from the clinical specialists that patients with non-Hodgkin's follicular lymphoma live longer than in the past, and it is reasonable to assume that this is at least partly due to the introduction of treatment with rituximab. The Committee considered that the manufacturer should have sought data from patient registries or observational data to validate the conversion rate assumed for the base-case estimate, and to confirm the degree to which rituximab maintenance treatment might prolong life. However, it was satisfied that the manufacturer's sensivity analyses, which assumed conversion rates of 70%, 80% and 90%, provided a plausible range of conversion rate estimates. The Committee heard from the manufacturer that the conversion rate was not an actual input in the model and could only be adjusted by artificially modifying other parameters. As such, the manufacturer was concerned that its revised analyses, which were requested by the Committee, were driven by implausible assumptions. The Committee noted the manufacturer's concerns but was satisfied that the sensitivity analyses addressed the uncertainty that the Committee initially had about the translation from progression-free survival to overall survival gain in the original analysis.

4.11 The Committee considered the concerns of the ERG that the early closure of the PRIMA trial may have overestimated the benefit from rituximab, and therefore the hazard ratio for progression-free survival (0.55) derived from the PRIMA trial should be increased to adjust for this bias. The Committee noted the revised sensitivity analyses from the ERG, which took account of the adjusted hazard ratio, but considered that adjusting for early reporting bias is not routinely included in technology appraisals and is not a current requirement in the NICE methods guide. The Committee therefore concluded that the manufacturer had used an appropriate hazard ratio and that the ERG's revised analyses using the higher hazard ratio would not be considered.

4.12 The Committee discussed the utility values used in the manufacturer's model. The Committee appreciated that no differences in health-related quality of life were observed between the arms of the PRIMA trial. The Committee considered sensitivity analyses from the ERG that showed that changes to the gains in utility in different health states in the model had a marginal effect on the base-case ICER, and the Committee was therefore persuaded that the ICERs presented by the manufacturer were largely driven by gains in overall survival.

4.13 The Committee noted that the ICERs for rituximab maintenance compared with observation in the manufacturer's submission and sensitivity analyses were less than £30,000 per QALY gained for most scenarios. The Committee also noted that the ERG's exploratory sensitivity analyses, which assumed a duration of clinical benefit from rituximab maintenance treatment of 36 to 48 months (in line with clinical opinion), resulted in ICERs ranging from £24,600 to £35,000 per QALY gained, depending on the conversion rate of progression-free survival to overall survival gain assumed. The Committee was aware that the model did not include the utility associated with delaying chemotherapy, and that if it were included, it would decrease the ICER (that is, improve the cost effectiveness) to an estimate which would be considered as a cost-effective use of NHS resources. Therefore, the Committee considered that rituximab maintenance therapy should be recommended as an option for the treatment of people with follicular non-Hodgkin's lymphoma that has responded to first-line induction treatment with rituximab in combination with chemotherapy.

Summary of Appraisal Committee's key conclusions

TA226 (STA)

Appraisal title: Rituximab for the first-line maintenance treatment of follicular non-Hodgkin's lymphoma

Section

Key conclusion

Rituximab maintenance therapy is recommended as an option for the treatment of people with follicular non-Hodgkin's lymphoma that has responded to first-line induction therapy with rituximab in combination with chemotherapy.

1.1, 4.13

Current practice

Clinical need of patients, including the availability of alternative treatments

The Committee heard from the clinical specialists that current management aims to prolong remission, delay progression (and therefore delay the use of chemotherapy), and improve quality of life. 'Watchful waiting' (observation) is the current standard treatment for people with advanced follicular non-Hodgkin's lymphoma that has responded to first-line induction therapy.

4.3

The technology

Proposed benefits of the technology

How innovative is the technology in its potential to make a significant and substantial impact on health-related benefits?

The clinical specialists expressed the view that rituximab maintenance treatment constituted optimal management because it could offer people longer periods of remission and better quality of life if used after first-line induction therapy.

Patient experts expressed the view that using rituximab maintenance treatment instead of watchful waiting may delay the need for eventual chemotherapy on relapse of the disease.

4.3

4.4

What is the position of the treatment in the pathway of care for the condition?

Rituximab has a UK marketing authorisation for the 'treatment of follicular lymphoma patients responding to induction therapy'.

2.1

Adverse effects

The incidence of grade 3 or 4 adverse events was significantly higher in the rituximab maintenance arm than in the observation arm of the PRIMA trial (24% vs 17%, p = 0.0026).

The Committee heard from the clinical specialists and patient experts that rituximab maintenance treatment is generally well tolerated and that adverse events are easily managed. The patient experts also highlighted that they consider the side effects associated with rituximab maintenance therapy to be less severe than those experienced with chemotherapy, which may be given if the disease relapses.

3.6, 4.7

Evidence for clinical effectiveness

Availability, nature and quality of evidence

The manufacturer derived efficacy data primarily from the PRIMA trial that compared rituximab maintenance with observation in people whose disease had responded to first-line induction therapy. The Committee noted that the most recent data from this trial were available from the post-study observational follow-up period, which had a median follow-up of 38 months. The Committee heard from the clinical specialists that the results from the PRIMA trial inform clinical practice in the UK.

The Committee was aware that the trial stopped earlier than originally planned on advice from a Data and Safety Monitoring Committee, but heard from the ERG that evidence suggests that studies which stop earlier than planned often overestimate the clinical benefit. However, the Committee was satisfied, after advice from the clinical specialists, that progression-free survival for people treated with rituximab maintenance therapy in the PRIMA trial reflected the clinicians' observations from clinical practice.

4.5, 4.6

Relevance to general clinical practice in the NHS

The Committee noted that in the PRIMA trial the median age at randomisation was 57 years. However, it heard from the clinical specialists that the mean age at the start of first-line treatment in the UK is usually between 60 and 65 years. Although the Committee acknowledged that people in clinical trials tend to be younger and fitter than those in clinical practice, it noted from sensitivity analyses conducted by the ERG that the manufacturer's base-case ICER varied depending on the age assumed at the start of treatment and therefore may have added uncertainty.

The Committee considered the revised base case from the manufacturer, which assumed that the mean age at induction was 62.5 years. It was satisfied that this analysis had appropriately adjusted for age and reflected the average patient population seen in UK clinical practice.

4.8

Uncertainties generated by the evidence

The Committee noted that because of the small number of deaths during the trial period, overall survival associated with rituximab maintenance treatment could not be estimated.

The Committee noted that the manufacturer assumed in the base case that the clinical benefit of rituximab maintenance would last for 6 years (2 years of treatment and 4 years of sustained benefit once treatment was stopped). The Committee noted the ERG's concerns that patient-level data for rituximab maintenance treatment from the PRIMA trial indicated that the duration of treatment effect appears to be 28 months. The Committee heard from the clinical specialists that data from the PRIMA trial indicated that rituximab maintenance treatment is clinically effective to at least 36 months and there is no evidence that the effect diminishes over time; therefore assuming a duration of benefit of only 28 months, as suggested by the ERG, may underestimate the actual effect of treatment. The Committee heard from the clinical specialists that rituximab is likely to provide a benefit for 3 to 4 years (that is, 1 to 2 years beyond treatment); however, it was not possible to predict a definite time period.

4.5

4.9

Are there any clinically relevant subgroups for which there is evidence of differential effectiveness?

Not applicable.

Estimate of the size of the clinical effectiveness including strength of supporting evidence

The Committee concluded that the available evidence shows that first-line maintenance treatment with rituximab improves progression-free survival compared with observation (36 months' median PFS: 74.9% vs 57.6% respectively; HR 0.55; p < 0.0001), but that the size of the overall survival benefit could not be determined.

4.5

Evidence for cost effectiveness

Availability and nature of evidence

The Committee heard from the ERG that inconsistencies and errors were identified in the manufacturer's model, but that correcting them only had a small effect on the manufacturer's base-case results.

The Committee heard from the manufacturer that its revised analyses, which were requested by the Committee, were driven by implausible assumptions. The Committee noted the manufacturer's concerns but was satisfied that the sensitivity analyses addressed the uncertainty that the Committee initially had when it considered the original analysis.

4.8

4.10

Uncertainties around and plausibility of assumptions and inputs in the economic model

The Committee noted that the manufacturer had assumed that the clinical benefit of rituximab maintenance would last for 6 years (2 years of treatment and 4 years of sustained benefit once treatment was stopped). The Committee heard from the ERG that the manufacturer's extrapolation of the clinical benefit of rituximab beyond the observed period in the PRIMA trial assumed a proportional increase in survival with time, which may not reflect the true effect.

The Committee considered sensitivity analyses conducted by the manufacturer that assumed a duration of treatment effect of 28 months, 36 months and 48 months and noted that the ICERs ranged from £17,300 to £27,400 per QALY gained. The Committee noted that these estimates were lower than those calculated by the ERG for the same scenarios but acknowledged that the manufacturer and the ERG had used different modelling approaches (section 3.29). The Committee was satisfied that the manufacturer's sensitivity analyses presented the most plausible range of estimates for the treatment effect in line with clinical opinion and the available data.

The Committee noted that the manufacturer's revised base-case analysis assumed that most (89.2%) of the progression-free survival benefit translated to an overall survival gain in its model. The Committee heard from the clinical specialists that it was not possible to verify the specific conversion rate from progression-free survival to overall survival from the literature or clinical experience, but that they would expect a conversion rate of at least 70%. The Committee was satisfied that the manufacturer's sensitivity analyses, which assumed conversion rates of 70%, 80% and 90%, provided a plausible range of conversion rate estimates.

The Committee considered the concerns of the ERG that the early closure of the PRIMA trial may have overestimated the benefit from rituximab, and therefore the hazard ratio for progression-free survival (0.55) derived from the PRIMA trial should be increased to adjust for this bias. The Committee noted the revised sensitivity analyses from the ERG, which took account of the adjusted hazard ratio, but considered that adjusting for early reporting bias is not routinely included in technology appraisals and is not a current requirement in the NICE methods guide.

4.9

4.10

4.11

Incorporation of health-related quality-of-life benefits and utility values

Have any potential significant and substantial health-related benefits been identified that were not included in the economic model, and how have they been considered?

The manufacturer's model included utility values of 0.88 and 0.79 for the PF1 and PF2 health states respectively. The Committee considered sensitivity analyses from the ERG that showed that changes to the gains in utility in different health states in the manufacturer's model had a marginal effect on the base-case ICER, and the Committee was therefore persuaded that the ICERs presented by the manufacturer were largely driven by gains in overall survival.

The Committee was aware that the model did not include the utility associated with delaying chemotherapy, and that if it were included, it would likely decrease the ICER (that is, improve the cost effectiveness). Although the Committee requested analysis of potential utility gains associated with delaying the need for chemotherapy after relapse, the manufacturer was unable to incorporate these because of limitations in the structure of the model.

3.12, 3.24, 4.12

3.25, 4.13

Are there specific groups of people for whom the technology is particularly cost effective?

Not applicable.

What are the key drivers of cost effectiveness?

The key drivers of cost effectiveness were assumptions about the duration of clinical benefit of rituximab maintenance, the conversion rate of progression-free survival to overall survival and the underestimation in the economic model of the utility associated with delaying chemotherapy treatment.

The Committee was satisfied that the manufacturer's sensitivity analyses presented the most plausible range of estimates for the duration of treatment effect and the translation from progression-free survival to overall survival gain.

4.9, 4.10

Most likely cost-effectiveness estimate (given as an ICER)

The Committee noted that the ICERs for rituximab maintenance compared with observation in the manufacturer's submission and sensitivity analyses were less than £30,000 per QALY gained for most scenarios. The Committee also noted that the ERG's exploratory sensitivity analyses, which assumed a duration of clinical benefit from rituximab maintenance treatment of 36 to 48 months (in line with clinical opinion), had ICERs ranging from £24,600 to £35,000 per QALY gained, depending on the conversion rate of progression-free survival to overall survival gain assumed. The Committee was aware that the model did not include the utility associated with delaying chemotherapy, and that if it were included, it would decrease the ICER (that is, improve the cost effectiveness) to an estimate which would be considered as a cost-effective use of NHS resources. Therefore the Committee considered that rituximab maintenance therapy should be recommended as an option for treatment for people with non-Hodgkin's lymphoma that has responded to first-line induction therapy with rituximab in combination with chemotherapy.

4.13

Additional factors taken into account

Patient access schemes (PPRS)

Not applicable.

End-of-life considerations

Not applicable.

Equalities considerations and social value judgements

No equalities issues were raised during the scoping exercise or during the course of the appraisal.