How are you taking part in this consultation?

You will not be able to change how you comment later.

You must be signed in to answer questions

  • Question on Consultation

    Has all of the relevant evidence been taken into account?
  • Question on Consultation

    Are the summaries of clinical and cost effectiveness reasonable interpretations of the evidence?
  • Question on Consultation

    Are the recommendations sound and a suitable basis for guidance to the NHS?
  • Question on Consultation

    Are there any aspects of the recommendations that need particular consideration to ensure we avoid unlawful discrimination against any group of people on the grounds of age, disability, gender reassignment, pregnancy and maternity, race, religion or belief, sex or sexual orientation?
The content on this page is not current guidance and is only for the purposes of the consultation process.

3 Committee discussion

The evaluation committee considered evidence submitted by Menarini Stemline, a review of this submission by the external assessment group (EAG), and responses from stakeholders. See the committee papers for full details of the evidence.

Impact of the condition

3.1

Multiple myeloma is an incurable, relapsing and remitting cancer of plasma cells. Relapsed multiple myeloma refers to previously treated myeloma that has progressed. Refractory refers to multiple myeloma that shows no response to treatment or that has progressed within 60 days of the last treatment. The clinical experts emphasised that multiple myeloma is a highly complex cancer with a wide range of symptoms and severity. The patient experts explained that the condition has a large psychological impact because of the constant possibility of relapse. They explained that the condition can have a large impact on quality of life, affecting all aspects of life for both the individual and their carers. The committee acknowledged that multiple myeloma is a chronic, incurable, highly individual condition, that can have a negative impact on quality of life for people with the condition and their families and carers.

Treatment pathway

3.2

At first line, treatment options depend on whether the person can have a stem cell transplant or not. For people who can have a stem cell transplant, NICE recommends the following treatments as options at first line:

For people who cannot have a stem cell transplant, NICE recommends the following treatments as options at first line:

At second line, NICE recommends the following treatments as options:

At third and fourth line, NICE recommends the following treatments as options:

At fourth line, NICE also recommends the following treatments as options:

At fifth line, NICE recommends the following treatments as options:

  • panobinostat plus bortezomib and dexamethasone (TA380)

  • pomalidomide plus low‑dose dexamethasone (TA427).

The clinical experts agreed with the EAG's clinical advisers that:

  • combination treatments with more agents are generally preferred

  • for people who cannot have a stem cell transplant, daratumumab plus lenalidomide and dexamethasone will likely become the most used first-line treatment option in the NHS.

The clinical experts explained that choice of treatment depends on a range of factors including previous treatments. They highlighted that a large proportion of people with newly diagnosed multiple myeloma are aged 75 and older. So, factors such as frailty and comorbidities are important considerations when offering treatment. They explained that, because of the highly individual nature of the condition and its response to treatment, a range of treatment options with different mechanisms of action are needed. The patient and clinical experts emphasised the high unmet need for effective and safe medicines that are easy to take, especially at later lines in the treatment pathway. The committee acknowledged the complex and evolving treatment pathway for multiple myeloma and the high unmet need for effective and safe treatments, especially at later lines.

Positioning of selinexor combination

Second line

3.3

For this evaluation, the company positioned selinexor plus bortezomib and dexamethasone (selinexor combination) as a second-line treatment for people whose condition is refractory (did not respond) to previous treatment with both daratumumab and lenalidomide. The clinical experts agreed with the company's positioning of selinexor combination as a second-line treatment option. They highlighted that most people who cannot have a stem cell transplant would be offered first-line treatment with daratumumab plus lenalidomide and dexamethasone. They said that the relevant comparator at second line is carfilzomib plus dexamethasone because this is the only option available to people whose condition is refractory to both daratumumab and lenalidomide. They explained that different factors would be considered when choosing between carfilzomib and selinexor such as comorbidities, individual preferences and ease of administration. Carfilzomib is associated with cardiac side effects and is administered by intravenous infusion. Selinexor, an oral tablet, is associated with gastrointestinal side effects and bortezomib is a subcutaneous medicine, so takes less time to administer in hospital.

Third line

3.4

The company also positioned selinexor combination at third line, for people who had 2 previous lines of any treatments. The clinical experts explained that for people who can still have lenalidomide, ixazomib plus lenalidomide and dexamethasone (ixazomib combination) would be the preferred option. But, they considered that at third line, most people's condition would be refractory to lenalidomide. So, they explained that for these people, there are limited treatment options available. One treatment option is panobinostat plus bortezomib and dexamethasone (panobinostat combination). But, they highlighted that because of the toxicity associated with panobinostat, it is not often used. The clinical experts acknowledged the toxicity associated with selinexor but explained that emerging real-world data shows that a dose reduction of selinexor can help reduce gastrointestinal side effects and thrombocytopenia, with potentially the same level of clinical effectiveness. The company explained that Jagannath et al. (2023), a study analysing data from the main clinical trial (BOSTON, see section 3.6) showed that progression-free survival improved with dose reduction. It explained that a reason for this result could be that people continue to have selinexor for longer at the reduced dose. The clinical experts agreed that selinexor provides an option with a different mechanism of action and that there are limited treatments available at third line.

Conclusion on positioning

3.5

The committee acknowledged that the company's positioning of selinexor combination is narrower than its marketing authorisation. It agreed with the company's positioning at second and third line and concluded that the choice of comparators was appropriate.

Clinical evidence

Key clinical trial: BOSTON

3.6

The clinical-effectiveness evidence for selinexor combination came from BOSTON, a phase 3, randomised, open-label, multi-national trial. The trial was stratified by previous proteasome inhibitor treatments, number of previous lines of treatment and the Revised International Staging System stage at entry. Adults aged at least 18 years with relapsing or remitting multiple myeloma who had already had 1 to 3 previous lines of treatment were randomised to selinexor combination (n=195) or bortezomib plus dexamethasone (n=207). Seventy-seven people randomised to the bortezomib plus dexamethasone group changed treatment to selinexor combination or selinexor plus dexamethasone after their condition progressed during the trial. The company used data from subgroups that had treatment at second line (49%) and at third line (32%). The remaining population that had treatment at fourth line (19%) was not included in the analyses for this evaluation (see sections 3.3 and 3.4). The primary outcome was progression-free survival assessed by an independent review committee that was blind to treatment group allocation. The committee noted that the average age of people in the subgroups was 67 years at second line and 65 years at third line. This was younger than people seen in the NHS, whose condition is usually diagnosed around 75 years (see section 3.2). The committee also noted that BOSTON was not statistically powered to find differences in outcomes in the subgroups and that the trial comparator is not relevant to the decision problem at second or third line. It noted that many people in the BOSTON subgroups did not have previous treatment with lenalidomide (68%). The committee was aware that most people having second- or third-line treatment in NHS clinical practice would have already had lenalidomide. So, it considered that there may be issues about how representative the population in BOSTON is to people likely to have selinexor combination in NHS clinical practice. These issues may lead to uncertainty in the generalisability of the results.

Indirect treatment comparisons

3.7

The company did Bayesian network meta-analyses using Markov chain Monte Carlo simulations to estimate the comparative effectiveness of selinexor combination to:

  • carfilzomib plus dexamethasone at second line

  • ixazomib combination at third line

  • panobinostat combination at third line.

The company chose to use random effects models because of the significant heterogeneity in the studies in the network meta-analyses. The EAG considered that the network meta-analyses used for the second-line comparison and the third-line comparison with panobinostat combination were appropriate. However, it considered that the third-line network meta-analysis with ixazomib combination was at high risk of bias because of the:

  • unanchored matching-adjusted indirect comparison used between pomalidomide plus dexamethasone (ICARIA-MM study) and bortezomib plus dexamethasone (BOSTON)

  • double use of bortezomib plus dexamethasone BOSTON data to estimate hazard ratios

  • use of by-arm median progression-free survival data from the MM-009 and MM-010 trials

  • potential violation of the proportional hazards assumption for many comparisons in the networks for progression-free and overall survival

  • inclusion of the MM-003 trial which may not be representative of NHS clinical practice because people in this trial had an average of 5 previous lines of treatment

  • substantial heterogeneity in some trials

  • unadjusted crossover in some of the trials.

The EAG preferred to use an unanchored matching-adjusted indirect comparison with the ixazomib combination. The company explained it adopted a pragmatic approach to deal with the heterogeneity between the trials. It considered that the unanchored matching-adjusted indirect comparison does not solve all the underlying uncertainty. It emphasised that the network meta-analysis is still its preferred approach because of the very small numbers included in the unanchored matching-adjusted indirect comparison. It confirmed that the unanchored matching-adjusted indirect comparison was not adjusted for subsequent treatments because no data was available. The committee agreed with the EAG that the network meta-analyses for the second-line comparison, and the third-line comparison with panobinostat combination were appropriate. It acknowledged the limitations of the unanchored matching-adjusted indirect comparison for ixazomib combination, in particular, not being adjusted for subsequent treatments which may affect overall survival. However, it concluded that the unanchored matching-adjusted indirect comparison is preferred for this third-line comparison with ixazomib combination because of the substantial limitations of the network meta-analysis.

Clinical-effectiveness results

3.8

From BOSTON (see section 3.6), selinexor combination showed:

  • in the second-line subgroup, a statistically significant improvement in progression-free survival compared with bortezomib plus dexamethasone (21 months compared with 11 months; hazard ratio (HR) 0.62, 95% confidence interval [CI] 0.41 to 0.95), but no statistically significant difference in overall survival (HR 0.91, 95% CI 0.57 to 1.45).

  • in the third-line subgroup, no statistically significant differences in progression-free survival (HR 0.75, 95% CI 0.46 to 1.22) or overall survival (HR 0.61, 95% CI 0.32 to 1.17) compared with bortezomib plus dexamethasone.

From the indirect treatment comparisons (see section 3.7), selinexor combination showed:

  • at second line, no statistically significant differences in progression-free survival (HR 0.73, 95% credible interval [CrI] 0.31 to 1.67]) or overall survival (HR 0.89, 95% CrI 0.32 to 2.45) compared with carfilzomib plus dexamethasone

  • at third line, no statistically significant differences in progression-free survival (HR 0.66, 95% CI 0.34 to 1.28) or overall survival (HR 1.29, 95% CI 0.63 to 2.64) compared with ixazomib combination

  • at third line, no statistically significant differences in progression-free survival (HR 0.80, 95% CrI 0.26 to 2.28) or overall survival (HR 1.24, 95% CrI 0.45 to 3.46) compared with panobinostat combination.

The clinical experts highlighted the heterogeneity of multiple myeloma and sequence of subsequent treatments across trials. They noted that BOSTON included mainly people whose condition was sensitive to a proteasome inhibitor, such as bortezomib. They considered that levels of previous lenalidomide use may be an important reason for the variation across trials, because of the resulting differences in the underlying biology, such as enrichment of subclones. The company highlighted that in its subgroup analysis of 106 people in BOSTON whose condition was refractory to lenalidomide, selinexor combination statistically significantly improved progression-free and overall survival compared with bortezomib plus dexamethasone (3 months longer progression-free survival and 8 months longer overall survival). It explained that this data had not been included in the model because the other trials did not have lenalidomide-refractory data and because the lenalidomide-refractory analysis was not done by line of treatment. The committee noted that, in general, selinexor combination had worse progression-free survival than its comparators at second- and third line, but that these findings were not statistically significant. It acknowledged that the BOSTON trial was not powered to detect differences in the subgroups, and that the indirect treatment comparisons results had wide credible intervals suggesting high levels of uncertainty.

Economic model

Company's modelling approach

3.9

The company presented a partitioned survival model with 3 health states: progression-free (including on and off treatment), progressed, and death. The probability of being in each health state was calculated using extrapolated progression-free survival, overall survival, and time-on-treatment curves. People start the model in the progression-free health state on second-line or third-line treatment. The model included a cycle length of 1 week with a half-cycle correction over a 35-year time horizon. The committee concluded that the company's model structure was acceptable for decision making.

Long-term extrapolations

Proportional hazards assumption
3.10

The company used BOSTON Kaplan–Meier data on progression-free survival, overall survival and time-on-treatment at second- and third line to extrapolate longer-term outcomes in the model. The company considered whether the proportional hazards assumption was violated using standard tests. This determined whether the extrapolations used were independently or jointly fitted. The EAG considered that because BOSTON patient-level data is available, independently fitted models are more robust. The company selected the most appropriate extrapolated survival curves based on best statistical fit, visual inspection and clinical plausibility. The company considered that the proportional hazards assumption was valid, except for progression-free survival at second line. It explained that in addition to visual inspection of the log-log and Schoenfeld residual plots, statistical tests were used to assess the proportional hazards assumption. It explained that all the probability values from the tests were above 0.05 except for progression-free survival at second line. The company explained that clinical expert advice it had received suggested that there was no reason why the hazards would vary over time. The EAG considered that the proportional hazards assumption was not valid, as evidenced by the variation over time in the log-log and Schoenfeld residual plots. The committee considered that the proportional hazards assumption is a strong assumption which required clear evidence to support its application. It agreed with the EAG that the proportional hazards assumption was likely to not be valid. The committee concluded that the proportional hazards assumption was violated and that independently fitted models should be used to extrapolate progression-free survival, overall survival and time on treatment.

Extrapolations for comparators
3.11

To model long-term progression-free and overall survival of the comparators, the company used the indirect treatment comparison results and applied them to the baseline curves for selinexor combination. For extrapolations of time on treatment, the company used the indirect treatment comparison progression-free survival hazard ratios and applied them to the same baseline time-on-treatment curve for selinexor combination. The EAG considered that it would be more appropriate to use bortezomib plus dexamethasone baseline curves because the proportional hazards assumption does not hold for outcomes in BOSTON. In addition, the proportional hazards assumption is more robust for other trials comparing against bortezomib plus dexamethasone, which was a common network comparator. The company explained that it preferred its base case because the proportional hazard assumption holds for all other trials in the network meta-analyses, whereas the log-log and Schoenfeld residual plots showed that it was violated in BOSTON. The committee agreed with the EAG that bortezomib plus dexamethasone is a more appropriate baseline for the comparator extrapolations. It also noted that at third line for progression-free survival and time-on-treatment extrapolations, the EAG had used independently fitted accelerated failure time models because the proportional hazards models were not suitable. It also acknowledged the EAG's request that the company derive progression-free survival estimates from the indirect treatment comparisons for the third-line comparators that are suitable for use with accelerated failure time models. The committee concluded that it preferred to use the EAG's extrapolations for decision making.

Overall survival benefit

3.12

In its base case, the company modelled differences in overall survival between treatments based on data from BOSTON Kaplan–Meier curves and indirect treatment comparisons. The EAG's base case assumed no overall survival differences between treatments and used bortezomib plus dexamethasone as the baseline overall survival curve. The EAG considered this was justified because the overall survival data from BOSTON is immature and uncertain, and no statistically significant overall survival differences were seen for any of the comparisons. The EAG noted that an overall survival benefit likely includes varying impacts of subsequent treatments on overall survival after disease progression. In addition, clinical advisers to the EAG suggested that after first line, overall survival is likely to be similar regardless of treatments at different lines. The committee considered in principle, that overall survival differences should be modelled. But, because of the lack of evidence, it preferred the EAG's base case in which no differences in overall survival between treatments were modelled, and overall survival relative to bortezomib plus dexamethasone was applied for all treatments.

Cost of subsequent treatments

3.13

The company included the cost of subsequent treatments by using a weighted average of these treatments in BOSTON and adjusted for treatments which are available in the NHS. The EAG considered that the subsequent treatments modelled by the company do not reflect NHS practice. For example, the company assumed that 56% of people who had ixazomib combination would have lenalidomide and dexamethasone, whereas clinical advice to the EAG suggested no one would have this subsequent treatment. The EAG instead used market share data provided by the company, and assumptions based on the NHS treatment pathway and adjusted for the proportion of people from BOSTON having subsequent treatments (80%). The clinical experts explained that there is significant attrition with each line of treatment. They noted that the average age of diagnosis is 75 to 80 years, and that some studies suggest that at fourth and fifth line, only about 20% of people remain on treatment. The committee recalled the younger cohort included in BOSTON and considered that, by using data from this study, the proportion of people continuing on subsequent treatments may be overestimated. The clinical experts explained that after third line, multiple myeloma is likely to be refractory to lenalidomide and people are more likely to have pomalidomide plus dexamethasone. They considered that there would be no significant differences in subsequent treatments after third line based on whether people had selinexor combination or panobinostat combination. The committee was aware that subsequent treatment assumptions were a key driver of costs and cost effectiveness in the model, particularly when assuming no overall survival benefits between treatments (see section 3.12). The committee acknowledged that the EAG's distributions of subsequent treatments excluded treatments that were not relevant to NHS clinical practice. However, it considered that these distributions, particularly after third line, did not reflect the opinion of the clinical experts. It concluded that it would have preferred to have seen subsequent treatments modelled more accurately based on the treatment pathway seen in NHS clinical practice.

Modelling of adverse events

3.14

In the company's base case, Grade 3+ treatment-emergent adverse events that occurred in at least 5% of people in BOSTON were modelled as weekly rates for the duration on therapy. The impacts of the adverse events on quality of life were also modelled as a weekly disutility. The company assumed that all adverse events are managed in primary and secondary care. In its base case, the EAG modelled adverse events as a one-off event in cycle 1 in line with previous multiple myeloma technology appraisals and assumed that adverse events are managed in secondary care. The clinical experts explained that adverse events are generally managed in secondary care. If side effects are not manageable, treatment is stopped. They considered that adverse events are likely to become less frequent over time with improved management and dose reduction, if appropriate. The committee considered that modelling a one-off event does not consider the distribution of adverse events over the duration on treatment and does not capture the long-term impact on quality of life. It acknowledged that the company's approach using cumulative adverse event rates divided to provide weekly event rates assumes constant incidence of adverse events over time, which was not appropriate and benefits treatments with shorter estimated progression-free survival such as selinexor. The committee concluded that the approach of modelling adverse events as a one-off event in cycle 1 was the best option.

Modelling of health state utilities

3.15

In its base case, the company used EQ‑5D‑5L data from BOSTON for health state utilities mapped to the EQ‑5D‑3L using the algorithm published in Hernandez -Alava et al. (2020). It applied pooled utilities from trial arms and assumed that health-related quality of life did not depend on treatment, lines of treatment or differences in treatment-emergent adverse event profiles. The company also provided a scenario analysis using utility values from Hatswell et al. (2019), a source used in other multiple myeloma technology appraisals. In its base case, the EAG used EQ‑5D‑5L data from BOSTON and line of treatment as a covariate. The clinical experts noted the small difference in utilities between the progression-free survival and progressed health states in BOSTON, whereas a larger difference was shown using the Hatswell et al. (2019)'s data. The company explained that often in trials, utilities for the progressed health state are based on an assessment at 1 timepoint shortly after disease progression. The clinical experts explained that disease-related and non-disease-related comorbidities increase over time. It is clinically plausible that over time and with later lines of treatment, the impact on health-related quality of life will be greater. The committee acknowledged the likely overestimation of the utility for the progressed health state but considered that it preferred to use the trial utility value data by line of treatment. It considered that the EAG's base-case approach for health state utilities was more appropriate for decision making.

Cost-effectiveness estimates

Committee's preferred assumptions

3.16

The committee's preferred assumptions were in line with that of the EAG's base case, which were:

  • using the results of the network meta-analyses for the second-line comparison with carfilzomib plus dexamethasone, and the third-line comparison with panobinostat combination (see section 3.7)

  • using the results of the unanchored matching-adjusted indirect comparison for the third-line comparison with ixazomib combination (see section 3.7)

  • using independently fitted models for extrapolations of progression-free survival, overall survival and time on treatment (see section 3.10)

  • using baseline curves of bortezomib plus dexamethasone for comparator extrapolations (see section 3.11)

  • assuming no difference in overall survival between treatments and using bortezomib plus dexamethasone as baseline for overall survival for all treatments (see section 3.12)

  • using EAG distributions of subsequent treatments (see section 3.13)

  • modelling of adverse events and associated disutility as a one-off event in cycle 1 (see section 3.14)

  • modelling health state utilities by line of treatment (see section 3.15).

The committee considered that the EAG's base case reflected its preferred assumptions.

The committee also noted the substantial level of uncertainty including:

  • the representativeness of the population from BOSTON and the generalisability of the results to people with multiple myeloma likely to have selinexor combination in NHS clinical practice (see section 3.6)

  • the wide credible intervals between outcomes for treatments in the indirect treatment comparisons (see section 3.8)

  • the uncertainty in longer-term extrapolations of progression-free survival, overall survival and time on treatment (see sections 3.10 to 3.12)

  • whether the EAG's modelled subsequent treatments were appropriate, given the different treatments assumed after disease progression in each treatment arm (see section 3.13).

Acceptable ICER

3.17

NICE's health technology evaluations manual notes that judgements about the acceptability of a technology as an effective use of NHS resources will take into account the degree of certainty around the incremental cost-effectiveness ratio (ICER). The committee will be more cautious about recommending a technology if it is less certain about the ICERs presented. NICE's health technology evaluations manual also states that decisions about the acceptability of the technology will consider aspects that relate to uncaptured benefits and non-health factors. The committee recalled the statements from the clinical and patient experts on the significant unmet need for effective and safe treatments at later lines in the treatment pathway. It also noted that selinexor has a novel mechanism of action and, as an oral treatment, would be easily administered and fit into the existing care pathway. The committee acknowledged the high unmet need for novel treatments especially at later lines in the treatment pathway. But, it also noted the high levels of uncertainty (see section 3.16). So, the committee concluded that an acceptable ICER would be below £20,000 per quality-adjusted life year (QALY) gained.

Company and EAG cost-effectiveness estimates

Second line
3.18

The committee considered the cost effectiveness of selinexor combination compared with carfilzomib plus dexamethasone at second line. In the company's and EAG's base case and all of the company's scenarios, the ICERs were substantially above £30,000 saved per QALY lost in the southwest quadrant of the cost-effectiveness plane. This suggested that selinexor combination is less effective and less expensive than carfilzomib plus dexamethasone. The estimated differences in QALYs between treatments were small. The exact ICERs cannot be reported here because some prices are commercial in confidence.

Third line
3.19

At third line, in the EAG's base case (which included the committee's preferred assumptions, see section 3.16), selinexor combination was dominated by both ixazomib combination and panobinostat combination. This suggested that selinexor combination is less effective and more expensive than both comparators. The estimated differences in QALYs between selinexor combination and these treatments were small. The committee noted that at third line, there is an increasing unmet need for new treatment options for people whose condition is refractory to lenalidomide. But, in the EAG's base case, selinexor combination was dominated and in the company's base case, all the ICERs were above the range considered to be a cost-effective use of NHS resources (see section 3.17).

Other factors

Equality

3.20

The recommendations apply equally to all people with relapsed or refractory multiple myeloma. Clinical experts noted that multiple myeloma is common in men, elderly people and people from African or Caribbean ethnic groups. The committee considered that its recommendations apply equally, regardless of sex, age and ethnicity. It concluded that the difference in prevalence did not represent an equality issue in this evaluation.

Innovation

3.21

The clinical experts considered that selinexor combination provided an alternative treatment option with a novel mechanism of action. The company highlighted some uncaptured benefits, including the impact on carer health-related quality of life. The committee considered there may be benefits uncaptured in the economic modelling. For example, the value of an additional oral treatment option, particularly at second line, whose ease of administration and adverse effect profile may make it more acceptable than existing options. The committee also acknowledged that there would be an increasing number of people whose condition is refractory to lenalidomide and daratumumab. It concluded that selinexor combination provided an alternative treatment option with a novel mechanism of action.

Severity

3.22

NICE's advice about conditions with a high degree of severity did not apply.

Conclusion

3.23

The ICERs using the committee's preferred assumptions were within the range that NICE considers a cost-effective use of NHS resources for second-line use of selinexor combination for multiple myeloma that is refractory to both daratumumab and lenalidomide. At third line, selinexor combination was not cost effective compared with both ixazomib combination and panobinostat combination. So, selinexor combination is recommended for routine commissioning in the NHS for second-line treatment of multiple myeloma in adults that is refractory to both daratumumab and lenalidomide.