3 Committee discussion

The evaluation committee considered evidence submitted by GSK, a review of this submission by the external assessment group (EAG), and responses from stakeholders. See the committee papers for full details of the evidence.

The condition

Details of condition

3.1

Myelofibrosis is a cancer of the bone marrow that replaces the marrow with scar tissue. Myelofibrosis can be a primary condition, or secondary to either polycythaemia vera or essential thrombocythaemia. As the bone marrow becomes more scarred, it becomes less able to produce blood cells. To compensate for this, the spleen and liver produce blood cells, causing the spleen and liver to enlarge. The patient expert explained that people with myelofibrosis experience symptoms including anaemia, fatigue, itching and night sweats. They explained that these symptoms affect many aspects of life for people with myelofibrosis. People with myelofibrosis may have their day-to-day activities restricted, may have to stop working and may need assistance from carers. The committee recognised the high symptom burden in people with myelofibrosis.

Clinical management

Treatment options

3.2

There are limited treatment options available for myelofibrosis. Allogeneic stem cell transplant is the only potential curative treatment available, but it is unsuitable for many people with myelofibrosis. Myelofibrosis has 4 different risk categories according to the Dynamic International Prognostic Scoring System (DIPSS) and DIPSS Plus: low, intermediate‑1, intermediate‑2 and high risk. Clinicians can use these risk scores to guide treatment. Most people with intermediate‑2 or high-risk myelofibrosis will initially have ruxolitinib, which was recommended in NICE's technology appraisal guidance on ruxolitinib for treating disease-related splenomegaly or symptoms in adults with primary or secondary myelofibrosis. People who have previously had ruxolitinib or for whom ruxolitinib is unsuitable, have treatment with best available therapy (BAT). BAT includes hydroxyurea, prednisone, erythropoiesis-stimulating agents (ESAs), androgens, aspirin, anagrelide, and thalidomide. The patient expert explained that treatments often lose effectiveness over time and that prognosis without ruxolitinib is poor. The clinical experts said that even when ruxolitinib has lost effectiveness, it is often used as part of BAT because no other treatments are available. The patient expert and the clinical experts noted that ruxolitinib can make some symptoms of myelofibrosis worse, particularly anaemia. They commented that momelotinib appears to improve anaemia and would be very valuable as an option to treat myelofibrosis. The committee agreed that people with myelofibrosis and clinicians would welcome a new treatment option for myelofibrosis.

Comparators

3.3

Momelotinib's marketing authorisation is for people with primary or secondary myelofibrosis (regardless of risk category) who have moderate to severe anaemia and who have either not had a Janus kinase (JAK) inhibitor, or have had ruxolitinib. But the company positioned momelotinib only for people with intermediate‑2 or high-risk myelofibrosis. The company proposed that the committee consider people who had not previously had a JAK inhibitor (from now, JAK inhibitor-naive) and people who had previously had ruxolitinib (from now, JAK inhibitor-experienced) separately. For the JAK inhibitor-naive population, the comparator was ruxolitinib. For the JAK inhibitor-experienced population, the comparator was BAT. The committee concluded that the positioning of momelotinib was appropriate. It also concluded that it was reasonable to consider these populations separately and that the comparators in each population were appropriate.

Defining moderate to severe anaemia

3.4

Momelotinib's marketing authorisation specifies its use in adults with moderate to severe anaemia. The company defined moderate to severe anaemia as 'treatment-requiring anaemia'. The company used a haemoglobin level of less than 12 g/dL as a threshold for people who may need treatment for their anaemia. The company noted that while not all people with a haemoglobin level of less than 12 g/dL would be considered to have moderate or severe anaemia, it was advised that a lower threshold may exclude some people who would need treatment for anaemia. But the EAG commented that a threshold of haemoglobin less than 10 g/dL was more likely to represent people who would be considered to have moderate or severe anaemia in NHS practice. The EAG also highlighted that the National Cancer Institute used a threshold of haemoglobin less than 10 g/dL to define moderate to severe anaemia. The committee concluded that results from separate subgroups for each threshold should be used to inform decision making. The committee also concluded that results including people without moderate to severe anaemia or people with intermediate‑1 myelofibrosis should not be considered for decision making.

Clinical evidence

Data sources

3.5

Clinical evidence in the JAK inhibitor-naive population came from SIMPLIFY‑1, a double-blind, phase 3 non-inferiority trial which compared momelotinib with ruxolitinib. Clinical evidence in the JAK inhibitor-experienced population came from SIMPLIFY‑2, an open-label, phase 3 superiority trial which compared momelotinib with BAT. Both trials included people who did not have moderate to severe anaemia and people with intermediate‑1 risk myelofibrosis. There were 280 people in SIMPLIFY‑1 and 111 people in SIMPLIFY‑2 with a haemoglobin level of less than 12 g/dL and intermediate‑2 or high-risk myelofibrosis. The dose of momelotinib used in both studies was 200 mg per day. The primary outcome in both studies was spleen response, defined as the proportion of people with a spleen volume reduction of 35% or more from baseline at 24 weeks. Other key outcomes in both trials were total symptom score (TSS) and rate of blood transfusion independence. Both trials also included a longer follow-up period, in which everyone had momelotinib, which was 216 weeks in SIMPLIFY‑1 and 204 weeks in SIMPLIFY‑2. The committee concluded that the trials were suitable for decision making.

Trial results

3.6

The committee concluded that results including people without moderate to severe anaemia or people with intermediate‑1 myelofibrosis should not be considered for decision making (see section 3.4). So, only evidence from people with intermediate‑2 and high-risk myelofibrosis who had haemoglobin levels of less than 12 g/dL was considered. The results of the SIMPLIFY‑1 trial were mixed. They showed that for the primary outcome of spleen response, momelotinib was statistically significantly non-inferior to ruxolitinib (the company considers the exact results to be confidential so they cannot be reported here). The EAG noted that the non-inferiority margin used in SIMPLIFY‑1 was wider than what is usually considered acceptable in clinical practice. But it also noted that spleen response rates were similar in the momelotinib and ruxolitinib arms. The results from SIMPLIFY‑1 also suggested that momelotinib was significantly superior to ruxolitinib in terms of blood transfusion independence rate. But the trial found that momelotinib was not statistically significantly non-inferior in terms of TSS (the company considers the exact results to be confidential so they cannot be reported here). The company noted that people in SIMPLIFY‑1 were not stratified using TSS, so there were differences in the baseline TSS of each arm of the trial, which may have affected the results. The committee noted that TSS response was defined as 50% reduction in symptom score at week 24, which meant that the reduction in absolute TSS differed based on the baseline score. The committee raised concerns about the rate of adverse events leading to treatment discontinuation in the momelotinib arm. But the EAG noted that this was likely because of the lower number of dose reductions allowed for people in the momelotinib arm of SIMPLIFY‑1 compared with the ruxolitinib arm of SIMPLIFY‑1. The results from SIMPLIFY‑2 showed that momelotinib was not statistically significantly superior to BAT in terms of spleen response (the company considers the exact results to be confidential so they cannot be reported here). The company stated that this may have been because of the high proportion of people who had treatment with ruxolitinib in the BAT arm (88.5%) and the lack of a washout period. It noted that few people in either arm of the trial had a spleen response at 24 weeks. The EAG considered this explanation reasonable. The results from SIMPLIFY‑2 also showed that momelotinib was statistically significantly superior to BAT in terms of TSS response and rate of blood transfusion independence (the company considers the exact results to be confidential so they cannot be reported here). The committee concluded that the results from the SIMPLIFY trials suggest that momelotinib is clinically effective at treating myelofibrosis.

Generalisability

3.7

The EAG noted that in SIMPLIFY‑1 and the momelotinib arm of SIMPLIFY‑2, ESAs were prohibited. It also noted that ESAs were also not commonly used in the BAT arm of SIMPLIFY‑2 (5.8% of people in the BAT arm of the trial used an ESA). ESAs stimulate the bone marrow to produce red blood cells which can help reduce anaemia. The EAG commented that in NHS practice, ESAs are used to manage anaemia in people with myelofibrosis. The EAG raised concerns that ESA use may reduce the need for blood transfusions, so the rate of blood transfusion independence in the SIMPLIFY trials may not be generalisable to the NHS. The company stated that there was no clear evidence that ESA use improves clinical outcomes in people treated with ruxolitinib. The clinical experts stated that most people with myelofibrosis would not have ESAs and most who did would not become blood transfusion independent. They also noted that it was extremely difficult for people to become blood transfusion independent while having ruxolitinib even with the use of ESAs. But they did note that they would expect that a higher proportion of people in the SIMPLIFY trials would be transfusion independent if ESAs were allowed. The committee concluded that not allowing use of ESAs in the SIMPLIFY trials may have resulted in more favourable blood transfusion independence results for momelotinib.

Economic models

Company's JAK inhibitor-naive modelling approach

3.8

The company developed separate models for the JAK inhibitor-naive and JAK inhibitor-experienced populations. For the JAK inhibitor-naive population, the company developed a cost-comparison model which compared momelotinib with ruxolitinib. In the cost-comparison model, all clinical outcomes were assumed to be the same for momelotinib and ruxolitinib except for transfusion rates and adverse events. The cost-comparison model used a 10‑year time horizon and it assumed there were no deaths during the model. The company base case used data from the intention-to-treat population in SIMPLIFY‑1, which included people who did not have moderate to severe anaemia and people who had intermediate‑1 risk myelofibrosis (see section 3.5), to maximise the available data for the model. The EAG provided 2 subgroup analyses that only considered people with intermediate‑2 and high-risk myelofibrosis: 1 analysis included people who had haemoglobin levels of less than 12 g/dL and 1 analysis included people with haemoglobin less than 10 g/dL (see section 3.4). Because of the mixed results of SIMPLIFY‑1 (see section 3.6), the EAG was concerned with the suitability of a cost-comparison model. NICE's manual on health technology evaluations states that a cost-comparison analysis can be used to assess technologies that are likely to provide similar or greater health benefits at similar or lower cost than the relevant comparators. The EAG noted that in SIMPLIFY‑1, the non-inferiority margin for spleen response was wide and non-inferiority was not proven for TSS (see section 3.6). It noted that this cast doubt over the suitability of a cost-comparison analysis. But it also noted that spleen response rates were similar in the momelotinib and ruxolitinib arms and that post-hoc analysis showed there was little difference between treatment arms when assessing individual symptom scores and absolute change in TSS from baseline. The EAG also noted that improvements in blood transfusion independence would compensate for lower responses in other areas. The clinical experts commented that the non-inferiority margin for spleen response in SIMPLIFY‑1 was acceptable. The clinical experts highlighted that momelotinib achieved favourable results when considering all 3 key outcomes. They also noted that spleen response and transfusion independence were considered more important for future myelofibrosis outcomes, but TSS was still important for considering patient outcomes. The committee was concerned about the costs of blood transfusions in the model. The EAG commented that the unit cost for blood transfusion was similar to NHS unit costs. But the committee was still concerned that the average resource use for blood transfusions was high in the model. The committee noted the uncertain effect that not allowing ESAs had on the results of SIMPLIFY‑1 (see section 3.7). It considered a scenario which removed the benefit of blood transfusion independence rate for momelotinib compared with ruxolitinib. The committee also noted the concerns with the TSS results from SIMPLIFY‑1. The committee concluded that a cost-comparison analysis was suitable to assess momelotinib in the JAK inhibitor-naive population.

Company's JAK inhibitor-experienced modelling approach

3.9

For the JAK inhibitor-experienced population, the company developed a cost-utility analysis which compared momelotinib with BAT. The cost-utility model was a Markov model that included 4 health states (transfusion-independent, transfusion-requiring, transfusion-dependent, and death). The cost-utility model had a time horizon of 33 years with a cycle length of 4 weeks. The company's base case cost-utility model only included people with intermediate‑2 and high-risk myelofibrosis who had haemoglobin levels of less than 12 g/dL. The EAG provided a subgroup analysis with people who had intermediate‑2 and high-risk myelofibrosis who had haemoglobin levels of less than 10 g/dL (see section 3.4). The baseline distribution of people in each health state was set to be equal in both treatment arms using a pooled baseline distribution across both treatment arms from SIMPLIFY‑2. People could transition between health states starting from the third cycle, using data from SIMPLIFY‑2 to produce health state transition probabilities. It was assumed that after 24 weeks, there were no improvements in transfusion status. In its base case cost-utility model, the company assumed survival was related to blood transfusion requirement status at week 24 (see section 3.10). It also assumed that people who stopped treatment with momelotinib would not have further treatment with ruxolitinib (see section 3.11). The committee concluded that the structure of the cost-utility model for the JAK inhibitor-experienced population was suitable for decision making.

Retreatment with ruxolitinib

3.11

In the company's base case cost-utility model, after treatment with momelotinib had stopped, people had BAT that did not include ruxolitinib. In the BAT arm of the model, 88.5% of people had treatment with ruxolitinib. The company stated that treatment with ruxolitinib after stopping momelotinib was unlikely. The EAG disagreed with the company's assumption. It noted that the assumption resulted in people in the momelotinib arm having treatment with a JAK inhibitor for a shorter time than people in the BAT arm of the model. The EAG highlighted that clinicians would like the option to treat people with ruxolitinib after treatment with momelotinib was stopped. The EAG's preferred assumption was that people who stopped momelotinib would have BAT with the same proportion of ruxolitinib use as people in the BAT arm. The clinical experts agreed with the EAG that, wherever possible, people should be treated with a JAK inhibitor. The committee agreed with the EAG and clinical experts and concluded that the most plausible assumption was that people who stop treatment with momelotinib would be treated with ruxolitinib.

Cost-effectiveness estimates

Committee's preferred cost-effectiveness estimates

3.12

For the JAK inhibitor-naive population, the company's and EAG's base case assumptions for the cost-comparison analysis were the same. But the committee recalled issues with the generalisability of the blood transfusion independence rates from SIMPLIFY‑1 and uncertainty around average resource use. So, the committee considered a scenario which removed the benefit of momelotinib on blood transfusion independence (see section 3.8). Because of confidential commercial arrangements for momelotinib, ruxolitinib, and other treatments in the model, the exact cost estimates are confidential and cannot be reported here. The cost-comparison analysis showed that momelotinib has similar costs to ruxolitinib in both the haemoglobin less than 12 g/dL subgroup and the haemoglobin less than 10 g/dL subgroup.

3.13

For the JAK inhibitor-experienced population, there were 2 differences between the company's and the EAG's base cases in the cost-utility analysis:

  • The company preferred the assumption that being blood transfusion independent increased survival. The EAG preferred removing this assumption (see section 3.10).

  • The company preferred the assumption that after stopping treatment with momelotinib, people would not have treatment with ruxolitinib. The EAG preferred the assumption that after stopping treatment with momelotinib, people have treatment with BAT using the same proportion of ruxolitinib as the BAT arm in the model (see section 3.11).

    The committee preferred the EAG's assumptions in both cases. Because of confidential commercial arrangements for momelotinib, ruxolitinib, and other treatments in the model, the exact cost-effectiveness estimates are confidential and cannot be reported here. When using the committee's preferred assumptions, the cost-effectiveness estimates were below the threshold NICE usually considers to be an acceptable use of NHS resources in both the haemoglobin less than 12 g/dL subgroup and the haemoglobin less than 10 g/dL subgroup.

Other factors

Equality

3.14

The committee considered that age over 65 is a prognostic characteristic for myelofibrosis. Age is a protected characteristic under the Equality Act 2010. But because its recommendation does not restrict access to treatment for some people over others, the committee agreed that there were no equality issues relevant to the recommendations.

Conclusion

Recommendation

3.15

The committee concluded that for people who had not previously had treatment with a JAK inhibitor, the costs of treatment with momelotinib were similar to the costs of treatment with ruxolitinib. The committee also concluded that for people who had previously had treatment with a JAK inhibitor (ruxolitinib), the cost-effectiveness estimates were below the range that NICE considers to be an acceptable use of NHS resources. So, it recommended momelotinib as an option for treating splenomegaly or symptoms of myelofibrosis in adults with moderate to severe anaemia who have not had a JAK inhibitor or have had ruxolitinib, only if they have intermediate‑2 or high-risk myelofibrosis.