The company and the EAG had different approaches to modelling long-term treatment effect. In its base case presented at the first committee meeting, the company assumed that everyone on olipudase alfa treatment would transition to the least severe health state (defined by spleen volume less than 6 multiples of normal and DLco 80% or above predicted value) from year 10, and would remain there for the rest of the modelled time horizon or until death. The EAG was concerned about the uncertainties in treatment effect in the longer term and preferred to freeze the treatment effect from year 3 onwards in its base case, meaning that people stayed in the same health state after 2 years of treatment. The committee considered that freezing the treatment effect after 2 years may be pessimistic, but it was concerned by the lack of justification for the company's approach. So, the committee asked the company to explore a scenario in which the treatment effect continued for 9 years and was frozen from year 10.
In response to the draft guidance, the company interviewed 6 clinicians to explore olipudase alfa's treatment effect in the longer term. Three of the clinicians felt unable to predict treatment effect waning, and another 3 estimated there would be none. But the EAG noted limitations relating to the methods of the interviews, including lack of transcripts or quotes, and uncertainty in the methods used to analyse the qualitative data. In the company's revised model, health states were frozen from year 10, but people taking olipudase alfa became gradually healthier up to this point, so everyone was in the least severe health state by year 10. The EAG noted that the company's revised approach was even more optimistic than its previous modelling of the long-term treatment effect because it saw people becoming healthier at an earlier timepoint. It highlighted that the company presented no further data from clinical trials to support olipudase alfa's treatment effect in the longer term. The EAG instead recycled the treatment effect seen in the clinical trials by maintaining constant transition probabilities from year 2 to year 10, with the health states frozen from year 10 onwards. The EAG considered that this approach aligned with the scenario requested by the committee.
The patient experts explained that the modelled health states were too simplistic, and by focusing on spleen volume and lung function the systemic nature of the condition was not properly captured, including the effects on malnutrition, fatigue, functioning and pain. They also advised that the ability to function in everyday life is a key area of improvement. They believed that these symptoms may not have been fully captured in the company's vignette study to inform the utility values of health states in the model. This was partly because the symptoms of ASMD are not fully understood. The clinical experts explained that, in their experience, spleen volume rapidly improved in the first few years, then continued to improve but at a slower rate. They also noted that most people can be expected to move into the mild category for impaired lung function. They stated that around 10% to 20% of people will have neurological symptoms, so have residual disease after treatment. Otherwise, people's quality of life becomes near normal. Taking into account that there may be an ongoing but more gradual improvement in the longer term, the additional evidence with longer follow up submitted by the company, and the associated uncertainties (see section 3.8), the committee agreed that it preferred the EAG's updated approach, which it considered to be in line with what would be expected. It noted that although spleen volume and lung function do not encapsulate the totality of the disease, they are still important outcomes, as well as proxy indicators of other outcomes and overall health state. The committee concluded that the EAG's approach for modelling long-term treatment effect was appropriate for decision making. It acknowledged that health states defined by spleen volume and lung function may underpredict the benefits associated with olipudase alfa, and took this into account in its decision making.