VENUE GSK at Stevenage Gunnels Wood Road Stevenage Hertfordshire SG1 2NY United Kingdom
Monday 28th September 2015, Hertfordshire
Please click below to see the speaker slides from the meeting:
Rob Hemmings
AnnKristinLeuchs
Chrissie Fletcher
Frank Bretz
James Carpenter
JamesRoger
Controversy and confusion exist on the definition and selection of appropriate estimands in the clinical trial context.
As a result the ICH Steering Committee endorsed a final Concept Paper in October 2014 with the goal of developing a new regulatory guidance, suggested to be an Addendum to ICH E9. The aim of the addendum is to promote harmonised standards on the choice of estimands in clinical trials and an agreed framework for planning, conducting and interpreting sensitivity analyses of clinical trial data. A working group sponsored by ICH has been established to develop the addendum and is due to report findings in December 2015.
This meeting will provide a forum to hear about the latest developments and discussions on this topic. Speakers include members of the ICH working group as well as representatives from academia, European regulatory bodies and industry. The day will end with a panel discussion including all speakers.
Presenters include:
Rob Hemmings
Statistics and Pharmacokinetics Unit Manager, MHRA, UK
Ann-Kristen Leuchs
Federal Institute for Drugs and Medical Devices, Bonn, Germany
Chrissie Fletcher
Executive Director, Global Biostatistical Science, Amgen Ltd, UK
Frank Bretz
Global Head Statistical Methodology group, Novartis, Basel, Switzerland
James Carpenter
Professor, London School of Hygiene and Tropical Medicine, UK
James Roger
Director, LiveData (UK) Ltd
| 8.45-9.10 | Arrival/Registration and Coffee |
|
| 9.10-9.15 | Welcome and introduction |
|
| 9.15-10.00 | Robert Hemmings (MHRA) | Estimands at ICH |
| 10.00-10.45 | Frank Bretz (Novartis) | Estimands and their role in clinical trials |
| 10.45-11.00 | Coffee |
|
| 11.00-11.45 | James Carpenter (LSHTM & MRC) | Estimands, Randomisation and Sensitivity Analysis |
| 11.45-12.30 | Plamen Kozlovski (Medical Director at Novartis) | Estimands in Diabetes Trials – what are different stakeholders interested in? |
| 12.30-1.30 | Lunch |
|
| 1.30-2.15 | Chrissie Fletcher (Amgen) | The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry |
| 2.15-3.00 | James Roger (Livedata) | Whether to use MMRM as primary estimand. |
| 3.00-3.15 | Coffee |
|
| 3.15-4.00 | Ann-Kristen Leuchs (BfArM) | Estimands in clinical trials and how they influence trial planning: a regulatory view |
| 4.00-4.30 | Panel Discussion |
|
| 4.30 | Close |
|
Abstracts
Rob Hemmings (Statistics and Pharmacokinetics Unit Manager, MHRA, UK)
Estimands at ICH
After a number of years discussing the problem of ‘missing data’, solutions arose and became widespread practice, but these solutions seemed to violate the ITT principle as it is described in ICH E9. Attention turned to identifying a precise answer to the question ‘what should we seek to estimate to demonstrate drug effects in a clinical trial’? The breadth of this question called for an answer on a global scale and hence a concept paper was drafted, and eventually adopted, for a group to draft an addendum to ICH E9. The talk will provide some more background on how the discussions came to be, the ICH process, the future plans of the group for developing the guidance and some initial thoughts from one regulator on what might be achieved and where further research work still needs to be done.
Frank Bretz (Global Head Statistical Methodology group, Novartis, Basel, Switzerland)
Estimands and their role in clinical trials
Defining the primary objective of a clinical trial in the presence of non-compliance or non-adherence to the assigned treatment is crucial for the choice of design, the statistical analysis and the interpretation of the results. At first glance this seems obvious, however, primary objectives stated in clinical trial protocols often fail to give a precise definition of the measure of intervention effect. The impact of potential confounding, e.g. due to non-compliance, missing data, treatment switching / discontinuation or intake of rescue medication, is frequently not taken into account when defining the intervention effect of interest. The need for a structured framework to specify the primary estimand (i.e. “what is to be estimated”) was highlighted in the context of missing data in the National Academy of Science document "The Prevention and Treatment of Missing Data in Clinical Trials"(2010). However, the need for clearly defined estimands applies to a broader setting. In this talk we will discuss the need for this framework, using real and hypothetical examples.
James R Carpenter (Professor LSHTM and MRC Clinical Trials Unit)
Estimands, Randomisation and Sensitivity Analysis
The increased focus on estimands - not just for sensitivity analysis, but for the primary analysis - is a welcome development, because it helps clarify the assumptions necessary for the analysis, and which of them can be verified.
However, it does raise a number of questions: -
1. How tightly should the estimand be defined? In other words, when is a sensitivity analysis actually changing the estimand?
2. What is the role of randomisation based inference?
3. To what extent should we worry if the sensitivity analysis violates the assumptions of the primary analysis?
I will argue that the way we answer these questions lead us to two different paradigms:
(a) Follow the established approach, where the primary analysis does not model deviations, and explore how robust inferences are to different assumptions about post-deviation behaviour
(b) Adopt a more formal causal approach to the primary analysis, in which the deviation process is explicitly accounted for.
If we shift to (b), we are moving decisively away from randomisation based inference. If we want to do this, it should be intentional, not accidental!
Plamen Kozlovski (Associate Global Program Medical Director at Novartis Pharma AG)
Estimands in Diabetes Trials – what are different stakeholders interested in?
Diabetes is a progressive disease which is associated with serious complications resulting from chronic exposure to elevated blood glucose levels and other metabolic abnormalities. Good blood glucose control assessed by glycated haemoglobin (HbA1C) is a key goal of treatment, as it has been demonstrated that near-normalization in HbA1c can prevent or delay the diabetic complications. This goal should be achieved without deterioration of the quality of life. However, when it comes to decision-making on priorities, the different parties involved in diabetes care – patients, health professionals, regulatory agencies, payers and pharmaceutical companies - may have different perspectives and needs. These differences in perspectives may imply different estimands – this may lead to challenges when designing a clinical development programme that aims to address the needs of all stakeholders.
Chrissie Fletcher (Executive Director, Global Biostatistical Science, Amgen Ltd, UK):
The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry
In recent years, there have been different perspectives emerging between regulators and Industry in terms of what estimand and measure of the intervention effect is of primary interest to be estimated for confirmatory trials supporting Marketing authorisations. Choices made in how to deal with non-adherence issues, such as missing data or taking rescue medication, in the study design and planned analyses influences what is actually being estimated in the clinical trial. In addition, sensitivity analyses conducted to support the conclusions from confirmatory trials can sometimes be misaligned with the estimand of primary interest, leading to difficulties in interpretation of results from confirmatory trials. The results of a recent survey conducted by the ICH E9 working group who are developing the addendum will be presented highlighting current practices relating to choices of primary estimands, techniques for preventing and minimising missing data, and common sensitivity analyses used to support primary analyses. Challenges with current practice in these areas and recommendations for overcoming these challenges will be discussed. A summary of key topics debated in the ICH E9 working group will be provided including considerations for how the addendum will align with the current ICH E9 guidance.
James Roger (Director, LiveData (UK) Ltd)
Whether to use MMRM as primary estimand.
There are two main impacts of early withdrawal on study results; first the potential selection bias caused by those withdrawing being different from the remaining subjects, and second the fact that subjects may receive alternative treatments after withdrawal. The most common method for handling early withdrawal in clinical studies is MMRM or some other form of missing at random (MAR) based analysis. The motivation behind MMRM is to solve the first issue while addressing an on-treatment question, i.e. what happens if a typical patient completes their assigned treatment. It does this by conditioning on the previous observations and other covariates that may inform on both missingness and outcome. So what is the scientific question of interest, i.e. the estimand that it targets? This cannot be answered without considering the second aforementioned issue which is related to treatment switching or modification after withdrawal.
If the design of the study, in terms of treatment after withdrawal from randomized treatment, matches the estimand, then collection of data after treatment withdrawal allows direct analysis. Then later absolute study termination after switching (truly missing data) can be handled via a modified MMRM approach. But when the design of the study after treatment withdrawal does not match the estimand any analysis must depend upon additional unverifiable information or assumptions. This is a whole new area of potential statistical research. Several of the more recent proposals ignore the first issue of selection bias. Any coherent approach must address both issues.
Ann-Kristen Leuchs (Federal Institute for Drugs and Medical Devices, Bonn, Germany)
Estimands in clinical trials and how they influence trial planning: a regulatory view
Estimands, which are precise definitions of that which is being estimated, are currently discussed in clinical research, especially in cases where post-randomization events such as non-adherence to treatment complicate the interpretation of trial results. Considering suitable estimands addressing the desired objectives and satisfying regulatory requirements is only the first step in appropriately planning clinical trials. The choice of estimand has consequences for various other factors to be considered during any trial’s planning phase. After deciding on the primary estimand, a trial design that enables addressing this estimand should be discussed. This, for example, includes considering measures to enhance retrieval of data or adherence to treatment. Following the specification of an appropriate design, an adequate primary analysis method that directly addresses the chosen estimand is to be selected including the use of retrieved data and missing data handling. The robustness of the primary analysis to deviations from its assumptions should be addressed in a final step by defining sensitivity analyses still addressing the primary estimand but using a different set of assumptions (internal validity). Moreover, sensitivity analyses aiming at alternative estimands can be considered to address the robustness with respect to the generalizability of results (external validity). This process is proposed as a suitable way to incorporate estimands in clinical development and illustrated with relevant examples from clinical practice and regulatory experience.
Registration Costs
Fee includes lunch & refreshments
* event is co-organised by PSI and
located in the UK
For information regarding the scientific content, contact:
Carly Barnett
Tel: +44 208 990 3781
Carly.m.barnett@gsk.com
Egbert Biesheuvel
Tel: +31 6 46869728
Egbert.biesheuvel@danone.com
VENUE GSK at Stevenage Gunnels Wood Road Stevenage Hertfordshire SG1 2NY United Kingdom
Monday 28th September 2015, Hertfordshire
Please click below to see the speaker slides from the meeting:
Rob Hemmings
AnnKristinLeuchs
Chrissie Fletcher
Frank Bretz
James Carpenter
JamesRoger
Controversy and confusion exist on the definition and selection of appropriate estimands in the clinical trial context.
As a result the ICH Steering Committee endorsed a final Concept Paper in October 2014 with the goal of developing a new regulatory guidance, suggested to be an Addendum to ICH E9. The aim of the addendum is to promote harmonised standards on the choice of estimands in clinical trials and an agreed framework for planning, conducting and interpreting sensitivity analyses of clinical trial data. A working group sponsored by ICH has been established to develop the addendum and is due to report findings in December 2015.
This meeting will provide a forum to hear about the latest developments and discussions on this topic. Speakers include members of the ICH working group as well as representatives from academia, European regulatory bodies and industry. The day will end with a panel discussion including all speakers.
Presenters include:
Rob Hemmings
Statistics and Pharmacokinetics Unit Manager, MHRA, UK
Ann-Kristen Leuchs
Federal Institute for Drugs and Medical Devices, Bonn, Germany
Chrissie Fletcher
Executive Director, Global Biostatistical Science, Amgen Ltd, UK
Frank Bretz
Global Head Statistical Methodology group, Novartis, Basel, Switzerland
James Carpenter
Professor, London School of Hygiene and Tropical Medicine, UK
James Roger
Director, LiveData (UK) Ltd
| 8.45-9.10 | Arrival/Registration and Coffee |
|
| 9.10-9.15 | Welcome and introduction |
|
| 9.15-10.00 | Robert Hemmings (MHRA) | Estimands at ICH |
| 10.00-10.45 | Frank Bretz (Novartis) | Estimands and their role in clinical trials |
| 10.45-11.00 | Coffee |
|
| 11.00-11.45 | James Carpenter (LSHTM & MRC) | Estimands, Randomisation and Sensitivity Analysis |
| 11.45-12.30 | Plamen Kozlovski (Medical Director at Novartis) | Estimands in Diabetes Trials – what are different stakeholders interested in? |
| 12.30-1.30 | Lunch |
|
| 1.30-2.15 | Chrissie Fletcher (Amgen) | The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry |
| 2.15-3.00 | James Roger (Livedata) | Whether to use MMRM as primary estimand. |
| 3.00-3.15 | Coffee |
|
| 3.15-4.00 | Ann-Kristen Leuchs (BfArM) | Estimands in clinical trials and how they influence trial planning: a regulatory view |
| 4.00-4.30 | Panel Discussion |
|
| 4.30 | Close |
|
Abstracts
Rob Hemmings (Statistics and Pharmacokinetics Unit Manager, MHRA, UK)
Estimands at ICH
After a number of years discussing the problem of ‘missing data’, solutions arose and became widespread practice, but these solutions seemed to violate the ITT principle as it is described in ICH E9. Attention turned to identifying a precise answer to the question ‘what should we seek to estimate to demonstrate drug effects in a clinical trial’? The breadth of this question called for an answer on a global scale and hence a concept paper was drafted, and eventually adopted, for a group to draft an addendum to ICH E9. The talk will provide some more background on how the discussions came to be, the ICH process, the future plans of the group for developing the guidance and some initial thoughts from one regulator on what might be achieved and where further research work still needs to be done.
Frank Bretz (Global Head Statistical Methodology group, Novartis, Basel, Switzerland)
Estimands and their role in clinical trials
Defining the primary objective of a clinical trial in the presence of non-compliance or non-adherence to the assigned treatment is crucial for the choice of design, the statistical analysis and the interpretation of the results. At first glance this seems obvious, however, primary objectives stated in clinical trial protocols often fail to give a precise definition of the measure of intervention effect. The impact of potential confounding, e.g. due to non-compliance, missing data, treatment switching / discontinuation or intake of rescue medication, is frequently not taken into account when defining the intervention effect of interest. The need for a structured framework to specify the primary estimand (i.e. “what is to be estimated”) was highlighted in the context of missing data in the National Academy of Science document "The Prevention and Treatment of Missing Data in Clinical Trials"(2010). However, the need for clearly defined estimands applies to a broader setting. In this talk we will discuss the need for this framework, using real and hypothetical examples.
James R Carpenter (Professor LSHTM and MRC Clinical Trials Unit)
Estimands, Randomisation and Sensitivity Analysis
The increased focus on estimands - not just for sensitivity analysis, but for the primary analysis - is a welcome development, because it helps clarify the assumptions necessary for the analysis, and which of them can be verified.
However, it does raise a number of questions: -
1. How tightly should the estimand be defined? In other words, when is a sensitivity analysis actually changing the estimand?
2. What is the role of randomisation based inference?
3. To what extent should we worry if the sensitivity analysis violates the assumptions of the primary analysis?
I will argue that the way we answer these questions lead us to two different paradigms:
(a) Follow the established approach, where the primary analysis does not model deviations, and explore how robust inferences are to different assumptions about post-deviation behaviour
(b) Adopt a more formal causal approach to the primary analysis, in which the deviation process is explicitly accounted for.
If we shift to (b), we are moving decisively away from randomisation based inference. If we want to do this, it should be intentional, not accidental!
Plamen Kozlovski (Associate Global Program Medical Director at Novartis Pharma AG)
Estimands in Diabetes Trials – what are different stakeholders interested in?
Diabetes is a progressive disease which is associated with serious complications resulting from chronic exposure to elevated blood glucose levels and other metabolic abnormalities. Good blood glucose control assessed by glycated haemoglobin (HbA1C) is a key goal of treatment, as it has been demonstrated that near-normalization in HbA1c can prevent or delay the diabetic complications. This goal should be achieved without deterioration of the quality of life. However, when it comes to decision-making on priorities, the different parties involved in diabetes care – patients, health professionals, regulatory agencies, payers and pharmaceutical companies - may have different perspectives and needs. These differences in perspectives may imply different estimands – this may lead to challenges when designing a clinical development programme that aims to address the needs of all stakeholders.
Chrissie Fletcher (Executive Director, Global Biostatistical Science, Amgen Ltd, UK):
The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry
In recent years, there have been different perspectives emerging between regulators and Industry in terms of what estimand and measure of the intervention effect is of primary interest to be estimated for confirmatory trials supporting Marketing authorisations. Choices made in how to deal with non-adherence issues, such as missing data or taking rescue medication, in the study design and planned analyses influences what is actually being estimated in the clinical trial. In addition, sensitivity analyses conducted to support the conclusions from confirmatory trials can sometimes be misaligned with the estimand of primary interest, leading to difficulties in interpretation of results from confirmatory trials. The results of a recent survey conducted by the ICH E9 working group who are developing the addendum will be presented highlighting current practices relating to choices of primary estimands, techniques for preventing and minimising missing data, and common sensitivity analyses used to support primary analyses. Challenges with current practice in these areas and recommendations for overcoming these challenges will be discussed. A summary of key topics debated in the ICH E9 working group will be provided including considerations for how the addendum will align with the current ICH E9 guidance.
James Roger (Director, LiveData (UK) Ltd)
Whether to use MMRM as primary estimand.
There are two main impacts of early withdrawal on study results; first the potential selection bias caused by those withdrawing being different from the remaining subjects, and second the fact that subjects may receive alternative treatments after withdrawal. The most common method for handling early withdrawal in clinical studies is MMRM or some other form of missing at random (MAR) based analysis. The motivation behind MMRM is to solve the first issue while addressing an on-treatment question, i.e. what happens if a typical patient completes their assigned treatment. It does this by conditioning on the previous observations and other covariates that may inform on both missingness and outcome. So what is the scientific question of interest, i.e. the estimand that it targets? This cannot be answered without considering the second aforementioned issue which is related to treatment switching or modification after withdrawal.
If the design of the study, in terms of treatment after withdrawal from randomized treatment, matches the estimand, then collection of data after treatment withdrawal allows direct analysis. Then later absolute study termination after switching (truly missing data) can be handled via a modified MMRM approach. But when the design of the study after treatment withdrawal does not match the estimand any analysis must depend upon additional unverifiable information or assumptions. This is a whole new area of potential statistical research. Several of the more recent proposals ignore the first issue of selection bias. Any coherent approach must address both issues.
Ann-Kristen Leuchs (Federal Institute for Drugs and Medical Devices, Bonn, Germany)
Estimands in clinical trials and how they influence trial planning: a regulatory view
Estimands, which are precise definitions of that which is being estimated, are currently discussed in clinical research, especially in cases where post-randomization events such as non-adherence to treatment complicate the interpretation of trial results. Considering suitable estimands addressing the desired objectives and satisfying regulatory requirements is only the first step in appropriately planning clinical trials. The choice of estimand has consequences for various other factors to be considered during any trial’s planning phase. After deciding on the primary estimand, a trial design that enables addressing this estimand should be discussed. This, for example, includes considering measures to enhance retrieval of data or adherence to treatment. Following the specification of an appropriate design, an adequate primary analysis method that directly addresses the chosen estimand is to be selected including the use of retrieved data and missing data handling. The robustness of the primary analysis to deviations from its assumptions should be addressed in a final step by defining sensitivity analyses still addressing the primary estimand but using a different set of assumptions (internal validity). Moreover, sensitivity analyses aiming at alternative estimands can be considered to address the robustness with respect to the generalizability of results (external validity). This process is proposed as a suitable way to incorporate estimands in clinical development and illustrated with relevant examples from clinical practice and regulatory experience.
Registration Costs
Fee includes lunch & refreshments
* event is co-organised by PSI and
located in the UK
For information regarding the scientific content, contact:
Carly Barnett
Tel: +44 208 990 3781
Carly.m.barnett@gsk.com
Egbert Biesheuvel
Tel: +31 6 46869728
Egbert.biesheuvel@danone.com
VENUE GSK at Stevenage Gunnels Wood Road Stevenage Hertfordshire SG1 2NY United Kingdom
Monday 28th September 2015, Hertfordshire
Please click below to see the speaker slides from the meeting:
Rob Hemmings
AnnKristinLeuchs
Chrissie Fletcher
Frank Bretz
James Carpenter
JamesRoger
Controversy and confusion exist on the definition and selection of appropriate estimands in the clinical trial context.
As a result the ICH Steering Committee endorsed a final Concept Paper in October 2014 with the goal of developing a new regulatory guidance, suggested to be an Addendum to ICH E9. The aim of the addendum is to promote harmonised standards on the choice of estimands in clinical trials and an agreed framework for planning, conducting and interpreting sensitivity analyses of clinical trial data. A working group sponsored by ICH has been established to develop the addendum and is due to report findings in December 2015.
This meeting will provide a forum to hear about the latest developments and discussions on this topic. Speakers include members of the ICH working group as well as representatives from academia, European regulatory bodies and industry. The day will end with a panel discussion including all speakers.
Presenters include:
Rob Hemmings
Statistics and Pharmacokinetics Unit Manager, MHRA, UK
Ann-Kristen Leuchs
Federal Institute for Drugs and Medical Devices, Bonn, Germany
Chrissie Fletcher
Executive Director, Global Biostatistical Science, Amgen Ltd, UK
Frank Bretz
Global Head Statistical Methodology group, Novartis, Basel, Switzerland
James Carpenter
Professor, London School of Hygiene and Tropical Medicine, UK
James Roger
Director, LiveData (UK) Ltd
| 8.45-9.10 | Arrival/Registration and Coffee |
|
| 9.10-9.15 | Welcome and introduction |
|
| 9.15-10.00 | Robert Hemmings (MHRA) | Estimands at ICH |
| 10.00-10.45 | Frank Bretz (Novartis) | Estimands and their role in clinical trials |
| 10.45-11.00 | Coffee |
|
| 11.00-11.45 | James Carpenter (LSHTM & MRC) | Estimands, Randomisation and Sensitivity Analysis |
| 11.45-12.30 | Plamen Kozlovski (Medical Director at Novartis) | Estimands in Diabetes Trials – what are different stakeholders interested in? |
| 12.30-1.30 | Lunch |
|
| 1.30-2.15 | Chrissie Fletcher (Amgen) | The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry |
| 2.15-3.00 | James Roger (Livedata) | Whether to use MMRM as primary estimand. |
| 3.00-3.15 | Coffee |
|
| 3.15-4.00 | Ann-Kristen Leuchs (BfArM) | Estimands in clinical trials and how they influence trial planning: a regulatory view |
| 4.00-4.30 | Panel Discussion |
|
| 4.30 | Close |
|
Abstracts
Rob Hemmings (Statistics and Pharmacokinetics Unit Manager, MHRA, UK)
Estimands at ICH
After a number of years discussing the problem of ‘missing data’, solutions arose and became widespread practice, but these solutions seemed to violate the ITT principle as it is described in ICH E9. Attention turned to identifying a precise answer to the question ‘what should we seek to estimate to demonstrate drug effects in a clinical trial’? The breadth of this question called for an answer on a global scale and hence a concept paper was drafted, and eventually adopted, for a group to draft an addendum to ICH E9. The talk will provide some more background on how the discussions came to be, the ICH process, the future plans of the group for developing the guidance and some initial thoughts from one regulator on what might be achieved and where further research work still needs to be done.
Frank Bretz (Global Head Statistical Methodology group, Novartis, Basel, Switzerland)
Estimands and their role in clinical trials
Defining the primary objective of a clinical trial in the presence of non-compliance or non-adherence to the assigned treatment is crucial for the choice of design, the statistical analysis and the interpretation of the results. At first glance this seems obvious, however, primary objectives stated in clinical trial protocols often fail to give a precise definition of the measure of intervention effect. The impact of potential confounding, e.g. due to non-compliance, missing data, treatment switching / discontinuation or intake of rescue medication, is frequently not taken into account when defining the intervention effect of interest. The need for a structured framework to specify the primary estimand (i.e. “what is to be estimated”) was highlighted in the context of missing data in the National Academy of Science document "The Prevention and Treatment of Missing Data in Clinical Trials"(2010). However, the need for clearly defined estimands applies to a broader setting. In this talk we will discuss the need for this framework, using real and hypothetical examples.
James R Carpenter (Professor LSHTM and MRC Clinical Trials Unit)
Estimands, Randomisation and Sensitivity Analysis
The increased focus on estimands - not just for sensitivity analysis, but for the primary analysis - is a welcome development, because it helps clarify the assumptions necessary for the analysis, and which of them can be verified.
However, it does raise a number of questions: -
1. How tightly should the estimand be defined? In other words, when is a sensitivity analysis actually changing the estimand?
2. What is the role of randomisation based inference?
3. To what extent should we worry if the sensitivity analysis violates the assumptions of the primary analysis?
I will argue that the way we answer these questions lead us to two different paradigms:
(a) Follow the established approach, where the primary analysis does not model deviations, and explore how robust inferences are to different assumptions about post-deviation behaviour
(b) Adopt a more formal causal approach to the primary analysis, in which the deviation process is explicitly accounted for.
If we shift to (b), we are moving decisively away from randomisation based inference. If we want to do this, it should be intentional, not accidental!
Plamen Kozlovski (Associate Global Program Medical Director at Novartis Pharma AG)
Estimands in Diabetes Trials – what are different stakeholders interested in?
Diabetes is a progressive disease which is associated with serious complications resulting from chronic exposure to elevated blood glucose levels and other metabolic abnormalities. Good blood glucose control assessed by glycated haemoglobin (HbA1C) is a key goal of treatment, as it has been demonstrated that near-normalization in HbA1c can prevent or delay the diabetic complications. This goal should be achieved without deterioration of the quality of life. However, when it comes to decision-making on priorities, the different parties involved in diabetes care – patients, health professionals, regulatory agencies, payers and pharmaceutical companies - may have different perspectives and needs. These differences in perspectives may imply different estimands – this may lead to challenges when designing a clinical development programme that aims to address the needs of all stakeholders.
Chrissie Fletcher (Executive Director, Global Biostatistical Science, Amgen Ltd, UK):
The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry
In recent years, there have been different perspectives emerging between regulators and Industry in terms of what estimand and measure of the intervention effect is of primary interest to be estimated for confirmatory trials supporting Marketing authorisations. Choices made in how to deal with non-adherence issues, such as missing data or taking rescue medication, in the study design and planned analyses influences what is actually being estimated in the clinical trial. In addition, sensitivity analyses conducted to support the conclusions from confirmatory trials can sometimes be misaligned with the estimand of primary interest, leading to difficulties in interpretation of results from confirmatory trials. The results of a recent survey conducted by the ICH E9 working group who are developing the addendum will be presented highlighting current practices relating to choices of primary estimands, techniques for preventing and minimising missing data, and common sensitivity analyses used to support primary analyses. Challenges with current practice in these areas and recommendations for overcoming these challenges will be discussed. A summary of key topics debated in the ICH E9 working group will be provided including considerations for how the addendum will align with the current ICH E9 guidance.
James Roger (Director, LiveData (UK) Ltd)
Whether to use MMRM as primary estimand.
There are two main impacts of early withdrawal on study results; first the potential selection bias caused by those withdrawing being different from the remaining subjects, and second the fact that subjects may receive alternative treatments after withdrawal. The most common method for handling early withdrawal in clinical studies is MMRM or some other form of missing at random (MAR) based analysis. The motivation behind MMRM is to solve the first issue while addressing an on-treatment question, i.e. what happens if a typical patient completes their assigned treatment. It does this by conditioning on the previous observations and other covariates that may inform on both missingness and outcome. So what is the scientific question of interest, i.e. the estimand that it targets? This cannot be answered without considering the second aforementioned issue which is related to treatment switching or modification after withdrawal.
If the design of the study, in terms of treatment after withdrawal from randomized treatment, matches the estimand, then collection of data after treatment withdrawal allows direct analysis. Then later absolute study termination after switching (truly missing data) can be handled via a modified MMRM approach. But when the design of the study after treatment withdrawal does not match the estimand any analysis must depend upon additional unverifiable information or assumptions. This is a whole new area of potential statistical research. Several of the more recent proposals ignore the first issue of selection bias. Any coherent approach must address both issues.
Ann-Kristen Leuchs (Federal Institute for Drugs and Medical Devices, Bonn, Germany)
Estimands in clinical trials and how they influence trial planning: a regulatory view
Estimands, which are precise definitions of that which is being estimated, are currently discussed in clinical research, especially in cases where post-randomization events such as non-adherence to treatment complicate the interpretation of trial results. Considering suitable estimands addressing the desired objectives and satisfying regulatory requirements is only the first step in appropriately planning clinical trials. The choice of estimand has consequences for various other factors to be considered during any trial’s planning phase. After deciding on the primary estimand, a trial design that enables addressing this estimand should be discussed. This, for example, includes considering measures to enhance retrieval of data or adherence to treatment. Following the specification of an appropriate design, an adequate primary analysis method that directly addresses the chosen estimand is to be selected including the use of retrieved data and missing data handling. The robustness of the primary analysis to deviations from its assumptions should be addressed in a final step by defining sensitivity analyses still addressing the primary estimand but using a different set of assumptions (internal validity). Moreover, sensitivity analyses aiming at alternative estimands can be considered to address the robustness with respect to the generalizability of results (external validity). This process is proposed as a suitable way to incorporate estimands in clinical development and illustrated with relevant examples from clinical practice and regulatory experience.
Registration Costs
Fee includes lunch & refreshments
* event is co-organised by PSI and
located in the UK
For information regarding the scientific content, contact:
Carly Barnett
Tel: +44 208 990 3781
Carly.m.barnett@gsk.com
Egbert Biesheuvel
Tel: +31 6 46869728
Egbert.biesheuvel@danone.com
VENUE GSK at Stevenage Gunnels Wood Road Stevenage Hertfordshire SG1 2NY United Kingdom
Monday 28th September 2015, Hertfordshire
Please click below to see the speaker slides from the meeting:
Rob Hemmings
AnnKristinLeuchs
Chrissie Fletcher
Frank Bretz
James Carpenter
JamesRoger
Controversy and confusion exist on the definition and selection of appropriate estimands in the clinical trial context.
As a result the ICH Steering Committee endorsed a final Concept Paper in October 2014 with the goal of developing a new regulatory guidance, suggested to be an Addendum to ICH E9. The aim of the addendum is to promote harmonised standards on the choice of estimands in clinical trials and an agreed framework for planning, conducting and interpreting sensitivity analyses of clinical trial data. A working group sponsored by ICH has been established to develop the addendum and is due to report findings in December 2015.
This meeting will provide a forum to hear about the latest developments and discussions on this topic. Speakers include members of the ICH working group as well as representatives from academia, European regulatory bodies and industry. The day will end with a panel discussion including all speakers.
Presenters include:
Rob Hemmings
Statistics and Pharmacokinetics Unit Manager, MHRA, UK
Ann-Kristen Leuchs
Federal Institute for Drugs and Medical Devices, Bonn, Germany
Chrissie Fletcher
Executive Director, Global Biostatistical Science, Amgen Ltd, UK
Frank Bretz
Global Head Statistical Methodology group, Novartis, Basel, Switzerland
James Carpenter
Professor, London School of Hygiene and Tropical Medicine, UK
James Roger
Director, LiveData (UK) Ltd
| 8.45-9.10 | Arrival/Registration and Coffee |
|
| 9.10-9.15 | Welcome and introduction |
|
| 9.15-10.00 | Robert Hemmings (MHRA) | Estimands at ICH |
| 10.00-10.45 | Frank Bretz (Novartis) | Estimands and their role in clinical trials |
| 10.45-11.00 | Coffee |
|
| 11.00-11.45 | James Carpenter (LSHTM & MRC) | Estimands, Randomisation and Sensitivity Analysis |
| 11.45-12.30 | Plamen Kozlovski (Medical Director at Novartis) | Estimands in Diabetes Trials – what are different stakeholders interested in? |
| 12.30-1.30 | Lunch |
|
| 1.30-2.15 | Chrissie Fletcher (Amgen) | The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry |
| 2.15-3.00 | James Roger (Livedata) | Whether to use MMRM as primary estimand. |
| 3.00-3.15 | Coffee |
|
| 3.15-4.00 | Ann-Kristen Leuchs (BfArM) | Estimands in clinical trials and how they influence trial planning: a regulatory view |
| 4.00-4.30 | Panel Discussion |
|
| 4.30 | Close |
|
Abstracts
Rob Hemmings (Statistics and Pharmacokinetics Unit Manager, MHRA, UK)
Estimands at ICH
After a number of years discussing the problem of ‘missing data’, solutions arose and became widespread practice, but these solutions seemed to violate the ITT principle as it is described in ICH E9. Attention turned to identifying a precise answer to the question ‘what should we seek to estimate to demonstrate drug effects in a clinical trial’? The breadth of this question called for an answer on a global scale and hence a concept paper was drafted, and eventually adopted, for a group to draft an addendum to ICH E9. The talk will provide some more background on how the discussions came to be, the ICH process, the future plans of the group for developing the guidance and some initial thoughts from one regulator on what might be achieved and where further research work still needs to be done.
Frank Bretz (Global Head Statistical Methodology group, Novartis, Basel, Switzerland)
Estimands and their role in clinical trials
Defining the primary objective of a clinical trial in the presence of non-compliance or non-adherence to the assigned treatment is crucial for the choice of design, the statistical analysis and the interpretation of the results. At first glance this seems obvious, however, primary objectives stated in clinical trial protocols often fail to give a precise definition of the measure of intervention effect. The impact of potential confounding, e.g. due to non-compliance, missing data, treatment switching / discontinuation or intake of rescue medication, is frequently not taken into account when defining the intervention effect of interest. The need for a structured framework to specify the primary estimand (i.e. “what is to be estimated”) was highlighted in the context of missing data in the National Academy of Science document "The Prevention and Treatment of Missing Data in Clinical Trials"(2010). However, the need for clearly defined estimands applies to a broader setting. In this talk we will discuss the need for this framework, using real and hypothetical examples.
James R Carpenter (Professor LSHTM and MRC Clinical Trials Unit)
Estimands, Randomisation and Sensitivity Analysis
The increased focus on estimands - not just for sensitivity analysis, but for the primary analysis - is a welcome development, because it helps clarify the assumptions necessary for the analysis, and which of them can be verified.
However, it does raise a number of questions: -
1. How tightly should the estimand be defined? In other words, when is a sensitivity analysis actually changing the estimand?
2. What is the role of randomisation based inference?
3. To what extent should we worry if the sensitivity analysis violates the assumptions of the primary analysis?
I will argue that the way we answer these questions lead us to two different paradigms:
(a) Follow the established approach, where the primary analysis does not model deviations, and explore how robust inferences are to different assumptions about post-deviation behaviour
(b) Adopt a more formal causal approach to the primary analysis, in which the deviation process is explicitly accounted for.
If we shift to (b), we are moving decisively away from randomisation based inference. If we want to do this, it should be intentional, not accidental!
Plamen Kozlovski (Associate Global Program Medical Director at Novartis Pharma AG)
Estimands in Diabetes Trials – what are different stakeholders interested in?
Diabetes is a progressive disease which is associated with serious complications resulting from chronic exposure to elevated blood glucose levels and other metabolic abnormalities. Good blood glucose control assessed by glycated haemoglobin (HbA1C) is a key goal of treatment, as it has been demonstrated that near-normalization in HbA1c can prevent or delay the diabetic complications. This goal should be achieved without deterioration of the quality of life. However, when it comes to decision-making on priorities, the different parties involved in diabetes care – patients, health professionals, regulatory agencies, payers and pharmaceutical companies - may have different perspectives and needs. These differences in perspectives may imply different estimands – this may lead to challenges when designing a clinical development programme that aims to address the needs of all stakeholders.
Chrissie Fletcher (Executive Director, Global Biostatistical Science, Amgen Ltd, UK):
The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry
In recent years, there have been different perspectives emerging between regulators and Industry in terms of what estimand and measure of the intervention effect is of primary interest to be estimated for confirmatory trials supporting Marketing authorisations. Choices made in how to deal with non-adherence issues, such as missing data or taking rescue medication, in the study design and planned analyses influences what is actually being estimated in the clinical trial. In addition, sensitivity analyses conducted to support the conclusions from confirmatory trials can sometimes be misaligned with the estimand of primary interest, leading to difficulties in interpretation of results from confirmatory trials. The results of a recent survey conducted by the ICH E9 working group who are developing the addendum will be presented highlighting current practices relating to choices of primary estimands, techniques for preventing and minimising missing data, and common sensitivity analyses used to support primary analyses. Challenges with current practice in these areas and recommendations for overcoming these challenges will be discussed. A summary of key topics debated in the ICH E9 working group will be provided including considerations for how the addendum will align with the current ICH E9 guidance.
James Roger (Director, LiveData (UK) Ltd)
Whether to use MMRM as primary estimand.
There are two main impacts of early withdrawal on study results; first the potential selection bias caused by those withdrawing being different from the remaining subjects, and second the fact that subjects may receive alternative treatments after withdrawal. The most common method for handling early withdrawal in clinical studies is MMRM or some other form of missing at random (MAR) based analysis. The motivation behind MMRM is to solve the first issue while addressing an on-treatment question, i.e. what happens if a typical patient completes their assigned treatment. It does this by conditioning on the previous observations and other covariates that may inform on both missingness and outcome. So what is the scientific question of interest, i.e. the estimand that it targets? This cannot be answered without considering the second aforementioned issue which is related to treatment switching or modification after withdrawal.
If the design of the study, in terms of treatment after withdrawal from randomized treatment, matches the estimand, then collection of data after treatment withdrawal allows direct analysis. Then later absolute study termination after switching (truly missing data) can be handled via a modified MMRM approach. But when the design of the study after treatment withdrawal does not match the estimand any analysis must depend upon additional unverifiable information or assumptions. This is a whole new area of potential statistical research. Several of the more recent proposals ignore the first issue of selection bias. Any coherent approach must address both issues.
Ann-Kristen Leuchs (Federal Institute for Drugs and Medical Devices, Bonn, Germany)
Estimands in clinical trials and how they influence trial planning: a regulatory view
Estimands, which are precise definitions of that which is being estimated, are currently discussed in clinical research, especially in cases where post-randomization events such as non-adherence to treatment complicate the interpretation of trial results. Considering suitable estimands addressing the desired objectives and satisfying regulatory requirements is only the first step in appropriately planning clinical trials. The choice of estimand has consequences for various other factors to be considered during any trial’s planning phase. After deciding on the primary estimand, a trial design that enables addressing this estimand should be discussed. This, for example, includes considering measures to enhance retrieval of data or adherence to treatment. Following the specification of an appropriate design, an adequate primary analysis method that directly addresses the chosen estimand is to be selected including the use of retrieved data and missing data handling. The robustness of the primary analysis to deviations from its assumptions should be addressed in a final step by defining sensitivity analyses still addressing the primary estimand but using a different set of assumptions (internal validity). Moreover, sensitivity analyses aiming at alternative estimands can be considered to address the robustness with respect to the generalizability of results (external validity). This process is proposed as a suitable way to incorporate estimands in clinical development and illustrated with relevant examples from clinical practice and regulatory experience.
Registration Costs
Fee includes lunch & refreshments
* event is co-organised by PSI and
located in the UK
For information regarding the scientific content, contact:
Carly Barnett
Tel: +44 208 990 3781
Carly.m.barnett@gsk.com
Egbert Biesheuvel
Tel: +31 6 46869728
Egbert.biesheuvel@danone.com
VENUE GSK at Stevenage Gunnels Wood Road Stevenage Hertfordshire SG1 2NY United Kingdom
Monday 28th September 2015, Hertfordshire
Please click below to see the speaker slides from the meeting:
Rob Hemmings
AnnKristinLeuchs
Chrissie Fletcher
Frank Bretz
James Carpenter
JamesRoger
Controversy and confusion exist on the definition and selection of appropriate estimands in the clinical trial context.
As a result the ICH Steering Committee endorsed a final Concept Paper in October 2014 with the goal of developing a new regulatory guidance, suggested to be an Addendum to ICH E9. The aim of the addendum is to promote harmonised standards on the choice of estimands in clinical trials and an agreed framework for planning, conducting and interpreting sensitivity analyses of clinical trial data. A working group sponsored by ICH has been established to develop the addendum and is due to report findings in December 2015.
This meeting will provide a forum to hear about the latest developments and discussions on this topic. Speakers include members of the ICH working group as well as representatives from academia, European regulatory bodies and industry. The day will end with a panel discussion including all speakers.
Presenters include:
Rob Hemmings
Statistics and Pharmacokinetics Unit Manager, MHRA, UK
Ann-Kristen Leuchs
Federal Institute for Drugs and Medical Devices, Bonn, Germany
Chrissie Fletcher
Executive Director, Global Biostatistical Science, Amgen Ltd, UK
Frank Bretz
Global Head Statistical Methodology group, Novartis, Basel, Switzerland
James Carpenter
Professor, London School of Hygiene and Tropical Medicine, UK
James Roger
Director, LiveData (UK) Ltd
| 8.45-9.10 | Arrival/Registration and Coffee |
|
| 9.10-9.15 | Welcome and introduction |
|
| 9.15-10.00 | Robert Hemmings (MHRA) | Estimands at ICH |
| 10.00-10.45 | Frank Bretz (Novartis) | Estimands and their role in clinical trials |
| 10.45-11.00 | Coffee |
|
| 11.00-11.45 | James Carpenter (LSHTM & MRC) | Estimands, Randomisation and Sensitivity Analysis |
| 11.45-12.30 | Plamen Kozlovski (Medical Director at Novartis) | Estimands in Diabetes Trials – what are different stakeholders interested in? |
| 12.30-1.30 | Lunch |
|
| 1.30-2.15 | Chrissie Fletcher (Amgen) | The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry |
| 2.15-3.00 | James Roger (Livedata) | Whether to use MMRM as primary estimand. |
| 3.00-3.15 | Coffee |
|
| 3.15-4.00 | Ann-Kristen Leuchs (BfArM) | Estimands in clinical trials and how they influence trial planning: a regulatory view |
| 4.00-4.30 | Panel Discussion |
|
| 4.30 | Close |
|
Abstracts
Rob Hemmings (Statistics and Pharmacokinetics Unit Manager, MHRA, UK)
Estimands at ICH
After a number of years discussing the problem of ‘missing data’, solutions arose and became widespread practice, but these solutions seemed to violate the ITT principle as it is described in ICH E9. Attention turned to identifying a precise answer to the question ‘what should we seek to estimate to demonstrate drug effects in a clinical trial’? The breadth of this question called for an answer on a global scale and hence a concept paper was drafted, and eventually adopted, for a group to draft an addendum to ICH E9. The talk will provide some more background on how the discussions came to be, the ICH process, the future plans of the group for developing the guidance and some initial thoughts from one regulator on what might be achieved and where further research work still needs to be done.
Frank Bretz (Global Head Statistical Methodology group, Novartis, Basel, Switzerland)
Estimands and their role in clinical trials
Defining the primary objective of a clinical trial in the presence of non-compliance or non-adherence to the assigned treatment is crucial for the choice of design, the statistical analysis and the interpretation of the results. At first glance this seems obvious, however, primary objectives stated in clinical trial protocols often fail to give a precise definition of the measure of intervention effect. The impact of potential confounding, e.g. due to non-compliance, missing data, treatment switching / discontinuation or intake of rescue medication, is frequently not taken into account when defining the intervention effect of interest. The need for a structured framework to specify the primary estimand (i.e. “what is to be estimated”) was highlighted in the context of missing data in the National Academy of Science document "The Prevention and Treatment of Missing Data in Clinical Trials"(2010). However, the need for clearly defined estimands applies to a broader setting. In this talk we will discuss the need for this framework, using real and hypothetical examples.
James R Carpenter (Professor LSHTM and MRC Clinical Trials Unit)
Estimands, Randomisation and Sensitivity Analysis
The increased focus on estimands - not just for sensitivity analysis, but for the primary analysis - is a welcome development, because it helps clarify the assumptions necessary for the analysis, and which of them can be verified.
However, it does raise a number of questions: -
1. How tightly should the estimand be defined? In other words, when is a sensitivity analysis actually changing the estimand?
2. What is the role of randomisation based inference?
3. To what extent should we worry if the sensitivity analysis violates the assumptions of the primary analysis?
I will argue that the way we answer these questions lead us to two different paradigms:
(a) Follow the established approach, where the primary analysis does not model deviations, and explore how robust inferences are to different assumptions about post-deviation behaviour
(b) Adopt a more formal causal approach to the primary analysis, in which the deviation process is explicitly accounted for.
If we shift to (b), we are moving decisively away from randomisation based inference. If we want to do this, it should be intentional, not accidental!
Plamen Kozlovski (Associate Global Program Medical Director at Novartis Pharma AG)
Estimands in Diabetes Trials – what are different stakeholders interested in?
Diabetes is a progressive disease which is associated with serious complications resulting from chronic exposure to elevated blood glucose levels and other metabolic abnormalities. Good blood glucose control assessed by glycated haemoglobin (HbA1C) is a key goal of treatment, as it has been demonstrated that near-normalization in HbA1c can prevent or delay the diabetic complications. This goal should be achieved without deterioration of the quality of life. However, when it comes to decision-making on priorities, the different parties involved in diabetes care – patients, health professionals, regulatory agencies, payers and pharmaceutical companies - may have different perspectives and needs. These differences in perspectives may imply different estimands – this may lead to challenges when designing a clinical development programme that aims to address the needs of all stakeholders.
Chrissie Fletcher (Executive Director, Global Biostatistical Science, Amgen Ltd, UK):
The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry
In recent years, there have been different perspectives emerging between regulators and Industry in terms of what estimand and measure of the intervention effect is of primary interest to be estimated for confirmatory trials supporting Marketing authorisations. Choices made in how to deal with non-adherence issues, such as missing data or taking rescue medication, in the study design and planned analyses influences what is actually being estimated in the clinical trial. In addition, sensitivity analyses conducted to support the conclusions from confirmatory trials can sometimes be misaligned with the estimand of primary interest, leading to difficulties in interpretation of results from confirmatory trials. The results of a recent survey conducted by the ICH E9 working group who are developing the addendum will be presented highlighting current practices relating to choices of primary estimands, techniques for preventing and minimising missing data, and common sensitivity analyses used to support primary analyses. Challenges with current practice in these areas and recommendations for overcoming these challenges will be discussed. A summary of key topics debated in the ICH E9 working group will be provided including considerations for how the addendum will align with the current ICH E9 guidance.
James Roger (Director, LiveData (UK) Ltd)
Whether to use MMRM as primary estimand.
There are two main impacts of early withdrawal on study results; first the potential selection bias caused by those withdrawing being different from the remaining subjects, and second the fact that subjects may receive alternative treatments after withdrawal. The most common method for handling early withdrawal in clinical studies is MMRM or some other form of missing at random (MAR) based analysis. The motivation behind MMRM is to solve the first issue while addressing an on-treatment question, i.e. what happens if a typical patient completes their assigned treatment. It does this by conditioning on the previous observations and other covariates that may inform on both missingness and outcome. So what is the scientific question of interest, i.e. the estimand that it targets? This cannot be answered without considering the second aforementioned issue which is related to treatment switching or modification after withdrawal.
If the design of the study, in terms of treatment after withdrawal from randomized treatment, matches the estimand, then collection of data after treatment withdrawal allows direct analysis. Then later absolute study termination after switching (truly missing data) can be handled via a modified MMRM approach. But when the design of the study after treatment withdrawal does not match the estimand any analysis must depend upon additional unverifiable information or assumptions. This is a whole new area of potential statistical research. Several of the more recent proposals ignore the first issue of selection bias. Any coherent approach must address both issues.
Ann-Kristen Leuchs (Federal Institute for Drugs and Medical Devices, Bonn, Germany)
Estimands in clinical trials and how they influence trial planning: a regulatory view
Estimands, which are precise definitions of that which is being estimated, are currently discussed in clinical research, especially in cases where post-randomization events such as non-adherence to treatment complicate the interpretation of trial results. Considering suitable estimands addressing the desired objectives and satisfying regulatory requirements is only the first step in appropriately planning clinical trials. The choice of estimand has consequences for various other factors to be considered during any trial’s planning phase. After deciding on the primary estimand, a trial design that enables addressing this estimand should be discussed. This, for example, includes considering measures to enhance retrieval of data or adherence to treatment. Following the specification of an appropriate design, an adequate primary analysis method that directly addresses the chosen estimand is to be selected including the use of retrieved data and missing data handling. The robustness of the primary analysis to deviations from its assumptions should be addressed in a final step by defining sensitivity analyses still addressing the primary estimand but using a different set of assumptions (internal validity). Moreover, sensitivity analyses aiming at alternative estimands can be considered to address the robustness with respect to the generalizability of results (external validity). This process is proposed as a suitable way to incorporate estimands in clinical development and illustrated with relevant examples from clinical practice and regulatory experience.
Registration Costs
Fee includes lunch & refreshments
* event is co-organised by PSI and
located in the UK
For information regarding the scientific content, contact:
Carly Barnett
Tel: +44 208 990 3781
Carly.m.barnett@gsk.com
Egbert Biesheuvel
Tel: +31 6 46869728
Egbert.biesheuvel@danone.com
VENUE GSK at Stevenage Gunnels Wood Road Stevenage Hertfordshire SG1 2NY United Kingdom
Monday 28th September 2015, Hertfordshire
Please click below to see the speaker slides from the meeting:
Rob Hemmings
AnnKristinLeuchs
Chrissie Fletcher
Frank Bretz
James Carpenter
JamesRoger
Controversy and confusion exist on the definition and selection of appropriate estimands in the clinical trial context.
As a result the ICH Steering Committee endorsed a final Concept Paper in October 2014 with the goal of developing a new regulatory guidance, suggested to be an Addendum to ICH E9. The aim of the addendum is to promote harmonised standards on the choice of estimands in clinical trials and an agreed framework for planning, conducting and interpreting sensitivity analyses of clinical trial data. A working group sponsored by ICH has been established to develop the addendum and is due to report findings in December 2015.
This meeting will provide a forum to hear about the latest developments and discussions on this topic. Speakers include members of the ICH working group as well as representatives from academia, European regulatory bodies and industry. The day will end with a panel discussion including all speakers.
Presenters include:
Rob Hemmings
Statistics and Pharmacokinetics Unit Manager, MHRA, UK
Ann-Kristen Leuchs
Federal Institute for Drugs and Medical Devices, Bonn, Germany
Chrissie Fletcher
Executive Director, Global Biostatistical Science, Amgen Ltd, UK
Frank Bretz
Global Head Statistical Methodology group, Novartis, Basel, Switzerland
James Carpenter
Professor, London School of Hygiene and Tropical Medicine, UK
James Roger
Director, LiveData (UK) Ltd
| 8.45-9.10 | Arrival/Registration and Coffee |
|
| 9.10-9.15 | Welcome and introduction |
|
| 9.15-10.00 | Robert Hemmings (MHRA) | Estimands at ICH |
| 10.00-10.45 | Frank Bretz (Novartis) | Estimands and their role in clinical trials |
| 10.45-11.00 | Coffee |
|
| 11.00-11.45 | James Carpenter (LSHTM & MRC) | Estimands, Randomisation and Sensitivity Analysis |
| 11.45-12.30 | Plamen Kozlovski (Medical Director at Novartis) | Estimands in Diabetes Trials – what are different stakeholders interested in? |
| 12.30-1.30 | Lunch |
|
| 1.30-2.15 | Chrissie Fletcher (Amgen) | The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry |
| 2.15-3.00 | James Roger (Livedata) | Whether to use MMRM as primary estimand. |
| 3.00-3.15 | Coffee |
|
| 3.15-4.00 | Ann-Kristen Leuchs (BfArM) | Estimands in clinical trials and how they influence trial planning: a regulatory view |
| 4.00-4.30 | Panel Discussion |
|
| 4.30 | Close |
|
Abstracts
Rob Hemmings (Statistics and Pharmacokinetics Unit Manager, MHRA, UK)
Estimands at ICH
After a number of years discussing the problem of ‘missing data’, solutions arose and became widespread practice, but these solutions seemed to violate the ITT principle as it is described in ICH E9. Attention turned to identifying a precise answer to the question ‘what should we seek to estimate to demonstrate drug effects in a clinical trial’? The breadth of this question called for an answer on a global scale and hence a concept paper was drafted, and eventually adopted, for a group to draft an addendum to ICH E9. The talk will provide some more background on how the discussions came to be, the ICH process, the future plans of the group for developing the guidance and some initial thoughts from one regulator on what might be achieved and where further research work still needs to be done.
Frank Bretz (Global Head Statistical Methodology group, Novartis, Basel, Switzerland)
Estimands and their role in clinical trials
Defining the primary objective of a clinical trial in the presence of non-compliance or non-adherence to the assigned treatment is crucial for the choice of design, the statistical analysis and the interpretation of the results. At first glance this seems obvious, however, primary objectives stated in clinical trial protocols often fail to give a precise definition of the measure of intervention effect. The impact of potential confounding, e.g. due to non-compliance, missing data, treatment switching / discontinuation or intake of rescue medication, is frequently not taken into account when defining the intervention effect of interest. The need for a structured framework to specify the primary estimand (i.e. “what is to be estimated”) was highlighted in the context of missing data in the National Academy of Science document "The Prevention and Treatment of Missing Data in Clinical Trials"(2010). However, the need for clearly defined estimands applies to a broader setting. In this talk we will discuss the need for this framework, using real and hypothetical examples.
James R Carpenter (Professor LSHTM and MRC Clinical Trials Unit)
Estimands, Randomisation and Sensitivity Analysis
The increased focus on estimands - not just for sensitivity analysis, but for the primary analysis - is a welcome development, because it helps clarify the assumptions necessary for the analysis, and which of them can be verified.
However, it does raise a number of questions: -
1. How tightly should the estimand be defined? In other words, when is a sensitivity analysis actually changing the estimand?
2. What is the role of randomisation based inference?
3. To what extent should we worry if the sensitivity analysis violates the assumptions of the primary analysis?
I will argue that the way we answer these questions lead us to two different paradigms:
(a) Follow the established approach, where the primary analysis does not model deviations, and explore how robust inferences are to different assumptions about post-deviation behaviour
(b) Adopt a more formal causal approach to the primary analysis, in which the deviation process is explicitly accounted for.
If we shift to (b), we are moving decisively away from randomisation based inference. If we want to do this, it should be intentional, not accidental!
Plamen Kozlovski (Associate Global Program Medical Director at Novartis Pharma AG)
Estimands in Diabetes Trials – what are different stakeholders interested in?
Diabetes is a progressive disease which is associated with serious complications resulting from chronic exposure to elevated blood glucose levels and other metabolic abnormalities. Good blood glucose control assessed by glycated haemoglobin (HbA1C) is a key goal of treatment, as it has been demonstrated that near-normalization in HbA1c can prevent or delay the diabetic complications. This goal should be achieved without deterioration of the quality of life. However, when it comes to decision-making on priorities, the different parties involved in diabetes care – patients, health professionals, regulatory agencies, payers and pharmaceutical companies - may have different perspectives and needs. These differences in perspectives may imply different estimands – this may lead to challenges when designing a clinical development programme that aims to address the needs of all stakeholders.
Chrissie Fletcher (Executive Director, Global Biostatistical Science, Amgen Ltd, UK):
The importance of the proposed ICH E9 addendum on estimands and sensitivity analyses to the Pharmaceutical Industry
In recent years, there have been different perspectives emerging between regulators and Industry in terms of what estimand and measure of the intervention effect is of primary interest to be estimated for confirmatory trials supporting Marketing authorisations. Choices made in how to deal with non-adherence issues, such as missing data or taking rescue medication, in the study design and planned analyses influences what is actually being estimated in the clinical trial. In addition, sensitivity analyses conducted to support the conclusions from confirmatory trials can sometimes be misaligned with the estimand of primary interest, leading to difficulties in interpretation of results from confirmatory trials. The results of a recent survey conducted by the ICH E9 working group who are developing the addendum will be presented highlighting current practices relating to choices of primary estimands, techniques for preventing and minimising missing data, and common sensitivity analyses used to support primary analyses. Challenges with current practice in these areas and recommendations for overcoming these challenges will be discussed. A summary of key topics debated in the ICH E9 working group will be provided including considerations for how the addendum will align with the current ICH E9 guidance.
James Roger (Director, LiveData (UK) Ltd)
Whether to use MMRM as primary estimand.
There are two main impacts of early withdrawal on study results; first the potential selection bias caused by those withdrawing being different from the remaining subjects, and second the fact that subjects may receive alternative treatments after withdrawal. The most common method for handling early withdrawal in clinical studies is MMRM or some other form of missing at random (MAR) based analysis. The motivation behind MMRM is to solve the first issue while addressing an on-treatment question, i.e. what happens if a typical patient completes their assigned treatment. It does this by conditioning on the previous observations and other covariates that may inform on both missingness and outcome. So what is the scientific question of interest, i.e. the estimand that it targets? This cannot be answered without considering the second aforementioned issue which is related to treatment switching or modification after withdrawal.
If the design of the study, in terms of treatment after withdrawal from randomized treatment, matches the estimand, then collection of data after treatment withdrawal allows direct analysis. Then later absolute study termination after switching (truly missing data) can be handled via a modified MMRM approach. But when the design of the study after treatment withdrawal does not match the estimand any analysis must depend upon additional unverifiable information or assumptions. This is a whole new area of potential statistical research. Several of the more recent proposals ignore the first issue of selection bias. Any coherent approach must address both issues.
Ann-Kristen Leuchs (Federal Institute for Drugs and Medical Devices, Bonn, Germany)
Estimands in clinical trials and how they influence trial planning: a regulatory view
Estimands, which are precise definitions of that which is being estimated, are currently discussed in clinical research, especially in cases where post-randomization events such as non-adherence to treatment complicate the interpretation of trial results. Considering suitable estimands addressing the desired objectives and satisfying regulatory requirements is only the first step in appropriately planning clinical trials. The choice of estimand has consequences for various other factors to be considered during any trial’s planning phase. After deciding on the primary estimand, a trial design that enables addressing this estimand should be discussed. This, for example, includes considering measures to enhance retrieval of data or adherence to treatment. Following the specification of an appropriate design, an adequate primary analysis method that directly addresses the chosen estimand is to be selected including the use of retrieved data and missing data handling. The robustness of the primary analysis to deviations from its assumptions should be addressed in a final step by defining sensitivity analyses still addressing the primary estimand but using a different set of assumptions (internal validity). Moreover, sensitivity analyses aiming at alternative estimands can be considered to address the robustness with respect to the generalizability of results (external validity). This process is proposed as a suitable way to incorporate estimands in clinical development and illustrated with relevant examples from clinical practice and regulatory experience.
Registration Costs
Fee includes lunch & refreshments
* event is co-organised by PSI and
located in the UK
For information regarding the scientific content, contact:
Carly Barnett
Tel: +44 208 990 3781
Carly.m.barnett@gsk.com
Egbert Biesheuvel
Tel: +31 6 46869728
Egbert.biesheuvel@danone.com
An introductory course giving an overview of the pharmaceutical industry and the drug development process as a whole, aimed at those with 1-3 years' experience. It comprises of six 2-day sessions covering a range of topics including Research and Development, Toxicology, Data Management and the Role of a CRO, Clinical Trials, Reimbursement, and Marketing.
Our monthly webinar explores examples of innovative data visualisations relevant to our day to day work. Each month a new dataset is provided from a clinical trial or other relevant example, and participants are invited to submit a graphic that communicates interesting and relevant characteristics of the data.
The book club’s usual focus is to read and discuss professional development books. In this short format event you can more easily develop you career without the commitment of reading the whole book - simply listen to the 1-hour long podcast before joining the interactive session on 21 May.
This webinar is organised by the RWD SIG and the Historical Data SIG. We will review recent methods, applications, and tools of integrating subject-level-data from clinical trial with external data using Bayesian methods and/or causal inference methods.
This networking event is aimed at statisticians that are new to the pharmaceutical industry who wish to meet colleagues from different companies and backgrounds.
This will be a 45 minute webinar which will explain the topic presented in the published paper, ‘Applying the Estimand Framework to Clinical Pharmacology Trials with a Case Study in Bioequivalance’. There will be 15 minutes for a panel Q&A with some of the authors following the presentation.
This 1-hour webinar will be an opportunity to hear about the methodology and first results of the iRISE consortium. iRISE is working towards a better understanding of reproducibility and the interventions that work to improve it. At the end of the presentation there will also be the opportunity to ask questions.
This one-day event focuses on the comprehensive management of transitioning to R/Open-Source, addressing the challenges and providing actionable insights. Attendees will participate in sessions covering essential topics such as training best practices, creating strategic plans, making the case to senior management, and managing both statistical and programming aspects of the transition.
This course is aimed at biostatisticians with no or some pediatric drug development experience who are interested to further their understanding. We will give you an introduction to the pediatric drug development landscape. This will include identifying the key regulations and processes governing pediatric development, a discussion on the needs and challenges when conducting pediatric research and a focus on the ways to overcome these challenges from a statistical perspective.
This networking event is aimed at statisticians that are new to the pharmaceutical industry who wish to meet colleagues from different companies and backgrounds.
The program will feature insightful sessions led by distinguished invited speakers, alongside a poster session showcasing the latest advancements in the field. Further details will be provided.
This networking event is aimed at statisticians that are new to the pharmaceutical industry who wish to meet colleagues from different companies and backgrounds.
The Institute of Cancer Research are seeking to appoint a Research Group Leader to join The CRUK Clinical Trials and Statistics Unit at the ICR.
This is an exciting, new opportunity for an experienced Statistician looking to take the next step in their career. Offered as a remote or hybrid position aligned with our site in Harrogate, North Yorkshire.
The BioMarin internship programme will enable students to gain valuable experience and knowledge of the processes and systems within BioMarin, whilst gaining an insight into the pharmaceutical/biotech industry.
About cookies on this site
We use cookies to collect and analyse information on site performance and usage, to provide social media features and to enhance and customise content and advertisements.
About cookies on this site
Cookies used on the site are categorized and below you can read about each category and allow or deny some or all of them. When categories than have been previously allowed are disabled, all cookies assigned to that category will be removed from your browser. Additionally you can see a list of cookies assigned to each category and detailed information in the cookie declaration.
Necessary cookies
Some cookies are required to provide core functionality. The website won't function properly without these cookies and they are enabled by default and cannot be disabled.
CookieHub is a Consent Management Platform (CMP) which allows users to control storage and processing of personal information.
Cloudflare is a global network designed to make everything you connect to the Internet secure, private, fast, and reliable.
Amazon Web Services offers a broad set of global cloud-based products including compute, storage, databases, analytics, networking, mobile, developer tools, management tools, IoT, security, and enterprise applications.
Microsoft Azure is a cloud computing platform offering a wide range of services, including virtual machines, databases, and AI tools.
Preferences
Preference cookies enables the web site to remember information to customize how the web site looks or behaves for each user. This may include storing selected currency, region, language or color theme.
Analytical cookies
Analytical cookies help us improve our website by collecting and reporting information on its usage.
Google Analytics is a web analytics service offered by Google that tracks and reports website traffic.
Vimeo, Inc. is an American video hosting, sharing, services provider, and broadcaster. Vimeo focuses on the delivery of high-definition video across a range of devices.
Cookies used on the site are categorized and below you can read about each category and allow or deny some or all of them. When categories than have been previously allowed are disabled, all cookies assigned to that category will be removed from your browser. Additionally you can see a list of cookies assigned to each category and detailed information in the cookie declaration.
Necessary cookies
Some cookies are required to provide core functionality. The website won't function properly without these cookies and they are enabled by default and cannot be disabled.
| Name | Hostname | Vendor | Expiry |
|---|---|---|---|
| ARRAffinity | .psiweb.org | Session | |
This cookie is set by websites run on the Windows Azure cloud platform. It is used for load balancing to make sure the visitor page requests are routed to the same server in any browsing session. | |||
| ARRAffinitySameSite | .psiweb.org | Session | |
Used to distribute traffic to the website on several servers in order to optimize response times. | |||
| __cf_bm | .vimeo.com | Cloudflare, Inc. | 1 hour |
The __cf_bm cookie supports Cloudflare Bot Management by managing incoming traffic that matches criteria associated with bots. The cookie does not collect any personal data, and any information collected is subject to one-way encryption. | |||
| _cfuvid | .vimeo.com | Session | |
Used by Cloudflare WAF to distinguish individual users who share the same IP address and apply rate limits | |||
| __cf_bm | .glueup.com | Cloudflare, Inc. | 1 hour |
The __cf_bm cookie supports Cloudflare Bot Management by managing incoming traffic that matches criteria associated with bots. The cookie does not collect any personal data, and any information collected is subject to one-way encryption. | |||
| AWSALBTGCORS | psi.glueup.com | 7 days | |
AWS Classic Load Balancer Cookie: Load Balancing Cookie: Used to map the session to the instance. Same value as AWSELB. | |||
| PHPSESSID | psi.glueup.com | Session | |
Cookie generated by applications based on the PHP language. This is a general purpose identifier used to maintain user session variables. It is normally a random generated number, how it is used can be specific to the site, but a good example is maintaining a logged-in status for a user between pages. | |||
| History.store | Session | ||
| cookiehub | .psiweb.org | CookieHub | 365 days |
Used by CookieHub to store information about whether visitors have given or declined the use of cookie categories used on the site. | |||
Preferences
Preference cookies enables the web site to remember information to customize how the web site looks or behaves for each user. This may include storing selected currency, region, language or color theme.
| Name | Hostname | Vendor | Expiry |
|---|---|---|---|
| vuid | .vimeo.com | 400 days | |
These cookies are used by the Vimeo video player on websites. | |||
| AWSALBCORS | psi.glueup.com | 7 days | |
Amazon Web Services cookie. This cookie enables us to allocate server traffic to make the user experience as smooth as possible. A so-called load balancer is used to determine which server currently has the best availability. The information generated cannot identify you as an individual. | |||
Analytical cookies
Analytical cookies help us improve our website by collecting and reporting information on its usage.
| Name | Hostname | Vendor | Expiry |
|---|---|---|---|
| _ga_ | .psiweb.org | 400 days | |
Contains a unique identifier used by Google Analytics 4 to determine that two distinct hits belong to the same user across browsing sessions. | |||
| _ga | .psiweb.org | 400 days | |
Contains a unique identifier used by Google Analytics to determine that two distinct hits belong to the same user across browsing sessions. | |||
