Date: Thursday 7th December 2023 Time: 13:00-14:30 GMT | 14:00-15:30 CET Speakers: Robert Hemmings (Consilium Salmonson & Hemmings), Antonio Remiro-Azócar (Bayer) and Nicholas Latimer (University of Sheffield).
Who is this event intended for? Regulatory and HTA statisticians. Anybody interested in the new EU HTA regulation.
What is the benefit of attending? Learn about the multiple frameworks used to define a research question and the context in which they are used. Discuss how they may complement each other in light of the new EU HTA regulation.
Registration
This event is free to attend, for both Members and Non-Members of PSI.
To register your place for this event, please click here.
Overview
Over the past years, areas of clinical development and patient access / health technology assessment (HTA) have moved closer together. However, both areas differ in how they approach their respective research or policy questions. While the estimand framework is being the focus in clinical development, HTA is being viewed through the lens of the PICO framework. This might lead to mutual misunderstandings and ultimately prevent timely patient access due to evidence gaps. Additionally, the Target Trial Emulation framework has become popular in the Real-World Data setting to translate research questions into a meaningful design, and share some commonalities with the estimand and PICO frameworks.
For randomized controlled trials (RCTs) in the regulatory setting, the estimand framework has been introduced and stimulated by the publication of the International Council of Harmonisation (ICH) E9 (R1) Addendum [1]. It is recognized by regulatory agencies such as EMA and the Food and Drug Administration (FDA). According to ICH guidance, an estimand is defined on the basis of five attributes: (1) treatment(s); (2) target population; (3) clinical outcome of interest; (4) population-level summary effect measure; and (5) strategy for intercurrent (post-randomization) events.
In HTA, the PICO framework is typically used to translate policy questions into research questions. PICOs consist of five components: (1) population; (2) intervention; (3) comparator(s); and (4) outcome. During the reimbursement process, the manufacturer typically submits an evidence dossier that addresses the research questions(s) included in the scope. Best-practice guidelines recommend specifying relevant PICO question(s) in the HTA scoping process [2]. In evidence synthesis, PICO questions are often formulated prior to the analysis in order to guide the data extraction required for systematic literature reviews [3].
The Target Trial Emulation (TTE), developed by Hernan et al. (2016) [3], is a framework proposed for Real-World Data studies to minimize common biases due to selection or confounding. TTE is a two-step process, whereby a protocol for an hypothetical RCT that would answer the question of interest is developed; This protocol is applied to the Real-World Data so that it mimics the data that would have been gathered for the RCT [5]. In this framework, eligibility criteria, treatment strategies, assignment procedures, follow-up period, outcome, causal contrasts of interest and analysis plan should be specified. Gomes, Latimer, Soares et al., in [4], discusses opportunities and challenges of using TTE with Real-World-Data in the HTA context.
In this webinar series, we will compare and contrast all three frameworks and discuss how they may complement each other, also in light of the new EU HTA regulation.
This webinar brings together Antonio Remiro-Azocar, Robert Hemmings and Nicholas Latimer, who are renowned experts in the respective fields. They will provide an introduction to these three concepts, illustrated with examples, thus enabling a solid understanding of these frameworks as well as their communalities and differences. A Q&A session will provide opportunities for the audience to engage with the speakers and clarify any questions.
Robert Hemmings is currently partner at Consilium Salmonson & Hemmings and has deep expertise in global clinical trial design, critical appraisal of clinical trial data and regulatory affairs. He was head of the group of statisticians and pharmacokineticists at the Medicines and Healthcare Products Regulatory Agency (MHRA) in the UK for nearly 20 years. He has been a member of the Committee for Medicinal Products for Human Use (CHMP) at the EMA for 11 years, has chaired EMA’s Scientific Advice Working Party 8 years, and chaired and served on EMA’s groups for biostatistics, modelling and simulation and extrapolation. Hemmings also represented the EU and was the Rapporteur for the revision of the ICH guideline E9 (R)1 addendum on estimands and sensitivity analysis in clinical trials, to the guideline on statistical principles for clinical trials. Additionally, he has involvement in multiple initiatives related to innovation in clinical trial design and regulatory strategy including, EMA’s Priority Medicines (PRIME) scheme for unmet medical needs, adaptable pathways, and accelerated access pathways in the UK.
Nicholas Latimer
Nicholas Latimer is professor of Health Economics at the School of Medicine and Population Health of the University of Sheffield, UK. His research interests focus on economic evaluation methodology, with a particular emphasis on the incorporation of survival analysis within economic models. Professor Latimer is especially interested in the use of causal inference methods to estimate comparative effectiveness in clinical trials confounded by treatment switching, and in observational (or “Big”, or “Real World”) data.
Professor Latimer is currently undertaking a Senior Research Fellowship funded by Yorkshire Cancer Research. During this Fellowship, his focus is on investigating the use of cancer registry datasets to estimate the comparative effectiveness of cancer treatments used in the NHS.
Antonio Remiro-Azócar
Antonio is Lead Medical Affairs Statistician at Bayer, specializing in health technology assessment (HTA), health economics and outcomes research (HEOR), and observational studies. At Bayer, Antonio leads cross-functional teams in providing inputs to life-cycle management strategies, publication plans, reimbursement requirements, HTA studies and analyses for payers, across a number of therapeutic areas. Prior to his current role, Antonio provided support on the statistical aspects of evidence synthesis, HTA and HEOR to contract research organizations such as IQVIA and ICON plc, and public bodies such as SickKids. Antonio holds a PhD in Statistical Science and an MSc in Machine Learning from University College London.
Scientific Meetings
PSI HTA SIG Webinar: Estimands, PICOs and Co. - Are we losing or gaining in translation?
Date: Thursday 7th December 2023 Time: 13:00-14:30 GMT | 14:00-15:30 CET Speakers: Robert Hemmings (Consilium Salmonson & Hemmings), Antonio Remiro-Azócar (Bayer) and Nicholas Latimer (University of Sheffield).
Who is this event intended for? Regulatory and HTA statisticians. Anybody interested in the new EU HTA regulation.
What is the benefit of attending? Learn about the multiple frameworks used to define a research question and the context in which they are used. Discuss how they may complement each other in light of the new EU HTA regulation.
Registration
This event is free to attend, for both Members and Non-Members of PSI.
To register your place for this event, please click here.
Overview
Over the past years, areas of clinical development and patient access / health technology assessment (HTA) have moved closer together. However, both areas differ in how they approach their respective research or policy questions. While the estimand framework is being the focus in clinical development, HTA is being viewed through the lens of the PICO framework. This might lead to mutual misunderstandings and ultimately prevent timely patient access due to evidence gaps. Additionally, the Target Trial Emulation framework has become popular in the Real-World Data setting to translate research questions into a meaningful design, and share some commonalities with the estimand and PICO frameworks.
For randomized controlled trials (RCTs) in the regulatory setting, the estimand framework has been introduced and stimulated by the publication of the International Council of Harmonisation (ICH) E9 (R1) Addendum [1]. It is recognized by regulatory agencies such as EMA and the Food and Drug Administration (FDA). According to ICH guidance, an estimand is defined on the basis of five attributes: (1) treatment(s); (2) target population; (3) clinical outcome of interest; (4) population-level summary effect measure; and (5) strategy for intercurrent (post-randomization) events.
In HTA, the PICO framework is typically used to translate policy questions into research questions. PICOs consist of five components: (1) population; (2) intervention; (3) comparator(s); and (4) outcome. During the reimbursement process, the manufacturer typically submits an evidence dossier that addresses the research questions(s) included in the scope. Best-practice guidelines recommend specifying relevant PICO question(s) in the HTA scoping process [2]. In evidence synthesis, PICO questions are often formulated prior to the analysis in order to guide the data extraction required for systematic literature reviews [3].
The Target Trial Emulation (TTE), developed by Hernan et al. (2016) [3], is a framework proposed for Real-World Data studies to minimize common biases due to selection or confounding. TTE is a two-step process, whereby a protocol for an hypothetical RCT that would answer the question of interest is developed; This protocol is applied to the Real-World Data so that it mimics the data that would have been gathered for the RCT [5]. In this framework, eligibility criteria, treatment strategies, assignment procedures, follow-up period, outcome, causal contrasts of interest and analysis plan should be specified. Gomes, Latimer, Soares et al., in [4], discusses opportunities and challenges of using TTE with Real-World-Data in the HTA context.
In this webinar series, we will compare and contrast all three frameworks and discuss how they may complement each other, also in light of the new EU HTA regulation.
This webinar brings together Antonio Remiro-Azocar, Robert Hemmings and Nicholas Latimer, who are renowned experts in the respective fields. They will provide an introduction to these three concepts, illustrated with examples, thus enabling a solid understanding of these frameworks as well as their communalities and differences. A Q&A session will provide opportunities for the audience to engage with the speakers and clarify any questions.
Robert Hemmings is currently partner at Consilium Salmonson & Hemmings and has deep expertise in global clinical trial design, critical appraisal of clinical trial data and regulatory affairs. He was head of the group of statisticians and pharmacokineticists at the Medicines and Healthcare Products Regulatory Agency (MHRA) in the UK for nearly 20 years. He has been a member of the Committee for Medicinal Products for Human Use (CHMP) at the EMA for 11 years, has chaired EMA’s Scientific Advice Working Party 8 years, and chaired and served on EMA’s groups for biostatistics, modelling and simulation and extrapolation. Hemmings also represented the EU and was the Rapporteur for the revision of the ICH guideline E9 (R)1 addendum on estimands and sensitivity analysis in clinical trials, to the guideline on statistical principles for clinical trials. Additionally, he has involvement in multiple initiatives related to innovation in clinical trial design and regulatory strategy including, EMA’s Priority Medicines (PRIME) scheme for unmet medical needs, adaptable pathways, and accelerated access pathways in the UK.
Nicholas Latimer
Nicholas Latimer is professor of Health Economics at the School of Medicine and Population Health of the University of Sheffield, UK. His research interests focus on economic evaluation methodology, with a particular emphasis on the incorporation of survival analysis within economic models. Professor Latimer is especially interested in the use of causal inference methods to estimate comparative effectiveness in clinical trials confounded by treatment switching, and in observational (or “Big”, or “Real World”) data.
Professor Latimer is currently undertaking a Senior Research Fellowship funded by Yorkshire Cancer Research. During this Fellowship, his focus is on investigating the use of cancer registry datasets to estimate the comparative effectiveness of cancer treatments used in the NHS.
Antonio Remiro-Azócar
Antonio is Lead Medical Affairs Statistician at Bayer, specializing in health technology assessment (HTA), health economics and outcomes research (HEOR), and observational studies. At Bayer, Antonio leads cross-functional teams in providing inputs to life-cycle management strategies, publication plans, reimbursement requirements, HTA studies and analyses for payers, across a number of therapeutic areas. Prior to his current role, Antonio provided support on the statistical aspects of evidence synthesis, HTA and HEOR to contract research organizations such as IQVIA and ICON plc, and public bodies such as SickKids. Antonio holds a PhD in Statistical Science and an MSc in Machine Learning from University College London.
Training Courses
PSI HTA SIG Webinar: Estimands, PICOs and Co. - Are we losing or gaining in translation?
Date: Thursday 7th December 2023 Time: 13:00-14:30 GMT | 14:00-15:30 CET Speakers: Robert Hemmings (Consilium Salmonson & Hemmings), Antonio Remiro-Azócar (Bayer) and Nicholas Latimer (University of Sheffield).
Who is this event intended for? Regulatory and HTA statisticians. Anybody interested in the new EU HTA regulation.
What is the benefit of attending? Learn about the multiple frameworks used to define a research question and the context in which they are used. Discuss how they may complement each other in light of the new EU HTA regulation.
Registration
This event is free to attend, for both Members and Non-Members of PSI.
To register your place for this event, please click here.
Overview
Over the past years, areas of clinical development and patient access / health technology assessment (HTA) have moved closer together. However, both areas differ in how they approach their respective research or policy questions. While the estimand framework is being the focus in clinical development, HTA is being viewed through the lens of the PICO framework. This might lead to mutual misunderstandings and ultimately prevent timely patient access due to evidence gaps. Additionally, the Target Trial Emulation framework has become popular in the Real-World Data setting to translate research questions into a meaningful design, and share some commonalities with the estimand and PICO frameworks.
For randomized controlled trials (RCTs) in the regulatory setting, the estimand framework has been introduced and stimulated by the publication of the International Council of Harmonisation (ICH) E9 (R1) Addendum [1]. It is recognized by regulatory agencies such as EMA and the Food and Drug Administration (FDA). According to ICH guidance, an estimand is defined on the basis of five attributes: (1) treatment(s); (2) target population; (3) clinical outcome of interest; (4) population-level summary effect measure; and (5) strategy for intercurrent (post-randomization) events.
In HTA, the PICO framework is typically used to translate policy questions into research questions. PICOs consist of five components: (1) population; (2) intervention; (3) comparator(s); and (4) outcome. During the reimbursement process, the manufacturer typically submits an evidence dossier that addresses the research questions(s) included in the scope. Best-practice guidelines recommend specifying relevant PICO question(s) in the HTA scoping process [2]. In evidence synthesis, PICO questions are often formulated prior to the analysis in order to guide the data extraction required for systematic literature reviews [3].
The Target Trial Emulation (TTE), developed by Hernan et al. (2016) [3], is a framework proposed for Real-World Data studies to minimize common biases due to selection or confounding. TTE is a two-step process, whereby a protocol for an hypothetical RCT that would answer the question of interest is developed; This protocol is applied to the Real-World Data so that it mimics the data that would have been gathered for the RCT [5]. In this framework, eligibility criteria, treatment strategies, assignment procedures, follow-up period, outcome, causal contrasts of interest and analysis plan should be specified. Gomes, Latimer, Soares et al., in [4], discusses opportunities and challenges of using TTE with Real-World-Data in the HTA context.
In this webinar series, we will compare and contrast all three frameworks and discuss how they may complement each other, also in light of the new EU HTA regulation.
This webinar brings together Antonio Remiro-Azocar, Robert Hemmings and Nicholas Latimer, who are renowned experts in the respective fields. They will provide an introduction to these three concepts, illustrated with examples, thus enabling a solid understanding of these frameworks as well as their communalities and differences. A Q&A session will provide opportunities for the audience to engage with the speakers and clarify any questions.
Robert Hemmings is currently partner at Consilium Salmonson & Hemmings and has deep expertise in global clinical trial design, critical appraisal of clinical trial data and regulatory affairs. He was head of the group of statisticians and pharmacokineticists at the Medicines and Healthcare Products Regulatory Agency (MHRA) in the UK for nearly 20 years. He has been a member of the Committee for Medicinal Products for Human Use (CHMP) at the EMA for 11 years, has chaired EMA’s Scientific Advice Working Party 8 years, and chaired and served on EMA’s groups for biostatistics, modelling and simulation and extrapolation. Hemmings also represented the EU and was the Rapporteur for the revision of the ICH guideline E9 (R)1 addendum on estimands and sensitivity analysis in clinical trials, to the guideline on statistical principles for clinical trials. Additionally, he has involvement in multiple initiatives related to innovation in clinical trial design and regulatory strategy including, EMA’s Priority Medicines (PRIME) scheme for unmet medical needs, adaptable pathways, and accelerated access pathways in the UK.
Nicholas Latimer
Nicholas Latimer is professor of Health Economics at the School of Medicine and Population Health of the University of Sheffield, UK. His research interests focus on economic evaluation methodology, with a particular emphasis on the incorporation of survival analysis within economic models. Professor Latimer is especially interested in the use of causal inference methods to estimate comparative effectiveness in clinical trials confounded by treatment switching, and in observational (or “Big”, or “Real World”) data.
Professor Latimer is currently undertaking a Senior Research Fellowship funded by Yorkshire Cancer Research. During this Fellowship, his focus is on investigating the use of cancer registry datasets to estimate the comparative effectiveness of cancer treatments used in the NHS.
Antonio Remiro-Azócar
Antonio is Lead Medical Affairs Statistician at Bayer, specializing in health technology assessment (HTA), health economics and outcomes research (HEOR), and observational studies. At Bayer, Antonio leads cross-functional teams in providing inputs to life-cycle management strategies, publication plans, reimbursement requirements, HTA studies and analyses for payers, across a number of therapeutic areas. Prior to his current role, Antonio provided support on the statistical aspects of evidence synthesis, HTA and HEOR to contract research organizations such as IQVIA and ICON plc, and public bodies such as SickKids. Antonio holds a PhD in Statistical Science and an MSc in Machine Learning from University College London.
Journal Club
PSI HTA SIG Webinar: Estimands, PICOs and Co. - Are we losing or gaining in translation?
Date: Thursday 7th December 2023 Time: 13:00-14:30 GMT | 14:00-15:30 CET Speakers: Robert Hemmings (Consilium Salmonson & Hemmings), Antonio Remiro-Azócar (Bayer) and Nicholas Latimer (University of Sheffield).
Who is this event intended for? Regulatory and HTA statisticians. Anybody interested in the new EU HTA regulation.
What is the benefit of attending? Learn about the multiple frameworks used to define a research question and the context in which they are used. Discuss how they may complement each other in light of the new EU HTA regulation.
Registration
This event is free to attend, for both Members and Non-Members of PSI.
To register your place for this event, please click here.
Overview
Over the past years, areas of clinical development and patient access / health technology assessment (HTA) have moved closer together. However, both areas differ in how they approach their respective research or policy questions. While the estimand framework is being the focus in clinical development, HTA is being viewed through the lens of the PICO framework. This might lead to mutual misunderstandings and ultimately prevent timely patient access due to evidence gaps. Additionally, the Target Trial Emulation framework has become popular in the Real-World Data setting to translate research questions into a meaningful design, and share some commonalities with the estimand and PICO frameworks.
For randomized controlled trials (RCTs) in the regulatory setting, the estimand framework has been introduced and stimulated by the publication of the International Council of Harmonisation (ICH) E9 (R1) Addendum [1]. It is recognized by regulatory agencies such as EMA and the Food and Drug Administration (FDA). According to ICH guidance, an estimand is defined on the basis of five attributes: (1) treatment(s); (2) target population; (3) clinical outcome of interest; (4) population-level summary effect measure; and (5) strategy for intercurrent (post-randomization) events.
In HTA, the PICO framework is typically used to translate policy questions into research questions. PICOs consist of five components: (1) population; (2) intervention; (3) comparator(s); and (4) outcome. During the reimbursement process, the manufacturer typically submits an evidence dossier that addresses the research questions(s) included in the scope. Best-practice guidelines recommend specifying relevant PICO question(s) in the HTA scoping process [2]. In evidence synthesis, PICO questions are often formulated prior to the analysis in order to guide the data extraction required for systematic literature reviews [3].
The Target Trial Emulation (TTE), developed by Hernan et al. (2016) [3], is a framework proposed for Real-World Data studies to minimize common biases due to selection or confounding. TTE is a two-step process, whereby a protocol for an hypothetical RCT that would answer the question of interest is developed; This protocol is applied to the Real-World Data so that it mimics the data that would have been gathered for the RCT [5]. In this framework, eligibility criteria, treatment strategies, assignment procedures, follow-up period, outcome, causal contrasts of interest and analysis plan should be specified. Gomes, Latimer, Soares et al., in [4], discusses opportunities and challenges of using TTE with Real-World-Data in the HTA context.
In this webinar series, we will compare and contrast all three frameworks and discuss how they may complement each other, also in light of the new EU HTA regulation.
This webinar brings together Antonio Remiro-Azocar, Robert Hemmings and Nicholas Latimer, who are renowned experts in the respective fields. They will provide an introduction to these three concepts, illustrated with examples, thus enabling a solid understanding of these frameworks as well as their communalities and differences. A Q&A session will provide opportunities for the audience to engage with the speakers and clarify any questions.
Robert Hemmings is currently partner at Consilium Salmonson & Hemmings and has deep expertise in global clinical trial design, critical appraisal of clinical trial data and regulatory affairs. He was head of the group of statisticians and pharmacokineticists at the Medicines and Healthcare Products Regulatory Agency (MHRA) in the UK for nearly 20 years. He has been a member of the Committee for Medicinal Products for Human Use (CHMP) at the EMA for 11 years, has chaired EMA’s Scientific Advice Working Party 8 years, and chaired and served on EMA’s groups for biostatistics, modelling and simulation and extrapolation. Hemmings also represented the EU and was the Rapporteur for the revision of the ICH guideline E9 (R)1 addendum on estimands and sensitivity analysis in clinical trials, to the guideline on statistical principles for clinical trials. Additionally, he has involvement in multiple initiatives related to innovation in clinical trial design and regulatory strategy including, EMA’s Priority Medicines (PRIME) scheme for unmet medical needs, adaptable pathways, and accelerated access pathways in the UK.
Nicholas Latimer
Nicholas Latimer is professor of Health Economics at the School of Medicine and Population Health of the University of Sheffield, UK. His research interests focus on economic evaluation methodology, with a particular emphasis on the incorporation of survival analysis within economic models. Professor Latimer is especially interested in the use of causal inference methods to estimate comparative effectiveness in clinical trials confounded by treatment switching, and in observational (or “Big”, or “Real World”) data.
Professor Latimer is currently undertaking a Senior Research Fellowship funded by Yorkshire Cancer Research. During this Fellowship, his focus is on investigating the use of cancer registry datasets to estimate the comparative effectiveness of cancer treatments used in the NHS.
Antonio Remiro-Azócar
Antonio is Lead Medical Affairs Statistician at Bayer, specializing in health technology assessment (HTA), health economics and outcomes research (HEOR), and observational studies. At Bayer, Antonio leads cross-functional teams in providing inputs to life-cycle management strategies, publication plans, reimbursement requirements, HTA studies and analyses for payers, across a number of therapeutic areas. Prior to his current role, Antonio provided support on the statistical aspects of evidence synthesis, HTA and HEOR to contract research organizations such as IQVIA and ICON plc, and public bodies such as SickKids. Antonio holds a PhD in Statistical Science and an MSc in Machine Learning from University College London.
Webinars
PSI HTA SIG Webinar: Estimands, PICOs and Co. - Are we losing or gaining in translation?
Date: Thursday 7th December 2023 Time: 13:00-14:30 GMT | 14:00-15:30 CET Speakers: Robert Hemmings (Consilium Salmonson & Hemmings), Antonio Remiro-Azócar (Bayer) and Nicholas Latimer (University of Sheffield).
Who is this event intended for? Regulatory and HTA statisticians. Anybody interested in the new EU HTA regulation.
What is the benefit of attending? Learn about the multiple frameworks used to define a research question and the context in which they are used. Discuss how they may complement each other in light of the new EU HTA regulation.
Registration
This event is free to attend, for both Members and Non-Members of PSI.
To register your place for this event, please click here.
Overview
Over the past years, areas of clinical development and patient access / health technology assessment (HTA) have moved closer together. However, both areas differ in how they approach their respective research or policy questions. While the estimand framework is being the focus in clinical development, HTA is being viewed through the lens of the PICO framework. This might lead to mutual misunderstandings and ultimately prevent timely patient access due to evidence gaps. Additionally, the Target Trial Emulation framework has become popular in the Real-World Data setting to translate research questions into a meaningful design, and share some commonalities with the estimand and PICO frameworks.
For randomized controlled trials (RCTs) in the regulatory setting, the estimand framework has been introduced and stimulated by the publication of the International Council of Harmonisation (ICH) E9 (R1) Addendum [1]. It is recognized by regulatory agencies such as EMA and the Food and Drug Administration (FDA). According to ICH guidance, an estimand is defined on the basis of five attributes: (1) treatment(s); (2) target population; (3) clinical outcome of interest; (4) population-level summary effect measure; and (5) strategy for intercurrent (post-randomization) events.
In HTA, the PICO framework is typically used to translate policy questions into research questions. PICOs consist of five components: (1) population; (2) intervention; (3) comparator(s); and (4) outcome. During the reimbursement process, the manufacturer typically submits an evidence dossier that addresses the research questions(s) included in the scope. Best-practice guidelines recommend specifying relevant PICO question(s) in the HTA scoping process [2]. In evidence synthesis, PICO questions are often formulated prior to the analysis in order to guide the data extraction required for systematic literature reviews [3].
The Target Trial Emulation (TTE), developed by Hernan et al. (2016) [3], is a framework proposed for Real-World Data studies to minimize common biases due to selection or confounding. TTE is a two-step process, whereby a protocol for an hypothetical RCT that would answer the question of interest is developed; This protocol is applied to the Real-World Data so that it mimics the data that would have been gathered for the RCT [5]. In this framework, eligibility criteria, treatment strategies, assignment procedures, follow-up period, outcome, causal contrasts of interest and analysis plan should be specified. Gomes, Latimer, Soares et al., in [4], discusses opportunities and challenges of using TTE with Real-World-Data in the HTA context.
In this webinar series, we will compare and contrast all three frameworks and discuss how they may complement each other, also in light of the new EU HTA regulation.
This webinar brings together Antonio Remiro-Azocar, Robert Hemmings and Nicholas Latimer, who are renowned experts in the respective fields. They will provide an introduction to these three concepts, illustrated with examples, thus enabling a solid understanding of these frameworks as well as their communalities and differences. A Q&A session will provide opportunities for the audience to engage with the speakers and clarify any questions.
Robert Hemmings is currently partner at Consilium Salmonson & Hemmings and has deep expertise in global clinical trial design, critical appraisal of clinical trial data and regulatory affairs. He was head of the group of statisticians and pharmacokineticists at the Medicines and Healthcare Products Regulatory Agency (MHRA) in the UK for nearly 20 years. He has been a member of the Committee for Medicinal Products for Human Use (CHMP) at the EMA for 11 years, has chaired EMA’s Scientific Advice Working Party 8 years, and chaired and served on EMA’s groups for biostatistics, modelling and simulation and extrapolation. Hemmings also represented the EU and was the Rapporteur for the revision of the ICH guideline E9 (R)1 addendum on estimands and sensitivity analysis in clinical trials, to the guideline on statistical principles for clinical trials. Additionally, he has involvement in multiple initiatives related to innovation in clinical trial design and regulatory strategy including, EMA’s Priority Medicines (PRIME) scheme for unmet medical needs, adaptable pathways, and accelerated access pathways in the UK.
Nicholas Latimer
Nicholas Latimer is professor of Health Economics at the School of Medicine and Population Health of the University of Sheffield, UK. His research interests focus on economic evaluation methodology, with a particular emphasis on the incorporation of survival analysis within economic models. Professor Latimer is especially interested in the use of causal inference methods to estimate comparative effectiveness in clinical trials confounded by treatment switching, and in observational (or “Big”, or “Real World”) data.
Professor Latimer is currently undertaking a Senior Research Fellowship funded by Yorkshire Cancer Research. During this Fellowship, his focus is on investigating the use of cancer registry datasets to estimate the comparative effectiveness of cancer treatments used in the NHS.
Antonio Remiro-Azócar
Antonio is Lead Medical Affairs Statistician at Bayer, specializing in health technology assessment (HTA), health economics and outcomes research (HEOR), and observational studies. At Bayer, Antonio leads cross-functional teams in providing inputs to life-cycle management strategies, publication plans, reimbursement requirements, HTA studies and analyses for payers, across a number of therapeutic areas. Prior to his current role, Antonio provided support on the statistical aspects of evidence synthesis, HTA and HEOR to contract research organizations such as IQVIA and ICON plc, and public bodies such as SickKids. Antonio holds a PhD in Statistical Science and an MSc in Machine Learning from University College London.
Careers Meetings
PSI HTA SIG Webinar: Estimands, PICOs and Co. - Are we losing or gaining in translation?
Date: Thursday 7th December 2023 Time: 13:00-14:30 GMT | 14:00-15:30 CET Speakers: Robert Hemmings (Consilium Salmonson & Hemmings), Antonio Remiro-Azócar (Bayer) and Nicholas Latimer (University of Sheffield).
Who is this event intended for? Regulatory and HTA statisticians. Anybody interested in the new EU HTA regulation.
What is the benefit of attending? Learn about the multiple frameworks used to define a research question and the context in which they are used. Discuss how they may complement each other in light of the new EU HTA regulation.
Registration
This event is free to attend, for both Members and Non-Members of PSI.
To register your place for this event, please click here.
Overview
Over the past years, areas of clinical development and patient access / health technology assessment (HTA) have moved closer together. However, both areas differ in how they approach their respective research or policy questions. While the estimand framework is being the focus in clinical development, HTA is being viewed through the lens of the PICO framework. This might lead to mutual misunderstandings and ultimately prevent timely patient access due to evidence gaps. Additionally, the Target Trial Emulation framework has become popular in the Real-World Data setting to translate research questions into a meaningful design, and share some commonalities with the estimand and PICO frameworks.
For randomized controlled trials (RCTs) in the regulatory setting, the estimand framework has been introduced and stimulated by the publication of the International Council of Harmonisation (ICH) E9 (R1) Addendum [1]. It is recognized by regulatory agencies such as EMA and the Food and Drug Administration (FDA). According to ICH guidance, an estimand is defined on the basis of five attributes: (1) treatment(s); (2) target population; (3) clinical outcome of interest; (4) population-level summary effect measure; and (5) strategy for intercurrent (post-randomization) events.
In HTA, the PICO framework is typically used to translate policy questions into research questions. PICOs consist of five components: (1) population; (2) intervention; (3) comparator(s); and (4) outcome. During the reimbursement process, the manufacturer typically submits an evidence dossier that addresses the research questions(s) included in the scope. Best-practice guidelines recommend specifying relevant PICO question(s) in the HTA scoping process [2]. In evidence synthesis, PICO questions are often formulated prior to the analysis in order to guide the data extraction required for systematic literature reviews [3].
The Target Trial Emulation (TTE), developed by Hernan et al. (2016) [3], is a framework proposed for Real-World Data studies to minimize common biases due to selection or confounding. TTE is a two-step process, whereby a protocol for an hypothetical RCT that would answer the question of interest is developed; This protocol is applied to the Real-World Data so that it mimics the data that would have been gathered for the RCT [5]. In this framework, eligibility criteria, treatment strategies, assignment procedures, follow-up period, outcome, causal contrasts of interest and analysis plan should be specified. Gomes, Latimer, Soares et al., in [4], discusses opportunities and challenges of using TTE with Real-World-Data in the HTA context.
In this webinar series, we will compare and contrast all three frameworks and discuss how they may complement each other, also in light of the new EU HTA regulation.
This webinar brings together Antonio Remiro-Azocar, Robert Hemmings and Nicholas Latimer, who are renowned experts in the respective fields. They will provide an introduction to these three concepts, illustrated with examples, thus enabling a solid understanding of these frameworks as well as their communalities and differences. A Q&A session will provide opportunities for the audience to engage with the speakers and clarify any questions.
Robert Hemmings is currently partner at Consilium Salmonson & Hemmings and has deep expertise in global clinical trial design, critical appraisal of clinical trial data and regulatory affairs. He was head of the group of statisticians and pharmacokineticists at the Medicines and Healthcare Products Regulatory Agency (MHRA) in the UK for nearly 20 years. He has been a member of the Committee for Medicinal Products for Human Use (CHMP) at the EMA for 11 years, has chaired EMA’s Scientific Advice Working Party 8 years, and chaired and served on EMA’s groups for biostatistics, modelling and simulation and extrapolation. Hemmings also represented the EU and was the Rapporteur for the revision of the ICH guideline E9 (R)1 addendum on estimands and sensitivity analysis in clinical trials, to the guideline on statistical principles for clinical trials. Additionally, he has involvement in multiple initiatives related to innovation in clinical trial design and regulatory strategy including, EMA’s Priority Medicines (PRIME) scheme for unmet medical needs, adaptable pathways, and accelerated access pathways in the UK.
Nicholas Latimer
Nicholas Latimer is professor of Health Economics at the School of Medicine and Population Health of the University of Sheffield, UK. His research interests focus on economic evaluation methodology, with a particular emphasis on the incorporation of survival analysis within economic models. Professor Latimer is especially interested in the use of causal inference methods to estimate comparative effectiveness in clinical trials confounded by treatment switching, and in observational (or “Big”, or “Real World”) data.
Professor Latimer is currently undertaking a Senior Research Fellowship funded by Yorkshire Cancer Research. During this Fellowship, his focus is on investigating the use of cancer registry datasets to estimate the comparative effectiveness of cancer treatments used in the NHS.
Antonio Remiro-Azócar
Antonio is Lead Medical Affairs Statistician at Bayer, specializing in health technology assessment (HTA), health economics and outcomes research (HEOR), and observational studies. At Bayer, Antonio leads cross-functional teams in providing inputs to life-cycle management strategies, publication plans, reimbursement requirements, HTA studies and analyses for payers, across a number of therapeutic areas. Prior to his current role, Antonio provided support on the statistical aspects of evidence synthesis, HTA and HEOR to contract research organizations such as IQVIA and ICON plc, and public bodies such as SickKids. Antonio holds a PhD in Statistical Science and an MSc in Machine Learning from University College London.
Upcoming Events
Joint PSI/EFSPI Visualisation SIG 'Wonderful Wednesday' Webinars
Our monthly webinar explores examples of innovative data visualisations relevant to our day to day work. Each month a new dataset is provided from a clinical trial or other relevant example, and participants are invited to submit a graphic that communicates interesting and relevant characteristics of the data.
PSI Introduction to Industry Training (ITIT) Course - 2024/2025
An introductory course giving an overview of the pharmaceutical industry and the drug development process as a whole, aimed at those with 1-3 years' experience. It comprises of six 2-day sessions covering a range of topics including Research and Development, Toxicology, Data Management and the Role of a CRO, Clinical Trials, Reimbursement, and Marketing.
PSI Training Course: Mixed Models and Repeated Measures
This course is presented through lectures and practical sessions using SAS code. It is suitable for statisticians working on clinical trials, who already have a good understanding of linear and generalised linear models.
This networking event is aimed at statisticians that are new to the pharmaceutical industry who wish to meet colleagues from different companies and backgrounds.
This networking event is aimed at statisticians that are new to the pharmaceutical industry who wish to meet colleagues from different companies and backgrounds.
This networking event is aimed at statisticians that are new to the pharmaceutical industry who wish to meet colleagues from different companies and backgrounds.
This networking event is aimed at statisticians that are new to the pharmaceutical industry who wish to meet colleagues from different companies and backgrounds.
We use cookies to collect and analyse information on site performance and usage, to provide social media features and to enhance and customise content and advertisements.
Cookies used on the site are categorized and below you can read about each category and allow or deny some or all of them. When categories than have been previously allowed are disabled, all cookies assigned to that category will be removed from your browser.
Additionally you can see a list of cookies assigned to each category and detailed information in the cookie declaration.
Some cookies are required to provide core functionality. The website won't function properly without these cookies and they are enabled by default and cannot be disabled.
Amazon Web Services offers a broad set of global cloud-based products including compute, storage, databases, analytics, networking, mobile, developer tools, management tools, IoT, security, and enterprise applications.
Microsoft Azure is a cloud computing platform offering a wide range of services, including virtual machines, databases, and AI tools.
ARRAffinity
ARRAffinitySameSite
Preferences
Preference cookies enables the web site to remember information to customize how the web site looks or behaves for each user. This may include storing selected currency, region, language or color theme.
Analytical cookies
Analytical cookies help us improve our website by collecting and reporting information on its usage.
Vimeo, Inc. is an American video hosting, sharing, services provider, and broadcaster. Vimeo focuses on the delivery of high-definition video across a range of devices.
Cookies used on the site are categorized and below you can read about each category and allow or deny some or all of them. When categories than have been previously allowed are disabled, all cookies assigned to that category will be removed from your browser.
Additionally you can see a list of cookies assigned to each category and detailed information in the cookie declaration.
Some cookies are required to provide core functionality. The website won't function properly without these cookies and they are enabled by default and cannot be disabled.
Necessary cookies
Name
Hostname
Vendor
Expiry
ARRAffinity
.psiweb.org
Session
This cookie is set by websites run on the Windows Azure cloud platform. It is used for load balancing to make sure the visitor page requests are routed to the same server in any browsing session.
ARRAffinitySameSite
.psiweb.org
Session
Used to distribute traffic to the website on several servers in order to optimize response times.
__cf_bm
.vimeo.com
Cloudflare, Inc.
1 hour
The __cf_bm cookie supports Cloudflare Bot Management by managing incoming traffic that matches criteria associated with bots. The cookie does not collect any personal data, and any information collected is subject to one-way encryption.
_cfuvid
.vimeo.com
Session
Used by Cloudflare WAF to distinguish individual users who share the same IP address and apply rate limits
__cf_bm
.glueup.com
Cloudflare, Inc.
1 hour
The __cf_bm cookie supports Cloudflare Bot Management by managing incoming traffic that matches criteria associated with bots. The cookie does not collect any personal data, and any information collected is subject to one-way encryption.
AWSALBTGCORS
psi.glueup.com
7 days
AWS Classic Load Balancer Cookie: Load Balancing Cookie: Used to map the session to the instance. Same value as AWSELB.
PHPSESSID
psi.glueup.com
Session
Cookie generated by applications based on the PHP language. This is a general purpose identifier used to maintain user session variables. It is normally a random generated number, how it is used can be specific to the site, but a good example is maintaining a logged-in status for a user between pages.
Used by CookieHub to store information about whether visitors have given or declined the use of cookie categories used on the site.
Preferences
Preference cookies enables the web site to remember information to customize how the web site looks or behaves for each user. This may include storing selected currency, region, language or color theme.
Preferences
Name
Hostname
Vendor
Expiry
vuid
.vimeo.com
400 days
These cookies are used by the Vimeo video player on websites.
AWSALBCORS
psi.glueup.com
7 days
Amazon Web Services cookie. This cookie enables us to allocate server traffic to make the user experience as smooth as possible. A so-called load balancer is used to determine which server currently has the best availability. The information generated cannot identify you as an individual.
Analytical cookies
Analytical cookies help us improve our website by collecting and reporting information on its usage.
Contains a unique identifier used by Google Analytics to determine that two distinct hits belong to the same user across browsing sessions.
_dd_s
player.vimeo.com
Datadog
1 hour
This cookie is set by Datadog to group all events generated from a unique user session across multiple pages. It contains the current session ID, whether the session is excluded due to sampling, and the expiration date of the session. The cookie is extended for an extra 15 minutes every time the user interacts with the website, up to the maximum user session duration (4 hours).