Non-inferiority trial là gì
AbstractNon-inferiority randomized clinical trials are indicated when it is intended to prove that an experimental group is not inferior to a control group by more than a margin of non-inferiority. However, this type of study differs from traditional randomized clinical trials (superiority studies) because they have particularities that impact on the formulation of hypothesis to be tested, experimental design (non-inferiority margin determination, adapted sample size calculation, sensitivity of the study and data final analysis) and also on the presentation of data when writing the manuscript. Therefore, this article aims to present and discuss the particularities of non-inferiority clinical studies, since these requirements are fundamental to guarantee the validity of the conclusions of this type of study. Show Randomized Controlled Trial; Equivalence Trial; Study Characteristics IntroductionRandomized clinical trials (RTC) are on the second to last step of the evidence-based pyramid. When compared to basic science/case series and casecontrol/cohort studies, RTC offers greater reliability in promoting changes of the current clinical protocols by the establishment of new ones.11. Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med. 2016 Aug;21(4):125-7. https://doi.org/10.1136/ebmed-2016-110401 Traditionally, researchers seek to verify, by means of a rigid clinical protocol, the superiority of an experimental group in relation to a positive control (gold standard). However, for a standard protocol (positive control) to be replaced by a new one, the experimental group does not necessarily have to be superior to control and in this case non-inferiority clinical trials gain importance. These are especially indicated when it is not possible to use a placebo group because active controls are necessary or because the experimental group has several advantages over the positive control that allow its use, even if it is not superior to control.22. Pinto VF. Estudos clínicos de não-inferioridade: fundamentos e controvérsias. J Vasc Bras. 2010;9(3):145-51. https://doi.org/10.1590/S1677-54492010000300009. However, the researcher often does not know that his research fits into a non-inferiority design and does not consider all its particularities in planning, execution and communication of this type of study design, compromising the credibility of the obtained results. Thus, this article aims to define non-inferiority clinical trials presenting their particularities and differentiating them from traditional randomized clinical trials. DefinitionRandomized clinical trials are close to the top of the evidence-based pyramid.11. Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med. 2016 Aug;21(4):125-7. https://doi.org/10.1136/ebmed-2016-110401
The main focus of this article will be given to the last item of this classification. The question that rises is: When to conduct a Non-inferiority Randomized Clinical Trial? The answer is simple, when the use of placebo is ethically unfeasible, as for example in drug therapies for severe chronic diseases, and when an experimental group should be compared to a gold standard (positive control).33. Hahn S. Understanding noninferiority trials. Korean J Pediatr. 2012 Nov;55(11):403-7. https://doi.org/10.3345/kjp.2012.55.11.403 In a superiority study the hypotheses are:
A non-inferiority study intends to demonstrate that the experimental group is not inferior to the control group by more than the non-inferiority margin, the hypotheses to be tested are:
First, it is important to learn how to define the margin of non-inferiority, since this is the main factor to be established in the design of a non- inferiority clinical trial. However, not only the margin of non-inferiority is important in this type of clinical study, but also other factors that will be better explored in this article, such as sample size, study sensitivity, population of analysis and reporting of the study. Non-inferiority marginThe non-inferiority margin quantifies the maximum loss of clinically acceptable efficacy so that the treatment under study (experimental group) can be declared non-inferior to the control.55. Althunian TA, Boer A, Groenwold RH, Klungel OH. Defining the noninferiority margin and analysing noninferiority: an overview. Br J Clin Pharmacol. 2017 Aug;83(8):1636-42. https://doi.org/10.1111/bcp.13280
In a non-inferiority clinical trial the measure of efficacy to be analyzed should be at 95% confidence interval of the difference between values found in the experimental group and in the control group. If the confidence interval of this difference is totally above zero, then the experimental group can be considered superior to the control group (Figure A). If the confidence interval is below zero but totally above the non-inferiority limit, then the experimental group can be considered not inferior to the control group (Figure B). On the other hand, if the confidence interval is completely below the non-inferiority limit, the experimental group should be considered inferior to the control group (Figure C). Finally, non-inferiority studies whose 95% confidence interval cross the non-inferiority limit, presenting superior and inferior values (Figure D, and E) are considered inconclusive. Figure Non-inferiority margin and the relationship with 95% confidence interval of the difference between experimental and control groups. Therefore, the establishment of a non-inferiority margin with an appropriate dimension is of main importance to the study. To determine the non-inferiority margin, researchers might always search for a comparison between a control and a placebo group, by means of pilot tests or by previously published data. Two methods are traditionally used to determine the non-inferiority margin. The first, known as the fixed margin method, uses a value ranging from 50 to 75% of the difference between the values found in control and placebo.22. Pinto VF. Estudos clínicos de não-inferioridade: fundamentos e controvérsias. J Vasc Bras. 2010;9(3):145-51. https://doi.org/10.1590/S1677-54492010000300009. Sample sizeThe sample calculation must be performed in all randomized clinical trials and the non-inferiority studies follow this rule. However, the calculation might be adapted to a study of this nature, since the non-inferiority margin has to be considered. The non-inferiority margin has a direct impact on the sample size, since if the non-inferiority margin is increased, the sample size is reduced, and if the non-inferiority margin is reduced the sample size is increased.55. Althunian TA, Boer A, Groenwold RH, Klungel OH. Defining the noninferiority margin and analysing noninferiority: an overview. Br J Clin Pharmacol. 2017 Aug;83(8):1636-42. https://doi.org/10.1111/bcp.13280 Several statistical software and online calculators are able to make the sample size calculation according to this type of study. A simple and complete tool can be found at http://powerandsamplesize.com. This online calculator contemplates the most commonly dependent variables used in non-inferiority clinical studies, such as dichotomous and quantitative variables. For example, to calculate the sample size of a study comparing two means, the investigator will need to define the following parameters: estimated mean of the control group, estimated mean of the placebo group, standard deviation, non-inferiority margin, relationship between sample size of the 2 groups, α error, and β error. At the calculated value, the researcher should also add a percentage referring to the possible losses of the clinical study (20% for example). All these parameters should also be described in the manuscript, to evidence how the sample size of the non-inferiority clinical trial was calculated, as performed in Llanos et al.77. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010 Aug;63(8):e1-37. https://doi.org/10.1016/j.jclinepi.2010.03.004 Sensitivity of the studySensitivity of a study is the ability of a clinical trial to discriminate an effective placebo treatment or, more generally, it is the property of detecting differences between treatments when they actually exist. The lack of sensitivity of the study may introduce a non-difference bias (e.g., increase in the false negative rate) in the comparisons, caused by the increase in type 2 or β error. This bias, in non-inferiority studies, may lead to ineffective treatments to be considered non-inferior22. Pinto VF. Estudos clínicos de não-inferioridade: fundamentos e controvérsias. J Vasc Bras. 2010;9(3):145-51. https://doi.org/10.1590/S1677-54492010000300009. However, the most important factor to guarantee the sensitivity of a non-inferiority study is a historical data from the literature showing that in fact the control group to be tested is superior to the negative control. Ideally, any randomized clinical trial should be performed with 3 groups: experimental, positive control and placebo. However, the inclusion of placebo is not always feasible from a financial point of view and is often contraindicated according to the ethical principals involved. Before conducting a clinical study comparing an experimental group with a control group, it is important to ensure that the control group is in fact superior to a placebo. Therefore, 2 factors are indispensable:
Population analyzedThere are two possible ways to assess data of randomized clinical trials, which is defined by the population considered in the final analyses. The intention to treat (ITT) considers the entire randomized population, even if some of them withdraw, were lost or did not adhere to the treatment. The per protocol (PP) includes only the patients that completed the treatment and adequately followed the protocol. In superiority studies, there is a consensus that intention to treat analysis should be preferred.22. Pinto VF. Estudos clínicos de não-inferioridade: fundamentos e controvérsias. J Vasc Bras. 2010;9(3):145-51. https://doi.org/10.1590/S1677-54492010000300009. On the other hand, the protocol analysis, which is done in a population of adherent patients, has a greater efficiency in discriminating treatments. Therefore, is the strategy to be followed first in the non-inferiority analysis, according to many authors.22. Pinto VF. Estudos clínicos de não-inferioridade: fundamentos e controvérsias. J Vasc Bras. 2010;9(3):145-51. https://doi.org/10.1590/S1677-54492010000300009. Report of a non-inferiority studyFinally, it is fundamental that there is an adequate report of the non-inferiority randomized clinical trial, considering all the particularities of this type of experiment. Therefore, it is important to follow the CONSORT guidelines,88. Llanos AH, Sapata VM, Jung RE, Hämmerle CH, Thoma DS, César Neto JB, et al. Comparison between two bone substitutes for alveolar ridge preservation after tooth extraction: cone-beam computed tomography results of a non-inferiority randomized controlled trial. J Clin Periodontol. 2019 Mar;46(3):373-81. https://doi.org/10.1111/jcpe.13079 ConclusionNon-inferiority randomized clinical trials should be carried out with increasing frequency, especially since in the health area, research ethics committees will no longer permit the evaluation of experimental groups compared to placebo groups, requiring the use of positive controls. However, there is still a lack of information about this type of experimental design and many protocols and therapies are incorrectly considered to be not inferior. Thus, discussing this topic in scientific events and scientific journals is of fundamental importance for the properly use of superiority, equivalence and non-inferiority randomized clinical trials by the scientific community. AcknowledgmentsThe authors thank the Pro-Rector of Research of USP, Research Commission of FO, FOB and FORP and the Organizing Committee for participating in the Grandes Desafios em Pesquisa Clínica na Odontologia event. Also, the author thanks CAPES Foundation (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, financial code 001) and CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnológico, financial codes 304128/2016-3 and 304405/2018-3). References
Publication Dates
History
This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |