Struggling to Run a Two One-Sided Equivalence Test (TOST)?
QI Macros can run an Equivalence test (TOST) in Excel for you!
When to use an Equivalence Test
Traditional t-Tests determine if means are the same or different, but they can have false positives. Equivalence testing determines an interval where the means can be considered equivalent.
The Equivalence (TOST) Test uses two t-tests assuming equal variances with a hypothesized mean difference (u1-u2 = interval).
Equivalence Test Example
Adhesive tape is measured immediately after production and 24 hours later. Are the measurements equivalent at these two different points in time? If they are, one measurement can be eliminated, saving time and money.
Select the data within your Excel spreadsheet, click on the QI Macros menu > Statistical Tools > F & t Tests and select Equivalence (TOST) Test:
QI Macros will prompt for a significance level (default = 0.05 or 0.95):
Along with the hypothesized mean difference. Default = 0:
QI Macros will perform the calculations and interpret the results for you!
If the +/-% is 5% (0.05), the means are not equivalent. At 10%, they are equivalent.
If both p-values are less than 0.05, the means are equivalent.
If both p-values are greater than 0.05, the test cannot conclude means are equivalent.
The equivalence test results include a Values Plot along with an Equivalence Plot.
Releases prior to July 2022 included a Box & Whisker plot.
Now here's where it gets interesting...
because the one-tailed p-values are both less than 0.05...the means can be declared equivalent.
So, we can eliminate one of the tests.
Define the two null and alternate Hypotheses for equivalence:
- The null hypothesis H01 is that the mean difference (x1-x2) <= 0.8
- The alternative hypothesis H11a is that the mean difference > 0.8
- The null hypothesis H02 is that the mean difference (x1-x2) >= 0.8
- The alternative hypothesis H12a is that the mean difference < 0.8
UEL (Upper Equivalence Limit ‐ upper limit of acceptability for the difference) and LEL (Lower Equivalence Limit ‐ lower limit of acceptability for the difference) are based off the sum of the 2 data sets' means, divided by 2, and multiplied by the +/‐% value found in cell H5 (this value affects the width of UEL/LEL).
The UEL, LEL, and Confidence Interval CAN BE UPDATED BY THE END USER in cells H3:H5 accordingly. And if the UEL and LEL are updated, the Confidence Interval lines and Equivalent/Not Equivalent statements will update automatically, based upon your data set.
NOTE: End users can also manually enter the Hypothesized Mean Difference (HMD). If the HMD is any # other than 0, both the UEL and LEL will be updated to match the postivie and negative HMD values (added in the July 2023 version of QI Macros).
95% line output represents your 95% Confidence Interval and since it is partially located outside of the Zone of Equivalence, this indicates that your data set statistically CANNOT claim equivalence.
75% line output represents your 75% Confidence Interval. And per information provided above, since it IS located w/in the Zone of Equivalence, if the end user chooses to use only a 75% Level of Confidence benchmark, their data set CAN statistically claim equivalence