Comparison of Test Statistics for Mean Difference Testing Between Two Independent Populations

Main Article Content

Wasinee Pradubsri, Chawanee Suphirat

Abstract

The purpose of the article is to evaluate the efficiency of seven test statistics for mean difference testing between two independent populations. The evaluation was based on the probability of type I error and power of the test at 0.05 significance level under population distributions assumed to be normal, exponential, log-normal, gamma, and Laplace with equal sample sizes, and both equal and unequal variances. The results showed that for equal variance, the test statistics with the highest testing power controlled the probability of type I error were Z-test for normal and exponential distributions, Welch based on rank test (WBR) for log-normal and gamma distributions, and Mann-Whitney U test (MWU) for Laplace distribution. For unequal variance, Z-test was more efficient under normal, exponential, log-normal, and gamma distributions, while WBR was appropriate for Laplace distribution.

Article Details

References

  1. J.V. Bradley, Robustness?, Br. J. Math. Stat. 31 (1978), 144-152. https://doi.org/10.1111/j.2044-8317.1978.tb00581.x.
  2. D. Wongchai, M. Lao, A. Thongteeraparp, A Comparison of Parametric and Nonparametric Test Statistics for Testing the Mean Difference of Two Independent Populations, Thai Sci. Technol. J. 31 (2023), 1-13. https://doi.org/10.14456/TSTJ.2023.11.
  3. B. Efron, R.J. Tibshirani, An Introduction to the Bootstrap, Chapman & Hall, New York, (1993).
  4. N.O. Eriobu, E.U. Umeh, Evaluation of Sensitivity of Three Selected Two-sample Nonparametric Tests, J. Basic Phys. Res. 9 (2019), 45-56.
  5. M.W. Fagerland, L. Sandvik, Performance of Five Two-Sample Location Tests for Skewed Distributions with Unequal Variances, Contemp. Clinic. Trials. 30 (2009), 490-496. https://doi.org/10.1016/j.cct.2009.06.007.
  6. P. Mann, Introductory Statistics, 7th ed., John Wiley & Sons, New Jersey, (2010).
  7. D. C. Montgomery, G.C. Runger, Applied Statistics and Probability for Engineers, 5th ed., John Wiley & Sons, New York, (2011).
  8. S. Montri, Nonparametric Bootstrap Method for Location Testing between Two Populations under Combined Assumption Violations, Burapha Sci. J. 25 (2020), 864-879.
  9. I. C. Oyeka, U. M. Okeh, Modified Intrinsically Ties Adjusted Mann-Whitney U Test, IOSR J. Math. 7 (2013), 52-56.
  10. J. Reiczigel, I. Zakariás, L. Rózsa, A Bootstrap Test of Stochastic Equality of Two Populations, Amer. Statistician. 59 (2005), 156-161. https://doi.org/10.1198/000313005x23526.
  11. M. Sangthong, P. Klubnual, Performance of Seven Statistics for Mean Difference Testing Between Two Populations Under Combined Assumption Violations, Naresuan Univ. J.: Sci. Technol. 29 (2021), 112-126. https://doi.org/10.14456/nujst.2021.40.
  12. S. Thidarat, Y. Preeya, S. Ratiwat, R. Wirayut, S. Saichon, Comparison of Nonparametric Test Statistics for Testing Population Mean between Two Independent Populations, Thai Sci. Technol. J. 26 (2018), 739-751.
  13. W. Wanishsakpong, K. Sodrung, A. Thongteeraparp, A Comparison of Nonparametric Statistics and Bootstrap Methods for Testing Two Independent Populations with Unequal Variance, Int. J. Anal. Appl. 21 (2023), 36. https://doi.org/10.28924/2291-8639-21-2023-36.
  14. B.L. Welch, The Significance of the Difference between Two Means When the Population Variables are Unequal, Biometrika. 20 (1938), 350-362. https://doi.org/10.2307/2332010.
  15. F. Wilcoxon, Individual Comparisons by Ranking Methods, Biometrics. 1 (1945), 80-83.
  16. J.C.F. Winter, Using the Student's T-Test With Extremely Small Sample Sizes, Pract. Assess. Res. Eval. 18 (2013), 1-12. https://doi.org/10.7275/e4r6-dj05.