Analysis of Nonparametric and Parametric Criteria for Statistical Hypotheses Testing. Chapter 1. Agreement Criteria of Pearson and Kolmogorov

  • F. V. Motsnyi National Academy of Statistics, Accounting and Audit
Keywords: математична статистика, вибірка, випадкові величини, статистичні гіпотези, число ступенів вільності; критична точка; емпірична частота, теоретична частота, емпірична функція, теоретична функція, закони розподілу, непараметричні критерії, критерій Пірсона, критерій Колмогорова

Abstract

In the statistical analysis of experimental results it is extremely important to know the distribution laws of the general population. ‎Because of all assumptions about the distribution laws are statistical hypotheses, they should be tested. ‎Testing hypotheses are carried out by using the statistical criteria that divided the multitude in two subsets: null and alternative. The ‎null hypothesis is accepted in subset null and is rejected in alternative subset. Knowledge of the distribution law is a prerequisite for the use of numerical mathematical methods. The hypothesis is accepted if the divergence between empirical and theoretical distributions will be random. The hypothesis is rejected if the divergence between empirical and theoretical distributions will be essential.

There is a number of different agreement criteria for the statistical hypotheses testing. The paper continues ideas of the author’s works, devoted to advanced based tools of the mathematical statistics. This part of the paper is devoted to nonparametric agreement criteria.

Nonparametric tests don’t allow us to include in calculations the parameters of the probability distribution and to operate with frequency only, as well as to assume directly that the experimental data have a specific distribution. Nonparametric criteria are widely used in analysis of the empirical data, in the testing of the simple and complex statistical hypotheses etc. They include the well known criteria of K. Pearson, A. Kolmogorov, N. H. Kuiper, G. S. Watson, T. W. Anderson, D. A. Darling, J. Zhang, Mann – Whitney U-test, Wilcoxon signed-rank test and so on. Pearson and Kolmogorov criteria are most frequently used in mathematical statistics.

Pearson criterion (-criterion) is the universal statistical nonparametric criterion which has -distribution. It is used for the testing of the null hypothesis about subordination of the distribution of sample empirical to theory of general population at large amounts of sample (n>50). Pearson criterion is connected with calculation of theoretical frequency. Kolmogorov criterion is used for comparing empirical and theoretical distributions and permits to find the point in which the difference between these distributions is maximum and statistically reliable. Kolmogorov criterion is used at large amounts of sample too. It should be noted, that the results obtained by using Pearson criterion are more precise because practically all experimental data are used.

The peculiarities of Pearson and Kolmogorov criteria are found out. The formulas for calculations are given and the typical tasks are suggested and solved. The typical tasks are suggested and solved that help us to understand more deeply the essence of Pearson and Kolmogorov criteria.

Downloads

Download data is not yet available.

References

Motsnyi, F. V. (2015). Suchasnyi bazovyi instrumentarii matematychnoi statystyky. Ch. 1, 2 [Advanced Based Tools of Mathematical Statistics. Part 1, 2]. Naukovyi Visnyk Natsinalnoi akademii statystyky, obliku ta audytu – Scientific Bulletin of the National Academy of Statistics, Accounting and Audit, 2,16–29, 3,14–25 (in Ukrainian).

Motsnyi, F. V. (2018). Statystychni Rozpodily Chi-kvadrat, Studenta, Fishera – Snedekora ta ikh zastosuvannia [Chi-Square, Student and Fisher – Snedecor Statistical Distributions and Their Application]. Statystyka Ukrainy – Statistics of Ukraine, 1, 16–23 (in Ukrainian).

Rudenko, V. M. (2012). Matematychna statystyka [Mathematical Statistics]. Kyiv: ‎Tsentr uchbovoi literatury (in Ukrainian).

Chimitova, E. V., Vedernikova, M. A., & Galanova, N. S. (2013). Neparametricheskie criterii soglasiia v zadachakh proverki adekvatnosti modelei nadezhnosti [Nonparametric coordination criteria in task of the checking the adequacy of reliability models]. Vestnik TGU: Upravlenie,Vychislitelnaia tekhnika i informatika – Scientific Bulletin of TGU: management, calculation engineering and information, 4 (25), 115–124 (in Russian).

Neparametrychni i parametrychni kryterii [Nonparametric and parametric criteria]. www.dic.academic.ru. Retrieved from https://www.dic.academic.ru/dic.nsf/ruwiki/290179 (in Ukrainian).

Parametricheskie i neparametricheskie kriterii [Parametric and nonparametric criteria]. www.studopedia.org. Retrieved from https: //www.studopedia.org/1-26663.html (in Russian).

Statystychni kryterii. Рarametrychni i neparametrychni kryterii [Statistical criteria. Parametric and nonparametric criteria]. www.pidruchniki.com. Retrieved from https://www.pidruchniki.com/12590605/statistika/statistichni_kriteriyi (in Ukrainian).

Parametrychni kryterii. Neparametrychni metody statystychnoi perevirky hipotez [Parametric criteria. Nonparametric methods of statistical hypotheses testing]. www.studlib.info. Retrieved from https://www.studlib.info/psikhologiya/771366-parametrichni-kriterii-neparametrichni-metodi-statistichnoi-perevirki-gipotez/ (in Ukrainian).

Khollender, M., & Vulf, D. (1983) Neparametricheskie metody statistiki [Nonparametric statistical methods]. Moskow: Financy i statistika (in Russian).

Lemeshko, B.Yu. (2014). Neparametricheskie kriterii soglasiia [Nonparametrical coordination criteria]. Мoskow: INFRA-M (in Russian).

Grauer, L. V., & Arkhipova, O. V. (2014). Lekciia 4. Parametricheskie i neparametricheskie kriterii odnorodnosti [Lecture 4. Parametrical and nonparametrical homogeneity criteriа]. www.compscicenter.ru, Retrieved from https://docplayer.ru/49327029-Lekciya-4-parametricheskie-i-neparametricheskie-kriterii-odnorodnosti.html (in Russian).

Choosing Between a Nonparametric Test and a Parametric Test. blog.minitab.com. Retrieved from http://blog.minitab.com/blog/adventures-in-statistics-2/choosing-between-a-nonparametric-test-and-a-parametric-test (in English).

Prokhorov, Yu. V., & Ponomarenko, L. S. (2004). Lektsii po teorii veroiatnostei i matematicheskoi statistike [Lectures on probability theory and mathematical statistics]. Moscow: MAKS Press (in Russian).

Postovalov, S. N. (2014). Primenenie kompiuternogo modelirovaniia dlia rasshireniia prikladnykh vozmozhnostei klassicheskikh metodov proverki statistycheskikh hipotez [Application of PC modelling for the widening of applied possibilities of classical methods of statistical hypothesis testing]. Extended abstracts of candidate’s thesis. Novosibirsk (in Russian).

Difference Between Parametric and Nonparametric Test. keydifferences.com. Retrieved from https://keydifferences.com/difference-between-parametric-and-nonparametric-test.html (in English).

Lemeshko, B. Yu., & Postovalov, S. N. (1999). Prikladnaia statistika. Pravila proverki soglasiia opytnogo raspredeleniia s teoreticheskim. Ch. 2. Neparametricheskie kriterii [Applied Statistics. Rules for verifying compliance of experimental distribution with theoretical]. Novosibirsk: NSTU (in Russian).

Petrov, S. I. (2012). Metrologiia, standartizatsiia i sertifikatsiia [Metrology, standardization and certification]. Omsk, OIVT (in Russian).

Bure, V. M., & Grauer, L. V. Lekciia 6. Kriterii soglasiia. Proverka nezavisimosti dvukh nominalykh priznakov [Lexture 6. Coordination criteria. Check of independence of two nominal signs]. www. google.com.ua. Retrieved from https://www. google.com.ua/search?hl=uk (in Russian).

Kriterii soglasiia [Coordination criteria].www.machinelearning.ru. Retrieved from http://www.machinelearning.ru/wiki/index.php?title=Критерии согласия (in Russian).

Kobzar, A. I. (2006). Prikladnaia matematicheskaia statistika. [Applied mathematical statistics]. Мoskow: Physmathlit (in Russian).

Gmurman, V. E. (1999). Teoriia veroiatnostei i mathematicheskaia ststistika [Probanility theory and mathematic statistics]. Moskow: Vysshaia shkola (in Russian).

Zhluktenko, V. I., Nakonechnyi, S. I., & Savina, S. S. (2001). Teoriia imovirnostei i matematychna statystyka. Ch.2. Matematychna statystyka [Probability theory and mathematical statistics. Part 2. Mathematical Statistics]. Kyiv: KNEU (in Ukrainian).

Snedecor, G. W., & Cochran, W. G. (1967). Statistical methods. (6th ed.). Iowa: Iowa State University Press (in English).

Teorema Pirsona [Pearson theorem]. www.studopedia.su. Retrieved from https://www.studopedia.su/10_94367_teorema-pirsona.html (in Russian)

Brown, J. D. (2004). Questions and answers about language testing statistics: Yates correction factor. The JALT Testing & Evaluation SIG Newsletter, 8(1), 22–27 (in English).

Kriterii Kolmogorova – Smirnova. www.machinelearning.ru. Retrieved from http://www.machinelearning.ru/wiki/index.php?title=Критерий...Смирнова

(in Russian).

Kriterii Kolmogorova – Smirnova i ego primenenie k postroeniiu doveritelnykh granits dlia neizvestnoi funktsii raspredeleniia [Kolmogorov-Smirnov criterion and its application to building confidence limits for an unknown distribution function]. www. stu.sernam.ru. Retrieved from http://www.stu.sernam.ru/book_stat1.php?id=138 (in Russian).

Kolmogorov, A. N. (1933). Sulla determinazione empirica di una legge di distribuzione. Giornale dell’Istituto Italiano degly Attuari,Vol. 4, № 1, 83–91. Retrievd from https://www.sciepub.com/reference/1552 (in Italiano)

Kriterii soglasiia Kolmogorova – Smirnova – sposob otsenki raspredeleniia sovokupnosti [Kolmogorov-Smirnov criterion – method of evaluation of population distribution]. www.medstatistic.ru. Retrieved from http://www.medstatistic.ru/theory/kolmogorov.html (in Russian).

Bolshev, L. N., & Smirnov, N. V. (2009) Tablitsy matematicheskoi statistiki [The tables of mathematic statistics]. Moskow: Nauka. Retrievd from http://www.studmed.ru/bolshev-ln-smirnov-nv-tablicy-matematicheskoy-statistiki_0a72637edd4.html (in Russian).

Kvantil [Quantil]. www.machinelearning.ru. Retrieved from http://www.machinelearning.ru/wiki/index.php?title (in Russian).

‎32. Lilliefors, H. W. (1967). On the Kolmogorov – Smirnov test for normality with mean and variance unknown. Journal of the American Statistical Association, Vol. 62, 399–402 (in English).

Barabasheva, Yu. M., Devyatkova, G.N., Tutubalin, B. N., & Uger, E. G. Kriterii Kolmogorova i eksperimentalnaia proverka zakonov nasledsvennosti Mendelia [Kolmogorov criterion and experimental checking of the Mendel heredity laws]. www.ecology.genebee.msu.ru. Retrieved from http://ecology.genebee.msu.ru/3_SOTR/CV_Barabasheva_publ/Kolm-Mend-2008.pdf (in Russian).

Tretiak, L. N. (2004). Obrabotka rezultatov nabludenii [Processing of the observations results]. Orenburg: GOU OGU. Retrieved from https://www.rucont.ru/efd/213178 (in Russian).

Laboratorna robota 8–9. Tema: Kryterii uzgodzhennosti rozpodiliv χ2 – Pirsona [Laboratory work 8-9. Coordination criteria of χ2 distribution]. www.ito.vspu.net. Retrieved from http://www.ito.vspu.net/ENK/obrobka_shahina-konoshevskiy/files/lab_8-9.htm (in Ukrainian).

Laboratorna robota № 3. Kryterii uzgodzhenosti Pearsona. Pobudova kryvoi Gaussa [Laboratory work №3. Pearson coordination criteria. Construction of Gauss curve]. www.tsatu.edu.ua. Retrieved from http://www.tsatu.edu.ua/kn/wp-content/uploads/sites/16/laboratorna-robota-3.pdf (in Ukrainian).

Laboratorna robota № 2. Identyficatsiia zakonu rozpodilu za kryteriiem Pirsona [Identification of distribution law for the test]. www.yasholt.vk.vntu.edu.ua. Retrieved from http://www.yasholt.vk.vntu.edu.ua/file/MOED/23cad4a7c55cb30ef9714876e1053c33.doc

Laboratornaia robota № 11. Kriterii Kolmogorova [Kolmogorov criterion]. www.arhiuch.ru. Retrieved from http://www.arhiuch.ru/lab11.html (in Russian).

Kriterii soglasiia. Proverka gipotez o vide funkcii raspredelenia [Coordination criteria. Testing hypotheses about the form of the distribution function]. termist.com. Retrieved from http://termist.com/bibliot/stud/stepnov/081_1.htm (in Russian).

Malinin, V. N. (2008). Statisticheskie metody analiza gidrometerologicheskoi informatsii [Statistical analysis methods of hydrometeorological information]. SPb: RGGMU. Retrieved from http://www.elib.rshu.ru/files_books/pdf/img-417184359.pdf (in Russian).


Abstract views: 427
PDF Downloads: 4430
Published
2018-12-17
How to Cite
Motsnyi, F. V. (2018). Analysis of Nonparametric and Parametric Criteria for Statistical Hypotheses Testing. Chapter 1. Agreement Criteria of Pearson and Kolmogorov. Statistics of Ukraine, 83(4), 14-24. https://doi.org/10.31767/su.4(83)2018.04.02