Estimation of the values of the sample coefficient of linear pair correlation, statistically indistinguishable from unity

Authors

  • Sergey A. Dobrotin The Russian Presidential Academy of National Economy and Public Administration (The Presidential Academy, RANEPA), Dzerzhinsky branch
  • Olga N. Kosyreva The Russian Presidential Academy of National Economy and Public Administration (The Presidential Academy, RANEPA), Dzerzhinsky branch https://orcid.org/0000-0003-2126-3275 (unauthenticated)

DOI:

https://doi.org/10.17308/sait/1995-5499/2025/1/12-23

Keywords:

indirect measurements, standard uncertainty, sample, linear pair correlation coefficient, insignificant difference from unity, statistical hypothesis testing

Abstract

Uncertainty assessment of indirect measurement results ensures their reliability. The formula for calculating the standard uncertainty specified in GOST 34100.3-2017 uses the coefficient of linear pair correlation between the results of direct measurements. The literature notes the effect of bias of its sample value due to such reasons as sample limitations, the presence of errors in measurement results, etc. To use a special case of this formula, it is necessary to develop a methodology for testing the hypothesis about an insignificant difference of the sample coefficient of linear pair correlation from one. In the special case of a normal distribution of correlation-dependent random variables with the same parameters, this hypothesis can be replaced by an equivalent one about an insignificant difference of the absolute value of the free term of the linear regression equation from zero. Using the method of statistical modeling of correlation-dependent normal variables with subsequent testing of this hypothesis, the dependence of the sample correlation coefficient, indistinguishable from one, on the sample size was obtained. A block diagram of the implementation of the numerical experiment is given. The standard deviation of the obtained correlation coefficient is estimated and its dependence on the sample size is shown. Using the weighted least squares method according to the methodology specified in RMG 54-2002, a fractional-linear regression equation is obtained, describing the dependence of the sample correlation coefficient, indistinguishable from one, on the sample size.

Author Biographies

  • Sergey A. Dobrotin, The Russian Presidential Academy of National Economy and Public Administration (The Presidential Academy, RANEPA), Dzerzhinsky branch

    Doctor of Technical Sciences, Professor, Head of the Department of Information, Natural Sciences and Humanities of The Russian Presidential Academy of National Economy and Public Administration (The Presidential Academy, RANEPA), Dzerzhinsky branch

  • Olga N. Kosyreva, The Russian Presidential Academy of National Economy and Public Administration (The Presidential Academy, RANEPA), Dzerzhinsky branch

    Associate Professor of the Department of Information, Natural Sciences and Humanities of The Russian Presidential Academy of National Economy and Public Administration (The Presidential Academy, RANEPA), Dzerzhinsky branch

References

GOST 34100.3-2017/ISO/IEC Guide 98- 3:2008 Uncertainty of measurement. Part 3. Guide to the expression of uncertainty in measurement. Moscow, Standartinform, 2018. (In Russian).

Popov A. A., Kosyreva O. N. and Dobrotin S. A. (2024) Solving Problems in Finding the Expanded Indirect Measurement Uncertainty. Transactions of NNSTU n.a. R. E. Alekseev. 2(145). P. 149–161. (in Russian).

Bavrina A. P. and Borisov I. B. (2021) Modern Rules of the Application of Correlation Analysis. Medical almanac. 3(68), 70–73. (in Russian).

Francis D. P., Coats A. J. S. and Gibson D. G. (1999) How high can a correlation coefficient be? Effects of limited reproducibility of common cardiological measures. International Journal of Cardiology. 69. P. 185–189. DOI

Sandomirski S. G. (2019) Dependence of the Correlation Coefficient Between the Results of a Parameter Measurement and Its Values on the Reduced Measurement Error. Devices and Methods of Measurements. 10(1). P. 90–98. DOI

Saccenti E., Hendriks M.H.W.B. and Smilde A. K. (2020) Corruption of the Pearson correlation coefficient by measurement error and its estimation, bias, and correction under different error models. Scientific Reports. 10(1):438. P. 1–19. DOI

Rocco P., Cilurzo F., Minghetti P., Vistoli G. and Pedretti A. (2017) Simulation data for an estimation of the maximum theoretical value and confidence interval for the correlation coefficient. Data in Brief. 14. P. 291–294. DOI

Schober P., Boer C. and Schwarte L. A. (2018). Correlation Coefficients. Anesthesia & Analgesia. 126(5). P. 1763–1768. DOI

Udod V. A. (2023) Calculation of the Correlation Coefficient of Random Variables Using Additional Information About the Form of Their Relationship. Tomsk State University Journal of Control and Computer Science. 62. P. 92–100. DOI

(in Russian). 10. Hägglund G. and Larsson R. (2006). Estimation of the Correlation Coefficient Based on Selected Data. Journal of Educational and Behavioral Statistics. 31(4). P. 377–411. DOI

Kulagin V. P., Ivanov A. I., Kuznecov Ju. M. and Serikova Ju. I. (2016) Korrektirovka pogreshnosti vychislenija kojefficientov korreljacii pri malyh vyborkah [Correction of the error in calculating correlation coefficients for small samples]. Proceedings of the International Symposium “Reliability and Quality”, May 23–31 2016, Penza, Russia. Penza, PGU. P. 261–263. URL

Onwuegbuzie A. and Daniel L. (1999) Uses and misuses of the correlation coefficient. Research in the Schools. 9. P. 73–90.

Slobodyan A. B. and Pashchenko F. F. (2017) Estimation of the maximum correlation coefficient using Bernstein copula. Automation and Remote Control. 78. P. 741–753. – DOI

Slobodyan A. B. (2017) About Estimation of the Maximum Correlation Coefficient. IEEE 11th International Conference on Application of Information and Communication Technologies (AICT), Moscow, Russia. P. 1–4. DOI

Baak M., Koopman R., Snoek H. and Klous S. (2020) A new correlation coefficient between categorical, ordinal and interval variables with Pearson characteristics. Computational Statistics & Data Analysis. 152(2). DOI

Chatterjee S. A. (2019) New Coefficient of Correlation. Journal of the American Statistical Association. 116. P. 2009–2022. DOI

Bolshev L. N. and Smirnov N. V. (1983) Tables of Mathematical Statistics. Moscow : Nauka, 1983. 416 p. (In Russian).

Dobrotin S. A. and Kosyreva O. N. (2024) Modeling the Distribution Density of the Linear Pair Correlation Coefficient. Modern State and Municipal Administration: in Search of Resources and Technologies for Social Development: Collection of Scientific Papers of the All-Russian Scientific and Practical Conference, April 18, 2024, Russian Presidential Academy of National Economy and Public Administration (RANEPA), Dzerzhinsky branch, Russia. P. 61–64. (in Russian).

Ahnazarova S. L. and Kafarov V. V. Optimization of Experiments in Chemistry and Chemical Engineering: A Textbook for Chemical Engineering Universities. Moscow: Higher School Publishing House. (in Russian).

GOST 34100.3.1-2017/ISO/IEC Guide 98-3/Suppl 1:2008 Uncertainty of measurement. Part 3. Guide to the expression of uncertainty in measurement. Supplement 1. Propagation of distributions using a Monte Carlo method. Moscow, Standartinform, 2018. (In Russian).

Bartenev V. G. and Bartenev G. B. (2021) On the New Representation of the Correlation Coefficient Estimate Distribution. Digital signal processing. 1. P. 59–62. (in Russian).

Characteristics of calibration instruments for measuring the composition and properties of substances and materials. Methodology for performing measurements using standard samples: Recommendations for interstate standardization 54-2002. Moscow, Standartinform, 2006. (In Russian).

Published

2025-05-12

Issue

Section

Mathematical Methods of System Analysis, Management and Modelling

How to Cite

Estimation of the values of the sample coefficient of linear pair correlation, statistically indistinguishable from unity. (2025). Proceedings of Voronezh State University. Series: Systems Analysis and Information Technologies, 1, 12-23. https://doi.org/10.17308/sait/1995-5499/2025/1/12-23