COMPARISON OF PREPROCESSING GEOGRAPHICALLY STRUCTURED DATA ON THE EXAMPLE OF PRICES IN DAILY DETAIL

Authors

  • Venera M. Timiryanova Ufa University of Science and Technology image/svg+xml
  • Aleksandr S. Dobrovoltsev Ufa University of Science and Technology image/svg+xml
  • Murat N. Shamuratov Ufa University of Science and Technology image/svg+xml
  • Angelina O. Vinogradova University of Science and Technology MISIS

DOI:

https://doi.org/10.17308/sait/1995-5499/2026/2/89-105

Keywords:

GIS technology, spatial autocorrelation, connectivity matrix, price, potato, microdata

Abstract

Price forecasting is important for the state interested in ensuring food security and social sustainability. It is important for enterprises in order to strengthen their competitive positions in the markets. The inclusion of a spatial lag contributes to improving the quality of such forecasts. The efficiency and locality of forecasts increase against the background of the development of data collection technologies used to obtain them. This study examines the effect of various methods of data pre-processing, construction of spatial weight matrices on spatial autocorrelation estimates. A computational experiment was conducted to compare alternative estimates of the global Moran’s index obtained using the data of the Sales in the Russian Federation platform for potatoes for the period 01.01.2021-31.12.2024. It included testing 5 approaches to excluding outliers, 2 approaches to data imputation, 3 approaches to establishing neighborhoods and 6 options for estimating spatial weights. The results show that the used methods of data pre-processing and estimating spatial weights affect the statistical significance of the estimates obtained, actualizing the importance of justifying the choice of alternatives. It was found that the highest spatial autocorrelation was detected in the data, the preprocessing of which included cutting off outliers beyond 1.5 interquartile range from the first and third quartiles. Comparison of neighborhood determination methods showed that higher estimates of spatial autocorrelation were obtained for options taking into account the location of three nearest neighbors and neighbors in a radius equal to the maximum value among all pairs of nearest neighbors. Standardization of spatial weight matrices has a positive effect on the evaluation results. This study provides practical recommendations for the use of data preprocessing and spatial weights estimation when testing for spatial autocorrelation in data, indicating their advantages and disadvantages.

Author Biographies

  • Venera M. Timiryanova, Ufa University of Science and Technology

    DSc in Economy Sciences, Assoc. Prof., Chief Researcher of the Laboratory for the Study of Socio-Economic Problems of Regions

  • Aleksandr S. Dobrovoltsev, Ufa University of Science and Technology

    Software Engineer, Institute of Computer Research

  • Murat N. Shamuratov, Ufa University of Science and Technology

    4th-year bachelor student, Department of Statistics and Business Informatics

  • Angelina O. Vinogradova, University of Science and Technology MISIS

    3rd year bachelor student, Department of engineering cybernetics

References

1. Шагайда Н. И., Терновский Д. С. Волатильность цен на продовольственные товары в 2021-2022 гг. в контексте продовольственной безопасности // Вопросы экономики. – 2023. – № 9. – C. 29–46. – DOI: 10.32609/0042- 8736-2023-9-29-46.

2. Benedetti I. Addressing Food Affordability in Italy: An Analysis of Food Inflation Dynamics Using Open Data. International Social Science Journal. – 2025. – 28 March. – DOI: /10.1111/ issj.12569.

3. Твердые цифры: открытые микроданные о потребительских ценах / А. Исаков [и др.] // Деньги и кредит. – 2021. – № 1. – С. 104–119. – DOI: 10.31477/rjmf.202101.104.

4. Тимирьянова В. М. Прогнозирование розничной торговли на высокочастотных обезличенных данных / В. М. Тимирьянова, И. А. Лакман, М. М. Ларькин // Компьютерные исследования и моделирование. – 2023. – Т. 15, № 6. – С. 1713–1734. – DOI: 10.20537/2076- 7633-2023-15-6-1713-1734.

5. Konny C. G., Williams B. K., Friedman D. M. Big Data in the US Consumer Price Index: Experiences and Plans. Big Data for 21st Century Economic Statistics. – University of Chicago Press, 2019.

6. Scanner data: advances in methodology and new challenges for computing consumer price indices. Economie et Statistique / Leclair M. [et al.]. Economics and Statistics. – 2019. – No 509. – P. 13–29. – DOI: 10.24187/ecostat.2019.509.1981.

7. Калинин А. М., Волин И. А. Информационные источники для расчета индекса потребительских цен: большие данные сети Интернет и систем ФНС России // Вопросы статистики. – 2022. – № 29 (1). – C. 44–51. – DOI: 10.34023/2313-6383-2022-29-1-44-51.

8. Chacaltana J., Leung V., Lee M. New Technologies and the Transition to Formality: The Trend Towards E-Formality. Employment Policy Department. Working Paper No. 247. – 2018. – 40 p.

9. Zhang L., Hua L. Major Issues in High-Frequency Financial Data Analysis: A Survey of Solutions. Mathematics. – 2025. – Vol. 13, 347. – DOI: 10.3390/math13030347.

10. Иванова В. И. Конвергенция цен на рынке зерна: исторический аспект / В. И. Иванова // Пространственная экономика. – 2015. – № 3. – С. 34–56. – DOI: 10.14530/se.2015.3.034- 056.

11. Кириллов А. М. Исследование пространственной автокорреляции: случай российской региональной инфляции // Прикладная эконометрика. – 2021. – № 4 (64). – С. 5–22. – DOI: 10.22394/1993-7601-2021-64-5-22.

12. Dai J. [et al.] Agricultural support and spatial price transmission: evidence from China’s maize sector. International Food and Agribusiness Management Review. – 2023. – № 26(2). – P. 325–340. – DOI: 10.22434/IFAMR2021.0160.

13. Ojogho O., Izekor O. B. Rice Price Differentials in Rural Markets of Edo State, Nigeria. Journal of Agroforestry and Environment. – 2023. – № 16(1). – P. 114–121. – DOI: 10.55706/ jae1614.

14. Динамика пространственной корреляции цен на овощи и фрукты / В. М. Тимирьянова [и др.]. // Пространственная экономика. 2023. – Т. 19, № 2. – С. 94–125. – DOI: 10.14530/ se.2023.2.094-125.

15. Cliff A. D., Ord J. K. Spatial Processes: Models and Applications. London: Pion, 1981. – Vol. 44. – 266 p.

16. Балаш В. А. Пространственная корреляция в статистических исследованиях / В. А. Балаш, А.Р. Файзлиев // Промышленность: экономика, управление, технологии. – 2008. – № 4(23). – С. 122–125.

17. Пространственная автокорреляция цен: чувствительность к выбору весовой матрицы и уровню агрегирования данных / В. М. Тимирьянова [и др.]. // Вестник Магнитогорского государственного технического университета им. Г. И. Носова. – 2025. – Т. 23, № 1. – С. 190–200. – DOI: 10.18503/1995-2732- 2025-23-1-190-200.

18. Zitoune I. The impact of data preparation techniques on house price prediction task // Вестник ВГУ. Серия: Системный анализ и информационные технологии. – 2025. – № 1. – C. 133–142. – DOI: 10.17308/sait/1995- 5499/2025/1/133-142.

19. Alghamdi T. A., Javaid N. Survey of Preprocessing Methods Used for Analysis of Big Data Originated From SGs. IEEE Access. – 2022. – Vol. 10. – P. 29149–29171. – DOI: 10.17016/ FEDS.2019.057.

20. Deshaies-Moreault C., Harper B., Yung W. Analysis of scanner data for the consumer price index at Statistics Canada. Chapter 17. The Unit Problem and Other Current Topics in Business Survey Methodology. Ed. B. Lorenc, M. Bavdaz, G. Haraldsen, D. Nedyalkova, P. Smith, L.-Ch. Zhang, T. Zimmermann. UK: Cambridge Scholars Publishing: Newcastle upon Tyne. 2018.

21. Aladangady A. [et al.] From Transactions Data to Economic Statistics: Constructing Real-time, High-frequency, Geographic Measures of Consumer Spending. Finance and Economics Discussion. 2019. Series 2019-057. Washington: Board of Governors of the Federal Reserve System. – DOI: 10.17016/FEDS.2019.057.

22. Clark S.D. [et al.] Dietary Patterns Derived from UK Supermarket Transaction Data with Nutrient and Socioeconomic Profiles. Nutrients. – 2021. – Vol. 13, 1481. – DOI: 10.3390/ nu13051481.

23. Chen H., Qian W., Wen W. The Impact of the COVID-19 Pandemic on Consumption: Learning from High Frequency Transaction Data. SSRN Working Paper No 3568574. – 2020. – DOI: 10.2139/ssrn.3568574.

24. Practical Guide for Processing Supermarket Scanner Data. EU: Eurostat. 2017. – Режим доступа: https://circabc.europa.eu/sd/ a/8e1333df-ca16-40fc-bc6a-1ce1be37247c/practical-guide-supermarket-scanner-data-september-2017.pdf. – (Дата обращения: 05.04.2023).

25. Chen H. [et al.] Spatial patterns of associations among ecosystem services across different spatial scales in metropolitan areas: A case study of Shanghai, China. Ecological Indicators Volume. – 2022. – 136(March). – 108682. – DOI: 10.1016/j.ecolind.2022.108682.

26. Deng H., Liu K., Feng J. Understanding the impact of modifiable areal unit problem on urban vitality and its built environment factors. Geo-Spatial Information Science. – 2024. – 28(2). – P. 455– 471. – DOI: 10.1080/10095020.2024.2336593.

27. Liang Zh. [et al.] Balancing simulation performance and computational intensity of CA models for large-scale land-use change simulations. Environmental Modelling & Software. – 2025. – Vol. 185. – 106293. – DOI: 10.1016/j.envsoft.2024.106293.

28. CNews Analytics: Рейтинг операторов фискальных данных 2025. – Режим доступа: https://www.cnews.ru/articles/2025-03-13_ cnews_analytics_rejting_operatorov_fiskalnyh – (Дата обращения: 05.04.2025).

29. Weinand S., von Auer L. Anatomy of regional price differentials: evidence from micro-price data. Spatial Economic Analysis. – 2020. – № 15(4). – P. 413–440. – DOI: 10.1080/17421772.2020.1729.

30. Anselin L. An Introduction to Spatial Data Science with GeoDa. Center for Spatial Data Science. University of Chicago. 2023. URL: https:// lanselin.github.io/introbook_vol1/broadening-the-concept-of-contiguity.html

31. Балаш В. А. Эконометрический анализ геокодированных данных о ценах на жилую недвижимость / В. А. Балаш, О. С. Балаш, А. В. Харламов // Прикладная эконометрика. – 2011. – № 2(22). – С. 62–77.

Published

2026-06-30

Issue

Section

System Analysis of Socio-Economic Processes

How to Cite

Timiryanova, V. M., Dobrovoltsev, A. S., Shamuratov, M. N., & Vinogradova, A. O. (2026). COMPARISON OF PREPROCESSING GEOGRAPHICALLY STRUCTURED DATA ON THE EXAMPLE OF PRICES IN DAILY DETAIL. Proceedings of Voronezh State University. Series: Systems Analysis and Information Technologies, 2, 89-105. https://doi.org/10.17308/sait/1995-5499/2026/2/89-105