Korean Journal of Agricultural and Forest Meteorology (한국농림기상학회지)

Korean Society of Agricultural and Forest Meteorology (한국농림기상학회)
권호 표지
DOI QR코드

DOI QR Code

Comparison of Statistic Methods for Evaluating Crop Model Performance

작물모형 평가를 위한 통계적 방법들에 대한 비교

  • Kim, Junhwan (Rice Research Division, National Institute of Crop Science, RDA) ;
  • Lee, Chung-Kuen (Rice Research Division, National Institute of Crop Science, RDA) ;
  • Shon, Jiyoung (Rice Research Division, National Institute of Crop Science, RDA) ;
  • Choi, Kyung-Jin (Rice Research Division, National Institute of Crop Science, RDA) ;
  • Yoon, Younghwan (Rice Research Division, National Institute of Crop Science, RDA)
  • 김준환 (농촌진흥청 국립식량과학원 답작과) ;
  • 이충근 (농촌진흥청 국립식량과학원 답작과) ;
  • 손지영 (농촌진흥청 국립식량과학원 답작과) ;
  • 최경진 (농촌진흥청 국립식량과학원 답작과) ;
  • 윤영환 (농촌진흥청 국립식량과학원 답작과)
  • Received : 2012.11.08
  • Accepted : 2012.12.10
  • Published : 2012.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

The objective of this short communication is to introduce several evaluation methods to crop model users because the evaluation of crop model performance is an important step to develop or select crop model. In this paper, mean error, mean absolute error, index of agreement, root mean square error, efficiency of model, accuracy factor and bias factor were explained and compared in terms of dimension and observed number. Efficiency of model and index of agreement are dimensionless and independent of number of observation. Relative root mean square, accuracy factor and bias factor are dimensionless and not independent of number of observation. Mean error and mean absolute error are affected by dimension and number of observation.

작물모형 평가에 사용되거나 사용할 수 있는 9가지 지표를 소개하였으며 이들의 특징은 다음과 같다. efficiency of model (EF)와 index of agreement (d)은 dimension이 없고 관측수(n)에 의존적이지 않았으며, dimension에 대해서만 자유로운 것은 relative root mean square error (RRMSE), bias factor (Bf)와 accuracy factor (Af)이다. Root mean sqruar, mean error, mean absolute error들은 관측수와 dimension에 영향을 받기 때문에 판단 시 주의가 필요하다. 따라서 이들의 특징을 파악하여 목적에 맞게 모형의 성능을 파악하여야 한다.

Keywords

References

  1. Bellocchi, G., M. Acutis, G. Fila, and Donatelli, Marcello, 2002: An Indicator of Solar Radiation Model Performance based on a Fuzzy Expert System. Agronomy Journal 94, 1222-1233. https://doi.org/10.2134/agronj2002.1222
  2. Bowman, B. and H. van Laar, 2006: Description and evaluation of the rice growth model ORYZA2000 under nitrogenlimited conditions. Agricultural Systems 87, 249-273. https://doi.org/10.1016/j.agsy.2004.09.011
  3. Choi, K, J. Lee, N. Chung, and W. Yang, 2002: The effect of temperature and day-length on the heading of rice cultivars. Treatises of Crop Researches 3, 163-170.
  4. Chung, U., K. Cho, and B. Lee, 2006: Evaluation of sitespecific potential for rice production in Korea under the changing climate. Korean Journal of Agricultural and Forest Meteorology 8, 229-241. (in Korean with English abstract)
  5. Cui, R. X. and B. W. Lee, 2002: Spikelets number estimation model using nitrogen nutrition status and biomass at panicle initiation and heading stage of rice. Korean Journal of Crop Science 47, 390-394.
  6. Shin, J. and M. Lee, 1995. Rice production in south Korea under current and future climates. Modeling the impact of climate change on rice production in Asia. Matthews R. M., Kroff M. J., Bachelet D. and van Larr H.H. (eds), IRRI, CAB International 199-213.
  7. Lee, C., J. Shin, D. Kim, K. Choi, T. Park, and J. Kim, 2004a: Flowering response of rice varieties on photoperiod at different temperature regimens. Treatises of Crop Researches 5, 258-264. (in Korean with English abstract)
  8. Lee, C., J. Shin, D. Kim, K. Choi, T. Park, and J. Kim, 2004b: Growth simulation of Ilpumbyeo under Korean environment using rice growth simulation model "Oryza 2000". Treatises of Crop Researches 5, 250-257. (in Korean with English abstract)
  9. Lee, C. 2008: Development and application of model for estimating grain weight and grain N content in rice. Seoul National University. Ph.D thesis 102-134. (in Korean with English abstract)
  10. Loague, K. and R. E. Green, 1991: Statistical and graphical methods for evaluating solute transport models:overview and application. Journal of Contaminant Hydrology 7, 51-73. https://doi.org/10.1016/0169-7722(91)90038-3
  11. Rinaldi, M., N. Losavio, and Z. Flagella, 2003: Evaluation and application of the OILCROP-SUN model for sunower in southern Italy. Agricultural Systems 78, 17-30. https://doi.org/10.1016/S0308-521X(03)00030-1
  12. Nash, J. and I. Sutcliffe, 1970: River flow forecasting through conceptual models Part1-A discussion of Principles. Journal of Hydrology 10, 282-290. https://doi.org/10.1016/0022-1694(70)90255-6
  13. Nicolardot, B., S. Recous, and B. Mary, 2001: Simulation of C and N mineralisation during crop residue decomposition: A simple dynamic model based on the C:N ratio of the residues. Plant and Soil 228, 83-103. https://doi.org/10.1023/A:1004813801728
  14. Ross, T., 1996: Indices for performance evaluation of predictive models in food microbiology. Journal of Applied Bacteriology 81, 501-508.
  15. Ross, T., P. Dalgaard, and S. Tienungoon, 2000: Predictive modelling of the growth and survival of Listeria in shery products. International Journal of Food Microbiology 62, 231-245. https://doi.org/10.1016/S0168-1605(00)00340-8
  16. Willmott, C., 1981: On the validation of models. Physical Geography 2(2), 184-194.
  17. Willmott, C., 1982: Some comments on the evaluation of model performance. Bulletin American Meteorological Society 63(11), 1309-1313. https://doi.org/10.1175/1520-0477(1982)063<1309:SCOTEO>2.0.CO;2