A Clustering Algorithm using Self-Organizing Feature Maps

자기 조직화 신경망을 이용한 클러스터링 알고리듬

  • Lee, Jong-Sub (Department of Technical Management Information Systems, Woosong University) ;
  • Kang, Maing-Kyu (Department of Information & Industrial Engineering, Hanyang University)
  • 이종섭 (우송대학교 IT(경영정보)학과) ;
  • 강맹규 (한양대학교 정보경영공학과)
  • Published : 2005.09.30

Abstract

This paper suggests a heuristic algorithm for the clustering problem. Clustering involves grouping similar objects into a cluster. Clustering is used in a wide variety of fields including data mining, marketing, and biology. Until now there are a lot of approaches using Self-Organizing Feature Maps(SOFMs). But they have problems with a small output-layer nodes and initial weight. For example, one of them is a one-dimension map of k output-layer nodes, if they want to make k clusters. This approach has problems to classify elaboratively. This paper suggests one-dimensional output-layer nodes in SOFMs. The number of output-layer nodes is more than those of clusters intended to find and the order of output-layer nodes is ascending in the sum of the output-layer node's weight. We can find input data in SOFMs output node and classify input data in output nodes using Euclidean distance. We use the well known IRIS data as an experimental data. Unsupervised clustering of IRIS data typically results in 15 - 17 clustering error. However, the proposed algorithm has only six clustering errors.

Keywords

References

  1. Aldenderfer, M. S., and Blashfield, R. K.(1984), Cluster Analysis, Saga Publications, London
  2. Anderson, E.(1939), The IRIS's of the Gaspe Peninsula, Bull. Amer. IRIS Soc., 59, 2-5
  3. Berry, M. J. A. and Linoff, G.(I997), Data Mining Techniques for Marketing, Sales, and Customer Support, John Wiley & Sons, New York
  4. Berry, M.J.A. and Linoff, G. S.(2004), Data Mining Techniquesfor Marketing, Sales, and Customer Relationship Management, John Wiley & Sons, New York
  5. Bezdek, J. C.(1981), Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum, New York
  6. Chan, H. M. and Milner, D. A.(1982), Directclustering algorithm for group formation in cellular manufacturing, Journal of Manufacturing Systems, 1(1), 65-75 https://doi.org/10.1016/S0278-6125(82)80068-X
  7. Chandrasekharan, M. P. and Rajagopolan, R.(1987), ZODIAC: An algorithm for concurrent format of part-families and machinecells, International Journal of Production Research, 25(6), 835-850 https://doi.org/10.1080/00207548708919880
  8. Chandrasekharan, M. P. and Rajagopolan, R.(1989), Groupability:An analysis of the properties of binary data matrices for group technology, International Journal of Production Research, 27(6), 1035-1052 https://doi.org/10.1080/00207548908942606
  9. Everitt, B. S.(1993), ClusterAnalysis, Edward Arnold, London
  10. Everitt, B. S., Laudau, S., and Leese, M.(2001), Cluster Analysis, Edward Arnold, London
  11. Huntsberger, T. L. and Ajjimarangsee, P.(1990), Parallel Self-Organizing Feature Maps for Unsupervised Pattern Recognition, International Journal of General Systems, 16(4), 357-372 https://doi.org/10.1080/03081079008935088
  12. Karayiannis, N. B.(1997). A Methodology for Constructing Fuzzy Algorithms for Learning Vector Quantization, IEEE Trans. Neural Networks, 8(3), 505-518 https://doi.org/10.1109/72.572091
  13. King, J. R. and Nakornchai, V.(1982), Machine-component group formation in group technology: Review and extension, International Journal of Production Research, 20(2), 117-133 https://doi.org/10.1080/00207548208947754
  14. Kohonen, T.(1984), Self-Organization and Associative Memory, Springer, Berlin
  15. Kohonen, T.(1988), Self-Organization and Associative Memory, Springer, Berlin
  16. Kohonen, T.(1997), Self-Organizing Maps, Springer, Berlin
  17. Kusiak, A.(2000), Computational Interlligence in Design and Manufacturing, John Wiley & Sons, New York
  18. Kusiak, A. and Chow, W. S.(1987), Efficient solving of the group technology problem, Journal of Manufacturing Systems, 6(2), 117-124 https://doi.org/10.1016/0278-6125(87)90035-5
  19. Mangiameli, P., Chen, S. K., and West, D.(1996), A Comparison of SOM Neural Network and Hierarchical Clustering Methods, European Journal of Operational Research, 93(2), 402-407 https://doi.org/10.1016/0377-2217(96)00038-0
  20. Pal, N. N., Bezdek, J. C., and Tasao, E. C. K.(1993), Generalized Clustering Networks and Kohonen's Self-Organizing Scheme, IEEE Trans. Neural Networks, 4(4), 549-551 https://doi.org/10.1109/72.238310
  21. Tasao, E. C. K., Bezdek, J. C., and Pal, N. N.(1994), Fuzzy Kohonen Clustering Networks, Pattern Recognition, 27(5), 754-757