Journal of the Korean Data Analysis Society

Korean Data Analysis Society (한국자료분석학회)
권호 표지

Search Efficiency of General Users and Legal Experts in Utilizing a Korean Legal Ontology Information Retrieval System

일반 이용자와 법 전문가의 온톨로지 기반 법률 검색시스템에 대한 검색 효율성에 관한 연구

  • Chang, In-ho (Department of Library and Information Science, Daejin University) ;
  • Kwon, Sun-Hee (Department of Global Economics, Daejin University)
  • 장인호 (대진대학교 문헌정보학과) ;
  • 권선희 (대진대학교 글로벌경제학과)
  • Received : 2015.07.09
  • Accepted : 2015.08.19
  • Published : 2015.08.31
⟨ Previous Next ⟩

Abstract

Search efficiency has long been stunted within the subject of law due to factors such as the mismatch between legal terminology and everyday language along with the polysemous and abstract character of the legal lexicon, which remain a continuing challenge in keyword searches for law-related information. In an effort to propose alternatives to such shortcomings, this study developed a question-and-answer information retrieval system on the basis of a legal ontology and examined possible differences between general users and legal experts in terms of search efficiency and user satisfaction. It's shown that there small are differences in search time and correct rate between legal experts and general users, which were: 1.52 minute to 1.79 minute, 1.04 to 1.02. Even the general cognitive satisfaction has shown that general users gave 4.3, legal experts 4.0 for satisfactory. The result that both groups turned out to have only small difference in suitability. Also considering that general users' satisfaction with search result, search process and functions, and convenience of usage is higher, it's proven to be also effective for general users with no legal knowledge.

현행 키워드 검색 방식으로는 법률용어와 일상용어의 불일치, 법률용어의 다의성, 법률 용어의 추상성 등으로 인하여 검색 효율성이 높지 못하다. 이에 법률 온토롤지를 구축하여 질의-응답형식의 법률 검색시스템을 구현하고, 검색 성능 및 이용자의 인지적 만족도 분석을 통해 일반 이용자와 법 전문가의 검색 효율성에 차이가 있는지를 검증하였다. 법 전문가와 일반 이용자의 검색시간과 정답률의 평균이 각각 1.52분과 1.79분, 1.04점과 1.02점으로 나타났으며, 인지적 만족도에서도 일반 이용자 평균 4.3, 법 전문가 평균 4.0의 만족도를 보여주고 있다. 온토롤지 기반법률 검색시스템은 개념 계층이 구조화되어 있어 일반 이용자가 검색의 범위를 확대하거나 축소할 수 있어 유용하게 이용할 수 있음을 보여 주고 있으며 일반 이용자와 법 전문가 모두 검색성능 및 이용자의 인지적 만족도가 높아 전반적인 검색 효율성이 크다는 것을 알 수 있었다. 특히 두 집단 간의 검색 적합성의 차이가 거의 없고, 검색 결과, 검색 과정, 검색 기능, 사용 용이성의 만족도가 일반 이용자가 더 높은 것을 볼 때 법적 지식이 없는 일반 이용자에게도 효과적인 것을 알 수 있다.

Keywords

References

  1. Benjamins, V. R., Casanovas, P., Breuker, J., Gangemi, A. (2005). Law and the semantic Web, an introduction. (Benjamins, V. R., Casanovas, P., Breuker, J., Gangemi, A., editors. (2005). Law and the Semantic Web, Legal Ontologies, Methodologies, Legal Information Retrieval, and Applications. Berlin:Springer-Verlag.), 1-17.
  2. Boella, G., Lesmo, L., Damiano, R. (2005). On the ontological status of norms. (Benjamins, V. R., Casanovas, P., Breuker, J., Gangemi, A., editors. (2005). Law and the Semantic Web, Legal Ontologies, Methodologies, Legal Information Retrieval, and Applications. Berlin:Springer-Verlag.), 125-141.
  3. Breuker, J., Casanovas, P., Klein, M. C. A. (2009). The flood, the channels and the dykes: Managing legal information in a globalized and digital world. (Breuker, J., Casanovas, P., Klein, M. C. A. (2009). Law, Ontologies and the Semantic Web: Channelling the Legal Information Flood. Amsterdam: IOS Press..), 3-18.
  4. Breuker, J., Valente, A., Winkels, R. (2005). Use and reuse of legal ontologies in knowledge engineering and information management. (Benjamins, V. R., Casanovas, P., Breuker, J., Gangemi, A., editors. (2005). Law and the Semantic Web, Legal Ontologies, Methodologies, Legal Information Retrieval, and Applications. Berlin:Springer-Verlag.), 36-64.
  5. Cassanovas, P., Casellas, N., Valbe, J.-J. (2009). An ontology-based decision support system for judges. (Breuker, J., Casanovas, P., Klein, M. C. A. (2009). Law, Ontologies and the Semantic Web: Channelling the Legal Information Flood. Amsterdam: IOS Press..), 165-175.
  6. Chang, I. H., (2011). Developing and evaluating an ontology-based legal retrieval system, Journal of the Korean Society for Library and Information Science, 45(2), 345-366. (in Korean). https://doi.org/10.4275/KSLIS.2011.45.2.345
  7. Cho, H. G. (2009). Design of forensics domain ontology for knowledge based cyber criminal investigation, Doctoral Dissertation, Pusan University. (in Korean).
  8. Corcho, O., Fernandez-Lopez, M., Gomez-Perez, A., Lopez-Cima, A. (2005). Building legal ontologies with METHONTOLOGY and WebODE. In Benjamins et. al. 2005a, 142-157.
  9. Kim, Y. S., Eom, J. K., Han, K. H. (2002). Advanced query analysis for product searching system, Journal of the Korean Data Analysis Society, 4(1), 77-89. (in Korean).
  10. Kim, J. H., Lee, K. S., Oh, J. H., Chang, D. S., Choi, K. S. (2001). KorQATeC2.0: Construction of test collection for evaluation of question answering system, Annual Conference on Human and Language Technology, 12(October), 397-404. (in Korean).
  11. Kim, Y. S., Ra, D. Y. (2005). Achieving retrieval effectiveness by category classification of words occurring in Web documents, Journal of the Korean Data Analysis Society, 5(2), 283-293. (in Korean).
  12. Kim, Y. S., Ra, D. Y. Han, K. H. (2003). Query analysis for query-product similarity computation, Journal of the Korean Data Analysis Society, 7(5), 1893-1093. (in Korean).
  13. Kingston, J., Schafer, B., Vandenberghe, W. (2005). No model behaviour ontologies for fraud detection. (Benjamins, V. R., Casanovas, P., Breuker, J., Gangemi, A., editors. (2005). Law and the Semantic Web, Legal Ontologies, Methodologies, Legal Information Retrieval, and Applications. Berlin:Springer-Verlag.), 233-248.
  14. Lee, J. H., Kim, H. S. (2007). A design and implementation of ontology-based retrieval system for the electronic records of university, Journal of the Korean Society for Information Management, 24(3), 343-362. (in Korean). https://doi.org/10.3743/KOSIM.2007.24.3.343
  15. Park, H. W., Park, S. J., Stuart, D., Lee, S. W. (2009). Understanding WeboNaver: API-based search tool for the Naver search engine, Journal of the Korean Data Analysis Society, 11(6B), 3427-3440. (in Korean).
  16. Ryu, J. K., Chung, K. Y., Kim, J. H., Rim, K. W., Lee, J. H. (2011). Recommendation using service ontology based context awareness modeling, Journal of Korea Contents Association, 11(2), 22-30. (in Korean). https://doi.org/10.5392/JKCA.2011.11.2.022
  17. van Laarschot, R. (2005). Ontology-based Knowledge Modelling in Dutch Civil Law. Master's thesis, Department of Artificial Intelligence, Vrije Universiteit Amsterdam.
  18. Voorhees, E. M., Tice, D. (1999). The TREC-8 Question Answering Track Evaluation, In Proceedings of the TREC-8, 83-106.