Two Steps Break-Cull Model for Automatic Indexing of Persian Texts

Message:
Abstract:
Purpose
Each language has its own problems. This leads to consider appropriate models for automatic indexing of every language. These models should concern the exhaustificity and specificity of indexing. This paper aims at introduction and evaluation of a model which is suited for Persian automatic indexing. This model suggests to break the text into the particles of candidate terms and to cull the most appropriate ones through a special method of term weighting.
Methodology
The introduction method of the automatic indexing model is performed through showing the steps and the possible problems for running them. Evaluation is based on the inclusion index. This index is used for determination the inter-indexer consistency. Therefore، the consistency of resulted index terms (from this model) and author keywords is determined.
Findings
Findings show that 90% of articles'' most weighted terms are similar to their first author keywords. The overall consistency between the results of running the model and author keywords is 76%. Compared with the prior works، the performance of the model is acceptable. Originality/Value: The initial value of this paper is concerning the automatic indexing with regard of Persian language problems. The model is well suited for using regular expression language which is supported by many programming languages. This diminishes the need to create database tables for text manipulation and processing. In addition، the model solves the problem of upper threshold for determination of final terms. Another algorithm makes it possible to determine the lower one. Finally، the number of culled terms does not depend on the text length. This guaranties the exhaustificity and specificity of indexing.
Language:
Persian
Published:
Research on Information Scienc & Public Libraries, Volume:21 Issue: 80, 2015
Pages:
13 to 40
https://www.magiran.com/p1405824  
سامانه نویسندگان
  • Tavakolizadeh Ravari، Mohammad
    Author
    Tavakolizadeh Ravari, Mohammad
    Associate Professor Information Science und Knowledge Studies, University of Yazd, یزد, Iran
اطلاعات نویسنده(گان) توسط ایشان ثبت و تکمیل شده‌است. برای مشاهده مشخصات و فهرست همه مطالب، صفحه رزومه را ببینید.
مقالات دیگری از این نویسنده (گان)