Discourse Parsing of Sociology Dissertation Abstracts Using Decision Tree Induction

Authors

  • Shiyan Ou Nanyang Technological University, Singapore
  • Christopher S.G. Khoo Nanyang Technological University, Singapore
  • Dion H. Goh Nanyang Technological University, Singapore
  • Hui-Ying Heng Nanyang Technological University, Singapore

DOI:

https://doi.org/10.7152/acro.v14i1.14114

Abstract

In this study, we investigated the use of decision tree induction to parse the macro-level discourse structure of sociology dissertation abstracts. We treated discourse parsing as a sentence categorization task. The attributes used in constructing the decision tree models were stemmed words that occurred in at least 35 sentences (out of 3694 sentences in 300 sample abstracts). Sentence location information was also used. The model obtained an accuracy rate of 71.3% when applied to a test sample of 100 abstracts. Another model that made use of information regarding the presence of 31 indicator words in neighboring sentences was also developed. Although this model did not obtain better results, a comparison of the two models suggests that an improvement in the classification of sentences in problem statement and research method section is possible by combining the models.

Downloads

Published

2003-10-01

Issue

14th ASIS SIG/CR Classification Research Workshop

Section

Articles

License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).