Loading...
An Evaluation of a Linguistically Motivated Conversational Software Agent Framework
Panesar, Kulvinder
Panesar, Kulvinder
Publication Date
2019-07
End of Embargo
Supervisor
Rights
© 2020 The Author. Published by Universitat Politecnica de Valencia. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Peer-Reviewed
yes
Open Access status
Accepted for publication
2019-03-03
Institution
Department
Awarded
Embargo end date
Additional title
Abstract
This paper presents a critical evaluation framework for a linguistically motivated conversational software agent (CSA). The CSA prototype investigates the integration, intersection and interface of the language, knowledge, and speech act constructions (SAC) based on a grammatical object, and the sub-model of belief, desires and intention (BDI) and dialogue management (DM) for natural language processing (NLP). A long-standing issue within NLP CSA systems is refining the accuracy of interpretation to provide realistic dialogue to support human-to-computer communication. This prototype constitutes three phase models: (1) a linguistic model based on a functional linguistic theory – Role and Reference Grammar (RRG), (2) an Agent Cognitive Model with two inner models: (a) a knowledge representation model, (b) a planning model underpinned by BDI concepts, intentionality and rational interaction, and (3) a dialogue model. The evaluation strategy for this Java-based prototype is multi-approach driven by grammatical testing (English language utterances), software engineering and agent practice. A set of evaluation criteria are grouped per phase model, and the testing framework aims to test the interface, intersection and integration of all phase models. The empirical evaluations demonstrate that the CSA is a proof-of-concept, demonstrating RRG’s fitness for purpose for describing, and explaining phenomena, language processing and knowledge, and computational adequacy. Contrastingly, evaluations identify the complexity of lower level computational mappings of NL – agent to ontology with semantic gaps, and further addressed by a lexical bridging solution.
Version
Published version
Citation
Panesar, K (2019) An Evaluation of a Linguistically Motivated Conversational Software Agent Framework. Journal of Computer-Assisted Linguistic Research. Issue 3: 41-66
Link to publisher’s version
Link to published version
Link to Version of Record
Type
Article