Evaluation | ||||||
What is AquaLog
AquaLog is a portable question-answering system which takes queries expressed in natural language and an ontology as input and returns answers drawn from one or more knowledge bases. AquaLog present an elegant solution in which different strategies are combined together. It makes use of the GATE NLP platform as part of the linguistic process , string metrics algorithms , a learning mechanism as a solution to manage domain-dependent lexicon, WordNet and a novel ontology-based relation similarity service to make sense of user queries with respect to the target knowledge base. The work on the AquaLog query answering system is based on the premise that the semantic web will benefit from the availability of natural language query interfaces, which allow users to query semantic markup viewed as a knowledge base As a conclusion, AquaLog provides an interface through which the users, which an specific issue or question in mind, can search for the information they are interested on, in an specific domain, as for example explore the KMi resource, with the facility of formulating the query in natural language. AquaLog is interactive. The ontology helps us to reformulate and understand the query in terms of concepts, instances, values and relations between them Domain AquaLog is currently using the KMi ontology and is coupled with the platform WebOnto, a web server which contains the knowledge models or ontologies in an OCML format. The domain covered by KMi ontology and knowledge base is related to the academic life in our department KMi (Knowledge Media institute), with information like personnel, projects, technologies, planet news, events, etc., which is automatically extracted from departmental databases and unstructured web pages. As pointed out above, AquaLog is an interface to query this semantic markup directly. For instance, we can ask a query such as "which are the projects in KMi related to the semantic web area" and, thanks to an inference engine able to reason about the semantic markup and draw inferences from axioms in the ontology, we can then get the correct answer. Evaluation Before hand, read this documentation, in particular, have a look into the AquaLog linguistic coverage and limitations. Think ten questions you would like to ask into the AquaLog system, about the academic KMi domain. You don't need to have a look into the rest of the website or to play with the system before the evaluation. Somehow, it is even better if you have never used AquaLog before our evaluation. In our meeting, you will be asked to put your questions directly into AquaLog and play with the system. Your interaction with the system will be recorded. AquaLog Linguistic Coverage So far, AquaLog is able to handle different categories of queries based on pure linguistic criteria. Brief explanation/examples of the main categories are presented in this section. Note: AquaLog is able to deal with some spelling mistakes Note: Wh-queries are queries formed by: "who", "which", "what", "does anybody", "are there any", "how many", "Give/List/Show/Tell (me) (all)"
Note: After using the system - Evaluate level of expertise of the user and correctness of the natural language expressions THANKS A LOT! :-D |
||||||