**** Artificial Social Agent Questionnaire Instrument ****
Author: Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, Willem-Paul Brinkman
Corresponding author: Siska Fitrianie, s.fitrianie@tudelft.nl
https://doi.org/10.4121/19650846

Interactive Intelligence Group
Department of Intelligent Systems
P.O. Box 5031,
2600 GA Delft,
The Netherlands

Description of the dataset
------------------------------------------------------------------------------------------------------------------------------------
The ASA_questionnaire_instrument.zip contains the output of the research into Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. The Artificial-Social-Agent Questionnaire: Establishing the long and short questionnaire versions. In ACM International Conference on Intelligent Virtual Agents (IVA’22), September, 2022, Faro, Portugal. ACM, New York, NY, USA. https://doi.org/10.1145/3514197.3549612. It also serves as a complementary material of the paper.


The ASA Questionnaire is an instrument for evaluating human interaction with an artificial social agent (ASA), resulted from multi-year efforts involving more than 100 Intelligent Virtual Agent (IVA) researchers worldwide within the OSF work-group of Artificial Social Agent Evaluation Instrument (https://osf.io/6duf7/). It has 19 measurement constructs constituted by 90 items, which capture more than 80% of the constructs identified in empirical studies published in the IVA conference 2013-2018. In addition, a representative item of each construct or dimension was selected to create a 24-item short version of the ASA questionnaire. Whereas the long version is suitable for a comprehensive evaluation of human-ASA interaction, the short version allows quick analysis and description of the interaction with the ASA. To support reporting ASA questionnaire results, we also put forward an ASA chart. The chart provides a quick overview of agent profile.


Abstract of the paper Fitrianie et al. (2022)
------------------------------------------------------------------------------------------------------------------------------------
We present the ASA Questionnaire, an instrument for evaluating human interaction with an artificial social agent (ASA), resulted from multi-year efforts involving more than 100 Intelligent Virtual Agent (IVA) researchers worldwide. It has 19 measurement constructs constituted by 90 items, which capture more than 80% of the constructs identified in empirical studies published in the IVA conference 2013-2018.  This paper reports on construct validity analysis, specifically convergent and discriminant validity of initial 131 instrument items that involved 532 crowd-workers who were asked to rate human interaction with 14 different ASAs. The analysis included several factor analysis models, and resulted in the selection of 90 items for inclusion of the long version of the ASA questionnaire. In addition, a representative item of each construct or dimension was selected to create a 24-item short version of the ASA questionnaire. Whereas the long version is suitable for a comprehensive evaluation of human-ASA interaction, the short version allows quick analysis and description of the interaction with the ASA. To support reporting ASA questionnaire results, we also put forward a ASA chart. The chart provides a quick overview of agent profile.

Requirements
------------------------------------------------------------------------------------------------------------------------------------
1. Pdf reader
2. Internet browser

Quick Instruction
------------------------------------------------------------------------------------------------------------------------------------
1. Unzip the ASA_questionnaire_instrument.zip
2. Use ASA-questionnaire.pdf to access the long and short versions of the ASA Questionnaire, also the explanation of the ASA Chart
3. Use the .html files in the folder 'ASA Chart Generator' to generate ASA Charts. The README.txt in this folder explains how to use the files and provides the reference into the numbering of the constructs/dimensions used in the generator; 14_ASAs_input.pdf provides examples of input based on 14 ASAs used in the research.

Revision
------------------------------------------------------------------------------------------------------------------------------------
01/09/2023
- Fix typeO on ASA Questionnaire UEP1
