{
"cells": [
{
"cell_type": "markdown",
"id": "d4b3629ddef32e4a",
"metadata": {},
"source": [
"# Kruskal Wallis across all conditions and pairwise between\n"
]
},
{
"cell_type": "markdown",
"id": "c79a2aaa4b595af9",
"metadata": {},
"source": [
"#### Recap - Conditions\n",
"**B:** Baseline, No communication\n",
"
**RTE (previously RTT):** Real-Time Textual Explanation\n",
"
**RV (previously RTV):** Real-Time Visual Communication\n",
"
**RVE:** Real-Time Visual Communication + Explanations\n",
"
**OTE (previously ST):** Textual Summary of Explanations\n",
"
**OVE (previously SVE):** Visual Summary of Explanations"
]
},
{
"cell_type": "markdown",
"id": "1392f701ce82597f",
"metadata": {},
"source": [
"#### 1. Prep variables"
]
},
{
"cell_type": "markdown",
"id": "a31504ce344b9887",
"metadata": {},
"source": [
"##### Import data and packages"
]
},
{
"cell_type": "code",
"execution_count": 1,
"id": "2068147d39a16a2b",
"metadata": {
"ExecuteTime": {
"end_time": "2024-12-28T22:29:10.207896Z",
"start_time": "2024-12-28T22:29:10.150654Z"
}
},
"outputs": [],
"source": [
"# Imports\n",
"import numpy as np\n",
"import pandas as pd\n",
"from scipy import stats\n",
"import matplotlib.pyplot as plt\n",
"import matplotlib.colors as mcolors\n",
"import seaborn as sns\n",
"\n",
"# Allow for viewing the whole table\n",
"pd.set_option('display.max_columns', None)\n",
"pd.set_option('display.max_rows', None)\n",
"\n",
"# Import dataset\n",
"file_path = 'capped_dataset.csv'\n",
"# file_path = 'capped_dataset_no_baseline.csv'\n",
"data = pd.read_csv(file_path)\n",
"\n",
"# Fix metrics and conditions\n",
"metrics = ['Compliance', 'Natural_Trust', 'Satisfaction', 'Artificial_Competence', 'Artificial_Willingness', 'Artificial_Trust', 'Communication_Rate']\n",
"conditions = ['B', 'RTE', 'RV', 'RVE', 'OTE', 'OVE']\n",
"# conditions = ['SVE', 'RVE', 'ST', 'RTV', 'RTT']"
]
},
{
"cell_type": "markdown",
"id": "aaef4e58fda43e57",
"metadata": {},
"source": [
"###### Aggregate metrics"
]
},
{
"cell_type": "code",
"execution_count": 2,
"id": "d3a3a632b2692b30",
"metadata": {
"ExecuteTime": {
"end_time": "2024-12-28T22:29:10.236216Z",
"start_time": "2024-12-28T22:29:10.227791Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"
\n", " | ID | \n", "Condition | \n", "Age | \n", "Region | \n", "Gender | \n", "Education Level | \n", "CS Major | \n", "MATRX Experience | \n", "Gaming Experience | \n", "Operating System | \n", "Trust 1 | \n", "Trust 2 | \n", "Trust 3 | \n", "Trust 4 | \n", "Trust 5 | \n", "Trust 6 (negative) | \n", "Trust 7 | \n", "Trust 8 | \n", "Satisfaction 1 | \n", "Satisfaction 2 | \n", "Satisfaction 3 | \n", "Satisfaction 4 | \n", "Satisfaction 5 | \n", "Satisfaction 6 | \n", "Satisfaction 7 | \n", "What information would you have liked the RescueBot to provide but was missing? | \n", "What did you like most about your collaboration with RescueBot? | \n", "What did you like least about your collaboration with RescueBot? | \n", "What do you think RescueBot thinks of you? How does that make you feel? | \n", "Completeness | \n", "Score | \n", "Ticks | \n", "Agent actions | \n", "Human actions | \n", "Joint actions | \n", "Human messages | \n", "Compliance | \n", "Search competence | \n", "Victim competence | \n", "Obstacle competence | \n", "Search willingness | \n", "Victim willingness | \n", "Obstacle willingness | \n", "Search confidence | \n", "Obstacle confidence | \n", "Victim confidence | \n", "Natural_Trust | \n", "Satisfaction | \n", "Artificial_Competence | \n", "Artificial_Willingness | \n", "Artificial_Trust | \n", "Artificial_Confidence | \n", "Communication_Rate | \n", "Ratio_Joint_Human | \n", "Ratio_Joint_Agent | \n", "Ratio_Human_Agent | \n", "Human_Action_Rate | \n", "Agent_Action_Rate | \n", "Joint_Action_Rate | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | \n", "B1 | \n", "B | \n", "18-24 | \n", "Europe | \n", "Woman | \n", "Bachelor | \n", "Yes | \n", "No | \n", "Very little experience | \n", "Macbook | \n", "5 | \n", "4 | \n", "5 | \n", "5 | \n", "4 | \n", "1 | \n", "3 | \n", "4 | \n", "5 | \n", "5 | \n", "5 | \n", "4 | \n", "4 | \n", "4 | \n", "4 | \n", "Maybe one or two | \n", "We get alung well | \n", "Sometimes I have to wait to send a message | \n", "Fast learner | \n", "1.000000 | \n", "27 | \n", "4854 | \n", "238 | \n", "322 | \n", "212 | \n", "15 | \n", "3 | \n", "0.2 | \n", "1.0 | \n", "1.0 | \n", "0.4 | \n", "1.000000 | \n", "1.000000 | \n", "0.30 | \n", "0.35 | \n", "1.0 | \n", "3.875 | \n", "4.428571 | \n", "0.733333 | \n", "0.800000 | \n", "0.766667 | \n", "0.550000 | \n", "0.030902 | \n", "0.658385 | \n", "0.890756 | \n", "1.352941 | \n", "0.663370 | \n", "0.490317 | \n", "0.436753 | \n", "
1 | \n", "B2 | \n", "B | \n", "18-24 | \n", "Europe | \n", "Man | \n", "High School | \n", "Yes | \n", "No | \n", "Some experience | \n", "Windows | \n", "5 | \n", "3 | \n", "4 | \n", "5 | \n", "5 | \n", "4 | \n", "4 | \n", "4 | \n", "4 | \n", "4 | \n", "4 | \n", "4 | \n", "3 | \n", "5 | \n", "5 | \n", "The robot should tell me to try and use it as ... | \n", "NaN | \n", "NaN | \n", "NaN | \n", "0.833333 | \n", "24 | \n", "5387 | \n", "229 | \n", "272 | \n", "170 | \n", "13 | \n", "3 | \n", "-0.4 | \n", "1.0 | \n", "0.4 | \n", "0.1 | \n", "0.730403 | \n", "-0.002227 | \n", "0.65 | \n", "0.20 | \n", "1.0 | \n", "4.250 | \n", "4.142857 | \n", "0.333333 | \n", "0.276059 | \n", "0.304696 | \n", "0.616667 | \n", "0.024132 | \n", "0.625000 | \n", "0.742358 | \n", "1.187773 | \n", "0.504919 | \n", "0.425097 | \n", "0.315575 | \n", "
2 | \n", "B3 | \n", "B | \n", "18-24 | \n", "Europe | \n", "Woman | \n", "Bachelor | \n", "No | \n", "No | \n", "No experience at all | \n", "Windows | \n", "4 | \n", "5 | \n", "5 | \n", "4 | \n", "4 | \n", "5 | \n", "4 | \n", "5 | \n", "4 | \n", "5 | \n", "5 | \n", "5 | \n", "5 | \n", "5 | \n", "4 | \n", "NaN | \n", "that he was informing me of his next action at... | \n", "maybe the text input received can highlight th... | \n", "NaN | \n", "1.000000 | \n", "27 | \n", "5270 | \n", "282 | \n", "297 | \n", "260 | \n", "14 | \n", "1 | \n", "-0.2 | \n", "0.6 | \n", "1.0 | \n", "0.0 | \n", "1.000000 | \n", "1.000000 | \n", "0.20 | \n", "1.00 | \n", "1.0 | \n", "4.500 | \n", "4.714286 | \n", "0.466667 | \n", "0.666667 | \n", "0.566667 | \n", "0.733333 | \n", "0.026565 | \n", "0.875421 | \n", "0.921986 | \n", "1.053191 | \n", "0.563567 | \n", "0.535104 | \n", "0.493359 | \n", "
3 | \n", "B4 | \n", "B | \n", "18-24 | \n", "Europe | \n", "Woman | \n", "Bachelor | \n", "Yes | \n", "No | \n", "Very little experience | \n", "Macbook | \n", "5 | \n", "3 | \n", "3 | \n", "4 | \n", "4 | \n", "5 | \n", "3 | \n", "4 | \n", "4 | \n", "4 | \n", "2 | \n", "2 | \n", "3 | \n", "4 | \n", "2 | \n", "NaN | \n", "The fact that RescueBot was informing me at al... | \n", "NaN | \n", "NaN | \n", "1.000000 | \n", "27 | \n", "5292 | \n", "281 | \n", "359 | \n", "239 | \n", "21 | \n", "4 | \n", "0.0 | \n", "1.0 | \n", "1.0 | \n", "0.1 | \n", "1.000000 | \n", "1.000000 | \n", "1.00 | \n", "1.00 | \n", "1.0 | \n", "3.875 | \n", "3.000000 | \n", "0.666667 | \n", "0.700000 | \n", "0.683333 | \n", "1.000000 | \n", "0.039683 | \n", "0.665738 | \n", "0.850534 | \n", "1.277580 | \n", "0.678382 | \n", "0.530990 | \n", "0.451625 | \n", "
4 | \n", "B5 | \n", "B | \n", "18-24 | \n", "Europe | \n", "Man | \n", "Bachelor | \n", "Yes | \n", "No | \n", "A lot of experience | \n", "Macbook | \n", "4 | \n", "4 | \n", "5 | \n", "5 | \n", "4 | \n", "5 | \n", "2 | \n", "3 | \n", "5 | \n", "4 | \n", "5 | \n", "5 | \n", "5 | \n", "5 | \n", "2 | \n", "NaN | \n", "That it was always falling back to me for guid... | \n", "That it would get stuck performing a task. I w... | \n", "I think the RescueBot trusts me. That makes me... | \n", "1.000000 | \n", "27 | \n", "4184 | \n", "240 | \n", "257 | \n", "210 | \n", "28 | \n", "2 | \n", "1.0 | \n", "1.0 | \n", "1.0 | \n", "1.0 | \n", "1.000000 | \n", "1.000000 | \n", "1.00 | \n", "0.70 | \n", "1.0 | \n", "4.000 | \n", "4.428571 | \n", "1.000000 | \n", "1.000000 | \n", "1.000000 | \n", "0.900000 | \n", "0.066922 | \n", "0.817121 | \n", "0.875000 | \n", "1.070833 | \n", "0.614245 | \n", "0.573614 | \n", "0.501912 | \n", "