Browse Source

backup userstudy

Jia, Jingyi 2 years ago
parent
commit
6ab11fb650

BIN
.DS_Store


BIN
Concepts for operating ground based rescue robots using virtual reality/.DS_Store


BIN
Hector_v2/.DS_Store


BIN
Hector_v2/obj/Debug/Assembly-CSharp.csprojAssemblyReference.cache


BIN
Hector_v2/obj/Debug/SteamVR.csprojAssemblyReference.cache


+ 11 - 1
Thesis.md

@@ -310,10 +310,14 @@ After all the tests were completed, participants were asked to compare the four
 >
 > experience vr
 
-
+A total of 8 volunteers participated in the user study (2 females and 6 males between 22 and 30 years, mean age 29.25 years). Five of them were computer science students at the university. Only two participants had previous experience with VR,  and both had played it only a few times.
 
 ##### Quantitative Results
 
+Part of the data for the quantitative analysis comes from the robot's performance and testing results, which were automatically recorded by the proposed system during the tests. The other part of the data comes from the questionnaires that the participants filled out after the test.
+
+
+
 ###### Robot Performance
 
 > introduce what was recorded
@@ -322,6 +326,12 @@ After all the tests were completed, participants were asked to compare the four
 >
 > analysis
 
+During the test ran, these following data were recorded.
+
+% `collision`
+
+The first is the number of collisions between the robot and objects in the scene, which reflects the probability of the robot being destroyed in different operation modes. The assumption before the experiment started was that the number of collisions should be highest in lab mode as well as in UI mode. This is because the two modes involve frequent switching back and forth between the scene and the console or control panel, which may result in the user not being able to concentrate on observing the obstacles in the scene.  【结果】
+
 
 
 ###### Rescue situation

BIN
User Study/.DS_Store


+ 10 - 0
User Study/Procedure.md

@@ -1,3 +1,13 @@
+## Form
+
+[NASA TLX](http://tools.s3psis.net/tlx/)
+
+[Userstudy Google Form](https://docs.google.com/forms/d/e/1FAIpQLSe_dXvjVn4hq89BLySOp5LnR78pstUkYiTKbV8rZ7yZ-q3Lyg/viewform)
+
+[Feedback](https://docs.google.com/forms/d/e/1FAIpQLSdmO92CUK7OopUAEP0YJxo66glwWBMDabc474cx3yQEuZxq3Q/viewform)
+
+
+
 ## List
 
 *Alle Informationen, die ich haben sollte, sowie die Daten, sobald der Test abgeschlossen ist.*

+ 0 - 0
User Study/TLX/README.md → User Study/README.md


BIN
User Study/TLX/.DS_Store


+ 0 - 5
User Study/TLX/HectorVR-1.csv

@@ -1,5 +0,0 @@
-id,participant,condition,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total,time
-1,HectorVR-0,Handle,55,55,55,55,55,55,0,2021/7/5 18:33
-2,HectorVR-0,Lab,55,55,55,55,55,55,0,2021/7/5 18:35
-3,HectorVR-0,Remote,55,55,55,55,55,55,0,2021/7/5 18:35
-4,HectorVR-0,UI,50,50,50,50,50,50,0,2021/7/5 18:36

+ 0 - 5
User Study/TLX/HectorVR-2.csv

@@ -1,5 +0,0 @@
-id,participant,condition,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total,time
-1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01

+ 0 - 5
User Study/TLX/HectorVR-3.csv

@@ -1,5 +0,0 @@
-id,participant,condition,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total,time
-1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01

+ 0 - 5
User Study/TLX/HectorVR-4.csv

@@ -1,5 +0,0 @@
-id,participant,condition,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total,time
-1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01

+ 0 - 5
User Study/TLX/HectorVR-5.csv

@@ -1,5 +0,0 @@
-id,participant,condition,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total,time
-1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01

+ 0 - 5
User Study/TLX/HectorVR-6.csv

@@ -1,5 +0,0 @@
-id,participant,condition,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total,time
-1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01

+ 0 - 5
User Study/TLX/Mean.csv

@@ -1,5 +0,0 @@
-condition,id,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total
-Handle,1.0,55.0,55.0,55.0,55.0,55.0,55.0,45.833333333333336
-Lab,2.0,55.0,55.0,55.0,55.0,55.0,55.0,45.833333333333336
-Remote,3.0,55.0,55.0,55.0,55.0,55.0,55.0,45.833333333333336
-UI,4.0,50.0,50.0,50.0,50.0,50.0,50.0,41.666666666666664

+ 0 - 25
User Study/TLX/Merged.csv

@@ -1,25 +0,0 @@
-,id,participant,condition,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total,time
-0,1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-1,2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-2,3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-3,4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01
-4,1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-5,2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-6,3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-7,4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01
-8,1,HectorVR-0,Handle,55,55,55,55,55,55,0,2021/7/5 18:33
-9,2,HectorVR-0,Lab,55,55,55,55,55,55,0,2021/7/5 18:35
-10,3,HectorVR-0,Remote,55,55,55,55,55,55,0,2021/7/5 18:35
-11,4,HectorVR-0,UI,50,50,50,50,50,50,0,2021/7/5 18:36
-12,1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-13,2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-14,3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-15,4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01
-16,1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-17,2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-18,3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-19,4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01
-20,1,HectorVR-0,Handle,55,55,55,55,55,55,55,2021-07-05 18:33:13
-21,2,HectorVR-0,Lab,55,55,55,55,55,55,55,2021-07-05 18:35:37
-22,3,HectorVR-0,Remote,55,55,55,55,55,55,55,2021-07-05 18:35:51
-23,4,HectorVR-0,UI,50,50,50,50,50,50,50,2021-07-05 18:36:01

+ 0 - 5
User Study/TLX/standard_deviation.csv

@@ -1,5 +0,0 @@
-,conditon,mental-demand,physical-demand,temporal-demand,performance,effort,frustration,total
-0,Handle,0.0,0.0,0.0,0.0,0.0,0.0,20.497289793748074
-1,Lab,0.0,0.0,0.0,0.0,0.0,0.0,20.497289793748074
-2,Remote,0.0,0.0,0.0,0.0,0.0,0.0,20.497289793748074
-3,UI,0.0,0.0,0.0,0.0,0.0,0.0,18.633899812498246

BIN
User Study/TestResult/.DS_Store


+ 5 - 0
User Study/TestResult/1.csv

@@ -0,0 +1,5 @@
+participant,condition,Remained Time,Collision,Drive Distance,Total driving time,Adverage speed,Rescued Target,Remained Visible Target,Remained Unvisible Target,time,
+1,HandleTest,0,2,414.837,66.08962,6.276886,9,1,0,2021/07/10 14:41,
+1,LabTest,0,23,1045.603,172.5321,6.060342,6,3,1,2021/07/10 15:02,
+1,RemoteTest,0,8,456.9017,93.45023,4.889252,5,3,2,2021/07/10 15:13,
+1,UITest,0,7,407.7353,157.2579,2.592781,6,0,4,2021/07/10 15:22,

+ 5 - 0
User Study/TestResult/2.csv

@@ -0,0 +1,5 @@
+participant,condition,Remained Time,Collision,Drive Distance,Total driving time,Adverage speed,Rescued Target,Remained Visible Target,Remained Unvisible Target,time
+2,LabTest,0,13,847.2929,207.5591,4.082153,5,5,0,2021/7/10 16:09
+2,RemoteTest,0,4,470.4358,158.8244,2.961986,6,2,2,2021/7/10 16:22
+2,UITest,0,1,647.9003,235.7928,2.747753,7,2,1,2021/7/10 16:58
+2,HandleTest,0,13,807.7278,104.3061,7.743824,8,2,0,2021/7/10 17:08

+ 5 - 0
User Study/TestResult/3.csv

@@ -0,0 +1,5 @@
+participant,condition,Remained Time,Collision,Drive Distance,Total driving time,Adverage speed,Rescued Target,Remained Visible Target,Remained Unvisible Target,time
+3,RemoteTest,0,3,730.2812,251.9804,2.898167,7,3,0,2021/7/10 17:39
+3,UITest,0,4,625.7359,225.2351,2.778146,6,3,1,2021/7/10 17:49
+3,HandleTest,0,29,735.5511,162.4034,4.52916,7,3,0,2021/7/10 17:59
+3,LabTest,0,78,836.9151,251.1339,3.332545,3,5,2,2021/7/10 18:28

+ 5 - 0
User Study/TestResult/4.csv

@@ -0,0 +1,5 @@
+participant,condition,Remained Time,Collision,Drive Distance,Total driving time,Adverage speed,Rescued Target,Remained Visible Target,Remained Unvisible Target,time
+4,UITest,0,12,521.4961,197.3396,2.642632,6,1,3,2021/7/10 19:06
+4,HandleTest,0,29,554.6651,118.1866,4.693131,3,5,2,2021/7/10 19:37
+4,LabTest,0,24,619.068,195.1462,3.172281,2,7,1,2021/7/10 19:48
+4,RemoteTest,0,3,420.6864,143.7477,2.926556,7,2,1,2021/7/10 19:58

+ 5 - 0
User Study/TestResult/5.csv

@@ -0,0 +1,5 @@
+participant,condition,Remained Time,Collision,Drive Distance,Total driving time,Adverage speed,Rescued Target,Remained Visible Target,Remained Unvisible Target,time,
+5,HandleTest,0,30,422.0653,99.28709,4.250959,3,4,3,2021/07/11 15:51,
+5,LabTest,0,37,732.7481,238.4349,3.073159,5,5,0,2021/07/11 16:09,
+5,RemoteTest,0,3,590.5034,146.4765,4.031386,7,2,1,2021/07/11 16:24,
+5,UITest,32,4,606.236,159.4348,3.802408,10,0,0,2021/07/11 16:41,

BIN
User Study/TestResult/Rescue situation.png


BIN
User Study/TestResult/Robot Performance.png


+ 1 - 0
User Study/TestResult/statistic.py

@@ -150,6 +150,7 @@ df_merged = pd.concat(df_from_each_file, ignore_index=True)
 # df_merged.to_csv( "Merged.csv")
 
 # save the results in csv
+df_merged["condition"] = df_merged["condition"].apply(lambda x: x.replace("Test",""))
 file = df_merged.groupby(["condition"]).mean() 
 file.to_csv( "Mean.csv")