Summary of Measures (Speech-Specific)

We present speech-specific measures which evaluate the general performance of the speech input method in terms of efficiency and effectiveness. These measures are intended to answer the following questions.

  • How responsive is the server?
  • How responsive is speech input?
  • How much delay is due to the user?
  • How much delay is due to the system?
  • What percentage of time is spent on the speech system?
  • What percentage of time (characters) is related to the keyboard?
  • What percentage of time is spent in inputting an initial sentence using the speech system?
  • What percentage of time (characters) is used to make corrections?
  • What percentage of correction time (characters) is related to the keyboard
  • What percentage of correction time (characters) is related to the speech system?

User Talking Time Divided by Server Process Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.40 0.63 0.69 0.68 0.72 1.07
English 0.55 0.64 0.67 0.67 0.70 0.79
Language User_Talking_Over_Server_Process_Time_Proportion.mean User_Talking_Over_Server_Process_Time_Proportion.sd
Chinese 0.68 0.14
English 0.67 0.06

User Talking Time Divided by Speech Session Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.27 0.37 0.40 0.39 0.43 0.47
English 0.34 0.38 0.41 0.41 0.43 0.46
Language User_Talking_Over_Speech_Session_Time_Proportion.mean User_Talking_Over_Speech_Session_Time_Proportion.sd
Chinese 0.39 0.06
English 0.41 0.03

User Delay Time Divided by Speech Session Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.28 0.32 0.33 0.34 0.37 0.44
English 0.30 0.32 0.34 0.34 0.36 0.39
Language User_Delay_Over_Speech_Session_Time_Proportion.mean User_Delay_Over_Speech_Session_Time_Proportion.sd
Chinese 0.34 0.04
English 0.34 0.03

System Delay Time Divided by Speech Session Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.18 0.24 0.25 0.27 0.28 0.43
English 0.21 0.24 0.25 0.25 0.26 0.29
Language System_Delay_Over_Speech_Session_Time_Proportion.mean System_Delay_Over_Speech_Session_Time_Proportion.sd
Chinese 0.27 0.06
English 0.25 0.02

Speech Session Time Divided by Trial Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.83 0.90 0.91 0.92 0.94 1.00
English 0.86 0.93 0.96 0.95 0.97 0.98
Language Speech_Session_Over_Trial_Time_Proportion.mean Speech_Session_Over_Trial_Time_Proportion.sd
Chinese 0.92 0.04
English 0.95 0.03

Keyboard Session Time Divided by Trial Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.00 0.06 0.09 0.08 0.10 0.17
English 0.01 0.03 0.04 0.05 0.07 0.14
Language Keyboard_Session_Over_Trial_Time_Proportion.mean Keyboard_Session_Over_Trial_Time_Proportion.sd
Chinese 0.08 0.04
English 0.05 0.03

First Speech Session Time Divided by Trial Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.66 0.81 0.86 0.85 0.88 1.00
English 0.77 0.88 0.92 0.91 0.94 0.97
Language First_Speech_Session_Over_Trial_Time_Proportion.mean First_Speech_Session_Over_Trial_Time_Proportion.sd
Chinese 0.85 0.08
English 0.91 0.05

Correction Time Divided by Trial Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.00 0.12 0.14 0.15 0.19 0.34
English 0.03 0.06 0.08 0.09 0.12 0.23
Language Correction_Over_Trial_Time_Proportion.mean Correction_Over_Trial_Time_Proportion.sd
Chinese 0.15 0.08
English 0.09 0.05

Keyboard Correction Time Divided by Correction Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.00 0.09 0.13 0.12 0.14 0.21
English 0.02 0.04 0.05 0.07 0.10 0.20
Language Keyboard_Correction_Over_Correction_Time_Proportion.mean Keyboard_Correction_Over_Correction_Time_Proportion.sd
Chinese 0.12 0.06
English 0.07 0.05

Speech Correction Time Divided by Correction Time

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.00 0.06 0.10 0.11 0.13 0.24
English 0.01 0.03 0.06 0.06 0.07 0.14
Language Speech_Correction_Over_Correction_Time_Proportion.mean Speech_Correction_Over_Correction_Time_Proportion.sd
Chinese 0.11 0.06
English 0.06 0.03

Number of First Speech Session Characters Divided by Number of Trial Characters

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.62 0.76 0.83 0.82 0.86 1.00
English 0.73 0.86 0.92 0.90 0.94 0.96
Language First_Speech_Session_Over_Trial_Character_Proportion.mean First_Speech_Session_Over_Trial_Character_Proportion.sd
Chinese 0.82 0.09
English 0.90 0.06

Number of Correction Characters Divided by Number of Trial Characters

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.00 0.14 0.17 0.18 0.24 0.38
English 0.04 0.06 0.08 0.10 0.14 0.27
Language Correction_Over_Trial_Character_Proportion.mean Correction_Over_Trial_Character_Proportion.sd
Chinese 0.18 0.09
English 0.10 0.06

Number of Keyboard Correction Characters Divided by Number of Correction Characters

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.00 0.15 0.18 0.17 0.20 0.29
English 0.00 0.06 0.07 0.10 0.13 0.34
Language Keyboard_Correction_Over_Correction_Character_Proportion.mean Keyboard_Correction_Over_Correction_Character_Proportion.sd
Chinese 0.17 0.07
English 0.10 0.08

Number of Speech Correction Characters Divided by Number of Correction Characters

Language Min. 1st Qu. Median Mean 3rd Qu. Max.
Chinese 0.00 0.00 0.04 0.05 0.06 0.17
English 0.00 0.01 0.03 0.03 0.04 0.08
Language Speech_Correction_Over_Correction_Character_Proportion.mean Speech_Correction_Over_Correction_Character_Proportion.sd
Chinese 0.05 0.05
English 0.03 0.02