Supporting non-native English speakers’ listening

Multiple technologies are available to support non-native English speakers (NNS), such as machine translation or displaying captions generated by automated speech recognition. However, simply making these technologies available does not provide effective support for NNS. This research focuses on NNS listening support, where we investigated the effects of displaying automated captions on listening comprehension. Our results suggest that the method of utilizing automated captions depends on NNS’s characteristics. Secondly, problems that NNS face during listening can be broadly divided into problems that can be resolved by displaying automated captions, and problems that cannot be solved but also increase the user's workload when they look at the automated captions. These results suggest that the support method should be changed depending on NNS user's characteristics as well as the types of listening problems.

Please click the thumbnail image to open the full-size PDF file.