Designing voice-aware text in voice media with background color and typography

Abstract

Speech-to-Text (STT) plays a significant role in voice media. While preserving semantic information, STT also results in a large loss of nonverbal information in the voice. The goal of voice-aware text design is to bridge the gap between expressive voice and its converted text. An online survey was carried out to compare the effect of different text design elements - font, background color, and typography - on emotion expressivity, content delivery, and appropriateness of converted text. Background color and typography enhanced all three scales; however, the font did not, and even had negative effects on content delivery and appropriateness. We also found that the combination of background color and typography was regarded as the most appropriate text design in both voice messaging and social media.