%0 Generic %B Beyond Language: Multimodal Semantic Representations %D 2021 %T Requesting clarifications with speech and gestures %A Ginzburg, Jonathan %A Lücking, Andy %X

In multimodal natural language interaction both
speech and non-speech gestures are involved in
the basic mechanism of grounding and repair.
We discuss a couple of multimodal clarifica-
tion requests and argue that gestures, as well as
speech expressions, underlie comparable paral-
lelism constraints. In order to make this precise,
we slightly extend the formal dialogue frame-
work KoS to cover also gestural counterparts
of verbal locutionary propositions.