Ma, Yuan; Donkers, Tim; Kleemann, Timm; Ziegler, Jürgen:
An Instrument for measuring users’ meta-intents
In: CHIIR '23 : Proceedings of the 2023 Conference on Human Information Interaction and Retrieval / Gwizdka, Jacek; Rieh, Soo Young (Hrsg.). - 2023 Conference on Human Information Interaction and Retrieval ; CHIIR 2023 ; March 19–23, 2023, Austin, Texas, USA - Washington: ACM, 2023, S. 290 - 302
2023Buchaufsatz/Kapitel in TagungsbandClosed access
Informatik
Damit verbunden: 1 Publikation(en)
Titel in Englisch:
An Instrument for measuring users’ meta-intents
Autor*in:
Ma, YuanUDE
LSF ID
61112
ORCID
0000-0002-9517-8797ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Donkers, TimUDE
GND
1318565251
LSF ID
59377
ORCID
0000-0002-9230-1243ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Kleemann, TimmUDE
LSF ID
59931
ORCID
0000-0001-8158-7445ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
;
Ziegler, JürgenUDE
GND
1015876811
LSF ID
3881
ORCID
0000-0001-9603-5272ORCID iD
Sonstiges
der Hochschule zugeordnete*r Autor*in
Open Access?:
Closed access
Sprache des Textes:
Englisch

Abstract in Englisch:

We propose the concept of meta-intents which represent high-level user preferences related to the interaction and decision-making in conversational recommender systems (CRS) and present a questionnaire instrument for measuring meta-intents. We conducted a two-stage user study, an exploratory study with 212 participants on Prolific, and a confirmatory study with 394 participants on Prolific. We obtained a reliable and stable meta-intents questionnaire with 22 question items, corresponding to seven latent factors (concepts). These seven factors cover important interaction preferences and are closely related to users' decision-making process. For example, the factor dialog-initiative reflects whether users prefer to follow the system's guidance or ask their own questions in a CRS. We conducted statistical analyses of meta-intents in two domains (smartphones and hotels), and a general chatbot scenario. We also investigated the influence of additional factors (demography, decision-making style) on meta-intents through Structural Equation Modeling (SEM). Our results provide preliminary evidence that the proposed meta-intents are domain and demography (gender, age) independent. They can be linked to the general decision-making style and can thus be instrumental in translating general decision-making factors into more concrete design guidance for CRS and their potential personalization. Meta-intents also provide a basis for future analyses of interaction behavior in CRS and the development of a cognitively founded theoretical framework.