메뉴 건너뛰기
소속 기관 / 학교 인증
인증하면 논문, 학술자료 등을  무료로 열람할 수 있어요.
한국대학교, 누리자동차, 시립도서관 등 나의 기관을 확인해보세요
(국내 대학 90% 이상 구독 중)
고객센터 ENG
주제분류

논문 기본 정보

저자정보
출처
Wiley Applied AI Letters 6(1)
오류 신고하기
표지

검색

    초록·키워드

    ABSTRACT Modern large language models (LLMs) represent a paradigm shift in what can plausibly be expected of machine learning models. The fact that LLMs can effectively generate sensible answers to a diverse range of queries suggests that they would be useful in customer support applications. While powerful, LLMs have been observed to be prone to hallucination which unfortunately makes their near‐term use in customer support applications challenging. To address this issue, we present a system that allows us to use an LLM to augment our customer support advocates by re‐framing the language modeling task as a discriminative classification task. In this framing, we seek to present the Top‐K best template responses for a customer support advocate to use when responding to a customer. We present the result of both offline and online experiments where we observed offline gains and statistically significant online lifts for our experimental system. Along the way, we present observed scaling curves for validation loss and Top‐K accuracy, resulted from model parameter ablation studies. We close by discussing the space of trade‐offs with respect to model size, latency, and accuracy as well as and suggesting future applications to explore.

    본문·목차

    최근 본 자료 전체보기