메뉴 건너뛰기
소속 기관 / 학교 인증
인증하면 논문, 학술자료 등을  무료로 열람할 수 있어요.
한국대학교, 누리자동차, 시립도서관 등 나의 기관을 확인해보세요
(국내 대학 90% 이상 구독 중)
고객센터 ENG
주제분류

논문 기본 정보

저자정보
(경기대학교) (경기대학교)
저널정보
제어로봇시스템학회 제어로봇시스템학회 논문지 제어로봇시스템학회 논문지 제30권 제10호
오류 신고하기

피인용 1

검색

    초록·키워드

    Open-vocabulary scene understanding aims to recognize arbitrary novel categories beyond the base label space. In this study, we propose a novel open-vocabulary 3D semantic segmentation model, OV-3DRENet, to address the limitations of existing models. Unlike existing 3D semantic segmentation models that perform point-level categorization, the proposed model performs region-level categorization using Mask3D as a 3D region mask proposal module to generate multiple class-agnostic point-cloud regions. The proposed model uses OpenScene, a pre-trained open-vocabulary point-cloud segmentation model, as a 3D point encoder to extract language-aligned 3D visual features for each region from the scene point cloud. Furthermore, it adopts OpenSeg, a pre-trained open-vocabulary image segmentation model, as a 2D pixel encoder to extract language-aligned 2D visual features for each region from multiview scene images. Finally, our model applies a novel 2D 3D visual feature ensemble scheme to allocate well-matched open-vocabulary class labels to point-cloud regions. By conducting various quantitative and qualitative experiments using a large benchmark dataset, ScanNet v2, we demonstrate the superiority of the proposed model.

    최근 본 자료 전체보기