KEIO RESEARCHERS INFORMATION SYSTEM

Career 【 Display / hide 】

Career 【 Display / hide 】

• 2022.04

  -

  Present

  Keio University, Faculty of Science and Technology, Professor

• 2020.04

  -

  2022.03

  Keio University, Faculty of Science and Technology, Associate Professor

• 2008.04

  -

  2020.03

  National Institute of Information and Communications Technology, Japan

• 2006.04

  -

  2008.03

  日本学術振興会 特別研究員

• 2004.04

  -

  2009.03

  ATR

display all >>

Academic Background 【 Display / hide 】

Academic Background 【 Display / hide 】

• 1998.04

  -

  2002.03

  Kyoto University, 工学部, 電気電子工学科

  University, Graduated

• 2002.04

  -

  2004.03

  Kyoto University, 情報学研究科, システム科学専攻

  Graduate School, Completed, Master's course

• 2004.04

  -

  2007.03

  Kyoto University, 情報学研究科, システム科学専攻

  Graduate School, Completed, Doctoral course

Academic Degrees 【 Display / hide 】

Academic Degrees 【 Display / hide 】

• 博士（情報学）, Kyoto University, Coursework, 2007.03

  自律ロボットにおける形態に基づく解釈系の構築

Research Areas 【 Display / hide 】

Research Areas 【 Display / hide 】

• Informatics / Perceptual information processing

• Informatics / Intelligent informatics

• Informatics / Intelligent robotics

Papers 【 Display / hide 】

Papers 【 Display / hide 】

• Mobile Manipulation Instruction Generation From Multiple Images With Automatic Metric Enhancement

  K Katsumata, M Kambara, D Yashima, R Korekata, K Sugiura

  IEEE Robotics and Automation Letters  2025

• DM2RM: dual-mode multimodal ranking for target objects and receptacles based on open-vocabulary instructions

  R Korekata, K Kaneda, S Nagashima, Y Imai, K Sugiura

  Advanced Robotics, 1-16 abs/2408.07910 2025

  • Access to Document (DOI)

• Pre-Manipulation Alignment Prediction for Open-Vocabulary Object Manipulation Based on End-Effector Trajectories

  M Kambara, K Sugiura

  2025 19th International Conference on Machine Vision and Applications (MVA), 1-5    1 - 5 2025

  • Access to Document (DOI)

• NaiLIA: 緩和損失に基づくネイルデザインのマルチモーダル検索

  雨宮佳音， 小松拓実， 八島大地， 是方諒介， 勝又圭， 杉浦孔明

  人工知能学会全国大会論文集 第 39 回 (2025), 2Win555-2Win555 (The Japanese Society for Artificial Intelligence)  JSAI2025 ( 0 ) 2Win555 - 2Win555 2025

  　View Summary

  <p>We focus on the task of retrieving nail design images based on dense intent descriptions, which represent long and multi-layered user intent for nail designs. This is challenging because such descriptions specify flexibly created paintings and pre-manufactured embellishments, as well as visual characteristics, spatial relationships, higher-order themes, and overall impressions. Existing vision-and-language foundation models often struggle to capture the interplay between paintings and embellishments, failing to incorporate multi-layered intent descriptions. To address this, we propose NaiLIA, a method that enables the retrieval of nail design images that comprehensively align with descriptions with dense user intent. Our approach estimates confidence scores for images that align with a given description and can be considered as positive examples but are not explicitly labeled (unlabeled positives), and incorporates this score into the loss function. To evaluate NaiLIA, we constructed a benchmark consisting of 10,625 images collected from people with diverse cultural backgrounds. The images were annotated with long and dense intent descriptions given by over 200 annotators. Experimental results demonstrate that the proposed method outperforms standard methods by 20.9 points in terms of recall@10.</p>

  • Access to Document (DOI)
  • CiNii Research

• Interactive robot action replanning using multimodal llm trained from human demonstration videos

  C Hori, M Kambara, K Sugiura, K Ota, S Khurana, S Jain, R Corcodel, ...

  ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and …    1 - 5 2025

  • Access to Document (DOI)

display all >>

Papers, etc., Registered in KOARA 【 Display / hide 】

Papers, etc., Registered in KOARA 【 Display / hide 】

• Relational Future Captioning Model for explaining likely collisions in daily tasks

  Sugiura, Komei

  AICカンファレンス予稿集 (慶應義塾大学AI・高度プログラミングコンソーシアム)     50 - 54 2023

• 生活支援ロボットによる参照表現理解モデルの構築

  Sugiura, Kōmei

  AICカンファレンス予稿集 (慶應義塾大学AI・高度プログラミングコンソーシアム)     28 - 29 2023

• Adversarial data augmentation for multimodal language understanding

  Sugiura, Komei

  科学研究費補助金研究成果報告書 2022

Reviews, Commentaries, etc. 【 Display / hide 】

Reviews, Commentaries, etc. 【 Display / hide 】

• 深層学習を用いたリアルタイム太陽フレア確率予報 Deep Flare Net(DeFN)

  西塚直人, 杉浦孔明, 久保勇樹, 田光江, 石井守

  日本地球惑星科学連合大会予稿集(Web) 2018 2018

Research Projects of Competitive Funds, etc. 【 Display / hide 】

Research Projects of Competitive Funds, etc. 【 Display / hide 】

• 実世界を検索可能とするクロスモーダル言語処理基盤の構築

  2023.04

  -

  2026.03

  基盤研究(B), Principal investigator

• 生活環境対話技術の研究開発

  2020.12

  -

  2026.03

  JST, ムーンショット型研究開発事業, Commissioned ｒesearch, Coinvestigator(s)

• 実世界に埋め込まれる人間中心の人工知能技術の研究開発

  2020.07

  -

  2025.02

  NEDO 人と共に進化する次世代人工知能に関する技術開発事業, Coinvestigator(s)

• マルチモーダル言語理解における敵対的データ拡張基盤の構築

  2020.04

  -

  2023.03

  科研費, 基盤研究(B), Principal investigator

• 文脈と解釈の同時推定に基づく相互理解コンピューテーションの実現

  2019.10

  -

  2025.03

  科学技術振興機構(JST) 戦略的創造研究推進事業(CREST), Coinvestigator(s)

display all >>

Intellectual Property Rights, etc. 【 Display / hide 】

Intellectual Property Rights, etc. 【 Display / hide 】

• 対象物検索システム、対象物検索方法および学習済モデル

  Date applied： 2019-095922  2019.05 

  Patent, Joint

• 言語識別装置及びそのためのコンピュータプログラム、並びに音声処理装置

  Date applied： 2019-062346  2019.03 

  Patent, Joint

• 把持装置、タグが付された容器、対象物把持プログラムおよび対象物把持方法

  Date applied： 2018-096213  2018.05 

  Date announced： 2019-198945  2019.11 

  Patent, Joint

• 予測システムおよび予測手法

  Date applied： 2018-090085  2018.05 

  Date announced： 2019-197323  2019.11 

  Patent, Joint

• 命令文推定システムおよび命令文推定方法

  Date applied： 2017-172922  2017.09 

  Date announced： 2019-049604  2019.03 

  Patent, Joint

display all >>

Awards 【 Display / hide 】

Awards 【 Display / hide 】

• トヨタ自動車HSRユーザ会2020優秀研究賞

  2020.11

  Type of Award： Other

• WRS2018パートナーロボットチャレンジ（バーチャルスペース）優勝 / 経済産業大臣賞

  2018.10

• WRS2018 人工知能学会賞

  2018.10

• IEEE/RSJ IROS 2018 RoboCup Best Paper Award

  2018.10

  Type of Award： Award from international society, conference, symposium, etc.

• 2018年度人工知能学会 全国大会優秀賞

  2018.07

  Type of Award： Award from Japanese society, conference, symposium, etc.

display all >>

Courses Taught 【 Display / hide 】

Courses Taught 【 Display / hide 】

• RECITATION IN INFORMATION AND COMPUTER SCIENCE

  2025

• MACHINE INTELLIGENCE

  2025

• LABORATORIES IN INFORMATION AND COMPUTER SCIENCE 2B

  2025

• LABORATORIES IN INFORMATION AND COMPUTER SCIENCE 2A

  2025

• INTRODUCTION TO MACHINE LEARNING

  2025

display all >>

Committee Experiences 【 Display / hide 】

Committee Experiences 【 Display / hide 】

• 2014

  -

  2021.06

  Trustee, RoboCup Federation

• 2014

  -

  2024.03

  Associate Editor, Advanced Robotics

• 2021

  Associate Editor, IEEE/RSJ IROS 2021

• 2019

  Associate Editor, IEEE/RSJ IROS 2019

• 2019

  Program Co-Chair, Conference on Robot Learning

display all >>