論文 - 斎藤　英雄

Violin pedagogy for finger and bow placement using augmented reality

斎藤 英雄

Asia-Pacific Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC 2012) （IEEE）     1 - 5 2012年12月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

Beginners need a long time before being able to
play correctly violin. Learning the bowing technique appears to
be a difficult task and retains most of the attention of beginners.
Besides this point, the finger placement is also an important part
of the learning but often under estimated. One difficulty is that
the fingerboard of the violin does not have frets. In this on-going
work, we present a marker-less augmented reality system that
advises the novice players about their fingering and bowing. We
display in real-time the virtual frets by tracking the violin with a
depth camera. We also capture and recognize the note currently
played to direct the placement of the bow on the strings.

レーザプラズマ式3次元ディスプレイデバイスのための物体の表面特徴量を利用したリソースアウェア・レンダリング

中谷 文香、藤代 一成、石川 尋代、斎藤英雄

日本バーチャルリアリティ学会論文誌 （日本バーチャルリアリティ学会）  17 （ 4 ） 419-428 2012年12月

研究論文（学術雑誌）, 共著, 査読有り

デプスカメラを用いたリアルタイム領域抽出による隠消現実感映像生成

清水 直樹, 橋本 昂宗, 植松 裕子, 斎藤 英雄

映像情報メディア学会誌 （社団法人 映像情報メディア学会）  66 （ 12 ） J549-J552 2012年11月

研究論文（学術雑誌）, 共著, 査読有り,  ISSN  13426907

Toward an augmented reality system for violin learning support

斎藤 英雄

Advances in Depth Image Analysis and Applications Lecture Notes in Computer Science （Springer Berlin Heidelberg）  7854   136 - 145 2012年11月

研究論文（国際会議プロシーディングス）, 共著, 査読有り,  ISSN  0302-9743

　概要を見る

Violin is one of the most beautiful but also one of the most difficult musical instruments for a beginner. This paper presents an on-going work about a new augmented reality system for training how to play violin. We propose to help the players by virtually guiding the movement of the bow and the correct position of their fingers for pressing the strings. Our system also recognizes the musical note played and the correctness of its pitch. The main benefit of our system is that it does not require any specific marker since our real-time solu-tion is based on a depth camera.

• Access to Document (DOI)

Camera Pose Estimation of a Smartphone at a Field without Interest Points

斎藤 英雄

Computer Vision - ACCV 2012 Workshops Lecture Notes in Computer Science （Springer Berlin Heidelberg）  7729   545 - 555 2012年11月

研究論文（国際会議プロシーディングス）, 共著, 査読有り,  ISSN  0302-9743

• Access to Document (DOI)

Colour Descriptors for Tracking in Spatial Augmented Reality

斎藤 英雄

Computer Vision - ACCV 2012 Workshops Lecture Notes in Computer Science （Springer Berlin Heidelberg）  7729   387 - 399 2012年11月

研究論文（国際会議プロシーディングス）, 共著, 査読有り,  ISSN  0302-9743

　概要を見る

Augmented Reality is an emerging research field, that aims
for the composition of real and virtual imagery, by means of a camera
and display device. Spatial augmented reality employs data projectors
to augment the real world. In this setting, traditional tracking methods
fall short due to the interference caused by the projector. Recent works
assume a calibration process to model the projector and assume continuity
in movement of the object being tracked. In this paper we present
a tracking-by-detection system that does not require such a procedure
and makes use of natural features represented by SIFT descriptors. We
evaluate a set of photometric invariants that have previously been shown
to improve the performance of object recognition, added to the descriptor
to reduce the influence of the projector. We evaluate the descriptors
based on precision-recall under projector distortion and the total system
based on its tracking performance. Results show tracking is significantly
more precise using one of the invariants.

• Access to Document (DOI)

Illumination Estimation from Shadow and Incomplete Object Shape Using an RGB-D Camera

斎藤 英雄

International Conference on Pattern Recognition (ICPR2012) （IEEE）     165 - 169 2012年11月

研究論文（国際会議プロシーディングス）, 共著, 査読有り,  ISSN  1051-4651

　概要を見る

Optical consistency between the real world and the
virtual objects is one of the important issues in Augmented
Reality (AR). This paper proposes a method
to estimate illuminations from an object shadow and
incomplete object shape information captured by an
RGB-D camera. The environmental illumination can
be estimated without any prior knowledge of the object
shape. The radiance of each light source is computed by
solving linear equations derived from color and depth
images. Since a priori knowledge of object shape is
not necessary, we can flexibly use/combine any objects.
Thus, we can use/combine multiple objects in the target
scene to increase the accuracy and flexibility. Experimental
results show the characteristics of our proposed
method.

Calibration-Free Projector-Camera System for Spatial Augmented Reality on Planar Surfaces

斎藤 英雄

International Conference on Pattern Recognition (ICPR2012) （IEEE）     85 - 88 2012年11月

研究論文（国際会議プロシーディングス）, 共著, 査読有り,  ISSN  1051-4651

　概要を見る

Spatial augmented reality extends augmented real-
ity by projecting virtual data directly on a target sur-
face, but requires to calibrate a projector-camera sys-
tem. This paper introduces a free-calibration projector-
camera system for spatial augmented reality with a pla-
nar surface. A pattern is projected on the target surface
that can be freely moved. The main difficulty is to make
the projected image fitting the target surface. This is of-
ten achieved by calibrating the projector according to
the camera’s pose, but the calibration process is offline
and restricts the configuration of the setup. Our pro-
posed method allows to independently move the projec-
tor, the camera or the surface while the projected image
continuously fit the target surface. The experimental re-
sults demonstrate the efficiency of our calibration-free
spatial augmented reality approach when applied on a
moving planar surface.

可視化と画像解析 第2回：CVにおける3次元復元技術とその応用

斎藤 英雄

Ｍｅｄｉｃａｌ　Ｉｍａｇｉｎｇ　Ｔｅｃｈｎｏｌｏｇｙ （日本医用画像工学会）  30 （ 4 ） 209-214, 2012年10月

研究論文（学術雑誌）, 単著

複数のスマートフォンカメラの協調利用による実時間隠消現実感

本田 俊博、斎藤英雄

日本バーチャルリアリティ学会論文誌 （日本バーチャルリアリティ学会）  17 （ 3 ） 181-190 2012年09月

研究論文（学術雑誌）, 共著, 査読有り

線分記述子（LEHF）を用いた実時間SLAM

廣瀬圭佑、斎藤英雄

日本バーチャルリアリティ学会論文誌 （日本バーチャルリアリティ学会）  17 （ 3 ） 201-208 2012年09月

研究論文（学術雑誌）, 共著, 査読有り

視点生成型学習による頑健な平面位置姿勢推定

吉田拓洋, 斎藤英雄, 清水雅芳, 田口哲典

日本バーチャルリアリティ学会論文誌 （日本バーチャルリアリティ学会）  17 （ 3 ） 191-200 2012年09月

研究論文（学術雑誌）, 共著, 査読有り

Fast Line Description for Line-based SLAM

斎藤 英雄

Proceedings of the British Machine Vision Conference （BMVA Press）     83.1 - 83.11 2012年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

Simultaneous localization and mapping (SLAM) is a technique to simultaneously
perform mapping of environments and localization of a camera in real-time. Most existing
monocular vision based SLAM techniques use point features as landmarks. However,
images of artificial environments with little texture often contain many line segments,
whereas few point features can be localized in such a scene. We propose here a realtime
line-based SLAM system, and a novel method for describing the features of line
segments (LEHF:Line-based Eight-directional Histogram Feature) in order to establish
correct 2D and 3D line correspondences (2D-3D correspondences). LEHF is a fast and
efficient way of describing features of line segments, which are detected by the line segment
detector (LSD) method. The line-based orthogonal iteration (LBOI) method and
the RANSAC algorithm are applied for the camera pose estimation. We conducted an
experiment in order to test our SLAM system in a desktop environment and to perform
augmented reality (AR). Moreover our SLAM system was evaluated by synthetic data.

• Access to Document (DOI)

Automatic Road Area Extraction from Printed Maps Based on Linear Feature Detection

斎藤 英雄

IEICE TRANSACTIONS on Information and Systems （電子情報通信学会）  E95-D （ 7 ） 1758-1765 2012年07月

研究論文（学術雑誌）, 共著, 査読有り

Real-Time People Counting in Crowded Areas by using Local Empirical Templates and Density Ratios

斎藤 英雄

IEICE TRANSACTIONS on Information and Systems （電子情報通信学会）  E95-D （ 7 ） 1791 - 1803 2012年07月

研究論文（学術雑誌）, 共著, 査読有り

全方位カメラを用いたテーブルトップ型ARシステム

林　智紀、斎藤　英雄、内山　英昭、ジュリアン　ピレ

画像ラボ    7-15 2012年05月

研究論文（学術雑誌）, 共著

FOOD REGION DETECTION USING BAG-OF-FEATURES REPRESENTATION AND COLOR FEATURE

斎藤 英雄

International Conference on Computer Vision Theory and Applications 2012 (VISAPP2012) （SciTePress）  1   709 - 713 2012年02月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA

斎藤 英雄

International Conference on Computer Vision Theory and Applications 2012 (VISAPP2012) （SciTePress）  2   66 - 71 2012年02月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

We present a method for overlaying a texture onto a non-rigid surface using a commodity depth camera. The
depth cameras are able to capture 3-D data of a surface in real-time, and have several advantages compared
with methods using only standard color cameras. However, it is not easy to register a 3-D deformable mesh to a
point cloud of the non-rigid surface while keeping its geometrical topology. In order to solve this problem, our
method starts by learning many representative meshes to generate surface deformation models. Then, while
capturing 3-D data, we register a feasible 3-D mesh to the target surface and overlay a template texture onto
the registered mesh. Even if the depth data are noisy or sparse, the learning-based method provides us with a
smooth surface mesh. In addition, our method can be applied to real-time applications. In our experiments,
we show some augmented reality results of texture overlay onto a non-textured T-shirt.

Foldable Augmented Maps

斎藤 英雄

IEICE TRANSACTIONS on Information and Systems （電子情報通信学会）  E95-D （ 1 ） 256-266 2012年01月

研究論文（学術雑誌）, 共著, 査読有り,  ISSN  1745-1361

Camera tracking by online learning of keypoint arrangements using LLAH in augmented reality applications

斎藤 英雄

Virtual Reality （Springer）  15 （ 2-3 ） 109-117 2011年10月

研究論文（学術雑誌）, 共著, 査読有り