MMG-based Gesture Recognition:筋肉の振動を利用したジェスチャ検出手法

By Research

We propose a novel hand gesture recognition method based on MMG (mechanomyogram). Skeletal muscles generate sounds specific to their activity. MMG is the technology to evaluate muscles’ activity by recording and analyzing those sounds. In previous researches, microphones and accelerometers are often used to sense the sounds of muscles. However those sensors are easily obstructed by environmental condition such as acoustic noise and human motion itself. In this paper, we propose to use a piezo-based MMG to improve robustness to environmental condition. The preliminary evaluation shows that the proposed method is able to classify several hand gestures correctly at high accuracy at a certain situation. 我々は，MMGを用いた新たなジェスチャ認識手法を提案する．MMGとは，筋繊維の収縮に伴って発生する微細な振動や機械的な変位を皮膚表面上にて記録したもので，加速度センサやマイクロフォンで観測される．電気的な活動を記録したEMGと比べて，MMGは筋繊維の機械的な側面を反映するとされる．筋肉の機械的な活動とはつまり身体運動であり，ゆえにMMGの検出・認識は身体運動の推定につながると期待される．そこで我々は，MMGによってジェスチャ認識が行えるのではないかと考えた．従って本研究の目的は，MMGによって筋活動推定を行い，ジェスチャ認識へと応用することにある．本稿ではMMGの検出方法と，その解析のために行った実験結果を報告する． Publications: Shumpei Yamakawa, Takuya

Read More

Vection field:ベクション場による歩行誘導手法

By Research, ,

  Along public pathways, visual signs and audio cues are used by pedestrians to guide them into forming smoother pedestrian flows. However, often ignored or neglected, these signals require greater pedestrian attentiveness and appropriate conscious effort. To solve this problem, we have proposed the concept of “vection field”. This is a field of optical flow that cues movement according to a pedestrian’s motion. Visual stimulus within this optical flow leads pedestrians innately in specific directions without requiring direct interventions. We have implemented such a field by covering the ground with a lenticular lens screen; in this setup, neither power supply nor position tracking of pedestrians is necessary. An experimental result from

Read More

Ego-motion analysis:運動計測システムの開発

By Research, , ,

In this paper, we present a new method to perform ego-motion analysis using intensity averaging of image data. The method can estimate general motions from two sequential images on pixel plane by calculating cross correlations. With distance information between camera and objects, this method also enables estimates of camera motion. This method is sufficiently robust even for out of focus image and the calculational overhead is quite low because it uses a simple averaging method. In the future, this method could be used to measure fast motions such as human head tracking, or robot movement. We present a detailed description of the proposed method, and experimental results demonstrating its basic

Read More

Lip Interface:くちびるインタフェース

By Research,

母音発声時の口唇形状は古くからインタフェースとして着目されており，その認識・応用手法について研究がなされてきた．しかしその多くは福祉を念頭においた発話認識や機器操作のためのインタフェースであり，エンタテインメントへの利用は少ない．人間は幼児期より，唇を発話のみならず食事や感情表現など様々な場面で動かしており，その形状の自由度は極めて高いと考えられる．そこで本研究では，任意の口唇形状を，エンタテインメントのためのインタフェースとして利用することを目指す．本発表ではまず口唇の開閉をインタフェースとして作成したエンタテインメントシステムについて報告する．

Read More

Bidirectional Finger Braille Device:双方向型指点字デバイス

By Research, , ,

This study is development of bidirectional finger braille device for deaf-blind people. Finger braille is one of tactual communication media for deaf-blind people; the utterer superimpose his/her hand on listener’s hand and tap listener’s index, middle and ring finger. See finger braille as a means of interpersonal communication, the finger braille device should be able to exchange the role of utterer and listener dynamically and useful for daily life. So we propose a wearable finger braille device with speakers. In this paper, we carried out experiment about the way of input-output on speakers. It was shown that speakers are reasonable for input-output element. 指点字とは，視聴覚障害者のためのコミュニケーション 手段の一つである．この指点字では，発話者が受話者の左 右それぞれの示指・中指・薬指の上に自らの指を重ね，両 手各指を点字の各点に見立て直接叩くことで点字と同様 の表現が可能となっている．近年では感情の表現・伝達の 可能性が指摘されており，より高度なコミュニケーション 手段であることが伺われる．一方で，会話のためには直

Read More