[B! MediaPipe] nagolingã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

nagoling id:nagoling

MediaPipeã«é–¢ã™ã‚‹nagolingã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

mediapipeã¨VSeeFace(Leap Motionãªã—)ã§VRMãƒ¢ãƒ‡ãƒ«ã‚’å‹•ã‹ã™å®Ÿé¨“ãƒ¡ãƒ¢
ä»¥å‰ã«æ›¸ã„ãŸè¨˜äº‹ã§ã¯ã€ThreeDPoseTrackerã¨VSeeFaceã‚’ä½¿ã£ã¦ã€ä¸ŠåŠèº«ã®Webã‚«ãƒ¡ãƒ©æ˜ åƒã ã‘ã§VRMãƒ¢ãƒ‡ãƒ«ã®æ‰‹ã‚„é¡”ã‚’å‹•ã‹ã—ã¦ã¿ã¾ã—ãŸã€‚ ä»Šåº¦ã¯ThreeDPoseTrackerã§ã¯ãªãmediapipeã®Holisticã¨Handsã‚’ä½¿ã£ã¦ã€æ‰‹ã‚„ä½“ã®å‹•ãã‚’ãƒˆãƒ©ãƒƒã‚ãƒ³ã‚°ã™ã‚‹ã“ã¨ã§ã€mediapipeã¨VSeeFace(Leap Motionãªã—)ã§ã€Webã‚«ãƒ¡ãƒ©ã ã‘ã§ãƒ¢ãƒ¼ã‚·ãƒ§ãƒ³ã‚ãƒ£ãƒ—ãƒãƒ£â€•ã—ã¦VRMãƒ¢ãƒ‡ãƒ«ã‚’å‹•ã‹ã™å®Ÿé¨“ã‚’ã—ã¾ã—ãŸã€‚ ã¾ã ã¾ã è©¦è¡ŒéŒ¯èª¤ã—ã¦ã„ã‚‹é€”ä¸ã§ã™ãŒã€ã“ã“ã¾ã§ã®è¨˜éŒ²ã‚’ãƒ¡ãƒ¢ã¨ã—ã¦æ®‹ã—ã¦ãŠãã¾ã™ã€‚ â€»è¿½è¨˜ï¼šä»Šã¯ã“ã‚“ãªã“ã¨ã‚’ã—ãªãã¦ã‚‚ã€ThreeDPoseTrackerã ã‘ã§åŒç‰ä»¥ä¸Šã®ã“ã¨ãŒã§ãã¾ã™ã€‚ ã‚„ã‚ŠãŸã‹ã£ãŸã“ã¨ Webã‚«ãƒ¡ãƒ©1å°ã®ä¸ŠåŠèº«ã®æ˜ åƒã§ã€é¡”ã‚„æ‰‹ãªã©ä¸ŠåŠèº«ã®å‹•ãã‚’ãƒˆãƒ©ãƒƒã‚ãƒ³ã‚°ã—ã¦ã€VRMãƒ¢ãƒ‡ãƒ«ã‚’å‹•ã‹ã™ã“ã¨ã§ã™ã€‚ è¦ã¯ãƒã‚¹ãƒˆã‚¢ãƒƒãƒ—ã®vtuberã¿ãŸã„ãª
nagoling 2023/02/06
MediaPipe

KalidoKit

VSeeFace

Vtuber
ãƒªãƒ³ã‚¯
ã€MediaPipe + KalidoKitã€‘ãƒ–ãƒ©ã‚¦ã‚¶ã§ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ é¡”èªè˜ã—ã¦éŠã¶
ã“ã‚“ã«ã¡ã¯ã€@d_etteiu8383ã§ã™ã€‚ã“ã®è¨˜äº‹ã¯å¤ã®ãƒ–ãƒã‚°ãƒªãƒ¬ãƒ¼ 2022å¹´ 28æ—¥ç›®ã®è¨˜äº‹ã§ã™ã€‚ æ¦‚è¦ æœ¬è¨˜äº‹ã§ã¯MediaPipeã®FaceMeshã¨KalidoKitã‚’åˆ©ç”¨ã—ã¦ã€ãƒ–ãƒ©ã‚¦ã‚¶ä¸Šã§ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«é¡”èªè˜ã‚’è¡Œã†æ–¹æ³•ã«ã¤ã„ã¦èª¬æ˜Žã—ã¾ã™ã€‚ ã‚¤ãƒ³ãƒˆãƒ çªç„¶ã§ã™ãŒæœ¬æ—¥9æœˆ6æ—¥ãŒä½•ã®æ—¥ã ã‹ã”å˜ã˜ã§ã—ã‚‡ã†ã‹ï¼Ÿãã†ã§ã™ã€çœŸä¸ã®ã‚“ã•ã‚“ã®èª•ç”Ÿæ—¥ã§ã™ãã€‚ å½¼å¥³ã¯ã‚¢ãƒ‹ãƒ¡ã€Žãƒ—ãƒªãƒ‘ãƒ©ã€ã®ç™»å ´äººç‰©ã®ä¸€äººã§ã™ãŒã€ã“ã®ã‚¢ãƒ‹ãƒ¡ã¯3DCGã‚’åˆ©ç”¨ã—ãŸãƒ©ã‚¤ãƒ–ã‚·ãƒ¼ãƒ³ãŒç‰¹å¾´çš„ã§ã™ã‚ˆãã€‚3Dã¨è¨€ãˆã°ã¨ã„ã†ã‚ã‘ã§æœ¬è¨˜äº‹ã§ã¯MediaPipeã®FaceMeshã¨KalidoKitã‚’åˆ©ç”¨ã—ãŸã€ãƒ–ãƒ©ã‚¦ã‚¶ä¸Šã§ã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ é¡”èªè˜ã«ã¤ã„ã¦èª¬æ˜Žã—ã¾ã™ã€‚ MediaPipe Face Mesh overview: https://google.github.io/mediapipe/solu
nagoling 2023/02/06
Vtuber

KalidoKit

MediaPipe
ãƒªãƒ³ã‚¯
1

ãŠçŸ¥ã‚‰ã›

ã‚‚ã£ã¨èªã‚€

å…¬å¼Twitter

@hatebu
æœ€æ–°ã®äººæ°—ã‚¨ãƒ³ãƒˆãƒªãƒ¼ã®é…ä¿¡

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

jæ¬¡ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

kå‰ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

lã‚ã¨ã§èªã‚€

eã‚³ãƒ¡ãƒ³ãƒˆä¸€è¦§ã‚’é–‹ã

oãƒšãƒ¼ã‚¸ã‚’é–‹ã

è¨å®šã‚’å¤‰æ›´ã—ã¾ã—ãŸx

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (3)

MediaPipeã«é–¢ã™ã‚‹nagolingã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬3é€±ï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´2æœˆï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

ã‚¿ã‚°

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (3)

MediaPipeã«é–¢ã™ã‚‹nagolingã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

mediapipeã¨VSeeFace(Leap Motionãªã—)ã§VRMãƒ¢ãƒ‡ãƒ«ã‚’å‹•ã‹ã™å®Ÿé¨“ãƒ¡ãƒ¢

ã€MediaPipe + KalidoKitã€‘ãƒ–ãƒ©ã‚¦ã‚¶ã§ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ é¡”èªè­˜ã—ã¦éŠã¶

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬3é€±ï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚­ãƒ³ã‚°ï¼ˆ2025å¹´2æœˆï¼‰

å…¬å¼Twitter

ã‚­ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (3)

MediaPipeã«é–¢ã™ã‚‹nagolingã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (2)

mediapipeã¨VSeeFace(Leap Motionãªã—)ã§VRMãƒ¢ãƒ‡ãƒ«ã‚’å‹•ã‹ã™å®Ÿé¨“ãƒ¡ãƒ¢

ã€MediaPipe + KalidoKitã€‘ãƒ–ãƒ©ã‚¦ã‚¶ã§ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ é¡”èªè˜ã—ã¦éŠã¶

ãŠçŸ¥ã‚‰ã›

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬3é€±ï¼‰

ä»Šé€±ã®ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´3æœˆç¬¬2é€±ï¼‰

æœˆé–“ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯æ•°ãƒ©ãƒ³ã‚ãƒ³ã‚°ï¼ˆ2025å¹´2æœˆï¼‰

å…¬å¼Twitter

ã‚ãƒ¼ãƒœãƒ¼ãƒ‰ã‚·ãƒ§ãƒ¼ãƒˆã‚«ãƒƒãƒˆä¸€è¦§

ã¯ã¦ãªãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

å…¬å¼Twitter

ã¯ã¦ãªã®ã‚µãƒ¼ãƒ“ã‚¹