æ©æ¢°å¦ç¿
ãã¼ãããä½ãDeep Learningãããã£ã¦ããã¡ãã¨Deep Learningã®åºç¤ãç解ãããã£ãã®ã§ãè³¼å ¥ããã www.oreilly.co.jp GitHub - oreilly-japan/deep-learning-from-scratch: ãã¼ãããä½ã Deep Learningã(O'Reilly Japan, 2016) èªãã§ã³ã¼ããæ¸ãâ¦
OAK-D S2ã®ç¶ãã nokixa.hatenablog.com æ¦è¦ ç°å¢æ§ç¯ ã³ã¼ãå¤æ´ å®è¡ ãã¾ãåããªãâ¦ å¯¾å¦ å®è¡çµæ image raw_world world mixed ä»¥ä¸ æ¦è¦ ååã®ãµã³ãã«ãããæ¤åºããæã3Dã§è¡¨ç¤ºãããµã³ãã«ããã£ãã®ã§ãããããã£ã¦ã¿ãã 使ã£ããµã³ãã«ã¯â¦
ååã®ç¶ãã nokixa.hatenablog.com ãã£ãã㨠ç°å¢ å®æ½ ã¢ãã«å¤æ´ BPFä½¿ç¨ ã¢ãã«å¤æ´&BPFä½¿ç¨ ããã¾ã§ ãã£ãã㨠ååã®hand_trackerã®ãµã³ãã«ã§ãOAK-Dããã¤ã¹ã§ãªãåç»ãã¡ã¤ã«ãå ¥åã«ã§ããã¨ã®ãã¨ã§ã試ããã å é¨ã§MediaPipeã使ç¨ããã¦â¦
ã¾ãç¶ãã ã¦ã¼ã¹ã±ã¼ã¹ æåã®ã¹ãããã®æ¬¡ã¨ãã¦ãHelloWorldã®ã»ãã«æ¸ããã¦ããã®ããã¦ã¼ã¹ã±ã¼ã¹ä¾ã DepthAIâs Documentation â DepthAI documentation | Luxonis ãããè¦ãã¨ãHand Trackingã®ãµã³ãã«ãåºã¦ããã®ã§ãããããã£ã¦ã¿ããã Handâ¦
OAK-D S2ã®ç¶ãã Hello World GitHubãªãã¸ããªã¯ãã¼ã³ ç°å¢ä½æ å®è¡ ããã¾ã§ Hello World å ¬å¼ããã¥ã¡ã³ããè¦ãã¨ããã¢ã¢ããªãåããã¦ã¿ã次ã®ã¹ãããã¨ãã¦ãHelloWorldããã¸ã§ã¯ãã§ã³ã¼ãã£ã³ã°ãã¦ã¿ãããã¨ããã®ãããã Hello World â Dâ¦
å»å¹´ã®10æã«è²·ã£ã¦ããå ¨ç¶é²ãã§ããªãã£ãã®ã§ã ä»åã¯USBã±ã¼ãã«ã®ä»¶ã«ã¤ãã¦ã nokixa.hatenablog.com æ¦è¦ OAK-D S2ã§ã¯7.5Wã®é»åãå¿ è¦ã ã£ãããä»ä½¿ã£ã¦ããPCã®USB3.0 Type-Aãã¼ãã§ã¯ä¾çµ¦ä¸å¯è½ã ã£ãã®ã§ã Thunderboltã®ãã¼ã(ã³ãã¯ã¿èªâ¦
姿å¢æ¨å®ã«ä»ã¾ã§OpenPoseãMediaPipeãYOLOv8ã使ã£ã¦ããããä»ã«ãè²ã ãããããªã®ã§æ´çãã¦ã¿ãã 2024å¹´2æç¾å¨èª¿ã¹ãã¨ããã§ã ã¾ã 調ã¹åãã¦ããªãããã ããªã¼ã§ä½¿ãããã®(ã¨ã¯è¨ãã©ã¤ã»ã³ã¹ã®å¶ç´ãã)ã¨ãåç¨ã®ãã®ã«åãã¦ã¿ãã å人ã§â¦
ä¼ç¤¾ã§å¿ è¦ã«ãªã£ãã®ã§ãYOLOã®v8ã試ãã¦ã¿ãã å ¬å¼GitHub ããããã㨠ç°å¢æºå æ¨è«å®è¡ GPU使ã GPU使ã£ã¦æ¨è« ä»¥ä¸ å ¬å¼GitHub github.com â é »ç¹ã«ãã¼ã¸ã§ã³ã¢ããããã®ã§ãv8.1.0ã®ã¿ã°ãä»ãã¦ããã¨ããã®ãªã³ã¯ã ããã¥ã¡ã³ãè¦ãã¨ãYOLO vâ¦
è²·ãããæ©ãã§ããOAK-D S2ãåã åã®è¨äºæ¸ããç´å¾ã«ãããã¨ãã¦ãH ZETTRIOè¦ã帰ãã«åãåã£ãã ã¨ãããã¨ã§ããã£ããéå°ãåããã¦ã¿ãã ã¾ãéå° åããã¦ã¿ã å ¬å¼ããã¥ã¡ã³ãè¦ã¦ã¿ã ãã¥ã¼ããªã¢ã«ãåããã¦ã¿ã é»åç¢ºèª PCã®USBãã¼ãâ¦
MediaPipeã®å ¬å¼ãµã¤ãè¦ã¦ããããã©ã¦ã¶ä¸ã§ãã試ãããã¢ããã£ãã®ã§ã å ¬å¼ãµã¤ã Hand Landmark Detectionã試ã (ã¤ãã§1) ããã°ç¨ã®gifå å·¥ä½æ¥ (ã¤ãã§2) MediaPipeã§é¡é ã ä»åã¯ããã¾ã§ å ¬å¼ãµã¤ã MediaPipe Studio MediaPipeã«å ¥ã£ã¦ããè²â¦
ååã¾ã§ãOpenPoseã使ã£ã¦ç»åããã®äººã®å§¿å¢æ¨å®ããã¦ãããGoogleã®MediaPipeã§ããããã£ããã¨ãã§ããã¨èãããã¨ãããã®ã§ã試ãã¦ã¿ãã åè MediaPipeæ¦è¦ç¢ºèª condaç°å¢ä½æ ã¾ãMOT16ã§è©¦ãã èªåã®ãã¢ãåç»ã§ãã£ã¦ã¿ãã hand_landmarkâ¦
OpenPoseç¶ãã nokixa.hatenablog.com ä»åã¯å 容ã ãã ãé·ãã ãã£ã¦ããããã㨠使ããã¼ã¿ ã»ãã«ã ãå°å ´ã¬ã³ãã ã¯ã«ã ãã£ãºãã¼ã©ã³ãã®ãã¾ãã åé³ãã¯ãã ã«ããã«ãã®ã²ã¨ ãã±ã¢ã³ å µé·ã¤ã©ã¹ã å°ãã¿ : Bingãã£ããã§ããããã¡ã¤ã«â¦
ååã«ç¶ããOpenPoseã®ãã¢ãããå°ãåããã¦ã¿ãã nokixa.hatenablog.com ãã£ã¦ã¿ãã㨠æã¨é¡ã®èªè 解å度è½ã¨ã å¦ççµæä¿å 姿å¢æ å ±ã®ãã¡ã¤ã«åºå å¥ã®åç»ãä½¿ç¨ èªåã§æ®å½±ããåç»ã§ 23/11/07 è¿½è¨ ä»ã®ã¨ããè©ä¾¡ ããã¾ã§ ãã£ã¦ã¿ãã㨠â¦
ååã®ç¶ãã å ¬å¼ã®OpenPoseã®ãµã³ãã«ãã試ãã«åããã¦ã¿ãã nokixa.hatenablog.com ãã«ãæ¸ã¿ãã¤ããªãåããã¦ã¿ã ãªãªã¼ã¹çãã¦ã³ãã¼ã ã¢ãã«ãã¦ã³ãã¼ã ãã¢å®è¡ ä»åã¯ããã¾ã§ ãã«ãæ¸ã¿ãã¤ããªãåããã¦ã¿ã Pythonããåããåã«ãâ¦
次ã®ãã¿ã OpenPoseã使ã£ã¦ãç»åããã®äººã®å§¿å¢æ¨å®ããã£ã¦ã¿ããã æ¦è¦ ããæ¹åè£ OpenPoseã®å¦ç¿æ¸ã¿ã¢ãã«ããOpenCVã®dnnã¢ã¸ã¥ã¼ã«ã§èªã¿è¾¼ã tf-pose-estimationãªãã¸ããªã使ã pytorch-openpose OpenPoseå ¬å¼ã®ããã¥ã¡ã³ã ããæ¹é¸æ ããâ¦
ååãYOLOãã試ãã§åããã¦ç»åèªèããããCPUã§ã®åä½ã ã£ãã ä»åãWindowsç°å¢ã§GPUã使ããããã«ã»ããã¢ããããã nokixa.hatenablog.com åèãµã¤ã ç©ä½èªèã«ä½¿ãç»å ã»ããã¢ããæé NVIDIAãã©ã¤ãã¼ã¤ã³ã¹ãã¼ã« Build Tools for Visualâ¦
ååãã«ã¡ã©(EZVIZ CP1)ããRTSPåä¿¡ã§ãããã¨ã確èªã§ããã®ã§ãç»åããã®ç©ä½èªèãç°¡åã«è©¦ãã¦ã¿ãã nokixa.hatenablog.com çµæã ãå ã« ããæ¹ condaã§YOLO試ãç¨ã®ç°å¢ä½æ GitHubãªãã¸ããªã®ã¯ãã¼ã³ ç°å¢ã»ããã¢ãã ã³ãã³ãããã³ããã§anaâ¦