æã 趣å³ãä»äºã§ã»ã³ãµãã¼ã¿ãæ±ããã¨ãããã®ã§, å æ¥('24/11)çºå£²ããããã»ã³ãµã¨æ©æ¢°å¦ç¿ã§ã¯ããã人éè¡åèªèãã¨ããæ¸ç±ã«å°ãèå³ãããè³¼å ¥ãã¦ã¿ã. ã»ã³ãµãã¼ã¿ã«ãã人éè¡åèªèãæ±ã£ã¦ããæ¸ç±ã¯ããã¾ã§ã«ãªãã£ã(ç¥ããªãã ããã)â¦
æè¿, ããã¹ãçæAIãæ´»ç¨ããã¢ããªæ¤è¨ããã¦ãã, RAG(Retrieval-Augmented Generation)ãAIã¨ã¼ã¸ã§ã³ãã«ã¤ãã¦èª¿ã¹ããã¨ãå¤ã. ããã§, å æ¥(2024/11/9)çºå£²ããããLangChainã¨LangGraphã«ããRAGã»AIã¨ã¼ã¸ã§ã³ã[å®è·µ]å ¥éããæ©éè³¼å ¥ã, ã»ã¼â¦
æè¿, ä¸ã®ä¸çæAIã®è©±é¡ã§æº¢ãããã£ã¦ããã, å æ¥(2024.10.24)Raspberry Pi AI HAT+ãçºå£²ãããè¨äºãè¦ãã, ã¤ãã¤ãæ°ã«ãªã£ã¦è³¼å ¥ãã¦ãã¾ã£ã. å®ã¯, ä»å¹´6æã«çºå£²ãããRaspberry Pi AI Kitã¯, æ°ã¥ããã¨ãã«ã¯ãã§ã«å¨åº«åãç¶æ ã§å½æããã«â¦
Jetson Orinãã©ãããã©ã¼ã ã®è£½åãçºå£²ããã¦ç´2å¹´ãçµã¡, NVIDIAã®JetPack SDKã®ãµãã¼ãããå¤ãJetsonãå¾ã ã«ã¯ããã¤ã¤ãã. æ¨æ¥, ä¹ ãã¶ãã«Jetsonã«è§¦ããã¨æã, ã¾ãã¯JetPack SDKãã¢ãããã¼ããããã¨ãã¦å°ãæéåã£ãã®ã§, ã¡ã¢ãæ®ãã¦â¦
æè¿, 趣å³ã§éçºãã¦ããKingyo AI Navi[1]ã§çæAIã使ã£ã¦ã¿ããã¨, GPT-3.5/4ãPaLM2(Google Vertex AI)ãªã©å¤§è¦æ¨¡è¨èªã¢ãã«(LLM)ã試ãã¦ãã. å½åã¯ChatGPTçã®APIãç´æ¥å©ç¨ãã¦ããã, LangChainã¨ãããChatGPTãªã©ã®å¤§è¦æ¨¡è¨èªã¢ãã«ã®æ©è½æ¡å¼µâ¦
Unityã§ç©ä½æ¤åºã試ãã¦ã¿ããã¨èª¿æ»ãã¦ããã, Barracudaã使ããã¨ã§onnxå½¢å¼ã®ã¢ãã«ãæ±ãããã¨ãåãã£ã. ããã§, Barracuda + YOLOv5ã§ç©ä½æ¤ç¥ã試ããã¨ã«ããã®ã ã, ããã¤ã注æãã¹ããã¤ã³ãããã£ãã®ã§å°ãã¾ã¨ãã¦ãã. é¢é£è¨äº: Unityâ¦
Unityã§ç©ä½æ¤åºã試ãã¦ã¿ããã¨èª¿æ»ãã¦ããã, Barracudaã使ããã¨ã§onnxå½¢å¼ã®ã¢ãã«ãæ±ãã[1]ãã¨ãåãã£ã. ããã§, Barracuda + YOLOv5ã§ç©ä½æ¤ç¥ã試ããã¨ã«ããã®ã ã, ããã¤ã注æãã¹ããã¤ã³ãããã£ãã®ã§å°ãã¾ã¨ãã¦ãã. é¢é£è¨äº: Unâ¦
ééã®ç¨®é¡ãå¤å¥ããã, 大åé¡å±±å¸ãééã«é¢ããæ å ±ãæä¾ãããKingyo AI Naviãã§ã®ChatGPTå©ç¨[1]ãæ¤è¨ãã¦ãã.mirai-tec.hatenablog.comããã, ChatGPT(GPT-3.5-turbo)ã§ã¯, 大åé¡å±±ã«é¢ããå¿çãããªããã¡ãã¡ãªæãã§ãã£ã. GPT-4ãªãæ¹åâ¦
æ°å¹´åã«, ééã®ç¨®é¡ãå¤å¥ããã, 大åé¡å±±å¸ãééã«é¢ããæ å ±ãæä¾ãããKingyo AI Naviãã£ã¦ãããããã¿ã¤ã[1]ãä½æãã.mirai-tec.hatenablog.comæè¿ChatGPTãããªãæµè¡ã£ã¦ãã, ChatGPTããKingyo AI Naviãã«çµã¿è¾¼ããã¨ã§æ°ããªæ å ±æä¾â¦
æ°å¹´åã«, ééã®ç¨®é¡ãå¤å¥ããã, 大åé¡å±±å¸ãééã«é¢ããæ å ±ãæä¾ãããKingyo AI Naviãã£ã¦ãããããã¿ã¤ã[1]ãä½æãã.mirai-tec.hatenablog.comæè¿ChatGPTãããªãæµè¡ã£ã¦ãã, ChatGPTããKingyo AI Naviãã«çµã¿è¾¼ããã¨ã§æ°ããªæ å ±æä¾â¦
æ°å¹´åã«, ééã®ç¨®é¡ãå¤å¥ããã, 大åé¡å±±å¸ãééã«é¢ããæ å ±ãæä¾ãããKingyo AI Naviãã£ã¦ãããããã¿ã¤ã[1]ãä½æãã. mirai-tec.hatenablog.comãKingyo AI Naviãã®ã·ã¹ãã æ§æã¯ä»¥ä¸ã®ããã«ãªã£ã¦ãã, ããã¹ãã«ããééã大åé¡å±±å¸ã«â¦
æè¿ã¡ã¿ãã¼ã¹ã話é¡ã¨ãªã£ã¦ããã®ã§, å°ã試ãã¦ã¿ãããã¨æ¨å¹´æ«ã«Meta Quest2ãè³¼å ¥ãã. ãã£ãããªã®ã§, Unityã使ã£ã¦Meta Quest2ã®ã³ã³ãã³ããä½ãããã¨æã, Unityã«åãã£ã¬ã³ã¸ãã¦ã¿ããã¨ã«ãã. (å®ã¯, ããªãæã«ä¸åº¦Unity 5ã«ãã£ã¬ã³ã¸â¦
2018å¹´ãã2020å¹´ã«ããã¦, ééã®èªèããããå¿ç¨ãããKingyo AI Naviãã¢ããª[1]ãéçºãã¦ãã.mirai-tec.hatenablog.comãã®éã«, Googleã®AutoML VisionãVision Edgeã使ã£ã¦ã¢ãã«ä½æãè¡ã£ã¦ãã.æè¿,ãKingyo AI Naviãã¢ããªãå±ç¤ºä¼ã«åºããâ¦
OpenCVã§Webã«ã¡ã©ç»åãåãè¾¼ã¿, PySide2ã®QGraphicsViewã«è¡¨ç¤ºããéã«, å°ãããã£ãã®ã§ã¡ã¢ãã¦ãã.[éçºç°å¢] CPU : Intel Core i7 - 7700 OS : Ubuntu 20.04 Python : 3.7.11 opencv-python-headless : 4.5.5.62 PySide2 : 5.15.2.1 1. ä¸å ·åçç¶ â¦
æè¿, YOLOv5, YOLOXãDetectron2ãªã©ãå°ã触ãæ©ä¼ããã£ãã®ã§, ã¾ãã¯YOLOv5ã«ã¤ãã¦å°ãã¾ã¨ãã¦ãã.å°ãåã«, YOLOv5æ¨è«ç·¨ãå¦ç¿ç·¨ã«ã¤ãã¦è¨è¼ããã, ä»åã¯ã¢ãã«å¤æç·¨ã¨ãããã¨ã§ONNXå½¢å¼ãTFLiteå½¢å¼ã¸ã®ã¢ãã«å¤æãªã©ã«ã¤ãã¦è¨ã. é¢é£è¨â¦
ãã®å¤(2022å¹´)ã«, ä¸è¨ã®ãããªã¹ããã¯ã®Windows PCãå°å ¥ãã.CPU : AMD Ryzen7 5800X RAM : 16GB OS : Windows 11 Pro SSD + HDD : 500GB + 6TB etc : æ°´å·ã¯ã¼ã©ã¼åå, WSL2ã«ããUbuntu 20.04ç°å¢ã®æ§ç¯ããã³CUDA, cuDNNã®å°å ¥ã«ã¤ãã¦è¨ãã. miraiâ¦
ãã®å¤(2022å¹´)ã«, ä¸è¨ã®ãããªã¹ããã¯ã®Windows PCãå°å ¥ãã.CPU : AMD Ryzen7 5800X RAM : 16GB OS : Windows 11 Pro SSD + HDD : 500GB + 6TB etc : æ°´å·ã¯ã¼ã©ã¼ããã¾ã§ã¯Windowsãã·ã³ã§Ubuntuã使ç¨ããå ´å, VMPlayerãVirtual Boxãå©ç¨ãã¦ããâ¦
ä»å¹´(2022å¹´)ã®æ¥ä»¥é, ãDALL·E 2ã[1], ãMidjourneyã[2], ãStable Diffusionã[3]ã¨ãã£ã精度ã®é«ãç»åçæAIã話é¡ã¨ãªã£ã¦ãã. ã¾ã, 2022å¹´9æ1æ¥ã«ã¯, ç»åçæAIãMidjourneyãã®çµµãç±³å½ã®ç¾è¡åè©ä¼ã§1ä½ã«ãªã£ãã¨ãã£ãã»ã³ã»ã¼ã·ã§ãã«ãªâ¦
æè¿, YOLOv5, YOLOXãDetectron2ãªã©ãå°ã触ãæ©ä¼ããã£ãã®ã§, YOLOv5ã«ç¶ãä»åã¯YOLOXã«ã¤ãã¦å°ãã¾ã¨ãã¦ãã. 1. ã¤ã³ã¹ãã¼ã«[1] 以å使ã£ã¦ããYOLOv3ã§ã¯, Darknetã¨å¼ã°ãæ©æ¢°å¦ç¿ãã¬ã¼ã ã¯ã¼ã¯ã使ããã¦ãã¦, 使ãã«ã¯ã½ã¼ã¹ã³ã¼ãã®ãã«ãâ¦
OpenPose[1]ãHRNet(High Resolution Network)[2]ãªã©ãªã¼ãã³ã½ã¼ã¹ã®å§¿å¢æ¨å®ã¢ã«ã´ãªãºã ã®ã³ã¼ããå ¬éããã¦ããã, ä»åKAPAO(Keypoints and Poses as Objects)[3]ã¨ãã姿å¢æ¨å®ææ³ã, å¦çãéã精度ãããã¨ããã®ã§è©¦ãã¦ã¿ã.試ãã«ããã, å°ãâ¦
æè¿, YOLOv5, YOLOXãDetectron2ãªã©ãå°ã触ãæ©ä¼ããã£ãã®ã§, ã¾ãã¯YOLOv5ã«ã¤ãã¦å°ãã¾ã¨ãã¦ãã.ååã¯YOLOv5ã¤ã³ã¹ãã¼ã«ããã³æ¨è«ç·¨ã«ã¤ãã¦è¨è¼ããã, ä»åã¯å¦ç¿ç·¨ã¨ãããã¨ã§, ãªãªã¸ãã«ãã¼ã¿ã使ã£ãã¢ãã«å¦ç¿ã«ã¤ãã¦è¨ã. 3. å¦ç¿[1â¦
æè¿, YOLOv5, YOLOXãDetectron2ãªã©ãå°ã触ãæ©ä¼ããã£ãã®ã§, ã¾ãã¯YOLOv5ã«ã¤ãã¦å°ãã¾ã¨ãã¦ãã. 1. ã¤ã³ã¹ãã¼ã«[1] 以å使ã£ã¦ããYOLOv3[1]ã§ã¯, Darknetã¨å¼ã°ãæ©æ¢°å¦ç¿ãã¬ã¼ã ã¯ã¼ã¯ã使ããã¦ãã¦, 使ãã«ã¯ã½ã¼ã¹ã³ã¼ãã®ãã«ãããå§ãâ¦
Pythonã§æ©æ¢°å¦ç¿ã使ã£ããã¢ãä½æãããã¨, GUIä½æã®ããã«PySide2ãã¤ã³ã¹ãã¼ã«ããã¨ãã, å°ãããã£ãã®ã§å¯¾å¦æ¹æ³ãã¡ã¢ãã¦ãã. 1. éçºç°å¢ ã¾ã, ããã£ãç°å¢ã§ãã, Ubuntu 20.04ä¸ã«minicondaã使ã£ã¦PyTorchéçºã®ä»®æ³ç°å¢ãæ§ç¯ãã¦ãã.â¦
æ®æ®µç©ä½æ¤ç¥ãè¡ãã¨ã, ããã¾ã§YOLOv3[1]ãssd_keras[2][3]ã使ã£ã¦ãã. ããã, ãããã®ç©ä½æ¤ç¥ãJetson Nanoãªã©çµã¿è¾¼ã¿ãã¼ãã§å¦çãããã¨ããã¨, ãã¬ã¼ã æ¯ã®å¦çã«çµæ§æéãããã, ç§æ°ãã¬ã¼ã ã»ã©ããå¦çã§ããªãã£ãããã. Jetsonã§DNâ¦
æ®æ®µç©ä½æ¤ç¥ãè¡ãã¨ã, ããã¾ã§YOLOv3[1]ãssd_keras[2][3]ã使ã£ã¦ãã. ããã, ãããã®ç©ä½æ¤ç¥ãJetson Nanoãªã©çµã¿è¾¼ã¿ãã¼ãã§å¦çãããã¨ããã¨, ãã¬ã¼ã æ¯ã®å¦çã«çµæ§æéãããã, ç§æ°ãã¬ã¼ã ã»ã©ããå¦çã§ããªãã£ãããã. Jetsonã§DNâ¦
æ®æ®µç©ä½æ¤ç¥ãè¡ãã¨ã, ããã¾ã§YOLOv3[1]ãssd_keras[2][3]ã使ã£ã¦ãã. ããã, ãããã®ç©ä½æ¤ç¥ãJetson Nanoãªã©çµã¿è¾¼ã¿ãã¼ãã§å¦çãããã¨ããã¨, ãã¬ã¼ã æ¯ã®å¦çã«çµæ§æéãããã, ç§æ°ãã¬ã¼ã ã»ã©ããå¦çã§ããªãã£ãããã. Jetsonã§DNâ¦
æ®æ®µç©ä½æ¤ç¥ãè¡ãã¨ã, ããã¾ã§YOLOv3[1]ãssd_keras[2][3]ã使ã£ã¦ãã. ããã, ãããã®ç©ä½æ¤ç¥ãJetson Nanoãªã©çµã¿è¾¼ã¿ãã¼ãã§å¦çãããã¨ããã¨, ãã¬ã¼ã æ¯ã®å¦çã«çµæ§æéãããã, ç§æ°ãã¬ã¼ã ã»ã©ããå¦çã§ããªãã£ãããã. Jetsonã§DNâ¦
æ®æ®µ, Jetson Nanoã§ã«ã¡ã©ã使ãéã«ã¯USBã¿ã¤ãã使ãã®ã ã, ä»åMIPI CSI-2ã¿ã¤ãã®ã«ã¡ã©ã試ãã¦ãã.[Jetson Nano] NVIDIA-JETSON-NANO(åæãã¼ã¸ã§ã³) JetPack 4.3 [ã«ã¡ã©] Jetson Nano Camera IMX219PQ 8M Color CMOS Sensor IR-Filter Wide Anglâ¦
æ®æ®µ, Jetson Nanoã§ã«ã¡ã©ã使ãéã«ã¯USBã¿ã¤ãã使ãã®ã ã, ä»ååãã¦MIPI CSI-2ã¿ã¤ãã®ã«ã¡ã©ã試ãã¦ã¿ã. ä»å使ã£ãã«ã¡ã©ã¯ãã. ã»Jetson Nano Camera IMX219PQ 8M Color CMOS Sensor IR-Filter Wide Angle Fished eye Len FOV158 degree OpenCVâ¦
æè¿, åç»åå¦çãããæ©ä¼ãå¢ãã¦, OpenCVã使ãäºãå¤ããªã£ãã®ã§, ä¹ ãã¶ãã«ææ°ã®æ¸ç±ãèªãã§ã¿ããã¨ã«ãã. (éå»ã«èªãã ã®ã¯OpenCV 2.4ã3.0ããã)OpenCV4ã«é¢é£ããæ¸ç±ã¯ããã¤ãããã®ã ã, ä»åã¯ãã®ä¸ã§ããå®è·µOpenCV4 for Pythonã¼ç»â¦