èªå®
ã§åãChatGPTã¨åã®FlexGenã試ã shi3zãããè奮ãã¦åããã¦ããFlexGen é¢ä¿ããè¨äºã¯ä»¥ä¸ ãã¨ãã¨GPUãç¡ãã¨åããªãã¨æã£ã¦ããã®ã§ãããã¿ã¤ã ã©ã¤ã³ã§ãã¯ãã³PããããRTX3060ã§FlexGenãåããã¦ãããã¤ã¼ããçºè¦ã ãRTX3060ãªãèªåãæã£ã¦ããï¼ãã¨ãããã¨ã§ã試ãã¦ã¿ããã¨ã«ãã¾ããã 追è¨ï¼ ç§ããã®è¨äºã§åããã¦ããã®ã¯å°ããã¢ãã«ã§ããã¨ããããã試ãã§åãããã ãã§ãshi3zãããåããã¦ããã¢ãã«ã¨ã¯ç°ãªãã¾ãã æ§è½ã®åèã«ããè¨äºã§ã¯ãªãã®ã§ããæ¿ç¥ãã ããããã大ãããµã¤ãºã®ã¢ãã«ã®ä½¿ç¨ã«é¢ãã¦ã¯ãFlexGenã®å
¬å¼ãªãã¸ããªãåç
§ãã ãããç§ãä»å¾è©¦ããã追è¨ãã¦ããã¾ãï¼ç¾ç¶ãç§ã®ç°å¢ã§ã¯åããã¦ãªãã§ãï¼ã FlexGenãDockerã§åãã çµæçã«ã¯ãDockerã使ããã¨ã§ç°¡åã«åããã¾ããã
{{#tags}}- {{label}}
{{/tags}}