æè¿ãªã¼ãã³ã«ãªã大è¦æ¨¡è¨èªã¢ãã«ï¼LLMï¼ããè»ä¸¦ã¿GPT-4ã¬ãã«ã®æ§è½ã¨ãªã£ã¦ãã¾ã Huggngfaceã§ç¡æã§ãã¦ã³ãã¼ãã§ããã®ã§ãããåé¡ã¯å¿ è¦VRAM容éã§ã 話é¡ã®ãCommand-r-Plusã¯ãæ¥æ¬èªæ§è½ã«ã¤ãã¦è©ä¾¡ãé«ããä¸é¨ã®æ§è½ã¯GPT-4並ã¿ã¨è¨ããã¾ããããããã«å¤§åã§104Bãã©ã¡ã¼ã¿ãããããã4bitã«éååãã¦ã60GBç¨åº¦ã®VRAMãå¿ è¦ã¨ãªãã¾ãã ã³ã³ã·ã¥ã¼ãã¼ã¯ã©ã¹ã®GPUã®æé«å³°ãRTX4090ã¯ãVRAM24GBã®ãããcommand-r-plusããã¹ã¦GPUã«è¼ãã¦æ¨è«ãããã¨èããã¨ã3å°ã®ãã«ãGPUãã¹ã¯ããããå¿ è¦ã§ã ããããRTX4090ã¯450Wæ¶è²»ã®GPUã®ããå·å´æ©æ§ã大ããã1ãã¹ã¯ãããã«3å°åããã®ã¯è³é£ã®æ¥ã¨ãªãã¾ãã å æ¥ãæ°´å·ã©ã¸ã¨ã¼ã¿ã¼ä»ãRTX4090ã§ããã«ãGPUãã¹ã¯ããããä½æãã¾ããã æ°´å·
{{#tags}}- {{label}}
{{/tags}}