[B! LLM] tekimenã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

tekimen id:tekimen

LLMã«é–¢ã™ã‚‹tekimenã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (4)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Llamaãƒ©ã‚¤ã‚»ãƒ³ã‚¹å¥‘ç´„ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¸ã®é©åˆæ€§ã«ã¤ã„ã¦
Metaç¤¾ãŒé–‹ç™ºã™ã‚‹AIãƒ¢ãƒ‡ãƒ«ã®ã‚·ãƒªãƒ¼ã‚ºã§ã‚ã‚‹ã€ŒLlamaã€ã¯ã€é«˜æ€§èƒ½ã§è²»ç”¨å¯¾åŠ¹æžœãŒé«˜ãã€æ¯”è¼ƒçš„å¯›å®¹ãªæ¡ä»¶ã§é ’å¸ƒã•ã‚Œã¦ã„ã‚‹ã¨å¤šãã®äººã€…ã‹ã‚‰è¦‹åšã•ã‚Œã¦ã„ã‚‹ã“ã¨ã‹ã‚‰ã‚·ã‚¹ãƒ†ãƒ ã¸ã®æŽ¡ç”¨ã‚„æ´¾ç”Ÿãƒ¢ãƒ‡ãƒ«ã®é–‹ç™ºç‰ã®åˆ©ç”¨ãŒæ‹¡å¤§ã—ã¦ã„ã‚‹ã‚ˆã†ã«è¦‹å—ã‘ã‚‰ã‚Œã‚‹ã€‚ã—ã‹ã—ã€Metaç¤¾ã®CEOãŒè‡ªã‚‰ã€ŒLlamaã¯ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã§ã‚ã‚‹ã€ã¨å–§ä¼ã™ã‚‹ã“ã¨ã§æœ¬å½“ã«LlamaãŒã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã§ã‚ã‚‹ã¨èª¤è§£ã™ã‚‹å‚¾å‘ã‚‚ã‚ã‚Šã€ã¾ãŸLlamaãƒ©ã‚¤ã‚»ãƒ³ã‚¹å¥‘ç´„è‡ªä½“ã«å¹¾ã¤ã‹ã®åŽ„ä»‹ãªå•é¡ŒãŒæ½œã‚“ã§ã„ã‚‹ã«ã‚‚é–¢ã‚ã‚‰ãšæŽ¡ç”¨ãŒé€²ã‚€ã“ã¨ã§ä»Šå¾Œæ³•çš„ãªå•é¡ŒãŒç”Ÿã˜ã‹ããªã„ã¨è€ƒãˆã‚‰ã‚Œã‚‹ã€‚ãã“ã§æœ¬ç¨¿ã§ã¯ã€å…ˆãšLlamaãƒ©ã‚¤ã‚»ãƒ³ã‚¹å¥‘ç´„ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¸ã®é©åˆæ€§ã‹ã‚‰è§£èª¬ã™ã‚‹ã“ã¨ã¨ã™ã‚‹ã€‚ ãªãŠã€Llamaãƒ©ã‚¤ã‚»ãƒ³ã‚¹å¥‘ç´„ã®ãƒ¢ãƒ‡ãƒ«åˆ©ç”¨æ™‚ã«ãŠã‘ã‚‹æ³¨æ„ç‚¹ã«é–¢ã—ã¦ã¯åˆ¥ã®è¨˜äº‹ã¨ã™ã‚‹ã€‚ AIã¯typoã™ã‚‹ Llamaã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¸ã®é©åˆæ€§ 1. ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹æ€§ã‚’å¦å®šã™ã‚‹ä¸»è¦ãªç†ç”± 1
tekimen 2025/01/15
AI

LLM

oss
ãƒªãƒ³ã‚¯
Jetson Orin Nano ã§æ—¥æœ¬èªžLLMã‚’å‹•ã‹ã—ã¦ã¿ãŸ
å¿…è¦ãªãƒ‡ãƒã‚¤ã‚¹ Jetson Orin Nano Developer Kit 8GB Ubuntu 20.04 ãŒã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã•ã‚Œã¦ã„ã‚‹PC NVMe SSD 0. å‰æº–å‚™ https://www.jetson-ai-lab.com/tutorial_text-generation.html ã‚’èªã‚€ã¨ preferably with NVMe SSD ã¨ã®ã“ã¨ãªã®ã§ã€SDK Manager ã‚’ä½¿ç”¨ã—ã¦ã€NVMe SSD ã« OS ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹ JetPack 6.x ã®æœ€æ–°ç‰ˆã¯ JetPack 6.0 Developer Preview ã§ã€ã¾ã ä¸å®‰å®šãªã®ã§ã€ JetPack 5.1.3 ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹ã‚‚ã®ã¨ã™ã‚‹ JetPack 5.x ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹ã«ã¯ Ubuntu 20.04 ãŒå¿…è¦ãªã®ã§ã€äº‹å‰ã«ç”¨æ„ã—ã¦ãŠãã“ã¨ â€»Ubuntu 22.04 ã ã¨ JetPack 6.x
tekimen 2024/12/18
LLM

Ubuntu

GPU

NVIDIA
ãƒªãƒ³ã‚¯
ã‚¸ãƒ£ãƒ³ã‚¯ãƒŽãƒ¼ãƒˆãƒ‘ã‚½ã‚³ãƒ³ã«Pythonã¨æ—¥æœ¬èªžLLMã®Rinnaã‚’å…¥ã‚Œã¦ãƒ¡ãƒ¢ãƒª16GBã¨Swapãƒ•ãƒ«ã§ãƒãƒ¼ã‚«ãƒ«è³ªå•ã—ã¦ã¿ãŸã€‚ãƒ¡ãƒ¢ãƒªè¶³ã‚Šãªãã¦ã‚‚Swapç©ã‚ã°ãªã‚“ã¨ã‹ãªã‚‹ã€‚ãƒãƒ¼ã‚«ãƒ«LLMæœ€é«˜
Kapper@Linuxã‚¬ã‚¸ã‚§ãƒ²ã‚¿ï¼†ç•°ä¸–ç•Œå°èª¬å®¶ï¼†ç”ŸæˆAIï¼†é›»åå·¥ä½œå¤§å¥½ã @kapper1224 ã‚¸ãƒ£ãƒ³ã‚¯ãƒŽãƒ¼ãƒˆãƒ‘ã‚½ã‚³ãƒ³16GBãƒ¡ãƒ¢ãƒªã«Ubuntuã¨Swapã¨Zramã‚¬ãƒ³ãƒ…ãƒŸã—ã¦LLMã®rinnaã‚’å‹•ã‹ã™ãƒ†ã‚¹ãƒˆã€‚ Zram16GBã«Swap4GBã®åˆè¨ˆ20GBã€‚ rinnaã‚’CPUã§å‹•ã‹ã™ã«ã¯32GBãƒ¡ãƒ¢ãƒªãŒå¿…è¦ã ã¨è¨€ã‚ã‚Œã¦ã„ã‚‹ãƒ»ãƒ»ãƒ» pic.twitter.com/JtNmAP4kH7 2023-11-05 08:53:53 Kapper@Linuxã‚¬ã‚¸ã‚§ãƒ²ã‚¿ï¼†ç•°ä¸–ç•Œå°èª¬å®¶ï¼†ç”ŸæˆAIï¼†é›»åå·¥ä½œå¤§å¥½ã @kapper1224 Ubuntuä¸Šã§rinnaã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹æ–¹æ³•ã¯ã“ã¡ã‚‰ã‚’å‚ç…§ã€‚ ã¾ãšpython3ã¨pipã¨gitãŒã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã•ã‚Œã¦ã„ã‚‹äº‹ã‚’å‰æã¨ã—ã¦ pip install transf ormers sentencepiece ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«çµ‚ã‚ã£ãŸã‚‰ã€ãƒ‡ãƒ¼ã‚¿ã‚’hugging
tekimen 2023/11/06
LLM

PC

python
ãƒªãƒ³ã‚¯
æ³¨ç›®ã®æ—¥æœ¬èªžå¤§è¦æ¨¡ãƒ¢ãƒ‡ãƒ«LLM-JP 13Bã‚’è©¦ã™(JSONåã‘ãŸ)ï½œshi3z
å›½ç«‹æƒ…å ±å¦ç ”ç©¶æ‰€ãŒä½œã£ãŸLLM-JP 13BãŒå…¬é–‹ã•ã‚Œã¦ã„ãŸã®ã§æ—©é€Ÿè©¦ã—ã¦ã¿ãŸã€‚è‰²ã€…ãªãƒ¢ãƒ‡ãƒ«ãŒå…¬é–‹ã•ã‚Œã¦ã„ã‚‹ãŒã€å…¨éƒ¨ç››ã‚Šã£ã½ã„ ã€Œllm-jp/llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0ã€ã‚’è©¦ã™ã€‚ ãƒžã‚·ãƒ³ã¯ã‚‚ã¡ã‚ã‚“ãƒ‰ã‚¹ãƒ‘ãƒ©è£½Memeplexãƒžã‚·ãƒ³(A6000x2)ã ã€‚ import torch from transf ormers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("llm-jp/llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0") model = AutoModelForCausalLM.from_pretrained("llm-jp/llm-jp-13b
tekimen 2023/10/23
json

LLM

AI

è‡ªç„¶è¨€èªžå‡¦ç†
ãƒªãƒ³ã‚¯
1