[B! æ©Ÿæ¢°å¦ç¿’][llm] takaya030ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

takaya030 id:takaya030

é–¢é€£ã‚¿ã‚°ã§çµžã‚Šè¾¼ã‚€ (7)

ã‚¿ã‚°ã®çµžã‚Šè¾¼ã¿ã‚’è§£é™¤

æ©Ÿæ¢°å¦ç¿’ã¨llmã«é–¢ã™ã‚‹takaya030ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

LLMé–‹ç™ºã®ãŸã‚ã«MLOpsãƒãƒ¼ãƒ ãŒã‚„ã‚‹ã¹ãã“ã¨ | ãƒ•ãƒ¥ãƒ¼ãƒãƒ£ãƒ¼æŠ€è¡“ãƒ–ãƒã‚°
ã¯ã˜ã‚ã«ã“ã‚“ã«ã¡ã¯ã€SAIG/MLOpsãƒãƒ¼ãƒ ã§ã‚¢ãƒ«ãƒã‚¤ãƒˆã‚’ã—ã¦ã„ã‚‹æ¿é‡Žãƒ»å¹³é‡Žã§ã™ã€‚ ä»Šå›žã¯ã€ŒLLMé–‹ç™ºã®ãŸã‚ã«MLOpsãƒãƒ¼ãƒ ãŒã‚„ã‚‹ã¹ãã“ã¨ã€ã¨ã„ã†ãƒ†ãƒ¼ãƒžã§ã€å¾“æ¥ã®MLOpsã¨ã®é•ã„ãƒ»ãƒ„ãƒ¼ãƒ«ãƒ»æ§‹æˆä¾‹ç‰ã«ã¤ã„ã¦èª¿æŸ»ãƒ»æ•´ç†ã—ã¾ã—ãŸã€‚ LLMã¨ã¯Large Launguage Modelï¼ˆå¤§è¦æ¨¡è¨€èªžãƒ¢ãƒ‡ãƒ«ï¼‰ã®ç•¥ã§ã‚ã‚Šã€ã“ã“ã§ã®LLMé–‹ç™ºã¨ã¯ã€ã€ŒLLMè‡ªä½“ã®é–‹ç™ºã€ãŠã‚ˆã³ã€ŒLLMã‚’æ´»ç”¨ã—ãŸã‚·ã‚¹ãƒ†ãƒ é–‹ç™ºã€ã®ä¸¡æ–¹ã‚’å«ã‚€ã‚‚ã®ã¨ã—ã¾ã™ã€‚LLMé–‹ç™ºã®ãƒ•ãƒãƒ¼ã«ã¤ã„ã¦ã¯ä»¥å‰ã«LLMé–‹ç™ºã®ãƒ•ãƒãƒ¼ã§è©³ç´°ã‚’èª¬æ˜Žã—ã¦ã„ã‚‹ã®ã§ã€ãœã²ä½µã›ã¦ã”è¦§ãã ã•ã„ã€‚ ã¾ãšã€MLOpsã¨ã¯ã€Œæ©Ÿæ¢°å¦ç¿’ãƒ¢ãƒ‡ãƒ«ã®å®Ÿè£…ã‹ã‚‰é‹ç”¨ã¾ã§ã‚’å††æ»‘ã«æŽ¨é€²ã™ã‚‹ãŸã‚ã®æ‰‹æ³•ã‚„è€ƒãˆæ–¹ã€ã®ã“ã¨ã§ã™ã€‚AIã®ç¤¾ä¼šå®Ÿè£…ãŒå¢—ãˆã‚‹ã«ä¼´ã„ã€MLOpsãƒãƒ¼ãƒ ã‚’è¨ã‘ã‚‹ä¼æ¥ã‚‚å¢—ãˆã¦ãã¾ã—ãŸã€‚ã¾ãŸã€æœ€è¿‘ã§ã¯LLMã‚„ãã®é–¢é€£æŠ€è¡“ãŒæ€¥é€Ÿã«ç™ºé”ã—ã¦ãã¦ãŠã‚Šã€ä»Šå¾ŒLLMã‚’ç”¨ã„ãŸã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³
takaya030 2023/09/13
mlops

æ©Ÿæ¢°å¦ç¿’

llm
ãƒªãƒ³ã‚¯
å¤§è¦æ¨¡è¨€èªžãƒ¢ãƒ‡ãƒ«ï¼ˆLLMï¼‰ã‚’ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³é–‹ç™ºã§æ´»ç”¨ã™ã‚‹ã«ã¯ï¼Ÿ ã‚°ãƒ¼ã‚°ãƒ«ãƒ»ã‚¯ãƒ©ã‚¦ãƒ‰ãŒåŸºç¤Žã‹ã‚‰è§£èª¬
å¤§è¦æ¨¡è¨€èªžãƒ¢ãƒ‡ãƒ«ï¼ˆLLMï¼‰ã¨ã¯ä½•ã‹ï¼ŸÂ ãã®ä»•çµ„ã¿ã¨å®Ÿç”¨åŒ–ã¾ã§ ç™»å£‡ã—ãŸã®ã¯ã€ã‚°ãƒ¼ã‚°ãƒ«ãƒ»ã‚¯ãƒ©ã‚¦ãƒ‰ãƒ»ã‚¸ãƒ£ãƒ‘ãƒ³åˆåŒä¼šç¤¾ã€€ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚ºã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒˆã®ä¸äº•æ‚¦å¸æ°ã¨ã€åŒç¤¾ã®AI/ML äº‹æ¥é–‹ç™ºéƒ¨é•·ã§ã‚ã‚‹ä¸‹ç”° å€«å¤§æ°ã®2äººã€‚ã¾ãšä¸äº•æ°ãŒã‚»ãƒƒã‚·ãƒ§ãƒ³ã®ãƒ†ãƒ¼ãƒžã§ã‚ã‚‹å¤§è¦æ¨¡è¨€èªžãƒ¢ãƒ‡ãƒ«ï¼ˆLLMï¼‰ã®åŸºç¤ŽçŸ¥è˜ã‚’è§£èª¬ã—ãŸã€‚ ã‚°ãƒ¼ã‚°ãƒ«ãƒ»ã‚¯ãƒ©ã‚¦ãƒ‰ãƒ»ã‚¸ãƒ£ãƒ‘ãƒ³åˆåŒä¼šç¤¾ Solutions Architect ä¸äº•æ‚¦å¸æ° ã‚¦ã‚£ã‚ãƒšãƒ‡ã‚£ã‚¢ã§ã€Œè¨€èªžãƒ¢ãƒ‡ãƒ«ã€ã‚’èª¿ã¹ã‚‹ã¨ã€ã€Œå˜èªžåˆ—ã«å¯¾ã™ã‚‹ç¢ºçŽ‡åˆ†å¸ƒã‚’è¡¨ã‚ã™ã‚‚ã®ã€ã¨ã‚ã‚‹ã€‚ä¸äº•æ°ã¯ã€ä¸–ã®ä¸ã«å˜åœ¨ã™ã‚‹å¤§é‡ã®è‡ªç„¶è¨€èªžã§æ›¸ã‹ã‚ŒãŸãƒ†ã‚ã‚¹ãƒˆæ–‡æ›¸ã«å¯¾ã—ã€ãã®æ–‡æ›¸ãŒã©ã‚Œã»ã©ã€Œã‚ã‚Šãã†ã€ãªã‚‚ã®ãªã®ã‹ã‚’ç¢ºçŽ‡ã§è¡¨ç¾ã™ã‚‹ã‚‚ã®ãŒè¨€èªžãƒ¢ãƒ‡ãƒ«ã§ã‚ã‚‹ã¨èª¬æ˜Žã—ãŸã€‚ è¨€èªžãƒ¢ãƒ‡ãƒ«ã®åˆ©ç”¨ä¾‹ã¨ã—ã¦ã€æ–‡ç« ã®æ¬¡ã«æ¥ã‚‹å˜èªžã®äºˆæ¸¬ãŒæŒ™ã’ã‚‰ã‚Œã‚‹ã€‚ä¾‹ãˆã°ã€"This is a â€¦â€¦"ã¨ã‚ã‚‹ã¨ã€å¤šãã®æ—¥æœ¬äººã¯"pen"ã¨æƒ³åƒã™ã‚‹ã“ã¨ãŒå¤šã„ã€‚ã
takaya030 2023/09/11
llm

æ©Ÿæ¢°å¦ç¿’

vertex

ai

gcp
ãƒªãƒ³ã‚¯
Google Colab ã§ LINE ã® japanese-large-lm ã‚’è©¦ã™ï½œnpaka
ã€ŒGoogle Colabã€ã§LINEã®ã€Œjapanese-large-lmã€ã‚’è©¦ã—ãŸã®ã§ã€ã¾ã¨ã‚ã¾ã—ãŸã€‚ 1. japanese-large-lmã€Œjapanese-large-lmã€ã¯ã€ã€ŒLINEã€ãŒé–‹ç™ºã—ãŸ36å„„ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ã®æ—¥æœ¬èªžLLMã§ã™ã€‚ 2. japanese-large-lmã®ãƒ¢ãƒ‡ãƒ«ã€Œjapanese-large-lmã€ã§ã¯ã€æ¬¡ã®3ç¨®é¡žã®ãƒ¢ãƒ‡ãƒ«ãŒæä¾›ã•ã‚Œã¦ã„ã¾ã™ã€‚ ãƒ»line-corporation/japanese-large-lm-3.6bÂ : ãƒ™ãƒ¼ã‚¹ãƒ¢ãƒ‡ãƒ« ãƒ»line-corporation/japanese-large-lm-3.6b-instruction-sftÂ : æŒ‡ç¤ºãƒ¢ãƒ‡ãƒ« ãƒ»line-corporation/japanese-large-lm-1.7bÂ : ãƒ™ãƒ¼ã‚¹ãƒ¢ãƒ‡ãƒ« 3. Colabã§ã®å®Ÿè¡ŒColabã§ã®å®Ÿè¡Œæ‰‹é †ã¯ã€æ¬¡ã®ã¨ãŠã‚Šã§ã™ã€‚ (1) Colabã®
takaya030 2023/08/17
colab

llm

æ©Ÿæ¢°å¦ç¿’
ãƒªãƒ³ã‚¯
Bardã®ã‚ˆã†ãªimage2textAIã‚’æ§‹ç¯‰ã—ã¦å‹•ç”»æ¤œç´¢ã‚·ã‚¹ãƒ†ãƒ ã‚’ä½œã‚‹
Turingæ ªå¼ä¼šç¤¾ã®è‡ªå‹•é‹è»¢MLãƒãƒ¼ãƒ ã§ã‚¤ãƒ³ã‚¿ãƒ¼ãƒ³ã‚’ã—ã¦ã„ã‚‹æ±å¤§B4ã®ä¸æ‘ã§ã™ã€‚ çªç„¶ã§ã™ãŒã€webæ¤œç´¢ã®ã‚ˆã†ã«ç°¡å˜ã«ã€ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸å†…ã«ä¿å˜ã•ã‚Œã¦ã„ã‚‹ã€æ—¥æ™‚ä»¥å¤–ã®ãƒ¡ã‚¿æƒ…å ±ã®ãªã„å‹•ç”»ãŒæ¤œç´¢å‡ºæ¥ã‚‹ã‚ˆã†ã«ãªã£ãŸã‚‰å¹¸ã›ã«ãªã‚Œã‚‹ã¨æ€ã„ã¾ã›ã‚“ã‹ï¼Ÿ ä¾‹ãˆã°ã€Œèµ¤ä¿¡å·ã§è»ŠãŒåœæ¢ã—ã¦ã„ã‚‹ã€ã¨ã„ã†æ¤œç´¢ã‚¯ã‚¨ãƒªã«å¯¾ã—ã¦ã€å®Ÿéš›ã«èµ¤ä¿¡å·ã§åœæ¢ã—ã¦ã„ã‚‹å‹•ç”»ãŒè¿”ã£ã¦ããŸã‚‰ã€ç°¡å˜ã«ãã‚Œã‚’ä¿¡å·æ¤œçŸ¥ï¼‹åœæ¢ã®ãƒ¢ãƒ‡ãƒ«å¦ç¿’ã«ä½¿ãˆã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ ä»Šå›žç§ãŒé–‹ç™ºã—ãŸå‹•ç”»æ¤œç´¢ã‚·ã‚¹ãƒ†ãƒ ã¯ã“ã‚Œã‚’AIã®åŠ›ã‚’å€Ÿã‚Šã¦å®Ÿç¾ã—ã¾ã—ãŸã€‚ã“ã‚Œã«ã‚ˆã‚Šã€æ ¼æ®µã«å‹•ç”»æ¤œç´¢ã®åˆ©ä¾¿æ€§ãŒå¢—ã—ã€ã‚ˆã‚Šå¤šæ§˜ãªå‹•ç”»ã‚’ç°¡å˜ã«ä½¿ç”¨ã§ãã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ä»Šå›žã¯ãã®ã‚·ã‚¹ãƒ†ãƒ ã«ã¤ã„ã¦ç´¹ä»‹ã—ã¾ã™ã€‚ ãƒ¯ãƒ³ãƒ‘ãƒ³ã§å‹•ç”»ã‚’æŽ¢ã›ã‚‹ã¨å¬‰ã—ã„ èª²é¡Œ Turingã§ã¯ã€èµ°è¡Œãƒ‘ãƒ¼ãƒˆãƒŠãƒ¼ã®æ–¹ã€…ã¨å…±ã«å¤§é‡ã®èµ°è¡Œãƒ‡ãƒ¼ã‚¿ã‚’åŽé›†ã—ã¦ãã¾ã—ãŸã€‚è»Šä¸¡ã«ã‚«ãƒ¡ãƒ©ãƒ»ãƒ‡ãƒ¼ã‚¿åŽé›†ã‚ãƒƒãƒˆã‚’è¼‰ã›ã¦ã€æ–‡å—é€šã‚Šæ¯Žæ—¥æœã‹ã‚‰æ™©ã¾ã§ãƒ‡ãƒ¼ã‚¿ã‚’å–
takaya030 2023/07/22
bard

llm

æ©Ÿæ¢°å¦ç¿’
ãƒªãƒ³ã‚¯
å¤–éƒ¨ãƒ‡ãƒ¼ã‚¿ã‚’Retrievalã—ã¦LLMæ´»ç”¨ã™ã‚‹ä¸Šã§ã®èª²é¡Œã¨å¯¾ç–æ¡ˆ - ABEJA Tech Blog
ã¯ã˜ã‚ã« ABEJAã§ãƒ‡ãƒ¼ã‚¿ã‚µã‚¤ã‚¨ãƒ³ãƒ†ã‚£ã‚¹ãƒˆã‚’ã—ã¦ã„ã‚‹æœéƒ¨ã§ã™ã€‚ ä»Šå›žã¯LLMã§å¤–éƒ¨ãƒ‡ãƒ¼ã‚¿ã‚’ä½¿ã†ã‚±ãƒ¼ã‚¹ã«ã¤ã„ã¦ã®ãŠè©±ã‚’ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ ã¯ã˜ã‚ã« LLMã¨å¤–éƒ¨ãƒ‡ãƒ¼ã‚¿ã®åˆ©ç”¨ Retrievalã¨LLM 0. (äº‹å‰æº–å‚™)å‚ç…§ã—ãŸã„ãƒ†ã‚ã‚¹ãƒˆãƒ‡ãƒ¼ã‚¿ã‚’DBã«æ ¼ç´ 1. ãƒ¦ãƒ¼ã‚¶ã®å…¥åŠ›æ–‡ã¨ã®ãƒ†ã‚ã‚¹ãƒˆé¡žä¼¼åº¦ã‚’è¨ˆç®—ã—ã¦ã€é–¢é€£ãƒ†ã‚ã‚¹ãƒˆã‚’æŠ½å‡ºã™ã‚‹(Retrieval) 2. é–¢é€£ãƒ†ã‚ã‚¹ãƒˆã‚’LLMã®ãƒ—ãƒãƒ³ãƒ—ãƒˆã«å…¥ã‚Œè¾¼ã¿ã€ãƒ¦ãƒ¼ã‚¶ã®å…¥åŠ›æ–‡ã«å›žç”ã™ã‚‹ã€‚ Retrievalæ™‚ã®èª²é¡Œ LangChainã§ã®ç”¨æ„ Case1: ãã‚Œãžã‚Œã®æ–‡ç« ãŒRetrievalã—ã«ãã„å½¢ã§ä¿å˜ã•ã‚Œã¦ã„ã‚‹ å¯¾ç–æ¡ˆ: ãƒšãƒ¼ã‚¸æ§‹é€ ã‚’æ„è˜ã—ãŸå½¢ã§å„æ–‡ç« ã‚’æ ¼ç´ã™ã‚‹ ä»–ã®å¯¾ç–æ¡ˆ èžãæ–¹ã‚’æ˜Žç¢ºã«ã™ã‚‹ é¡žä¼¼åº¦ã‚’æ¸¬ã‚‹ã‚¯ã‚¨ãƒªæ–‡ç« ã‚’ç½®ãæ›ãˆã‚‹ ä¸è¦ãã†ãªæ–‡ç« ã‚’ãƒ‡ãƒ¼ã‚¿ã‹ã‚‰å‰Šé™¤ã™ã‚‹ ãƒ‡ãƒ¼ã‚¿è‡ªä½“ã‚’LLMã§æ•´å½¢ã—ç›´ã™ Case2: æœªçŸ¥ã®å˜èªžã‚’å«ã‚€ ä»®èª¬: ãƒ‹ãƒ£ã‚ªãƒ
takaya030 2023/07/03
llm

æ©Ÿæ¢°å¦ç¿’

langchain
ãƒªãƒ³ã‚¯
1