SFTTrainerã§Llama3ã®ãã¡ã¤ã³ãã¥ã¼ãã³ã°ï¼QLoRAï¼ SFTTrainerã¨ã¯ ãã®è¨äºã§ã¯ãHuggingFaceã®SFTTrainerã使ã£ã¦ãLlama3ã®ã¢ãã«ã«QLoRAãã¡ã¤ã³ãã¥ã¼ãã³ã°ããã¾ãã SFTTrainerã¯ãæ師ãããã¡ã¤ã³ãã¥ã¼ãã³ã°ï¼Supervised Fine-tuningï¼ã§å¦ç¿ããããã®ã©ã¤ãã©ãªã§ãã Transformersã©ã¤ãã©ãªã«çµ±åããã¦ãããå°ãªãã³ã¼ãã§ãã¡ã¤ã³ãã¥ã¼ãã³ã°ã®å®è£ ãã§ãã¾ãã QLoRA QLoRAã¯ãLoRAã¨éååï¼Quantizationï¼ã®ï¼ã¤ã®è¦ç´ ããã¤ãã¡ã¤ã³ãã¥ã¼ãã³ã°ã®ææ³ã§ãã LoRAã¯ãã¢ãã«ã®ãã©ã¡ã¼ã¿ãä½ã©ã³ã¯è¡åã§è¿ä¼¼ãããã¨ã§ãæ´æ°ãããã©ã¡ã¼ã¿æ°ãå¤§å¹ ã«æ¸ããè¨ç®éãåæ¸ãã¦ãã¾ãã éååã¨ã¯ãã¢ãã«ã®ç²¾åº¦ãä¸ãã代ããã«ãGPUã¡ã¢ãªãå¤§å¹ ã«ç¯ç´ããæè¡ã«ãªãã¾ãã
ãã㯠ã¯ã¦ãªã¨ã³ã¸ãã¢ã¢ããã³ãã«ã¬ã³ãã¼2023 2æ¥ç®ã®è¨äºã§ãã ã¯ã¦ãªã¨ã³ã¸ã㢠Advent Calendar 2023 - Hatena Developer Blog ã¯ã¦ãªã¨ã³ã¸ãã¢ã®ã«ã¬ã³ãã¼ | Advent Calendar 2023 - Qiita ãããããã¿ã¼ã¯ç·å¼µãããã©ãé çªãåã£ã¦ããã¾ã§é·ãéã½ã¯ã½ã¯ããã®ãå«ãã¨ããçç±ã§ä¾å¹´2æ¥ç®ãçãããã«ãã¦ãã id:pokutuna ã§ããä»å¹´ãæåãã¾ããã 観å åæã¨ã¯ ç®ãéããã°æãåºãããã®ã³ã¼ã... ãã® Issue... ããªãã Web ç³»ã®ã¨ã³ã¸ãã¢ã§ããã趣å³ã§éçºãã¦ããæ¹ã§ãããå¿ è¦ã«å¿ãã¦ã©ã¤ãã©ãªããã¬ã¼ã ã¯ã¼ã¯ã®ã³ã¼ããèªãã®ã¯ãããããã¨ã§ããããå ¬éã®å ´ã§éçºããã¦ããã½ããã¦ã§ã¢ã¯ãã½ã¼ã¹ã³ã¼ãã ãã§ãªããéçºã³ãã¥ããã£ã§ã®è°è«ããã°å ±åãªã©ãè¦ããã¨ãã§ãã¾ãã ãªã
Fast ML Inference, Simple APIRun the top AI models using a simple API, pay per use. Low cost, scalable and production ready infrastructure. $2.7 per 1M input tokens curl -X POST \ -d '{"input": "What is the meaning of life?", "stream": true}' \ -H 'Content-Type: application/json' \ https://api.deepinfra.com/v1/inference/meta-llama/Meta-Llama-3.1-405B-Instruct
ä»åã¯ãã¹ãã¼ããã³ã¢ããªã®è²©å£²åå ¥ã«ä¿ãæ¶è²»ç¨ã®åæ±ãã«ã¤ãã¦ãiOSã¢ããªã¨Androidã¢ããªã®ããããã®éãã«è§¦ããªãã 解説ãããã¨æãã¾ãã Appleã¨Googleã®ã¢ããªã®æä¾å½¢æ ã®éã Apple社ãæä¾ãã¦ãã端æ«(iPhoneã»iPad)ã§åä½ããã¢ããªã®ãã¨ããiOSã¢ããªããGoogle社ãæä¾ãã¦ãããAndroid OSãã«ãã£ã¦åä½ããã¢ããªããAndroidãã¢ããªã¨ããã¾ãã ãiOSã¢ããªãã¯App StoreããAndroidã¢ããªãã¯Google Play Storeãããã¦ã³ãã¼ããããã¨ãã§ããã®ã§ããããiOSã¢ããªãã¨ãAndroidã¢ããªãã®éçºè ããæ¶è²»è ã¸ã®å¥ç´ä¸ã®æä¾å½¢æ ã¯ããããç°ãªãã¾ãã ã¹ãã¼ããã³ã¢ããªã®è²©å£²åå ¥ã«ä¿ãæ¶è²»ç¨ã®åãæ±ãã¯ããOSï¼ãªãã¬ã¼ãã£ã³ã°ã·ã¹ãã ï¼ãiOSãAndroidããããè³¼å ¥ãããå ´æãæ¥æ¬
Over the years, Flutter has attracted millions of developers who built user interfaces across every platform. Flutter began as a UI toolkit for mobile - iOS and Android, only. Then Flutter added support for web. Finally, Flutter expanded to Mac, Windows, and Linux. Across this massive expansion of scope and responsibility, the Flutter team has only marginally increased its size. To help expand Flu
ããã«ã¡ã¯ï¼@kakeyangã§ãï¼ ä¹ ãã¶ãã®æ稿ã§ãã ãªããªããããæ²ç¸ã®å «é山諸島ã«æ è¡ã«è¡ã£ã¦ã¾ããã®ã§ãï¼ æ¥½ããã£ããªãï¼é ãç®ï¼ ä»åã¯ãéçºã§çµé¨ããéä¿¡é害ã®åå ã¨ãã®å¯¾çãå ¬éãã¾ãã åå ãLinuxã«ã¼ãã«ã®è¨å®ã ã£ãã®ã§ãçµæ§è¦å´ãã¾ããããã é害æ¦è¦ ç°ãªããããã¯ã¼ã¯å ï¼çæ¹ã¯å¼ç¤¾ãããã¯ã¼ã¯ï¼ã®ç©çãµã¼ãéï¼å¼ç¤¾ãåä¿¡å´ï¼ã§ã¤ã³ã¿ã¼ãããè¶ãã«ã½ã±ããéä¿¡ãè¡ãã æ¯åã§ã¯ãªãã1å²ç¨åº¦ã®å²åã§ãéä¿¡å´ã§connection timeoutã観測ã åä¿¡å´ã«ã¯apacheã®ãã°ãæ®ã£ã¦ããªãã£ãã®ã§ãwebãµã¼ãã«ã¯å±ãã¦ããªãã éä¿¡å´ã§tracerouteããã¨ã確ãã«å¼ç¤¾ãããã¯ã¼ã¯å ã«ã¯å ¥ã£ã¦ããã å¼ç¤¾ãããã¯ã¼ã¯å ã®F/Wããç©çãµã¼ãã®éã®ã©ããã§éä¿¡ãé絶ãã¦ããã£ã½ãï¼ ã¨ããã¨ããã¾ã§ã¯ããã«å¤æãã¾ããã 調æ»å 容 ãã¼ã¿ã»ã³ã¿ã¼ã¨
ãããããtcp_tw_recycleãã£ã¦ãªã«ï¼ TIME_WAITç¶æ ã®ã½ã±ãã*1ãé«éã«åå©ç¨ããããã®Linuxã«ã¼ãã«ç¹æã®ä»çµã¿ãããã ã/etc/sysctl.confãã§ããã¤ï¼net.ipv4.tcp_tw_recycleï¼ã1ã«ãã¦ãã£ã¦ãsysctl -pãããã ãã§æå¹ã«ãªãã¾ãã ãTIME_WAITã®ã½ã±ãããå°ãªããã¦ããããã§ããï¼ãããããï¼ãã¨ããæãã§è¨å®ãã¦ãã¾ãããã«ãªãã¾ããã»ã»ã» ãªãã§ãã¡ãªã®ï¼ çµè«ããè¨ãã¨ãããã¤ãæå¹ã«ããã¨ããåãã°ãã¼ãã«IPã®ã¯ã©ã¤ã¢ã³ãããã®æ¥ç¶ã§ãã¤TCPãã±ããã«ã¿ã¤ã ã¹ã¿ã³ãæ å ±ãå ¥ã£ã¦ããå ´åã§ãã»ã¼åæã«ãã±ãããéãã¨ãå¤ãã¿ã¤ã ã¹ã¿ã³ãã®æ¹ã®ãã±ãããåæã«ãããããã¡ããã¾ãã ã©ããããã¨ãªã®ã»ã»ã» ãtcp_tw_recycleãã¯ããåä¸IPããã®ãã±ãããå°çããã¨ãã使ã£ã¦ããã½ã±
Update: 2019-01-04 Windows 㧠PHP ã®ãã¹ãããã¦ããã SSL certificate problem: unable to get local issuer certificate ... ã®ãããªã¨ã©ã¼ãåºã¾ãããã©ãã curl ãåºãã¦ãããããªã®ã§ãããããªãã足ãã¦ãªãï¼ãã¨èª¿ã¹ã¦ã¿ãã確ãã«ç§ã®ç°å¢ã«ã¯è¨å®ããã¦ãªãã£ãã§ããããã SSL certificate problem: unable to get local issuer certificate ã«ããã¨ãã¾ã https://curl.haxx.se/ca/cacert.pem ãã curl ç¨ã®è¨¼ææ¸ããã¦ã³ãã¼ããã¦ãã©ããã«ç½®ãã¾ãã C:\php\extras\ssl ããããããããªã 次ã«ããã®å ´æã php.ini ã«è¨è¼ãã¾ãã [curl] ; A defau
ããã»ã¹ã®ã¡ã¢ãªä½¿ç¨éã«é¢ããææ¨ãå¦ã¶ (VSS, RSS, PSS, USS) 2022 å¹´ 08 æ 01 æ¥ Â Linux æè¡ãã¿ ç®æ¬¡ ã¯ããã« VSS, RSS, PSS, USS ã¨ã¯ 2.1 VSS (Virtual Set Size) 2.2 RSS (Resident Set Size) 2.3 PSS (Proportional Set Size) 2.4 USS (Unique Set Size) VSS, RSS, PSS, USSã¯ã©ããã£ã¦ç¢ºèªããã®ï¼ 3.1 VSS, RSSã®ç¢ºèªæ¹æ³(topãpsãå©ç¨ãã) 3.2 PSS, USSã®ç¢ºèªæ¹æ³(smemãå©ç¨ãã) ã¾ã¨ã åèæç® 1.ã¯ããã« çµè¾¼ã¿ Linux ã«ããã¦ãã¦ã¼ã¶ç©ºéã§åä½ããã¦ããããã»ã¹ãã©ã®ãããã¡ã¢ãªã使ç¨ãã¦ãããç¥ããããªããã¨ãããã¨æãã¾ãï¼ä¾ãã° Web ãã©ã¦ã¶
HDDãæ» ã³ãâSSDã¨å ±åâã«è½ã¡çããçç±ãSSDä¸å¼·ãé»ããã³ã¹ãã®å£ãããã©ã¼ã«ã¹ã 2024å¹´10æ22æ¥ æ±å大å¦å½éé£æºé¨ç¹ä»»ææ (åèªææ) ç°ä¸ é½ä¸é å·¥å¦è ã1983å¹´æ±å大å¦å¤§å¦é¢å·¥å¦ç 究ç§å士åæ課ç¨ä¿®äºã2006å¹´åå士å¾æ課ç¨ä¿®äºãå士ï¼å·¥å¦ï¼ã1983å¹´ãã2016å¹´ã¾ã§ãæ±èã°ã«ã¼ãã«ã¦ãHDDãããã©ãã·ã¥ã¡ã¢ãªã使ã£ãSSDãªã©é«å¯åº¦ã¹ãã¬ã¼ã¸æè¡ã®ç 究éçºãå®ç¨åã«æºããã2005å¹´ã«ã¯ãåç´ç£æ°è¨é²æ¹å¼ãæ¡ç¨ããHDDã®ä¸çåã®è£½ååã主å°ããã山形大å¦å¤§å¦é¢çå·¥å¦ç 究ç§ãæ±å大å¦é»æ°éä¿¡ç 究æææãçµã¦2024å¹´4æããç¾è·ãIEEEãã§ãã¼ã好ããªãã®ã¯ã¹ãã¼ã¨ç»å±±ã¨èç ®ä¼ã ãããã£ã¼ã«ï¼æ±å大å¦å ¬å¼ãµã¤ãå ï¼ researchmap 1956å¹´ã«åãã¦ç»å ´ãããã¼ããã£ã¹ã¯ãã©ã¤ãï¼ä»¥ä¸HDDï¼ã¨ã1991å¹´ã«åãã¦ç»å ´ããã½ãªããã¹ãã¼
ããã«ã¡ã¯ãã¢ãã¿ã㦠ã³ã¢ã·ã¹ãã ã¨ã³ã¸ãã¢ãªã³ã°é¨é é éãã¡ã¤ã³ã°ã«ã¼ãã®å®è¦ã§ãã ãã®è¨äºã§ã¯ç§ãé¢ãã£ã¦ãã社å ã·ã¹ãã ãä»®æ³ãµã¼ã(AWS EC2)ããã³ã³ããã«ç§»è¡ããå¾ã«ã³ã³ãããããã¦ä»®æ³ãµã¼ãã«æ»ãã話ããç´¹ä»ãã¾ãã 諸説æ ã³ã³ãã移è¡ã«ã¤ã㦠ã³ã³ããå対象ã·ã¹ãã ã«ã¤ã㦠ç´é¢ããæ§ã ãªåé¡ ãªãªã¼ã¹å¾ã®å¤æ°ã®æ®èª²é¡ å±éããæ©è½ã®æ°ãå¤ããã ã³ã³ããåã®ã¡ãªãããèãã£ã ãªããããªã£ãã ããã£ãã㨠ã¾ã¨ã 追è¨ï¼ ç¾å¨ãªã... 諸説æ ã³ã³ãã移è¡ã«ã¤ã㦠ã·ã¹ãã ã®ã³ã³ãã移è¡ã¨ã¯ãã¢ããªã±ã¼ã·ã§ã³ããµã¼ãã¹ãåä½ãããããã®å¿ è¦ãªãã¹ã¦ã®ç°å¢ããä¸ã¤ã®ãã³ã³ãããã¨ãã¦ããã±ã¼ã¸åãã¦åä½ã§ããããã«ãããã¨ã§ããããã«ãããã¢ããªã±ã¼ã·ã§ã³ã¯ä»ã®ã·ã¹ãã ã¨ç¬ç«ãã¦å®è¡ããé害åé¢ãã§ããããç°å¢ã®éãã«ããå½±é¿ãåãã«ãããªããã移æ¤æ§ãåä¸
ã¯ã©ã¦ãã¹ãã¬ã¼ã¸ãç¹ã«ãªãã¸ã§ã¯ãã¹ãã¬ã¼ã¸ã«ã¤ãã¦è³ªåãããã¾ãã AWSãä¾ã«åºãã¨S3ã¸ã®æ¸ãè¾¼ã¿é度ã¨èªã¿è¾¼ã¿é度ã¯ãã¼ã«ã«ã®HDDã¨SSDã®ä¸éãããåºã¦ããèªèã§ãããã®ãããªæ§è½ãæã£ã¦ããã®ã«25ãã«/TBã®ãããªå®ä¾¡ã§æä¾ã§ãã¦ããã®ã¯ã©ã®ãããªå®è£ ãããã¦ããã®ã§ããããï¼ è»½ãæ¤ç´¢ããã¨S3ã®ã¬ã¤ãã³ã·ã¯1æ¡ããªç§ã帯åã¯ã¯ã©ã¤ã¢ã³ãå´ã®ãããã¯ã¼ã¯ãããã«ããã¯ã«ãªãã¾ã§(ã¤ã¾ã100Gbpsã¬ãã«)åºãããã§ãããããã99.999999999%(11ãã¤ã³)ã®èä¹ æ§ã¨ããæ°åã¯çåå¯ãªåªåã§åºããæ°åã§ã¯ããã¾ããã ãªããããªé«éãªã¹ãã¬ã¼ã¸ããããªã«å®ãã®ãã¨ããã®ã¯ä¸è¨ã§ã¯ãçµæ¸ã®åãã¨ãªãã¾ããããå°ãåã¿ç ãã¨ããã¤ãã®è¦ç´ ãããã¾ãã S3ã¯ã¾ãé¤ããç¥ããªãã¯ã©ã¦ããã¸ãã¹å社ã§ã¯ãªã³ãã¬ãã¹ãã³ãã±ã¼ã·ã§ã³ã§é¡§å®¢èªèº«ãå¥ç´ãã¦ããç©çãã¼ãã¦ã§
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}