AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning  (ICLR'24 spotlight) Yuwei Guo1 Ceyuan Yang2â Anyi Rao3 Zhengyang Liang2 Yaohui Wang2 Yu Qiao2 Maneesh Agrawala3 Dahua Lin1,2 Bo Dai2 âCorresponding Author. 1The Chinese University of Hong Kong 2Shanghai AI Laboratory 3Stanford University [Paper] [Github] [BibTeX] Click to Play the Animations! Methodology
1977å¹´ã«ã¢ãã¡ã¼ã¿ã¼ã¨ãã¦ããããã¦ã¹ã«å ¥ç¤¾[注 1][2]ãã家ãªãåããå®å³¶ãããããã®ã¸ã§ã¼2ããã¹ãã¼ã¹ã³ãã©ããªã©ã®TVã·ãªã¼ãºããã¨ã¼ã¹ããããããã¦ãã³ããªã©ã®åå ´æ ç»ã®ä½ç»ãæ å½ãããå社ã®ä¼å ±ãæã®ã«ãã§ãã©ã¹ãã«æ¼«ç»ãæãã¦è¼ãããã¨ããã[1]ã 1980å¹´ã«ã¹ã¿ã¸ãªãããªã·ãã«æ´»åã®å ´ã移ããå¾ã1986å¹´ããããªã¼ã¨ãªããæ¼åºãææããããã«ãªãã ãã¡ã³ãããã ã®å¤§åéº å°çãæã!ãªãã¾ãã¡ãã§åãã¦ç£ç£ãæ å½ãã[2][3]ãæ§æã»çµµã³ã³ãã»èæ¬ã¾ã§ãææãã5å¹´ã®æ³æã¨6ä¸æã®åç»ãããã¦å¶ä½ãããä½åã ã£ããã1992å¹´ã®å®æå¾ãåå ´å ¬éã¯ããããç´20年以ä¸ã¢ãã¡ãã¡ã³ã¯ãã¡ãããæ¥çé¢ä¿è ã§ãããã»ã¨ãã©ä½åã«è§¦ããæ©ä¼ã«æµã¾ããªã"å¹»"ã®ä½åã¨ãªã£ã¦ãã¾ã£ã[注 2][2]ã ã¡ã³ãããã ã®å¤§åéºãå ¬éãããªãã£ããã¨ãã1994å¹´ã宮沢賢治ã®
github.com çµæ ç°å¢æ§ç¯ Ubuntu 20.04 on WSL2 (Windows 11) Python 3.9CUDAã¯å¿ è¦ããã¾ããã 以ä¸ãã¤ã³ã¹ãã¼ã«ããå¿ è¦ãããã¾ãã sudo apt install libosmesa6-dev freeglut3-dev sudo apt install libglfw3-dev libgles2-mesa-dev sudo apt install libosmesa6ãã®å¾ã«ä»¥ä¸ãå®è¡ããã°å®äºã§ãã git clone https://github.com/facebookresearch/AnimatedDrawings.git cd AnimatedDrawings pip install -e . å®è¡ç»é¢ã«è¡¨ç¤ºå®è¡ import os os.environ['PYOPENGL_PLATFORM'] = 'osmes
ã¢ãã¡ã¼ã·ã§ã³ã§ã¯åããã¤ã³ãã¨ãªãåç»ã¨åç»ã®éã«ããä¸å²ããã¨å¼ã°ããã«ãããæããã¨ã§å®éã«ãã£ã©ã¯ã¿ã¼ãç©ä½ãåãã¦ããããã«è¦ãã¦ãã¾ãããããªä¸å²ãããäºæ¬¡å ç»åã®çæã«åªããç»åçæAIã®ãNovelAIãã§ä½æããæ¹æ³ãçºè¦ããã¨ãTwitterã¦ã¼ã¶ã¼ã®ãã(@ao_love_yuimop)æ°ã解説ãã¦ãã¾ãã ç»åçæAIã§åä½å«ãã¢ãã¡ã®ä¸å²ãç»åãä½ãæ¹æ³ãçºè¦ããã®ã§ããã®æ¹æ³ãå®è¡ããWebãµã¼ãã¹ãä½ãã¾ããã(ãããã£ã·åç»ä»ã)ï¼çæ§ã«ãã使ãé ãã¾ããï¼ - Qiita https://qiita.com/ystmg/items/c78c2b3e0bcdf0f77125 chara-zokusei.jp/nakawari https://chara-zokusei.jp/nakawari ããæ°ã¯NovelAIã触ãä¸ã§ãåå¾ã®ç»åããä¸éåä½ãæããä¸
ãã®ãªãã¸ããªã§ã¯ãæ ªå¼ä¼ç¤¾ãã³ãã¤ãã ã³ç 究æãåéããã¢ã¼ã·ã§ã³ãã£ããã£ã®ãã¼ã¿ã»ãããå ¬éãã¦ãã¾ãã ã²ã¼ã ãæ ç»ã¨ãã£ãã¡ãã£ã¢ã¯ãªã¢ã«ã§è¡¨ç¾åè±ããªãã£ã©ã¯ã¿ã¼ã¢ãã¡ã¼ã·ã§ã³è¡¨ç¾ã追æ±ãã¦ãããå¤æ§ãªã¹ã¿ã¤ã«ã®ã¢ã¼ã·ã§ã³ãAIã§çæãããã¨ã«é·å¹´ã®é¢å¿ãããã¾ããã³ã³ãã³ãå¶ä½ã®è¦æ¨¡ã大ãããªãã«ã¤ããã¢ã¼ã·ã§ã³ãã£ããã£ãªã©ã®æ¹æ³ã使ç¨ããåé²ã§å¤æ§ãªã¢ã¼ã·ã§ã³ãæããããªããªãå°æ¥ãäºæ³ããã¾ããè¿å¹´æ³¨ç®ãéãã¦ããã®ã¯ãç¹å®ã®ã³ã³ãã³ããå«ãã¯ãªããå ã®ã¢ã¼ã·ã§ã³ããåãã³ã³ãã³ããç¶æããªããå¥ã®ã¹ã¿ã¤ã«ã®å¥ã®ã¢ã¼ã·ã§ã³ã«å¤æãããã¨ãç®çã¨ããã¢ã¼ã·ã§ã³ã¹ã¿ã¤ã«è»¢éï¼Motion Style Transfer 以ä¸ãMSTï¼ã§ããã¢ã¼ã·ã§ã³ã¯ã³ã³ãã³ãã¨ã¹ã¿ã¤ã«ã§æ§æãããã³ã³ãã³ãã¯ã¢ã¼ã·ã§ã³ã®ãã¼ã¹ã§ãããã¹ã¿ã¤ã«ã¯ã¢ã¼ã·ã§ã³ã«é¢é£ä»ãããããã£ã©ã¯ã¿ã¼ã®æ°åã
æè¿ã®ã¦ã§ããµã¤ãå¶ä½ã§ã¯ãã¢ãã¡ã¼ã·ã§ã³ãã¾ãã¾ãéè¦ã«ãªã£ã¦ãã¦ãã¾ãã ãã®è¨äºã¯ãLottieã®ä½¿ãæ¹ãã¾ã¨ããåºæ¬ã¬ã¤ãã§ããLottieã®é åã¯ãã¡ãããAfter Effectsã¸ã®Aiãã¡ã¤ã«ã®èªã¿è¾¼ã¿ãã¢ãã¡ã¼ã·ã§ã³ä½æããã©ã°ã¤ã³ãå©ç¨ããJSONãã¡ã¤ã«ã®æ¸ãåºããWebãµã¤ãã§ã®ã¢ãã¡ã¼ã·ã§ã³è¡¨ç¤ºã¾ã§ä¸é£ã®æµããã¾ã¨ãã¦ãã¾ãã Lottieãå©ç¨ããã°ãæ軽ã«ããã¦è»½éã«åç»ãè²¼ãä»ãããã¨ãã§ããã®ã§ãããã¾ã§ã¢ãã¡ã¼ã·ã§ã³ã試ãããã¨ã®ãªãã²ã¨ã«ããªã¹ã¹ã¡ã§ãã ã³ã³ãã³ãç®æ¬¡ 1. Lottieï¼ãããã£ã¼ï¼ã£ã¦ä½ï¼ 2. Lottieãå©ç¨ããã¡ãªããã¯ï¼ 3. Lottieã¢ãã¡ã¼ã·ã§ã³ä½ææé ã¬ã¤ã 4. After Effectsã¸ã®Aiãã¡ã¤ã«ã®èªã¿è¾¼ã¿ 5. After Effectsã§ã¢ãã¡ã¼ã·ã§ã³ä½æ 6. Lottie JSONãã¡ã¤ã«ã§ã¢
ã¯ããã« ãã®è¨äºã¯VTuber Tech #1 Advent Calendar 2019 1æ¥ç®ã®è¨äºã§ãã ãã¦ãiOSã®ARKit 3ã§Motion Captureã®æ©è½ã追å ããã¾ããã ARKit 3 Motion Captureãããã¤ãã£ãã®å ¬å¼ãµã³ãã«ã¨Unity ARFundationã®ãµã³ãã«ã§æ¯è¼ãã¦ã¿ãã ä½å¹¹ã§ã¯å¤§ä½åããããã®ç²¾åº¦ãåºã¦ããæ°ãããããã¨æ¨ªåãã ã¨ç»é¢å¤ã§ãèªèããç¯å²ãã§ããã pic.twitter.com/zRlrgWgNSl â ãªãã / ãªãªã«ã¡ãã (@nkjzm) December 1, 2019 Unityã§ã¯ARãæ±ãããã®ããªã¼ã ã¯ã¼ã¯ã§ããAR Foundationã§ARKit 3ã®æ©è½ã使ããã¨ãããã¨ã§ãæ©é試ãã¦ã¿ã¾ãããä»åã¯VRMå½¢å¼ã®ã¦ãã®åããªãªã«ã¡ããããARKit 3ã使ã£ã¦åããã¦è¡ããã¨æãã¾ãã ç°
Scroller ã¨ããã®ã¯ãã¹ã¯ãã¼ã«æã®ã¢ãã¡ã¼ã·ã§ã³ãå®ç¾ããããã® x,y ä½ç½®ãè¨ç®ãã¦ãããã¯ã©ã¹ã§ãã Scroller 㨠OverScroller ãç¨æããã¦ãã¾ãã OverScroller ã¯è¡ãéãã¦æ»ã£ã¦ãããããªã¢ãã¡ã¼ã·ã§ã³ãã§ãã¾ãã Scroller ã«ã¯ã¢ãã¡ã¼ã·ã§ã³ãéå§ããã¡ã½ããã¨ã㦠fling startScroll() ãç¨æããã¦ãã¾ãã 使ãæ¹ã¯ãããªæãã§ãã 1. scroller.forceFinished() ã§ã¢ãã¡ã¼ã·ã§ã³ãæ¢ãã 2. scroller.fling() ã¾ã㯠scroller.startScroll() ã§ã¢ãã¡ã¼ã·ã§ã³ãéå§ãã 3. View.postInvalidateOnAnimation() ãå¼ã¶ããããå¼ã¶ã¨ View.computeScroll() ãå¼ã°ãã 4. View.comput
æè»å¤ãã©ã°ã¤ã³ã使ç¨ãã¦ã¹ã«ã¼ãã1é ç¹1åä½åã ã¯ã³ãã¼ã¹ãå¸ã£ã½ããªãã¾ããã ã¢ã¼ã·ã§ã³ãã°ã¬ã¤æ§ ã¢ãã«ãã¨ãã³ãã°ãµ / ããã«ããæ§ https://t.co/jq80xxzPDc
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ã©ã³ãã³ã°
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}