GitHub - pricingassistant/mrq: Mr. Queue - A distributed worker task queue in Python using Redis & gevent
Simple code: We originally switched from Celery to RQ because Celery's code was incredibly complex and obscure (Slides). MRQ should be as easy to understand as RQ and even easier to extend. Great dashboard: Have visibility and control on everything: queued jobs, current jobs, worker status, ... Per-job logs: Get the log output of each task separately in the dashboard Gevent worker: IO-bound tasks
Herman Schaaf
Programmer and traveler. Currently writing Production Go @ironzeb leanpub.com/produc... Read this first 3 Rules for Choosing Nonfiction Books I love reading nonfiction. But, as I am sure you can relate, I only have limited time. Even if we were able to make enough time to read one book a week on average—certainly not the case for me right now—we would still only be able to read around 3,000 books
mongoengine
mongoengine MongoEngine is a Document-Object Mapper (think ORM, but for document databases) for working with MongoDB from Python. It uses a simple declarative API, similar to the Django ORM. Documentation available at docs.mongoengine.org - there is currently a tutorial, a user guide and API reference. Simple to use from mongoengine import * # To define a schema for a # document, we create a class
MongoDB 2.4 ã®æ€§èƒ½ 徹底評価 - ä¸å¹´engineerã®ç‹¬ã‚Šè¨€ - crumbjp
ã¾ã¨ã‚ 超長ããªã£ãŸã®ã§ã¾ã¨ã‚を上ã«æŒã£ã¦ããŸã€‚ å··ã§è¨€ã‚ã‚Œã¦ã„ã‚‹ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã¯çµæ§‹å˜˜ãŒå¤šã„事ãŒè§£ã£ã¦ããŸã€‚ ãƒ„ãƒ¼ãƒ«ç‰ workingSet Analyzer ã¯ä¿¡ç”¨ãªã‚‰ãªã„。（overSecondsã¯ã¾ã‚良ã„） mongoperfã®å€¤ã¯å®Œå…¨ã«å‚考ã«ãªã‚‰ãªã„。 insert mongoperfã®å€¤ã¯insert性能ã¨é–¢é€£ã—ãªã„。（何を測ã£ã¦ã‚‹ã‚“ã ？） カラムã®ãƒ—リアãƒã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã«ã‚ˆã‚‹UPDATE時ã®ãƒ‡ãƒ¼ã‚¿è‚¥å¤§åŒ–回é¿($setOnInsert)ã¯MUST。 クリティカルãªæ™‚間帯ã«ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ãƒ•ã‚¡ã‚¤ãƒ«(2GB)ã®ç”Ÿæˆã‚’é¿ã‘ã‚‹ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã®åŠ¹æžœã¯æ‡ç–‘的。 レコードプリアãƒã‚±ãƒ¼ã‚·ãƒ§ãƒ³ãƒ»ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã¯é ‘張る価値ãŒç„¡ã„。(ã‚€ã—ã‚逆効果) update 上記ã®é€šã‚Šå¿…ãšin-placeã«ãªã‚‹ã‚ˆã†ã«ã™ã‚‹ã€‚ paddingFactorãŒå‹•ãよã†ã ã¨ãŠè©±ã«ãªã‚‰ãªã„性能劣化 remove ã‹ãªã‚Šé«˜é€Ÿã€‚ 全件削除ã®å ´
建築批評空間をå¯è¦–化ã—ã¦ã¿ãŸ | ã›ã‹ã„らã¼
最近Pythonã«ã¯ã¾ã£ã¦ã„ã¾ã™ã€‚ ã¤ã„ã§ã«æ©Ÿæ¢°å¦ç¿’ã®å‹‰å¼·ã«ã‚‚ã¯ã¾ã£ã¦ã„ã¾ã™ã€‚ ã“りゃã‚建築批評空間をå¯è¦–化ã™ã‚‹ã—ã‹ã‚ã‚‹ã¾ã„。 公開ã•ã‚Œã¦ã„る建築批評ã¨ã„ãˆã°ã€Œã€Ž10+1ã€ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ã§ã™ã。 ãªã‚“ã¨ãªã見ãŸæ„Ÿã˜ã€ã‚¢ãƒ‰ãƒ¬ã‚¹ã¯ ã“ã‚“ãªæ„Ÿã˜ã«ãªã£ã¦ã‚‹ã®ã§ã€é©å½“ã«ç•ªå·ã‚’増やã—ã¦ã£ãŸã¨ã“ã‚ã€ã©ã†ã‚„ら1549ã¾ã§ã‚ã‚‹ã¿ãŸã„。 ã¨ã„ã†ã‚ã‘ã§ã€å…¨ãƒšãƒ¼ã‚¸ã‚’次ã®ã‚·ã‚§ãƒ«ã‚¹ã‚¯ãƒªãƒ—トã§å–å¾—ã—ã¾ã™ # var1=http://db.10plus1.jp/backnumber/article/articleid/ var2=.html for ((i=1;i<1550;i++)) do wget -O $i$var2 $var1$i/ done; ã“ã®1549ã®ä¸ã«ã‚‚æ¯æŠœã‘ã«ãªã£ã¦ã‚‹ç•ªå·ãŒ100ã‚ã‚Šã¾ã—ãŸã€‚ ãã‚Œã§ã€è¨˜äº‹ã«ã‚ˆã£ã¦ã¯ ã“ã‚“ãªå…·åˆã«å…¬é–‹ã•ã‚Œã¦ãªã„ã‚‚ã®ã‚‚ã‚ã‚Šã¾ã™ã€‚å…¨1449記事ã®ã†ã¡ã€å…¬é–‹æ•°ï¼š721ã€æœªå…¬
Fluentdã‹ã‚‰MongoDBã«ãƒ‡ãƒ¼ã‚¿ã‚’æ–‡å—列(string)ã‹ã‚‰æ•°å€¤(integer)ã«å¤‰æ›ã—ã¦å…¥ã‚Œã‚‹ - Glide Note
最近よã†ã‚„ã仕事ã§ã‚¬ãƒƒãƒ„リFluentdã¨MongoDBを触るよã†ã«ãªã£ã¦ã¡ã‚‡ã£ã¨ãƒãƒžã£ãŸã“ã¨ãŒ ã‚ã£ãŸã®ã§èª°ã‹ã®å½¹ã«ç«‹ã¤ã‹ã‚‚知れãªã„ã®ã§æ›¸ã„ã¦ãŠã。 Fluentd界隈ã¯é–‹ç™ºãŒæ´»ç™ºãªã®ã§ã€æ•°ãƒ¶æœˆå¾Œã«ã¯ã“ã®è¨˜äº‹ã®æƒ…å ±ã‚‚æらãå¤ããªã£ã¦ã„ã‚‹ã®ã§ã”注æ„ãã ã•ã„。 çµè«– 書ã„ã¦ãŸã‚‰é•·ããªã£ã¦ã—ã¾ã£ãŸã®ã§å…ˆã«è¦ç‚¹ã¨ã„ã†ã‹çµè«–を書ã„ã¦ãŠã。 apache => fluentd => MongoDB ã¨apacheã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’MongoDBã«å…¥ã‚ŒãŸã¨ãã«codeã‚„sizeã¨ã„ã£ãŸæ•°å€¤ãŒæ–‡å—列(string)ã¨ã—ã¦å…¥ã£ã¦ã„㟠td-agent.confã®formatを自作ã™ã‚‹ã¨ã€æ™‚間以外ã®ãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ãŒæ–‡å—列(string)ã¨ã—ã¦æ‰±ã‚れる fluent-plugin-typecastを利用ã™ã‚‹ã“ã¨ã§codeã‚„sizeã¨ã„ã£ãŸç‰¹å®šã®ãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ã‚’ã€stringã‚„integerãªã©ã®ä»»æ„ã®ãƒ‡ãƒ¼ã‚¿åž‹ã«å¤‰æ›å¯èƒ½
Happy Elements Labs: fluentdã¨MongoDBã§ãƒ¦ãƒ¼ã‚¶ãƒ¼è¡Œå‹•ã‚’見ãˆã‚‹åŒ–
ã¯ã˜ã‚㫠エンジニアã®@ryooo321ã§ã™ã€‚ よã‚ã—ããŠé¡˜ã„ã—ã¾ã™ã€‚ 今回ã¯å¼Šç¤¾ã§é‹ç”¨ä¸ã®å…¨ã‚¢ãƒ—リã§åˆ©ç”¨ã—ã¦ã„る行動分æžãƒ—ラットフォームã«ã¤ã„ã¦ã”紹介ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ 2012å¹´ã®6月ã«ä½œã£ã¦ã‹ã‚‰ã€ç´„9ヶ月ã»ã©é‹ç”¨ã—ã¦ã„ã¾ã™ã€‚ 特徴 ・手ãŒã‹ã‹ã‚‰ãªã„データストア ・ã•ã¾ã–ã¾ãªå•ã„åˆã‚ã›å¯¾å¿œã§åˆ©ç”¨ã§ãる柔軟ãªã‚¯ã‚¨ãƒª ・機æ•ãªMap/Reduceã«ã‚ˆã‚‹é›†è¨ˆ ・集計çµæžœã‚’CSVやグラフã§å¯è¦–化 目的 ・ユーザーã®å•ã„åˆã‚ã›ã«åŠ¹çŽ‡çš„ã«å¯¾å¿œã—ã€ã‚¢ãƒ—リã®ä¼ç”»ãƒ»é–‹ç™ºã«é›†ä¸ã™ã‚‹ãŸã‚ ・ユーザーã®è¡Œå‹•ã‚’抽象化・å¯è¦–化ã™ã‚‹ã“ã¨ã§PDCAã®è³ªã‚’å‘上ã•ã›ã‚‹ãŸã‚ 行動ãƒã‚°ã®ãƒ•ãƒãƒ¼ 1. ユーザーã‹ã‚‰Ruby on Rails製ã®ã‚½ãƒ¼ã‚·ãƒ£ãƒ«ã‚²ãƒ¼ãƒ ã«ãƒªã‚¯ã‚¨ã‚¹ãƒˆ 2. Railsã‹ã‚‰ãƒãƒ¼ã‚«ãƒ«ã®fluentdã«ãƒã‚°å‡ºåŠ›(fluent-logger-ruby) 3. ãƒãƒ¼ã‚«ãƒ«ã®fluentd
MongoDBã®è–„ã„本
2.6対応版 MongoDBã®è–„ã„本 The Little MongoDB Book Karl Seguin è‘— / 濱野 å¸ è¨³ i 目次 目次 i ã“ã®æœ¬ã«ã¤ã„㦠iii ライセンス . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii 著者ã«ã¤ã„㦠. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii è¬è¾ž . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii 最新ãƒãƒ¼ã‚¸ãƒ§ãƒ³ . . . . . . . . . . . . . . . . . .
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Reddit - Dive into anything
orientechnologies.com - orientechnologies リソースãŠã‚ˆã³æƒ…å ±
Come Work With Me At MongoDB
GitHub - alonho/pql: A python expression to MongoDB query translator
{{#tags}}- {{label}}
{{/tags}}