Data Developer Platform
Home Data Developer Platform¶ A Data Platform Specification, open for adoption by any data platform developer. A modern way to run data engineering teams¶ Data teams are drained from continuously plumbing integrations and fragile pipelines, which leaves little to no time to focus on the real deal - data and data applications. Businesses that have a good grasp on data realise that today data makes
Modern Data Stack / モダンデータスタックã¨ã„ã†ãƒˆãƒ¬ãƒ³ãƒ‰ã«ã¤ã„㦠- satoshihirose.log
ã¯ã˜ã‚ã« Modern Data Stack ? Modern Data Stack ã®ç‰¹å¾´ã‚„メリットã€é–¢é€£ã™ã‚‹ãƒˆãƒ¬ãƒ³ãƒ‰ データインフラã®ã‚¯ãƒ©ã‚¦ãƒ‰ã‚µãƒ¼ãƒ“ス化 / Data infrastructure as a service データ連æºã‚µãƒ¼ãƒ“スã®ç™ºå±• ELT! ELT! ELT! Reverse ETL テンプレート化ã•ã‚ŒãŸ SQL and YAML ãªã©ã«ã‚ˆã‚‹ãƒ‡ãƒ¼ã‚¿ã®ç®¡ç† セマンティックレイヤーã®å‡‹è½ã¨ Headless BI 計算フレームワーク (Computation Frameworks) 分æžãƒ—ãƒã‚»ã‚¹ã®æ°‘主化ã€ãƒ‡ãƒ¼ã‚¿ã‚¬ãƒãƒŠãƒ³ã‚¹ã¨ãƒ‡ãƒ¼ã‚¿ãƒ¡ãƒƒã‚·ãƒ¥ã®è©¦ã¿ プãƒãƒ€ã‚¯ãƒˆçµ„ã¿è¾¼ã¿ç”¨ãƒ‡ãƒ¼ã‚¿ã‚µãƒ¼ãƒ“ス リアルタイムAnalytics Engineer ã®ç™»å ´ å„社ファウンダーãŒè€ƒãˆã‚‹ Modern Data Stack ã•ã„ã”ã« Further Readings ã¯ã˜ã‚ã« Modern Dat
Announcing PartiQL: One query language for all your data | Amazon Web Services
AWS Open Source Blog Announcing PartiQL: One query language for all your data Data is being gathered and created at rates unprecedented in history. Much of this data is intended to drive business outcomes but, according to the Harvard Business Review, “…on average, less than half of an organization’s structured data is actively used in making decisions…†The root of the problem is that data is typ
オープンデータå–å¾—å…ˆã¾ã¨ã‚ - Qiita
2018/1/1時点ã§åˆ©ç”¨å¯èƒ½ãªã€ã‚ªãƒ¼ãƒ—ンデータã®ä¸»è¦å–得先を記載ã—ã¾ã™ã€‚ 1. 世界ä¸ã®å›½ã‚„都市ã®æƒ…å ± EUã¨ã‚¤ã‚®ãƒªã‚¹ Public Data EU http://publicdata.eu Open Data Europe http://data.europa.eu/euodp/en/home UK Government Data https://data.gov.uk アフリカ Africa Open Data https://africaopendata.org Code for South Africa http://code4sa.org Code for Africa https://codeforafrica.org アジア Open Cities Project http://www.opencitiesproject.org Open Nepal http://data
Data Models
Data Models: A Comprehensive Guide to Structuring Information for Optimal Insights and Decision-Making In the realm of data management, the use of effective data models plays a pivotal role in organizing and representing information in a structured and meaningful way. Data models serve as the blueprint for databases, facilitating efficient data storage, retrieval, and analysis. This article delves
Integrating Apache NiFi with Kafka
Integrating Apache NiFi with Apache Kafka Mark Payne - markap14@hotmail.com A couple of weeks ago, Joey Echeverria wrote a fantastic blog post about how to get started with Apache NiFi (Incubating), available at http://ingest.tips/2014/12/22/getting-started-with-apache-nifi/ . In it, Joey outlines how to quickly build a simple dataflow that automatically picks up any data from the /dropbox directo
LINE DEVELOPER DAY 2016 開催ã®ãŠçŸ¥ã‚‰ã› « LINE Engineers' Blog
LINEæ ªå¼ä¼šç¤¾ã¯ã€2023å¹´10月1æ—¥ã«LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã«ãªã‚Šã¾ã—ãŸã€‚LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã®æ–°ã—ã„ブãƒã‚°ã¯ã“ã¡ã‚‰ã§ã™ã€‚ LINEヤフー Tech Blog saegusa2017-04-16Yoshihiro was a network engineer at LINE, responsible for all levels of LINE's infrastructure. Since being named Infra Platform Department manager, he is finding ways to apply LINE's technology and business goals to the platform. ã“ã‚“ã«ã¡ã¯ã€‚LINEã§ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚„データセンターを担当ã—ã¦ã„る三æžã§ã™ã€‚2017å¹´1月ã«JANOG39ã§ç™»å£‡ã™ã‚‹æ©Ÿä¼šã‚’é ‚ãã¾ã—ãŸã®ã§ã€ä»Šå›ž
オープンソースã®ãƒãƒ«ã‚¯ãƒ‡ãƒ¼ã‚¿ãƒãƒ¼ãƒ€ãƒ¼ã€ŒEmbulkã€ç™»å ´ã€‚fluentdã®ãƒãƒƒãƒç‰ˆã€ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ãŒæ”¯æ´
オープンソースã®ãƒãƒ«ã‚¯ãƒ‡ãƒ¼ã‚¿ãƒãƒ¼ãƒ€ãƒ¼ã€ŒEmbulkã€ç™»å ´ã€‚fluentdã®ãƒãƒƒãƒç‰ˆã€ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ãŒæ”¯æ´ 何ギガãƒã‚¤ãƒˆã‚‚ã‚ã‚‹CSVをデータベースã«èªã¿è¾¼ã¾ã›ã‚‹ã‚ˆã†ãªãƒãƒ«ã‚¯ãƒ‡ãƒ¼ã‚¿ã‚’ãƒãƒƒãƒå‡¦ç†ã™ã‚‹ãŸã‚ã®ãƒ„ール「Embulkã€ãŒã‚ªãƒ¼ãƒ—ンソースã§å…¬é–‹ã•ã‚Œã¾ã—ãŸã€‚ コミッターã¨ã—ã¦é–‹ç™ºã—ã¦ã„ã‚‹ã®ã¯ã€ãƒã‚°åŽé›†ãƒ„ールã¨ã—ã¦çŸ¥ã‚‰ã‚Œã‚‹fluentdãªã©ã®é–‹ç™ºè€…ã¨ã—ã¦çŸ¥ã‚‰ã‚Œã‚‹å¤æ©‹è²žä¹‹æ°ã€è¥¿æ¾¤ç„¡æˆ‘æ°ã€ä¸æ‘浩士æ°ã‚‰ã§ã€3人ãŒæ‰€å±žã™ã‚‹Treasure Dataも開発を支æ´ã—ã¦ã„ã¾ã™ã€‚ å¤æ©‹æ°ã¯Embulkã«ã¤ã„ã¦ã€Œç°¡å˜ã«è¨€ã†ã¨fluentdã®ãƒãƒƒãƒç‰ˆã§ã™ã€ã¨èª¬æ˜Žã€‚1月27æ—¥ã«è¡Œã‚ã‚ŒãŸã€Œãƒ‡ãƒ¼ã‚¿è»¢é€ãƒŸãƒ‰ãƒ«ã‚¦ã‚§ã‚¢å‹‰å¼·ä¼šã€ã§ã€Embulkã®ç´¹ä»‹ã‚’è¡Œã„ã¾ã—ãŸã€‚ Embulkã¯ãƒ—ラグインベースã®ãƒãƒ«ã‚¯ãƒ‡ãƒ¼ã‚¿ãƒãƒ¼ãƒ€ãƒ¼ å¤æ©‹æ°ã¯ã¾ãšã€ä¾‹ãˆã°CSVファイルをPostgreSQLã«èªã¿è¾¼ã¾ã›ã‚ˆã†ã¨ã™ã‚‹ã¨ã€CSVã®æ—¥ä»˜ã®ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆãŒ
æœæ°ã®ã„ãªã„蔵元ãŒç¤ºã—ãŸã€Œãƒ‡ãƒ¼ã‚¿åˆ†æžã•ãˆã™ã‚Œã°è·äººã®æŠ€ã‚’è·äººæŠœãã§ã‚‚å†ç¾ã§ãã‚‹ã€ã¨ã„ã†äº‹å®Ÿã®å‡„ã¿ï¼ˆè¿½è¨˜ã‚り） - 渋谷駅å‰ã§åƒãデータサイエンティストã®ãƒ–ãƒã‚°
先日ã€ã¨ã‚るコンサルã®ç¤¾é•·ã•ã‚“ã¨ãŠé…’を飲ã¿ãªãŒã‚‰ãŠè©±ã—ã¦ã„ã¦å‡ºã¦ããŸè©±é¡ŒãŒã€Œç•¢ç«Ÿãƒ‡ãƒ¼ã‚¿åˆ†æžã£ã¦ä½•ã®å½¹ã«ç«‹ã¤ã‚“ã ã‚ã†ï¼Ÿã€ã¨ã„ã†ã‚‚ã®ã ã£ãŸã‚“ã§ã™ãŒã€ãã“ã§åƒ•ãŒæ€ã„出ã—ã¦ç´¹ä»‹ã—ãŸã®ãŒã€Œçºç¥ã€ã§ä¸–界進出をæˆåŠŸã•ã›ã¦ã„ã‚‹æ—é…’é€ ã®ã‚¨ãƒ”ソードã ã£ãŸã®ã§ã—ãŸã€‚ ã¨ã„ã†ã“ã¨ã§ã€ãã®äº‹ä¾‹ã‚’振り返りãªãŒã‚‰ä¹…ã—ã¶ã‚Šã«ã¡ã‚‡ã£ã¨ä¸Žå¤ªè©±ã§ã‚‚ã—よã†ã¨æ€ã„ã¾ã™ã€‚ http://www.tv-tokyo.co.jp/cambria/backnumber/20140116.html ã¡ãªã¿ã«ä¸Šã¯ã¯ã¦ãƒ–ã§ã‚‚大ããªè©±é¡Œã‚’呼んã æ±æ´‹çµŒæ¸ˆã®ç‰¹é›†è¨˜äº‹ã§ã™ãŒã€åƒ•ã«ã¨ã£ã¦ã¯ãƒ†ãƒ¬æ±ã‚«ãƒ³ãƒ–リア宮殿ã§ç´¹ä»‹ã•ã‚ŒãŸæ™‚ã®æ˜ åƒã®æ–¹ãŒé¥ã‹ã«è¡æ’ƒçš„ã§ã—ãŸã€‚ 「çºç¥ã€ã¯æœæ°ã§ã‚‚何ã§ã‚‚ãªã„普通ã®ç¤¾å“¡ãŒã€ãƒ‡ãƒ¼ã‚¿ã«åŸºã¥ã„ã¦ä¸€æŒ™æ‰‹ä¸€æŠ•è¶³ã‚’決ã‚ãªãŒã‚‰ä»•è¾¼ã‚“ã§ã„ã‚‹ æ±æ´‹çµŒæ¸ˆã®è¨˜äº‹ã§ã¯å‰²ã¨ã–ã£ãã‚Šã¨ã—ã‹æ›¸ã‹ã‚Œã¦ãªã„ã‚“ã§ã™ãŒã€ã‚«ãƒ³ãƒ–リア宮殿ã§æ”¾æ˜ ã•ã‚ŒãŸæ˜ åƒã§ã¯çºç¥ã®è£½é€ 工程ã®
ç·å‹™çœï½œå ±é“資料｜API機能ã§åˆ©ç”¨ã§ãる統計データã®æ‹¡å……
ç·å‹™çœã¯ã€çµ±è¨ˆãƒ‡ãƒ¼ã‚¿ã®é«˜åº¦åˆ©ç”¨ç’°å¢ƒã‚’充実ã•ã›ã‚‹ãŸã‚ã€æœ¬æ—¥ã‹ã‚‰ã€API機能ã§åˆ©ç”¨ã§ãる統計データを拡充ã—ã¾ã—ãŸã€‚ã“ã‚Œã«ã‚ˆã‚Šã€æ”¿åºœçµ±è¨ˆã®ã‚ªãƒ¼ãƒ—ンデータ化を推進ã•ã›ã€åœ°åŸŸæŒ¯èˆˆã‚„ビジãƒã‚¹ã®æ´»æ€§åŒ–ãªã©æ§˜ã€…ãªåˆ†é‡Žã«è²¢çŒ®ã§ãã‚‹ã‚‚ã®ã¨è€ƒãˆã¦ãŠã‚Šã¾ã™ã€‚
Highcharts JSã¯1000件を超ãˆã‚‹ãƒ‡ãƒ¼ã‚¿ã¯ãƒ—ãƒãƒƒãƒˆã§ãã¾ã›ã‚“。デフォルトã§ã¯ã€‚ - ã´ã‚ˆãƒã‚°
昨日ã®è¨˜äº‹ã§Highchartsã«ã¤ã„ã¦è©±é¡Œã«ã—ã¾ã—ãŸã€‚今日ã¯å®Ÿéš›ã«Highchartsを使ã£ãŸéš›ã«æ€ã„ã£ãã‚Šãƒãƒžã£ãŸã¨ã“ã‚ãŒã‚ã‚‹ã®ã§ã€ãã“ã«ã¤ã„ã¦æ›¸ã„ã¦ãŠãã¾ã™ã€‚ 昨日紹介ã—ãŸã‚·ãƒ³ãƒ—ルãªä¾‹ã§ã¯Highchartsã«æ¸¡ã—ãŸãƒ‡ãƒ¼ã‚¿åˆ—ã«ã¯å€¤ã®ã¿ãŒå…¥ã£ã¦ã„ã¾ã—ãŸã€‚ã“ã®ã‚ˆã†ãªã‚±ãƒ¼ã‚¹ã§ã¯ãƒ‡ãƒ¼ã‚¿æ•°ã¯å•é¡Œã«ãªã‚Šã¾ã›ã‚“（リファレンスã«ã‚ˆã‚‹ã¨ãã®ã¯ãšï¼‰ã€‚ ã§ã™ãŒã€Highchartsã§ã¯ãƒ‡ãƒ¼ã‚¿ä¸€ã¤ä¸€ã¤ã«åå‰ã‚’付ã‘ãŸã‚Šä»»æ„ã®ã‚ーã§å€¤ã‚’渡ã—ãŸã‚Šã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ 一ã¤ä¸€ã¤ã®ãƒ‡ãƒ¼ã‚¿ã¯jsonçš„ãªæ§‹é€ ã«ãªã£ã¦ã„ã¾ã™ã€‚yã¨ã„ã†ã‚ーã¯Y軸用ã®å€¤ã€nameã¨ã„ã†ã‚ーã¯ãƒ„ールãƒãƒƒãƒ—ã«ç”¨ã„られるåå‰ç”¨ã®å€¤ã§ã™ã€‚ãれ以外ã«ã‚‚ä»»æ„ã®ã‚ーを使ã†ã“ã¨ãŒã§ãã¾ã™ã€‚ $(function () { $('#chart').highcharts({ series: [{ data: [{y:3,name:"s6w1vnde"},{y:7
JavaScriptã§ãƒã‚¤ãƒŠãƒªãƒ•ã‚¡ã‚¤ãƒ«ã‚’扱ã†æ–¹æ³• - Tech-Sketch
HTML5ã«ã‚ˆã£ã¦ã€<audio>ã‚„<video>ãªã©ãƒ¡ãƒ‡ã‚£ã‚¢ãƒ•ã‚¡ã‚¤ãƒ«ã‚’扱ã†æ©Ÿèƒ½ãŒæ‹¡å……ã•ã‚Œã€JavaScriptã‹ã‚‰ã‚‚音声ファイルãŒå–り扱ãˆã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ å„ブラウザ毎ã«å¯¾å¿œçŠ¶æ³ã¯ç•°ãªã‚Šã¾ã™ãŒã€ã“れらã®æ©Ÿèƒ½ã‚’有効活用ã™ã‚‹ãŸã‚Ajaxリクエストã«ã‚ˆã£ã¦éŸ³æ¥½ã®ãƒã‚¤ãƒŠãƒªãƒ•ã‚¡ã‚¤ãƒ«ã‚’å–å¾—ã—ã€å†ç”Ÿã™ã‚‹ã¾ã§ã®JavaScriptã‚’ã¾ã¨ã‚ã¦ã¿ã¾ã—ãŸã€‚ ã¯ã˜ã‚ã« HTML5ã«ã‚ˆã£ã¦ã€<audio>ã‚„<video>ãªã©ãƒ¡ãƒ‡ã‚£ã‚¢ãƒ•ã‚¡ã‚¤ãƒ«ã‚’扱ã†æ©Ÿèƒ½ãŒæ‹¡å……ã•ã‚Œã€JavaScriptã‹ã‚‰ã‚‚音声ファイルãŒå–り扱ãˆã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ ã¨ã„ã†ã“ã¨ã§ã€å„ブラウザ毎ã«å¯¾å¿œçŠ¶æ³ã¯ç•°ãªã‚Šã¾ã™ãŒã€Ajaxリクエストã«ã‚ˆã£ã¦éŸ³æ¥½ã®ãƒã‚¤ãƒŠãƒªãƒ•ã‚¡ã‚¤ãƒ«ã‚’å–å¾—ã—ã€å†ç”Ÿã™ã‚‹ã¾ã§ã®JavaScriptã‚’ã¾ã¨ã‚ã¦ã¿ã¾ã—ãŸã€‚サンプルã¯éŸ³å£°ãƒ•ã‚¡ã‚¤ãƒ«ã®å—ä¿¡ã€å†ç”Ÿã‚’Coffee Scriptã§æ›¸ã„ãŸã‚‚ã®ã§ã™ãŒã€ãƒã‚¤ãƒŠãƒªãƒ•ã‚¡ã‚¤ãƒ«ã‚’å–å¾—ã—ãŸå¾Œã®å‡¦ç†
ランã‚ング
ランã‚ング
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
SandDance has moved
http://pnda.io/
Geckoboard | Real-time KPI dashboards that improve team performance
Apache Flink® — Stateful Computations over Data Streams
Apache NiFi
VisuAlgo moves to https://visualgo.net/en
æ±äº¬ãƒ¡ãƒˆãƒã€åˆ—車ã®åœ¨ç·šä½ç½®ãªã©å…¨ç·šã‚ªãƒ¼ãƒ—ンデータ化ã€è»Šä¸¡ã®æ‰€å±žä¼šç¤¾ã‚‚　
copy-base64 - Chrome Web Store
{{#tags}}- {{label}}
{{/tags}}