[B! JSON] ButterflyFishã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ButterflyFish id:ButterflyFish

JSONã«é–¢ã™ã‚‹ButterflyFishã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (139)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Go ã§ Protocol Buffer ã§ JSON ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ãƒ»ãƒ‡ã‚³ãƒ¼ãƒ‰ã™ã‚‹
ã“ã®è¨˜äº‹ã¯ Magic Moment Advent Calendar 2024 17 æ—¥ç›®ã®è¨˜äº‹ã§ã™ã€‚ ãƒ¡ãƒªãƒ¼ã‚¯ãƒªã‚¹ãƒžã‚¹ã‚¤ãƒ–ï¼ðŸŽ„ Magic Moment ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã® scent-y ã§ã™ã€‚ å¼Šç¤¾ã§ã¯ç‰¹å®šã®æ™‚ç‚¹ã§ã®ãƒ‡ãƒ¼ã‚¿ã®çŠ¶æ…‹ã‚’ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã¨ã—ã¦ DB ã«ãã®ã¾ã¾ä¿å˜ã—ãŸã„ã‚±ãƒ¼ã‚¹ãŒã‚ã‚Šã€ãã†ã„ã£ãŸãƒ‡ãƒ¼ã‚¿ã‚’ã‚¹ã‚ãƒ¼ãƒžå®šç¾©ã—ã¦ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚³ãƒ¼ãƒ‰ã§æ‰±ã„ã‚„ã™ãã™ã‚‹ãŸã‚ã«ã€Protocol Buffers ã‚’æ´»ç”¨ã—ã¦ã„ã¾ã™ã€‚ Protobuf ã¯æ§‹é€ åŒ–ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã‚’è¨€èªžã‚„ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ ã«ä¾å˜ã›ãšã«ã‚·ãƒªã‚¢ãƒ©ã‚¤ã‚ºã™ã‚‹ã“ã¨ã‚’å¯èƒ½ã«ã—ã¾ã™ã€‚ Protobuf ã‚’æŽ¡ç”¨ã—ã¦ã„ã‚‹ç†ç”±ã¨ã—ã¦ã¯ã€å˜ã« JSON ã§æ°¸ç¶šåŒ–ã™ã‚‹ã ã‘ã ã¨ã‚¹ã‚ãƒ¼ãƒžã®å†…å®¹ãŒåˆ¶ç´„ã•ã‚Œãšã€ç•°ãªã‚‹ã‚µãƒ¼ãƒ“ã‚¹é–“ã§å‚ç…§ã—ãŸã„éš›ã«æ‰±ã„ã¥ã‚‰ã‹ã£ãŸã‚Šã™ã‚‹ã®ã§ã€ãƒ¡ãƒ³ãƒ†ãƒŠãƒ³ã‚¹æ€§ã‚’è€ƒæ…®ã—ã¦ Protobuf ã‚’æŽ¡ç”¨ã—ã¦ã„ã¾ã™ã€‚ ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã«
ButterflyFish 2024/12/26
golang

json
ãƒªãƒ³ã‚¯
DuckDB ã§å…¥ã‚Œåã«ãªã£ã¦ã„ã‚‹ JSON ã‚’ UNNEST ã™ã‚‹è©±
{ "blog_post": { "id": 1, "title": "Understanding JSON", "author": "Jane Smith", "comments": [ { "id": 1, "user": "Alice Johnson", "comment": "Great article!", "timestamp": "2024-12-01T12:34:56Z" }, { "id": 2, "user": "Bob Lee", "comment": "I learned a lot.", "timestamp": "2024-12-02T15:20:30Z" } ] } }
ButterflyFish 2024/12/19
json

duckdb
ãƒªãƒ³ã‚¯
DuckDB ã§ Web API ã‚’å©ã„ã¦ JSON ã‚’ãƒ‘ãƒ¼ã‚¹ã™ã‚‹è©±
å‰åº§ ä»Šæ—¥ã¯12æœˆ13æ—¥ã®é‡‘æ›œæ—¥ã§ã™ã€‚ ãã†ã€13æ—¥ã®é‡‘æ›œæ—¥ã€‚ã€‚ã€‚ ã ã‹ã‚‰ã€ã‚¸ã‚§ã‚¤ã‚½ãƒ³ã€‚ã€‚ã€‚ JSON ã«é–¢ã™ã‚‹è©±ã‚’ã—ã¾ã™ï¼ã‚¦ã‚©ãƒ¼ï¼ ã¨ã¯ã„ãˆã€JSON ã§ä¸€æœ¬è¨˜äº‹ã‚’æ›¸ãã®ã¯é›£ã—ã‹ã£ãŸã®ã§ã€DuckDB ã§ JSON ã‚’è§¦ã£ã¦ã¿ãŸè©±ï¼ˆå¾Œç·¨ï¼‰ã‚’ã—ã¾ã™ã€‚[1] æœ¬é¡Œ ä»Šå›žã¯ä½•ã‚’ã™ã‚‹ã®ï¼Ÿ DuckDB ã§ã‚¹ã‚¯ãƒ¬ã‚¤ãƒ”ãƒ³ã‚°ã‚’ã—ã¾ã™ï¼ å…·ä½“çš„ã«ã¯ã€WebAPI ã«å¯¾ã—ã¦ã€DuckDB ã‹ã‚‰ãƒªã‚¯ã‚¨ã‚¹ãƒˆã‚’ã—ã¦ã€ãã® JSON å½¢å¼ã®ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã‚’ãƒ†ãƒ¼ãƒ–ãƒ«åŒ–ã—ã¾ã™ï¼ å®Ÿè·µã®å‰ã®æº–å‚™ï¼š 2 ã¤ ï¼ˆï¼‘ï¼‰å¯¾è±¡ã® Web API ã®èª¬æ˜Ž ä»Šå›žã€Zenn ã® API ã‚’å¯¾è±¡ã«ã—ã¾ã™ï¼ å…·ä½“çš„ãªã‚¨ãƒ³ãƒ‰ãƒã‚¤ãƒ³ãƒˆã‚„ä»•æ§˜ã¯å…¬é–‹ã•ã‚Œã¦ã„ãªã„ã§ã™ãŒã€Zenn ã‚’ãƒ–ãƒ©ã‚¦ã‚¶ã®é–‹ç™ºè€…ãƒ„ãƒ¼ãƒ«ã§è¦‹ã‚‰ã‚Œã‚‹ç¯„å›²ã® API ã‚’å©ã„ã¦æ¤œè¨¼ã—ã¾ã™ï¼ ä»Šå›žã®å¯¾è±¡ã®ã‚¨ãƒ³ãƒ‰ãƒã‚¤ãƒ³ãƒˆã¨ã—ã¦ã¯ã€ä»¥ä¸‹ã§ã™ã€‚ { "articles": [ { "id": 339
ButterflyFish 2024/12/19
duckdb

json
ãƒªãƒ³ã‚¯
ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã‚’Markdownã‚„JSONã«å¤‰æ›ã—ã¦ãã‚Œã‚‹ã€ŒDoclingã€ã‚’è©¦ã™
ã“ã“ã§çŸ¥ã£ãŸã€‚ è©¦ã—ã«ã€ç¥žæˆ¸å¸‚ãŒå…¬é–‹ã—ã¦ã„ã‚‹è¦³å…‰ã«é–¢ã™ã‚‹çµ±è¨ˆãƒ»èª¿æŸ»è³‡æ–™ã®ã†ã¡ã€ã€Œä»¤å’Œ5å¹´åº¦ ç¥žæˆ¸å¸‚è¦³å…‰å‹•å‘èª¿æŸ»çµæžœã«ã¤ã„ã¦ã€ã®PDFã§ä¸€åº¦è©¦ã—ã¦ã„ãŸã®ã ã‘ã©ã‚‚: ï¼ˆå‡ºå…¸ï¼‰ ç¥žæˆ¸å¸‚Webã‚µã‚¤ãƒˆã®ã€Œè¦³å…‰ã«é–¢ã™ã‚‹çµ±è¨ˆãƒ»èª¿æŸ»ã€ã®ãƒšãƒ¼ã‚¸ ä¸Šè¨˜ã«ã‚ã‚‹ã€Œä»¤å’Œ5å¹´åº¦ ç¥žæˆ¸å¸‚è¦³å…‰å‹•å‘èª¿æŸ»çµæžœã«ã¤ã„ã¦ã€ã®PDF æ—¥æœ¬èªžã§ã‚‚ã€æ¦‚ãå•é¡Œãªãã€è¡¨ãªã©ã‚‚ãã‚Œã„ã«ãƒ‘ãƒ¼ã‚¹ã•ã‚Œã‚‹ ãŸã ã—ã€è¡¨ãŒç”»åƒ ã«ãªã£ã¦ã‚‹å ´åˆã«ã€ã†ã¾ãè§£é‡ˆã•ã‚Œãªã„ï¼ˆè¡¨ã¯è§£é‡ˆã•ã‚Œã‚‹ãŒã€ä¸ã®æ–‡å—ãŒåŒ–ã‘ã‚‹ï¼‰ OCRãŒæ£ã—ãã§ãã¦ã„ãªã„å¯èƒ½æ€§ ã¨ã„ã†ã®ãŒã‚ã£ã¦ã€ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆèªã‚“ã ã‘ã©ã‚ã‹ã‚‰ãªãã¦ã€ãã‚Œä»¥ä¸Šæ·±è¿½ã„ã—ã¦ãªã‹ã£ãŸã€‚ ãŸã ã€Xç•Œéšˆã‚’è¦‹ã‚‹é™ã‚Šã¯è©•åˆ¤ã¯è‰¯ã•ãã†ã§ã€ã„ã‚ã„ã‚è¨˜äº‹ã‚‚å‡ºã¦ããŸã¿ãŸã„ãªã®ã§ã€æ”¹ã‚ã¦è©¦ã—ã¦ã¿ã‚‹ã€‚ GitHubãƒ¬ãƒã‚¸ãƒˆãƒª ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆ Docling Doclingã¯ã€ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã‚’è§£æžã—ã€ç°¡å˜ã‹ã¤è¿…é€Ÿã«å¸Œæœ›ã®å½¢å¼ã«ã‚¨ã‚¯ã‚¹ãƒãƒ¼ãƒˆã—ã¾ã™ã€‚
ButterflyFish 2024/11/06
markdown

json

document
ãƒªãƒ³ã‚¯
DuckDB ã§ JSON Lines å½¢å¼ã®ãƒã‚°ã‚’ç²¾æŸ»ã™ã‚‹
ã¾ã¨ã‚ åœ§ç¸®ã•ã‚ŒãŸè¤‡æ•°ã® JSON Lines ã‚’èªã¿è¾¼ã‚ã‚‹ S3 ã‹ã‚‰ç›´æŽ¥èªã¿è¾¼ã‚ã‚‹ å¥½ããªã‚¿ã‚¤ãƒŸãƒ³ã‚°ã§ Parquet ã§å‡ºåŠ› DuckDB ã¨ã¯ ã“ã¡ã‚‰ã‚’ã©ã†ãžã€‚ DuckDBé›‘ç´¹ä»‹(1.1å¯¾å¿œç‰ˆ)@DuckDBåº§è«‡ä¼š - Speaker Deck åœ§ç¸®æ¸ˆã¿ã®ãƒã‚°ã‚’èªã¿è¾¼ã‚€ è§£æžå¯¾è±¡ã®ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã£ã¦ spam-20240501.jsonl.gz ã‚„ egg-20240601.jsonl.zst ã¿ãŸã„ã«åœ§ç¸®ã•ã‚Œã¦ã„ãŸã‚Šã—ã¾ã™ã€‚ ç‰¹ã«æ—¥ä»˜å˜ä½ã§åˆ†ã‹ã‚Œã¦ãŸã‚Šã™ã‚‹ã“ã¨ã¯å¤šã„ã§ã™ã€‚ãã“ã‹ã‚‰ç›®çš„ã®ãƒã‚°ã‚’æŽ¢ã—å‡ºã™ã®ã¯ã€åŸºæœ¬ã¯ã‚¹ã‚¯ãƒªãƒ—ãƒˆã‚’æ›¸ãã“ã¨ãŒå¤šã„ã¨æ€ã„ã¾ã™ã€‚ DuckDB ã‚’ä½¿ãˆã°è‰²ã€…è§£æ±ºã—ã¾ã™ã€‚
ButterflyFish 2024/10/30
duckdb

json
ãƒªãƒ³ã‚¯
Rustå§‹ã‚ã¦ã¿ãŸã€‚JSONãƒ•ã‚©ãƒ¼ãƒžãƒƒã‚¿ãƒ¼ã‚’ä½œã£ã¦ã¿ãŸ | stin's Blog
å”çªã«Rustã‚’ä½¿ã£ã¦ã¿ãŸã„ã¨æ€ã£ãŸã®ã§å‹‰å¼·ã‚’å§‹ã‚ã¦ã¿ã¾ã—ãŸã€‚ å§‹ã‚ãŸç†ç”±å§‹ã‚ã¦ã¿ãŸã‹ã£ãŸç†ç”±ã¯è‰²ã€…ã‚ã‚Šã¾ã™ã€‚ ã¾ãšã¯ã‚„ã¯ã‚Šãƒ•ãƒãƒ³ãƒˆã‚¨ãƒ³ãƒ‰é–‹ç™ºãƒ„ãƒ¼ãƒ«ãŒè‰²ã€…ã¨Rustã§å®Ÿè£…ã•ã‚Œã‚‹ã“ã¨ã§ã™ã€‚Vercelã¯Turborepoã¨Turbopackã‚’Rustã§å®Ÿè£…ã—ã¦ã„ã¾ã™ãã€‚JavaScriptã‚³ãƒ³ãƒ‘ã‚¤ãƒ©ã®SWCã‚‚Rustã§å®Ÿè£…ã•ã‚Œã¦ã„ã¾ã™ã€‚ã‚ã¨ã¯ã€uhyoã•ã‚“ã®nitrogqlã‚‚Rustã§ä½œã‚‰ã‚Œã¦ã„ã¦ã€ãŠã‚‚ã—ã‚ã„ãªã¨æ€ã„ã¾ã—ãŸã€‚ãã‚“ãªæ„Ÿã˜ã§ã€ã‚³ãƒ³ãƒ‘ã‚¤ãƒ©å®Ÿè£…ã§RustãŒã‚ˆãä½¿ã‚ã‚Œã¦ã„ã‚‹ã“ã¨ã¨ã€ãƒ“ãƒ«ãƒ‰ãƒ„ãƒ¼ãƒ«ãªã©ã®ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã«èˆˆå‘³ãŒã‚ã£ãŸã®ãŒ1ã¤ç›®ã®ç†ç”±ã§ã™ã€‚ ã‚ã¨ã¯ã€Tauriã§ã™ãã€‚ãµã¨ãƒ‡ã‚¹ã‚¯ãƒˆãƒƒãƒ—ã‚¢ãƒ—ãƒªã‚’ä½œã‚ŠãŸã„ã¨æ€ã£ãŸã¨ãã«Tauriã‚’èª¿ã¹ãŸã‚“ã§ã™ãŒã€Tauriã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã‚’Rustã§æ›¸ã‘ãŸã‚‰ã‹ã£ã“ã„ã„ãªã¨æ€ã„ã¾ã—ãŸã€‚æ™®é€šã«JavaScriptã§ã‚‚æ›¸ã‘ã‚‹ã‚‰ã—ã„ã‚“ã§ã™ãŒã€ã‹ã£ã“ã‚ˆã•é‡è¦–ã§ã™ã€‚
ButterflyFish 2024/10/16
rust

WebAssembly

wasm

json

JSON
ãƒªãƒ³ã‚¯
JSON Parsing from Scratch in Haskell
May 4, 2020 A forty-one minute read 33 ðŸ’¬ 11 ðŸ—£ï¸ â¤ï¸ 28 ðŸ” Tags: programmingparsingJSONhaskell JSON is probably the most used standard file format for storing and transmitting data on the Internet in recent times. Though it was historically derived from JavaScript, it is a programming language independent format and is now supported by almost all languages. JSON has a simple syntax specification wi
ButterflyFish 2024/10/06
json

Haskell

JSON
ãƒªãƒ³ã‚¯
Information on RFC 8259 Â» RFC Editor
The JavaScript Object Notation (JSON) Data Interchange Format, December 2017 File formats: Status:INTERNET STANDARD Obsoletes:RFC 7159 Author:T. Bray, Ed. Stream:IETF Source:jsonbis (art) Cite this RFC: TXT Â | XML Â | BibTeX DOI: Â https://doi.org/10.17487/RFC8259 Discuss this RFC: Send questions or comments to the mailing list json@ietf.org Other actions: View Errata Â | Submit Errata Â | Find IPR Di
ButterflyFish 2024/06/21
RFC

json

JSON
ãƒªãƒ³ã‚¯
OpenAPI v4.0 (A.K.A "Project Moonwalk") Â· Bump.sh
What is coming next for OpenAPI, as v4.0 of the OpenAPI Specification gets closer to being released? What major changes are coming, how easy will it be to upgrade, and how do tooling companies feel about it? Recent History of OpenAPI OpenAPI has been around for a long time, but only hit the mainstream when OpenAPI v3.0 was released in 2017. It made it a whole lot easier to describe the majority of
ButterflyFish 2024/05/06
openapi

json
ãƒªãƒ³ã‚¯
How to use JSON Path Â· Bump.sh
A few years ago most API designers, developers, and technical writers would have had very little reason to bump into JSONPath, but its starting to get more and more relevant as more tools and standards start relying on it. So what is JSONPath, what is it used for, and how can you get up to speed with using it? JSONPath is a query language that can be used to extract data from JSON documents, which
ButterflyFish 2024/05/04
json

openapi

JSON
ãƒªãƒ³ã‚¯
ãªã‚“ã§ã‚‚ãƒ¡ãƒ¢ã—ã¦å€‹äººçš„ãªçŸ¥è˜ã‚’è“„ãˆã‚‹ã€ŒObsidianã€ã®ã‚ãƒ£ãƒ³ãƒã‚¹ãƒ‡ãƒ¼ã‚¿ä¿å˜å½¢å¼ã€ŒJSON Canvasã€ãŒã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹åŒ–ã€ä¸èº«ã¯ã“ã‚“ãªæ„Ÿã˜
Markdownå½¢å¼ã§ãƒ¡ãƒ¢ã‚’ä½œæˆã§ãã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã®ObsidianãŒä½¿ç”¨ã—ã¦ã„ã‚‹Obsidian Canvasãƒ•ã‚¡ã‚¤ãƒ«å½¢å¼ã‚’ã€ŒJSON Canvasã€ãƒ•ã‚¡ã‚¤ãƒ«å½¢å¼ã¨ã—ã¦ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹åŒ–ã™ã‚‹ã“ã¨ã‚’ç™ºè¡¨ã—ã¾ã—ãŸã€‚ JSON Canvas â€” An open file format for infinite canvas data. https://jsoncanvas.org/ Announcing JSON Canvas: an open file format for infinite canvas data - Obsidian https://obsidian.md/blog/json-canvas/ ä»•æ§˜ã«ã¤ã„ã¦ã¯jsoncanvas.orgã«è¨˜è¼‰ã•ã‚Œã¦ã„ã¾ã™ã€‚ã‚µã‚¤ãƒˆã«ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹ã¨ã“ã‚“ãªæ„Ÿã˜ã€‚å³ä¸‹ã®ã€ŒToggle outputã€ã‚’ã‚¯ãƒªãƒƒã‚¯ã—ã¦ã¿ã¾ã™ã€‚ å³å´ã«JSON Canvaså½¢å¼
ButterflyFish 2024/04/28
json

markdown
ãƒªãƒ³ã‚¯
æ§‹é€ åŒ–ãƒã‚°ã®ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆ logfmt vs JSON lines - methaneã®ãƒ–ãƒã‚°
æ§‹é€ åŒ–ãƒã‚°ã®ãƒ—ãƒ©ã‚¯ãƒ†ã‚£ã‚¹ã‚’ã‚ã¡ã“ã¡ã§èª¿ã¹ã¦ã„ãŸã‚‰ã€logfmtã‚’æŽ¨å¥¨ã™ã‚‹è¨˜äº‹ã‚’è¦‹ã¤ã‘ãŸã®ã§èª¿ã¹ã¦ã¿ã¾ã—ãŸã€‚ å…ˆã«çµè«–ã‚’è¨€ã†ã¨ã€JSON linesã‚’ä½¿ã£ã¦ãŠãã®ãŒè‰¯ã•ãã†ã§ã™ã€‚ logfmt ã«ã¤ã„ã¦ logfmtã¨ã¯ã‚¹ãƒšãƒ¼ã‚¹åŒºåˆ‡ã‚Šã§ key=value ã‚’ä¸¦ã¹ãŸãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã§ã™ã€‚æ–‡å—åˆ—ã«ã¯ã‚¯ã‚©ãƒ¼ãƒˆã¨ã‚¨ã‚¹ã‚±ãƒ¼ãƒ—ã«ã‚ˆã£ã¦ã‚¹ãƒšãƒ¼ã‚¹ã‚„æ”¹è¡Œã‚’å«ã‚ã‚‰ã‚Œã¾ã™ã€‚ at=info method=GET path=/ host=mutelight.org fwd="124.133.52.161" dyno=web.2 connect=4ms service=8ms status=200 bytes=1653 (logfmt ã‹ã‚‰å¼•ç”¨) ã‚ã¡ã“ã¡ã§ logfmt ã®ãƒªãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã¨ã—ã¦ç´¹ä»‹ã•ã‚Œã¦ã„ã‚‹ã®ã¯ã“ã®è¨˜äº‹ã§ã™ã€‚ https://brandur.org/logfmt ç™ºæ˜Žã•ã‚ŒãŸã®ã¯ã©ã“ã‹åˆ†ã‹ã‚Šã¾ã›ã‚“ãŒã€æµè¡Œ
ButterflyFish 2024/03/04
logging

json
ãƒªãƒ³ã‚¯
DuckDB ãƒ¡ãƒ¢ v1
è‰²ã€…å¤ããªã£ãŸã®ã§ 1 ã‹ã‚‰æ›¸ãç›´ã—ãŸ DuckDB ãƒ¡ãƒ¢ v2 ãƒ¢ãƒãƒ™ãƒ¼ã‚·ãƒ§ãƒ³ JSONL ã‚’èªã¿è¾¼ã‚“ã§è§£æžã™ã‚‹ãƒ„ãƒ¼ãƒ«ãŒæ¬²ã—ã‹ã£ãŸ ãƒã‚°ã‚’èªã¿è¾¼ã¾ã›ãŸã„ã®ã§åœ§ç¸®æ©Ÿèƒ½ã¯å¿…é ˆ è‡ªç¤¾ã®ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸è£½å“ãŒå‡ºåŠ›ã™ã‚‹ JSONL ã‚’èªã¿è¾¼ã‚“ã§è§£æžã§ãã‚‹ä»•çµ„ã¿ é¡§å®¢ãŒå•é¡Œè§£æžã‚’æ°—è»½ã«ã§ãã‚‹ã‚ˆã†ã«ã—ãŸã„ é¡§å®¢å‘ã‘ãƒ„ãƒ¼ãƒ«ã¨ã—ã¦æä¾›ã—ãŸã„ ã¤ã¾ã‚Šé¡§å®¢ç’°å¢ƒã§å‹•ã‹ã—ãŸã„ 1 ãƒã‚¤ãƒŠãƒª OSS ã¨ã—ã¦æä¾›ã—ãŸã„ Apache-2.0 ã¨ã—ã¦å…¬é–‹ã—ãŸã„ ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã¯å¤§ããã¦ã‚‚ 100 GB ã¯è¡Œã‹ãªã„ ã‚‚ã¨ã‚‚ã¨ Go + SQLite + JSONB ã§æ¤œè¨Žã—ã¦ã„ãŸ SQL ã§æ›¸ããŸã„ SQLite ãƒ•ã‚¡ã‚¤ãƒ«ã¨ã—ã¦æ›¸ãå‡ºã—ãŸã„ SQLite ãƒ•ã‚¡ã‚¤ãƒ«ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã¯ä¿¡é ¼ã§ãã‚‹ S3 ãªã©ã«ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ç½®ã„ã¦ãŠãã ã‘ã«ã—ãŸã„ ã‚¯ãƒ©ã‚¦ãƒ‰ç‰ˆã«çµ„ã¿è¾¼ã¿ãŸã„ é¡§å®¢æ¯Žã« duckdb ãƒ•ã‚¡ã‚¤ãƒ«ä½œã‚Œã°ã„ã„ã®ã§ã¯ï¼Ÿ duckdb ãƒ•ã‚¡
ButterflyFish 2024/02/05
sql

json

rust

duckdb
ãƒªãƒ³ã‚¯
JSONã®å·®åˆ†ã‚’å–ã£ã¦JSON Patchã‚’å¾—ã‚‹ã«ã¯diffsonãŒãŠã™ã™ã‚ - Lambdaã‚«ã‚¯ãƒ†ãƒ«
ã“ã†ã„ã†ãƒ„ã‚¤ãƒ¼ãƒˆã‚’è¦‹ãŸã€‚ Scala (or Java) ã§ã€jsonã®diffã‚’patchãƒ•ã‚¡ã‚¤ãƒ«ã¿ãŸã„ãªæ„Ÿã˜ã§ã‚ã‹ã‚Šã‚„ã™ã„ãƒ†ã‚ã‚¹ãƒˆã§å‡ºåŠ›ã—ã¦ãã‚Œã‚‹ãƒ©ã‚¤ãƒ–ãƒ©ãƒªãªã„ã‹ãªã‚ã€‚ãã—ã¦jacksonã«ä¾å˜ã—ã¦ãªã„ã¨ã„ã„ãªâ€” Arthur (@Arthur1__) 2024å¹´1æœˆ13æ—¥ ç¾ä»£ã®ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã§ã¯JSONã®å·®åˆ†ã‚’å–ã£ãŸã‚Šã€é€†ã«ãƒ‘ãƒƒãƒã‚’å½“ã¦ã‚‹ã¨ã„ã†ã“ã¨ãŒã‚ˆãã‚ã‚‹ã€‚å¯èƒ½ãªã‚‰ãã‚ŒãŒPretty Printã§ãã‚‹ã¨è‰¯ã„ã€‚ JSONã®å·®åˆ†ã‚’Scalaã§å–ã‚‹æ–¹æ³•ã«ã¤ã„ã¦ã„ãã¤ã‹èª¿ã¹ã¦ã¿ãŸã®ã§ãƒ¡ãƒ¢ã€‚ JSONã®å·®åˆ†ã‚’ã©ã†è¡¨ç¾ã™ã‚‹ï¼Ÿ JSON Patch diffson diffsonã§JSON Patchã‚’ç”Ÿæˆã™ã‚‹ diffsonã§JSON Patchã‚’é©ç”¨ã™ã‚‹ diffsonã§JSON Merge Patchã‚’ç”Ÿæˆã™ã‚‹ diffsonã§JSON Merge Patchã‚’é©ç”¨ã™ã‚‹ JSON Pat
ButterflyFish 2024/01/15
json

JSON
ãƒªãƒ³ã‚¯
[Go] json.Unmarshal ã¨ json.Decoder ã®ä½¿ã„åˆ†ã‘ ï½ž json.Decoder ã«è¦ªã—ã‚€
ã¯ã˜ã‚ã« ä»Šã‚„ã‚ã‚‰ã‚†ã‚‹ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã¯ Go ã§æ›¸ã‹ã‚Œã¦ã„ã‚‹ã¨è¨€ã£ã¦ã‚‚éŽè¨€ã§ã¯ãªã„ï¼ˆéŽè¨€ï¼‰ã€‚ãã—ã¦ã€ä»Šã‚„ã‚ã‚‰ã‚†ã‚‹ãƒ‡ãƒ¼ã‚¿ã¯ json ã§ã‚ã‚‹ã¨è¨€ã£ã¦ã‚‚éŽè¨€ã§ã¯ãªã„ï¼ˆéŽè¨€ï¼‰ã€‚ ã¨ãªã‚‹ã¨ã€Go ã§ json ã‚’æ‰±ã†é »åº¦ã‚‚å¿…ç„¶çš„ã«å¤šããªã‚‹ã€‚ãã—ã¦åˆã‚ã¦ Go ã§ json ã‚’ãƒ‡ã‚³ãƒ¼ãƒ‰ã™ã‚‹ã‚³ãƒ¼ãƒ‰ã‚’æ›¸ã“ã†ã¨ã—ãŸäººã¯ã€å¿…ãšã“ã®å•é¡Œã«ã¶ã¡å½“ãŸã‚‹ã€‚ ã€Œjson.Unmarshal ã¨ json.Decoder ã¯ä½•ãŒé•ã†ã®ã‹ï¼Ÿãã—ã¦ã©ã¡ã‚‰ã‚’ä½¿ãˆã°ã„ã„ã®ã‹ï¼Ÿã€ ãã—ã¦ã‚°ã‚°ã‚‹ã¨å¤§æŠµä»¥ä¸‹ã®ã‚ˆã†ãªç”ãˆã«ãŸã©ã‚Šç€ãã€‚ å…¥åŠ›ãŒæ–‡å—åˆ—ï¼ˆstringï¼‰ã‚„ãƒã‚¤ãƒˆåˆ—ï¼ˆ[]byteï¼‰ã®å ´åˆã¯ json.Unmarshal() ã‚’ä½¿ã† å…¥åŠ›ãŒã‚¹ãƒˆãƒªãƒ¼ãƒ ï¼ˆio.Readerï¼‰ã®å ´åˆã¯ json.Decoder ã‚’ä½¿ã† ãªã‚‹ã»ã©ã€ç¢ºã‹ã«ãƒ‘ãƒƒã¨è¦‹ã¯ãã‚Œã§ã„ã„ã‚ˆã†ã«æ€ãˆã‚‹ã€‚æ€ãˆã‚‹ã‚“ã ãŒã€ã‚ˆãè¦‹ã‚‹ã¨å®Ÿã¯ä»–ã«ã‚‚ã„ãã¤ã‹è€ƒæ…®ã™ã¹ãç‚¹ãŒã‚ã‚‹ã€‚
ButterflyFish 2023/12/10
golang

json

JSON
ãƒªãƒ³ã‚¯
Writing useful terminal TUI on Linux with dialog and jq - Fedora Magazine
Why a Text User Interface? Many use the terminal on a daily basis. A Text User Interface (TUI) is a tool that will minimize user errors and allow you to become more productive with the terminal interface. Let me give you an example: I connect on a daily basis from my home computer into my Physical PC,Â using Linux. All remote networking is protected using a private VPN.Â After a while it was irritat
ButterflyFish 2023/11/25
linux

json

cli
ãƒªãƒ³ã‚¯
Building a high performance JSON parser
This talk is a case study of designing an efficient Go package. Iâ€™m going to use the example of building a high performance JSON parser. Supports streaming operations Itâ€™s unrealistic to expect to have the entire input in memory. Buffering in memory is a availability risk, input sizes are usually unknown and potentially unbounded. Buffering before processing introduces latency. Streaming reads let
ButterflyFish 2023/11/06
json

performance

golang

JSON
ãƒªãƒ³ã‚¯
enjargo - another way to generate go json encoders
ButterflyFish 2023/10/27
golang

JSON

json
ãƒªãƒ³ã‚¯
Goè¨€èªžã§é«˜é€ŸJSONãƒ©ã‚¤ãƒ–ãƒ©ãƒªã‚’ãƒ¡ãƒ¢ãƒªå®‰å…¨ã«ã—ãŸã‚‰ã•ã‚‰ã«é€Ÿããªã£ãŸè©±
ã¯ã˜ã‚ã« ã“ã‚“ã«ã¡ã¯ã€‚Sugawara Yuutaã§ã™ã€‚"Goè¨€èªžã§æœ€é€Ÿã®JSONãƒ‡ã‚³ãƒ¼ãƒ€ãƒ¼ã‚’ä½œã£ãŸè©±", "ãã‚Œã§ã‚‚åƒ•ã¯Goã§æœ€é€Ÿã®JSONãƒ‡ã‚³ãƒ¼ãƒ€ãƒ¼ã‚’ä½œã‚ŠãŸã‹ã£ãŸ"...ä»¥æ¥ã®æ–¹ã¯ã¾ãŸèªã‚“ã§ã„ãŸã ãã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã™ã€‚ã¾ã ã®æ–¹ã¯ã€çµŒç·¯ã‚’ä¼ãˆã‚„ã™ããªã‚‹ã¨æ€ã†ã®ã§ã€ãã¡ã‚‰ã®æ–¹ã‚‚èªã‚“ã§ã„ãŸã ã‘ãŸã‚‰å¹¸ã„ã§ã™ã€‚ ãã®å¾Œ Goè¨€èªžãƒãƒ¼ãƒ ã®ãƒ¡ãƒ³ãƒãƒ¼ãŒå–ã‚Šçµ„ã‚“ã§ã„ã‚‹æ–°ã—ã„ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã®JSONãƒ©ã‚¤ãƒ–ãƒ©ãƒªã§ã‚ã‚‹go-json-experiment/jsonã¨ã„ã†ãƒ¬ãƒã‚¸ãƒˆãƒªã‚’ç™ºè¦‹ã—ã¾ã—ãŸã€‚(åŽ³å¯†ã«è¨€ã†ã¨ã€çŸ¥ã£ã¦ã¯ã„ãŸã®ã§ã™ãŒä¸èº«ç‰ã¯è¦‹ã¦ã„ãªã„çŠ¶æ…‹ã§ã—ãŸã€‚) ãã“ã§å¦ã‚“ã ã“ã¨ãŒå°‘ã—ã§ã‚‚å½¹ã«ç«‹ã¦ã°ã¨issueã‚’æå‡ºã—ãŸã¨ã“ã‚ã€ãã®ã¨ãã®JSONãƒ‡ã‚³ãƒ¼ãƒ€ãƒ¼ã«è¶³ã‚Šãªã„ã‚‚ã®ãŒè¦‹ãˆã¦ããŸãŸã‚ã€ä»Šå›žã¯åƒ•ã®è¦‹ã¤ã‘ãŸèª²é¡Œã¨ã€ã©ã®ã‚ˆã†ã«è§£æ±ºã—ã‚ˆã†ã¨ã—ãŸã‹ãƒ»ã—ãŸã‹ã‚’è©±ã›ã‚Œã°ã¨æ€ã„ã¾ã™ã€‚ è¦‹ã¤ã‘ãŸèª²é¡Œ ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã‚‚é‡è¦ã§ã™ãŒ
ButterflyFish 2023/09/23
golang

json
ãƒªãƒ³ã‚¯
ã€Pythonã€‘JSONã®ç‰¹å®šã®ã‚ãƒ¼ã ã‘æ®‹ã—ã¦ä¸è¦éƒ¨åˆ†ã¯å‰Šé™¤ã™ã‚‹ - Qiita
import json def filter_json(data): if isinstance(data, dict): filtered_data = {} for key, value in data.it ems(): if key == "legacy": filtered_data[key] = value elif isinstance(value, (dict, list)): filtered_value = filter_json(value) if filtered_value: filtered_data[key] = filtered_value return filtered_data elif isinstance(data, list): filtered_data = [] for it em in data: filtered_it em = filter_j
ButterflyFish 2023/07/06
python

json

JSON
ãƒªãƒ³ã‚¯
1 2 3 4 5 6 7 æ¬¡ã®ãƒšãƒ¼ã‚¸