[B! parser] TokyoIncidentsã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

TokyoIncidents id:TokyoIncidents

parserã«é–¢ã™ã‚‹TokyoIncidentsã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (7)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ANTLRã‚’ä½¿ã£ã¦ã¿ã‚‹
å§‹ã‚ã‚‹å‰ã« ã¨ã‚Šã‚ãˆãšã€ã¾ãšã¯ANTLRã¨ã¯ã©ã‚“ãªã‚‚ã®ã‹ä½¿ã£ã¦ã¿ã¾ã—ã‚‡ã†ã€‚ ANTLR ã®ãƒšãƒ¼ã‚¸ã‹ã‚‰ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰ã—ã¾ã™ã€‚ ä»Šå›žã¯ã€ç¾åœ¨ï¼ˆ2006/07/18ï¼‰ã®å®‰å®šæœ€æ–°ç‰ˆã§ã‚ã‚‹ 2.7.6 ã‚’ä½¿ã†ã“ã¨ã«ã—ã¾ã—ãŸã€‚ ANTLRã®ã‚ˆã†ãªãƒ„ãƒ¼ãƒ«ã‚’ä½¿ã†ã¨ãã«ã€æœ€ä½Žé™çŸ¥ã£ã¦ãŠãå¿…è¦ã®ã‚ã‚‹äº‹ãŒã‚ã‚Šã¾ã™ã€‚ ãã‚Œã¯æ£è¦è¡¨ç¾ã§ã™ã€‚ ã“ã‚Œã‚’çŸ¥ã£ã¦ã„ãªã„ã¨ã€æ£ç›´ANTLRã‚’ä½¿ã†ã®ã¯åŽ³ã—ã„ã§ã™ã€‚ åŸºæœ¬çš„ãªã¨ã“ã‚ã ã‘çŸ¥ã£ã¦ã„ã‚Œã°å……åˆ†ã§ã™ã®ã§ã€ ã¾ãšã¯æ£è¦è¡¨ç¾ã‚’å¦ã‚“ã§ãŠãã¾ã—ã‚‡ã†ã€‚ ç°¡å˜ãªä¾‹ ANTLRã§ã¯ã€ä¸€ã¤ã®ãƒ‘ãƒ¼ã‚µã‚’ä½œæˆã™ã‚‹ã®ã« Parser / Lexer ã‚’å¯¾ã§ä½¿ã„ã¾ã™ã€‚ ä»Šå›žã¯Antlrã®ã‚µã‚¤ãƒˆã«ç¿’ã£ã¦(ãƒ‘ã‚¯ã£ã¦ï¼Ÿ)ã€æ•°å€¤æ¼”ç®—å¼ã‚’è§£æžã™ã‚‹ãƒ‘ãƒ¼ã‚µã‚’ä½œæˆã—ã¾ã™ã€‚ ã¾ãšã€ä»¥ä¸‹ã®å†…å®¹ã‚’ãƒ•ã‚¡ã‚¤ãƒ«ã«ä¿å˜ã—ã¾ã™ã€‚ expr.g class ExprParser extends Parser; expr: mexpr (
TokyoIncidents 2015/08/08
programming

parser
ãƒªãƒ³ã‚¯
http-parser ã¨ picohttpparser ã¨ã®æ¯”è¼ƒ - methaneã®ãƒ–ãƒã‚°
h2o Advent Calendar 2014 ã®è¨˜äº‹ã§ã™ã€‚ Minefield ã¯ http-parser (nginx ã®ãƒ‘ãƒ¼ã‚µãƒ¼ã¨åŸºæœ¬çš„ã«åŒã˜ã‚‚ã®) ã‚’åˆ©ç”¨ã—ã¦ã„ã‚‹ã®ã§ã™ãŒã€ã“ã‚Œã‚’ picohttpparser ã«ç½®ãæ›ãˆã¦ã¿ã¾ã™ã€‚ æœ€åˆã¯ libh2o ã«ç½®ãæ›ãˆã‚‹ã¤ã‚‚ã‚Šã ã£ãŸã®ã§ã™ãŒã€ã¾ã API ãŒ unstable ã§ã‚¢ãƒ—ãƒªã«çµ„ã¿è¾¼ã‚€æ‰‹é †ã‚‚ç¢ºç«‹ã•ã‚Œã¦ãªã„ã®ã§ parser ã ã‘ã‚’ç½®ãæ›ãˆã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ ã¾ã å®Œæˆã—ã¦ã„ãªã„ã®ã§ã™ãŒã€ Hello, World ãã‚‰ã„ã¯å•é¡Œãªãå‹•ããƒ¬ãƒ™ãƒ«ã«ãªã£ãŸã®ã§ã€ã“ã“ã¾ã§ã§æ°—ã¥ã„ãŸ http-parser ã¨ picohttpparser ã®é•ã„ã‚’ç´¹ä»‹ã—ã€ãƒ™ãƒ³ãƒãƒžãƒ¼ã‚¯å¯¾æ±ºã‚‚ã‚„ã£ã¦ã¿ã¾ã™ã€‚ ç‰¹ã«ç½®ãæ›ãˆã‚’å§‹ã‚ã‚‹å‰ã¯ã€ perf top ã§ execute_http_parser ã¨ã„ã† http-parser ã®é–¢æ•°ãŒ2%ç¨‹åº¦ã—ã‹CPUã‚’
TokyoIncidents 2014/12/22
ãŠãŠã€æ¬²ã—ã‹ã£ãŸæƒ…å ±ã ã€‚è¨è¨ˆæ€æƒ³ãŒå…¨ãé•ã†ã‚“ã ã‚ã†ãªãƒ¼ã£ã¦ã„ã†ã®ã¨ã‚¼ãƒã‚³ãƒ”ãƒ¼ãªã®ã‹ãªãƒ¼ã£ã¦ã„ã†ã®ã ã„ãŸã„ã‚ã£ã¦ãŸ

HTTP

parser

h2o
ãƒªãƒ³ã‚¯
Lexer and parser generators (ocamllex, ocamlyacc)
ã“ã®ç« ã§ã¯ ocamllex ã¨ ocamlyacc ã®è§£èª¬ã‚’ã—ã¾ã™ã€‚ocamllex ã¯ã€æ£è¦è¡¨ç¾ã®é›†åˆã¨ã€ãã‚Œã«å¯¾å¿œã™ã‚‹ã‚»ãƒžãƒ³ãƒ†ã‚£ã‚¯ã‚¹ã‹ã‚‰å—å¥è§£æžå™¨ã‚’ç”Ÿæˆã—ã€ocamlyacc ã¯æ–‡æ³•ã¨ã€ãã‚Œã«å¯¾å¿œã™ã‚‹ã‚»ãƒžãƒ³ãƒ†ã‚£ã‚¯ã‚¹ã‹ã‚‰æ§‹æ–‡è§£æžå™¨ã‚’ç”Ÿæˆã—ã¾ã™ã€‚ ã“ã®ãƒ—ãƒã‚°ãƒ©ãƒ ç”Ÿæˆãƒ„ãƒ¼ãƒ«ã¯ã€C è¨€èªžç’°å¢ƒã§æœ‰åãª lex ã¨ yacc ã¨ã¨ã¦ã‚‚ã‚ˆãä¼¼ã¦ã„ã¾ã™ã€‚ã“ã®ç« ã¯ lex ã¨ yacc ã®çŸ¥è˜ãŒã‚ã‚‹ã“ã¨ã‚’å‰æã¨ã—ã¦ã„ã¾ã™ã€‚ocamllex ã¨ ocamlyacc ã«ä¸Žãˆã‚‹ã‚½ãƒ¼ã‚¹ã®æ–‡æ³•ã‚„ lex ã¨ yacc ã¨ã®ä¸»ãªç›¸é•ç‚¹ãªã©ã¯è§£èª¬ã—ã¾ã™ãŒã€lex ã¨ yacc ã§ã®å—å¥è§£æžå™¨ã‚„æ§‹æ–‡è§£æžå™¨ã®åŸºæœ¬çš„ãªæ›¸ãæ–¹ã¯è§£èª¬ã—ã¾ã›ã‚“ã€‚lex ã¨ yacc ã‚’ã‚ˆãçŸ¥ã‚‰ãªã„æ–¹ã¯ã€``Compilers: principles, techniques, and tools''(Aho, Sethi and Ullman
TokyoIncidents 2014/03/06
programming

parser

OCaml
ãƒªãƒ³ã‚¯
4-1. Parser
4-1. æ§‹æ–‡è§£æžã®è©± ç¾åœ¨ã¾ã§ã®å‡¦ç†ç³»ã«ã¯ã€ãƒŸãƒ‹OCamlè¨€èªžãƒ—ãƒã‚°ãƒ©ãƒ ã®æ§‹æ–‡è§£æžã‚’è¡Œã£ã¦ãã‚Œã‚‹éƒ¨åˆ†ãŒãªã„ã®ã§ã€ ãŸã¨ãˆã°ã€if 2=1 then 1*2 else 1*(2+3) ã¨ã„ã†å¼ã‚’ã€ If (Eq(IntLit 2, IntLit 1), Times(IntLit 1, IntLit 2), Times(IntLit 1, Plus(IntLit 2,IntLit 3))) ã¨ã„ã†ã‚ˆã†ã« expåž‹ã®å¼ã¨ã—ã¦æ›¸ã‹ãªãã¦ã¯ãªã‚‰ãšã€å…¥åŠ›ãŒå¤§å¤‰ã§ã‚ã‚Šã€é–“é•ã„ã‚„ã™ã„ã€‚ ã‚‚ã—ã€ parse "if 2=1 then 1*2 else 1*(2+3)" ã¨ã™ã‚‹ã¨ã€ä¸Šè¨˜ã®expåž‹ã®å¼ã‚’ç”Ÿæˆã—ã¦ãã‚Œã‚‹é–¢æ•°parseãŒã‚ã‚Œã°ã€å¤§å¤‰ã«ä¾¿åˆ©ã§ã‚ã‚‹ã€‚ ã“ã“ã§ã€ã€Œæ§‹æ–‡è§£æžã™ã‚‹ã€ã¨ã„ã†è¨€è‘‰ã‚’ä½¿ã£ã¦ããŸãŒã€æ£ç¢ºã«ã¯ä»¥ä¸‹ã®2ã¤ã®ãƒ—ãƒã‚°ãƒ©ãƒ ã‹ã‚‰æ§‹æˆã•ã‚Œã‚‹ã€‚ å—å¥è§£æžå™¨ (lexer)..å…¥åŠ›æ–‡å—åˆ—ã‚’ã€ãƒˆãƒ¼ã‚¯ãƒ³(
TokyoIncidents 2014/03/06
programming

parser

OCaml
ãƒªãƒ³ã‚¯
Rubyã¯æ¨™æº–ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã«Ruby lexer/parserãŒã‚ã‚‹ã®ãŒã„ã„ - Islands in the byte stream (legacy)
ã“ã‚Œã¯ç‰¹ç†ã™ã¹ãç‰¹å¾´ã ã¨æ€ã†ã€‚ãƒ’ã‚¢ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã‚‚ã¡ã‚ƒã‚“ã¨å‡¦ç†ã§ãã‚‹ã€‚ require "ripper" require "pp" src = <<'END' def foo p [<<-"A", <<-"B"] Hello, %{"Ruby"} world! A one, two three B end END pp Ripper.lex(src) çµæžœ: [[[1, 0], :on_kw, "def"], [[1, 3], :on_sp, " "], [[1, 4], :on_ident, "foo"], [[1, 7], :on_nl, "\n"], [[2, 0], :on_sp, " "], [[2, 2], :on_ident, "p"], [[2, 3], :on_sp, " "], [[2, 4], :on_lbracket, "["], [[2, 5], :on_hered
TokyoIncidents 2014/03/06
ruby

parser
ãƒªãƒ³ã‚¯
Beautiful Soup: We called him Tortoise because he taught us.
You didn't write that awful page. You're just trying to get some data out of it. Beautiful Soup is here to help. Since 2004, it's been saving programmers hours or days of work on quick-turnaround screen scraping projects. Beautiful Soup is a Python library designed for quick turnaround projects like screen-scraping. Three features make it powerful: Beautiful Soup provides a few simple methods and
TokyoIncidents 2010/11/17
python

html

parser
ãƒªãƒ³ã‚¯
Parse::RecDescent - å†å¸°ä¸‹é™ãƒ‘ãƒ¼ã‚µã®ç”Ÿæˆ (Generate Recursive-Descent Parsers) - perldoc.jp
åå‰Â¶ Parse::RecDescent - å†å¸°ä¸‹é™ãƒ‘ãƒ¼ã‚µã®ç”Ÿæˆ (Generate Recursive-Descent Parsers) ãƒãƒ¼ã‚¸ãƒ§ãƒ³Â¶ This document describes version 1.94 of Parse::RecDescent, released April 9, 2003. ã“ã®ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã¯ã€2003å¹´4æœˆ9æ—¥ã«ãƒªãƒªãƒ¼ã‚¹ã•ã‚ŒãŸ Parse::RecDescentã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³1.94ã«ã¤ã„ã¦è¿°ã¹ãŸã‚‚ã®ã§ã‚ã‚‹ã€‚ æ¦‚è¦Â¶ use Parse::RecDescent; # $grammarã®ä»•æ§˜æ›¸ã‹ã‚‰ãƒ‘ãƒ¼ã‚µã‚’ç”Ÿæˆ $parser = new Parse::RecDescent ($grammar); # $othergrammarã®ä»•æ§˜æ›¸ã‹ã‚‰ãƒ‘ãƒ¼ã‚µã‚’ç”Ÿæˆ $anotherparser = new Parse::RecDescent ($otherg
TokyoIncidents 2009/06/12
perl

cpan

parser
ãƒªãƒ³ã‚¯
1