2024/6/4追è¨ï¼åå¼·ä¼ï¼OTFSG #2ï¼ã§ä»¥ä¸ã®è¨äºã®å 容ãæ´çï¼æ å ±ã追å ããçºè¡¨ããã¾ããã以ä¸ããã®æã®ã¹ã©ã¤ãã«ãªãã¾ãã®ã§ãä½µãã¦ãåç §ãã ãã speakerdeck.com ãã®è¨äºã¯ Distributed computing (Apache Spark, Hadoop, Kafka, ...) Advent Calendar 2023 ã®2æ¥ç®ã®è¨äºã§ãã Apache Icebergã«ããã¦ãCatalogã¯ãã®æ ¹å¹¹ãæ ãã³ã³ãã¼ãã³ãã ãIcebergã®reader,writerã¯Catalogã«ãã£ã¦ãã¼ãã«ãçºè¦ããæ´åæ§ãç¶æããªãããã¼ãã«ãæä½ã§ãããä¸æ¹ã§Catalogãæ§æããé¸æè¢ã¯å¤æ§ã§ãè¦ä»¶ã«å¿ãã¦é¸ã¶å¿ è¦ããããããã§æ¬è¨äºã§ã¯ãIceberg Catalogã®ä¸»ãªé¸æè¢ã¨ç¹å¾´ãã¾ã¨ããã ããããIcebergã£ã¦ãªã«ï¼ã¨ããæ¹ã¯ä»¥ä¸ã®
ã¯ããã« æ¦è¦ Apache Iceberg(ã¢ã¤ã¹ãã¼ã°)ã¨ã¯ [éè¦] Icebergã®æ¬è³ªã¯Table Specã§ãã Table Spec ãã¼ã¸ã§ã³ Icebergãã³ãºãªã³ Icebergã®ç¹å¾´ åææ¸ãè¾¼ã¿æã®æ´åæ§æ ä¿ èªã¿åãä¸è²«æ§ãTime Travelã¯ã¨ãªãRollback Schema Evolution Hidden Partitioning Hidden Partitioningã®ç¨®é¡ æé truncate[W] bucket[N] Partition Evolution Sort Order Evolution ã¯ã¨ãªæ§è½ã®æé©å ã¦ã¼ã¹ã±ã¼ã¹ Icebergã®ã¢ã¼ããã¯ã㣠Iceberg Catalog Iceberg Catalogã®é¸æè¢ metadata layer metadata files manifest lists manifest f
Amazon Web Services ããã° AWS Glueã§Apache Sparkã¸ã§ããã¹ã±ã¼ãªã³ã°ãããã¼ã¿ããã¼ãã£ã·ã§ã³åå²ããããã®ãã¹ããã©ã¯ãã£ã¹ AWS Glueã¯Apache Spark ETLã¸ã§ãã§ã®ãã¼ã¿åæã»ãã¼ã¿å¦çãè¡ãããã«ãæ§ã ãªãã¼ã¿ã½ã¼ã¹ãã大éã®ãã¼ã¿ã»ãããæºå(æ½åºããã³å¤æ)ãããã¼ããããµã¼ãã¼ã¬ã¹ãªç°å¢ãæä¾ãã¾ãããã®æ稿ã®ã·ãªã¼ãºã§ã¯ãApache Sparkã¢ããªã±ã¼ã·ã§ã³ã¨Glueã®ETLã¸ã§ãã®éçºè ãããã°ãã¼ã¿ã¢ã¼ããã¯ãããã¼ã¿ã¨ã³ã¸ãã¢ãããã³ãã¸ãã¹ã¢ããªã¹ãããAWS Glueä¸ã§å®è¡ãããã¼ã¿å¦çã®ã¸ã§ããèªåçã«ã¹ã±ã¼ã«ããã®ã«å½¹ã«ç«ã¤ãã¹ããã©ã¯ãã£ã¹ã«ã¤ãã¦èª¬æãã¾ãã ã¾ãæåã®æ稿ã§ã¯ããã¼ã¿å¦çãè¡ãã¸ã§ãã®ã¹ã±ã¼ãªã³ã°ã管çããä¸ã§éè¦ãª2ã¤ã®AWS Glueã®æ©è½ã«ã¤ãã¦èª¬æãã¾ãã1ã¤ç®ã¯ã
IoTãAIã®ã¦ã¼ã¹ã±ã¼ã¹ãã¾ãã¾ãå¢ãã¦ããã®ãªããããã°ãã¼ã¿ããªã¢ã«ã¿ã¤ã ã«SQLã§ã¯ã¨ãªããéè¦ãé«ã¾ã£ã¦ããããã¡ããå®ç¾ããã½ãªã¥ã¼ã·ã§ã³ã¨ãã¦ãApache Hive 㨠Druid ã®çµåããé åã§ãã Apache Hive 㨠Druid ã¨ãå®ç¸¾ã®é«ããªã¼ãã³ã½ã¼ã¹ã½ããã¦ã§ã¢ï¼OSSï¼ã 両æ¹ã¨ãé常ã«å¤§éã®ãã¼ã¿ã§ã対å¿ã§ããã¹ã±ã¼ã«ã¢ã¦ãã»ã¢ã¼ããã¯ãã£ã Apache Hive 㨠Druid èªä½ãä¾åã³ã³ããã³ãå ¨ã¦ã¯ãApache Ambariã使ã£ã¦GUIã¦ã£ã¼ã¶ã¼ã§ã¤ã³ã¹ãã¼ã«å¯è½ã ç°¡åãªè¨å®ã ãã§é£æºå¯è½ã ä»åã¯Apache Hiveã¨Druidã使ã£ããªã¢ã«ã¿ã¤ã SQLå¦çãããµã³ãã«ã¿ãªãã説æããã Apache Hive 2ã¨ã¯ Apache Hiveã¯Hadoopä¸ã®SQLãã¼ã¿ã»ã¦ã§ã¢ãã¦ã¹ã§ããææ°ã®Hive 2.2ã¯æ°ããLLA
ã¯ããã« ãã®è¨äºã¯ããµã¼ããµã¤ãã¨ã³ã¸ãã¢ã®å¹³å¡ãªæ¥å¸¸ã§å¾ã Apache Thrift ã®åºæ¬çãªä½¿ãæ¹ãæ·¡ã ã¨èª¬æãããã®ã§ãã é度ãªæå¾ ã¯ããªãã§ãã ããã ããã¨ãï¼³ï½ï½ï½ï½1)ã¢ããã«ã®iOSããã³OS Xã®ããã®ããã°ã©ãã³ã°è¨èªã¨åéããã¦ãã®ãã¼ã¸ãéãã¦ãã¾ã£ãæ¹ã«ã¯ãã¿ã¾ããã ã¿ããªã¾ã©ããããµã¼ããµã¤ãã®ã¨ã³ã¸ãã¢ã¶ãããããã§ãã ã¨ã³ã¸ãã¢ã®çæ§ã«ãããã¾ãã¦ã¯ãæ®æ®µããããããã°ã©ãã³ã°ã§ããããï¼ ãã¦ã諸å§å ã«ããã¾ãã¦ã¯ãµã¼ãã¹ãªãªã¼ã¹æµ ãç£è¦ã»éç¨å³ããæãæ¢åã®ãµã¼ãã¹ã¨ã®é£æºã¨ã¯åã°ããã§ç¡è¶ãªå®è£ ããããå¾ãªããªãã¦ãã¨ãã¾ã¾ããã®ã§ã¯ãªãã§ããããï¼ ç§ã«è³ã£ã¦ã¯ãããã®ãµã¼ãã¹ã®é£æºããããªã«é£ããã¯ãããªããã¨ããåã«ã¯è§£æ±ºçãå°ãªããã¨ãæãã¦ãã¾ãä»æ¥æ¤é ã§ãã2)è¶ è¨³ããã¨ãRoRã®ãµã¼ãã¹ã§Javaã®APIãå©ãããã£ãã¨ãã«T
Maven ãå©ç¨ããå ´åããã¹ããã¹ãããããã®ã¯æ¬æ¥ã§ããã°æ¨å¥¨ãããªãããã§ããã ãã¹ãã«æéãããããããã®ã§æ®æ®µã¯ãã¹ããã¹ãããããã ã¹ã±ã¸ã¥ã¼ã«ã«è¿½ããã¦ãã¹ãã³ã¼ãã®ã¡ã³ããã³ã¹ã追ãã¤ããªãï¼ãã©ãã«ãã¯éãããâ¦*1 ãªã©ã®äºæ ã«ãããã¹ããã¹ããããããå ´é¢ã«åºããããã¨ãããã¾ãã ã¾ãã«ã"rm -rf src/test/java" ã¨ããã¯ã¤ã«ããªææ³ãè¦ãããã®ã§ãã⦠ãã¹ããã¹ãããããã«ã¯â¦ ãã¹ãã®å®è¡ã®ã¿ãã¹ããããã mvn install -DskipTests=true ãã¹ãã³ã¼ãã®ã³ã³ãã¤ã«ãããã³ãã¹ãã®å®è¡ãã¹ããããã mvn install -Dmaven.test.skip=true ãã¹ããã¹ãããããã«ã¯ä¸è¨ã使ãåãã¾ãã å¾è ã®å ´åãjar:test-jar(org.apache.maven.plugins:maven
ã¢ããªã±ã¼ã·ã§ã³ã¨ã³ã¸ãã¢ã§ãããã Docker 㨠Mesos åå¼·ä¼ https://sakura-kanto.doorkeeper.jp/events/53777 2016å¹´11æ18æ¥(é) çºè¡¨è³æ æ¬ã¹ã©ã¤ãã®æ³å®ã¯ ã Mesos ã£ã¦èãããã¨ãããã©ãããããããªããã ã Apache Mesosã£ã¦ä½ã ï¼ ã ã¨ãã£ãçåãæã¤èªè ã§ãã Mesos ã®æ¦å¿µãèæ¯ãç¥ãããã®è³æã§ãRead less
ç§èåã©ãã飯島 è³¢å¿ ã·ã¥ãã£ã ããã³(@rshtykh) ã¯ããã« ãµã¤ãã¼ã¨ã¼ã¸ã§ã³ãå ã®ç 究éçºçµç¹ã§ããç§èåã©ãã¯ã大è¦æ¨¡ãã¼ã¿åºç¤ã®éçºã»éç¨ã«å ãã¦æ¤ç´¢ã»æ©æ¢°å¦ç¿ã»ãã¼ã¿ãã¤ãã³ã°ãªã©ãæ´»ç¨ãã¦ãå¼ç¤¾ã®åãµã¼ãã¹ã¨æ§ã ãªå½¢ã§é£æºãã¦ãããä»åãAmebaãããã¯ã¹ã§ä½¿ç¨ãã¦ããã¬ã³ã¡ã³ãAPIã«åæ£ãã£ãã·ã¥ãå°å ¥ãã¦ã·ã¹ãã è² è·ã軽æ¸ããäºä¾ãç´¹ä»ããã Amebaãããã¯ã¹ Amebaãããã¯ã¹ã§ã¯ãAmebaãå±éãããµã¼ãã¹ã®ä¸ã§ãã¾ããããªãããã¯ãè¨äºãé¸å®ãé ä¿¡ãã¦ããã誰ã«ã©ã®ãããã¯ã表示ãããã«ã¤ãã¦ããã¤ãã®å¤å®ãå¦çãç¬æã«ãããããä»åã®æ¹åã§ä¸å±¤éãã¬ã¹ãã³ã¹ãè¿ããã¨ãã§ããããã«ãªã£ãã å³1. Amebaãããã¯ã¹ã®ããã°ãããã¸ã®é ä¿¡ ã·ã¹ãã æ§æ ä»åãæ¹å対象ã¨ãªã£ãã¬ã³ã¡ã³ãAPIå¨ãã®ã·ã¹ãã æ§æã以ä¸ã®å³2ã«ç¤ºããä¸é¨çç¥ãã¦
Enterprise IT leaders across industries are tasked with preparing their organizations for the technologies of the future â which is no simple task. With the use of AI exploding, Cloudera, in partnership with Researchscape, surveyed 600 IT leaders who work at companies with over 1,000 employees in the U.S., EMEA and APAC regions. The survey, [â¦] Read blog post
Android ã¢ããªãéçºãã¦ãã㨠Apache License, Version 2.0 ã®ã©ã¤ãã©ãªã使ããã¨ãå¤ãã¨æãã¾ãã Licenses | Android Developers ä¸ã®ãã¼ã¸ãè¦ãã¨ãããããã«ãAndroid Open Source Project ã¯åºæ¬çã« Apache License, Version 2.0 ã§ãããAndroid Open Source Project 以å¤ã®ã©ã¤ãã©ãªãè¦ã¦ããAndroid é¢ä¿ã§ã¯ Apache License, Version 2.0 ãå¤æ°æ´¾ã®ããã§ãã ããããããã§ã使ç¨ããæ©ä¼ã®å¤ã Apache License, Version 2.0 ã®ã©ã¤ãã©ãªã§ãããAndroid ã¢ããªã«çµã¿è¾¼ãã¨ãã« (ã©ã¤ã»ã³ã¹çã«) ä½ãããå¿ è¦ãããã®ã調ã¹ãã®ã§ã¾ã¨ãã¦ããã¾ãã æ³å¾ã¨ãã©ã¤ã»ã³ã¹ã«ã¤ãã¦ã¯
第16å Hadoopã½ã¼ã¹ã³ã¼ããªã¼ãã£ã³ã°(2014/05/29) çºè¡¨è³æ ãApache Sparkã®ãç´¹ä»ãï¼ååï¼Sparkã®ããã³ï¼ NTTãã¼ã¿ åºç¤ã·ã¹ãã äºæ¥æ¬é¨ OSSãããã§ãã·ã§ãã«ãµã¼ãã¹ åæ© æ (Masaru Dobashi) http://oss.nttdata.co.jp/ å¾åã¯ãã¡ã â http://www.slideshare.net/hadoopxnttdata/apache-sparkRead less
Apacheã®Filterã¢ã¸ã¥ã¼ã«ãä½ã£ã話ãããããid:c9katayamaã«æ å ±å ¬éããã¨è¨ãããã¾ã¾ã§ããã®ã§å ¬éãã¾ãã Cè¨èªã®åå¼·ãããããªãApache2.xã®ã¢ã¸ã¥ã¼ã«ãä½ã£ã¦ã¿ããããªãgdb使ã£ã¦ãããã°ãã¦ã¿ããããªã¨èãã¦ã人ã«ãå§ãã§ãã Javaã§ã®Servletã®éçºçµé¨ã®ãã人ã§ããã°ãFilterã®å¦çã®åãããªã¯ã¨ã¹ãã³ã³ããã¹ãã®èãæ¹ã¯åããæãã¯ããªã®ã§ãã¨ã³ããªãèªã¿çµããé ã«ã¯Apacheã®ã¢ã¸ã¥ã¼ã«ãgdbã§ãããã°ããªããä½ãäºãåºæ¥ãã¯ãã§ãã mod_orzãä½æ ä»åã¯mod_orzã¨ããApacheã¢ã¸ã¥ã¼ã«ãä½æãã¾ãã Apacheã¢ã¸ã¥ã¼ã«ãä½æããéã«ã¯ãapxsã¨ããã¢ã¸ã¥ã¼ã«éçºç¨ã®ã³ãã³ãã使ç¨ããã³ãã¬ã¼ããä½ãã¾ãã # apxs -g -n orz Creating [DIR] orz Creating [F
Apacheã®è¨å®ã§ Order deny,allowã¨ã Satisfy anyã¨ãããªãã ãæå³ãããã人ã®ããã«ãåã¯ãã£ã¨ããã£ã¦ãªãã£ãã åºæ¬ Apacheã®ã¢ã¯ã»ã¹å¶å¾¡ã«ã¯ã ãã¹ãã«ããå¶å¾¡ (Order,Allow,Deny) ã¦ã¼ã¶èªè¨¼ã«ããå¶å¾¡ (Auth*, Require) ã®2éããããã Satisfyã¯ã2éãããã¢ã¯ã»ã¹å¶å¾¡ã®ä¸¡æ¹ãæºããå¿ è¦ããããã©ããã決å®ãããããã©ã«ãã¯Satisfy allãSatisfy anyãªããã©ã¡ããçæ¹æºããã°ããã Order http://httpd.apache.org/docs/2.2/mod/mod_authz_host.html#order Order deny,allowã¯ãå ¨ã¦ã®ãã¹ãããã®ã¢ã¯ã»ã¹ã許å¯ããã Order allow,denyã¯ãå ¨ã¦ã®ãã¹ãããã®ã¢ã¯ã»ã¹ãæå¦ããã Order d
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}