Skip to content

Latest commit

 

History

History
90 lines (82 loc) · 3.14 KB

File metadata and controls

90 lines (82 loc) · 3.14 KB

High-Level Overview

The Apache Arrow Java modules implement various specifications including the columnar format and IPC. Most modules are native Java implementations, but some modules are JNI bindings to the C++ library.

Arrow Java Modules
Module Description Implementation
arrow-format Generated Java files from the IPC Flatbuffer definitions. Native
arrow-memory-core Core off-heap memory management libraries for Arrow ValueVectors. Native
arrow-memory-unsafe Memory management implementation based on sun.misc.Unsafe. Native
arrow-memory-netty Memory management implementation based on Netty. Native
arrow-vector An off-heap reference implementation for Arrow columnar data format. Native
arrow-tools Java applications for working with Arrow ValueVectors. Native
arrow-jdbc (Experimental) A library for converting JDBC data to Arrow data. Native
flight-core An RPC mechanism for transferring ValueVectors. Native
flight-sql Contains utility classes to expose Flight SQL semantics for clients and servers over Arrow Flight. Native
flight-integration-tests Integration tests for Flight RPC. Native
arrow-performance JMH benchmarks for the Arrow libraries. Native
arrow-algorithm (Experimental) A collection of algorithms for working with ValueVectors. Native
arrow-avro (Experimental) A library for converting Avro data to Arrow data. Native
arrow-compression (Experimental) A library for working with compression/decompression of Arrow data. Native
arrow-c-data Java implementation of C Data Interface JNI
arrow-orc (Experimental) A JNI wrapper for the C++ ORC reader implementation. JNI
arrow-gandiva Java wrappers around the native Gandiva SQL expression compiler. JNI
arrow-dataset Java bindings to the Arrow Datasets library. JNI

Arrow Java modules support working with data (1) in-memory, (2) at rest, and (3) on-the-wire.