Skip to content

A standard field/column description in metadata #48696

@simonaubertbd

Description

@simonaubertbd

Describe the enhancement requested

Hello,

From what I understand, we can add custom metadata with a key pair system like described here :
https://arrow.apache.org/docs/python/generated/pyarrow.Field.html#pyarrow.Field.with_metadata

This is very powerful but what would be even better for interoperability to also have a field/column description with a standardized name.
Field description is probably the most common metadata, it exists in SQL, in most of industry software such as Tableau, Alteryx, Dataïku and it would definitly help to have it with a standard name in Arrow

(please note I asked for the same enhancement for Apache parquet here : apache/parquet-format#447 )

Best regards,

Simon

Component(s)

Python

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions