Skip to content

Build an arrow table in one pass #767

@gadomski

Description

@gadomski

Right now we do two passes through our items to create a table:

  1. Pop geometries and add them to their geometry builders, explode bbox to an object
  2. Infer schema using infer_json_schema_from_iterator

It'd be nice to do this one pass. It's a little tricky because we manage state while iterating, and the infer_json_schema_from_iterator Item type demands an ArrowError which is a little awkward, since we have other errors that pop up while iterating.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions