Skip to content

[Variant] Avoid collecting offset iterator #7901

@friendlymatthew

Description

@friendlymatthew

Related to #7878

map_bytes_to_offsets is a utility that transforms a byte buffer into an iterator of offsets, based on a given size.

It is used in several places throughout the validation code.

In all cases, we can avoid materializing the iterator with .collect() by instead looping over it directly and moving the relevant checks into that loop

Metadata

Metadata

Assignees

Labels

enhancementAny new improvement worthy of a entry in the changelogparquetChanges to the parquet crate

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions