-
Couldn't load subscription status.
- Fork 1.7k
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem or challenge?
I noticed it when reviewing #18207
When writing spill files in the sort executor, it requires some pre-processing steps for the batches to spill to avoid duplicate writes, specifically
| Self::organize_stringview_arrays(globally_sorted_batches)?; |
This step should apply to all spilling usages, not only limited to the sort executor, so a better way is to put it inside SpillManager/InProgressSpillFile, or maybe Arrow IPC writer if possible.
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request