Skip to content

Commit fc34890

Browse files
[Data] Remove buffer capacity from ShufflingBatcher (#48243)
## Why are these changes needed? the ShufflingBatcher._buffer_capacity field is not used anywhere so we can remove it.
1 parent f44890f commit fc34890

File tree

1 file changed

+0
-4
lines changed

1 file changed

+0
-4
lines changed

python/ray/data/_internal/batcher.py

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -211,10 +211,6 @@ def __init__(
211211
# Round it up internally to `batch_size` since our algorithm requires it.
212212
# This is harmless since it only offers extra randomization.
213213
shuffle_buffer_min_size = batch_size
214-
self._buffer_capacity = max(
215-
2 * shuffle_buffer_min_size,
216-
shuffle_buffer_min_size + batch_size,
217-
)
218214
self._buffer_min_size = shuffle_buffer_min_size
219215
self._builder = DelegatingBlockBuilder()
220216
self._shuffle_buffer: Block = None

0 commit comments

Comments
 (0)