Skip to content

Commit

Permalink
[Data] Remove buffer capacity from ShufflingBatcher (#48243)
Browse files Browse the repository at this point in the history
## Why are these changes needed?

the ShufflingBatcher._buffer_capacity field is not used anywhere so we
can remove it.
  • Loading branch information
ArturNiederfahrenhorst authored Oct 25, 2024
1 parent f44890f commit fc34890
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions python/ray/data/_internal/batcher.py
Original file line number Diff line number Diff line change
Expand Up @@ -211,10 +211,6 @@ def __init__(
# Round it up internally to `batch_size` since our algorithm requires it.
# This is harmless since it only offers extra randomization.
shuffle_buffer_min_size = batch_size
self._buffer_capacity = max(
2 * shuffle_buffer_min_size,
shuffle_buffer_min_size + batch_size,
)
self._buffer_min_size = shuffle_buffer_min_size
self._builder = DelegatingBlockBuilder()
self._shuffle_buffer: Block = None
Expand Down

0 comments on commit fc34890

Please sign in to comment.