Skip to content

Commit 237b44c

Browse files
carmoccaBordatchaton
authored
Mention how the progress bar updates (#75)
Co-authored-by: Jirka Borovec <[email protected]> Co-authored-by: tchaton <[email protected]>
1 parent 015a546 commit 237b44c

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

src/litdata/processing/data_processor.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -949,7 +949,10 @@ def run(self, data_recipe: DataRecipe) -> None:
949949

950950
self._cleanup_cache()
951951

952-
print(f"Starting {self.num_workers} workers with {num_items} items.")
952+
print(
953+
f"Starting {self.num_workers} workers with {num_items} items."
954+
f" The progress bar is only updated when a worker finishes."
955+
)
953956

954957
if self.input_dir is None and self.src_resolver is not None and self.input_dir:
955958
self.input_dir = self.src_resolver(self.input_dir)

0 commit comments

Comments
 (0)