request of num_proc for all files in load_dataset

[pphuc25]

Feature request

adding num_proc for all files in load_dataset, and also download_config add datasets.DownloadConfig('num_proc=...')

Motivation

With the ever-increasing volume of data in today's world, the process of downloading and extracting data has become excessively time-consuming. It is imperative to optimize and execute these tasks in a more efficient and expeditious manner.

Your contribution

#26326 #26457

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.