Skip to content

Commit

Permalink
fix import error
Browse files Browse the repository at this point in the history
Signed-off-by: Zhang, Weiwei1 <weiwei1.zhang@intel.com>
  • Loading branch information
WeiweiZhang1 committed Jan 17, 2025
1 parent 0b765ac commit 35512fe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion auto_round/calib_dataset.py
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@ def get_pile_val_dataset(tokenizer, seqlen, dataset_name="swift/pile-val-backup"
from transformers.utils.versions import require_version
require_version("modelscope",
"Loading swift/pile-val-backup dataset requires modelscope to be installed, `pip install modelscope`")
from modelscope import MsDataset
from modelscope import MsDataset # pylint: disable=E0401
calib_dataset = MsDataset.load('swift/pile-val-backup',
'default', split=split).to_iterable_dataset() #, use_streaming=True
calib_dataset = calib_dataset.take(10000)
Expand Down

0 comments on commit 35512fe

Please sign in to comment.