Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug in build bert #2373

Closed
Alireza3242 opened this issue Oct 24, 2024 · 1 comment
Closed

Bug in build bert #2373

Alireza3242 opened this issue Oct 24, 2024 · 1 comment
Labels
bug Something isn't working triaged Issue has been triaged by maintainers

Comments

@Alireza3242
Copy link

I want to build a bert model with tensorrt 0.13

python3 /app/src/convert/build.py --model BertForSequenceClassification --model_dir /app/data/model --output_dir /app/data/tllm_checkpoint --dtype float16

response:

[TensorRT-LLM] TensorRT-LLM version: 0.13.0
[10/24/2024-21:38:25] [TRT] [I] [MemUsageChange] Init CUDA: CPU +14, GPU +0, now: CPU 151, GPU 432 (MiB)
[10/24/2024-21:38:27] [TRT] [I] [MemUsageChange] Init builder kernel library: CPU +1995, GPU +366, now: CPU 2302, GPU 798 (MiB)
[10/24/2024-21:38:27] [TRT-LLM] [W] Invalid timing cache, using freshly created one
Traceback (most recent call last):
  File "/app/src/convert/tookabert/build.py", line 279, in <module>
    if args.model_dir is not None and os.path.exist(
AttributeError: module 'posixpath' has no attribute 'exist'. Did you mean: 'exists'?
@Superjomn Superjomn added bug Something isn't working triaged Issue has been triaged by maintainers build labels Oct 27, 2024
@symphonylyh
Copy link
Collaborator

good catch. yes it should be os.path.exists. fixed internally now adn we'll release it in next week's main branch update. closing for now. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

3 participants