Skip to content

[LLM] [NPU] StaticLLMPipeline: support weightless caching #7540

[LLM] [NPU] StaticLLMPipeline: support weightless caching

[LLM] [NPU] StaticLLMPipeline: support weightless caching #7540

cpp-greedy_causal_lm-windows

succeeded Jan 31, 2025 in 37m 15s
Set up job
2s
Run actions/checkout@v4
22s
Run actions/setup-python@v4
0s
Run curl --output ov.zip https://storage.openvinotoolkit.org/repositories/openvino/packages/nightly/2025.1.0-17911-83c047443de/w_openvino_toolkit_windows_2025.1.0.dev20250116_x86_64.zip
3s
Run unzip -d ov ov.zip
5s
Run dirs=(ov/*) && mv ov/*/* ov && rmdir "${dirs[@]}"
0s
Build app
13m 53s
Download and convert model
21m 10s
Run set PATH=.\build\openvino_genai\;%PATH% && call .\ov\setupvars.bat && .\build\samples\cpp\text_generation\Release\greedy_causal_lm.exe .\TinyLlama-1.1B-Chat-v1.0\ 69 > .\cpp.txt
10s
Run echo import transformers > ref.py
0s
Run python ref.py
39s
Run set PATH=.\build\openvino_genai\;%PATH% && set "PYTHONPATH=./build/" && call .\ov\setupvars.bat && python samples\python\text_generation\greedy_causal_lm.py .\TinyLlama-1.1B-Chat-v1.0\ 69 > .\py.txt
10s
Run fc .\cpp.txt .\py.txt
0s
Run set PATH=.\build\openvino_genai\;%PATH% && set "PYTHONPATH=./build/" && call .\ov\setupvars.bat && python samples\python\text_generation\lora.py .\TinyLlama\TinyLlama-1.1B-intermediate-step-1431k-3T\ adapter_model.safetensors "How to create a table with two columns, one of them has type float, another one has type int?"
37s
Post Run actions/setup-python@v4
0s
Post Run actions/checkout@v4
1s
Complete job
0s