Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Phi-3.5-vision-instruct and Phi-3-vision-128k-instruct #1609

Merged
Merged
Changes from 1 commit
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
88d42d8
Phi-3.5-vision-instruc
Wovchena Nov 1, 2024
f33328e
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Nov 4, 2024
afdacce
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Nov 7, 2024
9d7c7a0
encode
Wovchena Nov 7, 2024
2531c92
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Nov 13, 2024
98837fb
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Nov 25, 2024
21dc498
Add hd_feature_transformer
Wovchena Nov 27, 2024
b34b14e
actual data infer
Wovchena Nov 29, 2024
9becb41
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Dec 5, 2024
174226f
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Dec 10, 2024
2da8658
align tokenizers
Wovchena Dec 10, 2024
27d913d
skip resize
Wovchena Dec 11, 2024
66f75d5
vision
Wovchena Dec 12, 2024
c7fc21c
regex
Wovchena Dec 12, 2024
1614a1d
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Jan 6, 2025
83834a2
code style
Wovchena Jan 8, 2025
524982f
Revert "code style"
Wovchena Jan 8, 2025
edb2dc1
working chat
Wovchena Jan 9, 2025
f4c8bb8
Put resize back
Wovchena Jan 9, 2025
2d988ab
clean up
Wovchena Jan 9, 2025
ffdf449
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Jan 9, 2025
6e24a25
clean up
Wovchena Jan 9, 2025
3fd78e4
fix compilation
Wovchena Jan 9, 2025
91b170f
fix prefix
Wovchena Jan 9, 2025
793e4c8
Add instructions to reproduce
Wovchena Jan 10, 2025
670d942
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Jan 14, 2025
bab2d46
Split get_encoded_input_ids
Wovchena Jan 14, 2025
b3ca05a
sintax
Wovchena Jan 14, 2025
cbb354c
Merge branch 'master' into phi-3.5-vision-instruct
Wovchena Jan 15, 2025
02d36b5
Phi-3.5-vision-instruc history
Wovchena Jan 15, 2025
9336dac
Save tokens per image
Wovchena Jan 17, 2025
6ea9abc
Merge branch 'releases/2025/0' into phi-3.5-vision-instruct
Wovchena Jan 17, 2025
ea3f23e
Merge branch 'phi-3.5-vision-instruct' into Phi-3.5-vision-instruc-hi…
Wovchena Jan 20, 2025
0652749
Resolve merge conflict
Wovchena Jan 20, 2025
d546486
clean up
Wovchena Jan 20, 2025
ac16d4d
Merge branch 'master' into Phi-3.5-vision-instruc-history
Wovchena Jan 20, 2025
98f73e2
clean up
Wovchena Jan 20, 2025
a5c63dd
Remove comment
Wovchena Jan 21, 2025
0d08310
Freeze mac OV_BRANCH
Wovchena Jan 22, 2025
e2c7999
Merge branch 'master' into Phi-3.5-vision-instruc-history
Wovchena Jan 22, 2025
066d972
Add notes
Wovchena Jan 22, 2025
313050d
Merge branch 'master' into Phi-3.5-vision-instruc-history
ilya-lavrenov Jan 22, 2025
03a29fc
Extend notes
Wovchena Jan 22, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove comment
Wovchena committed Jan 21, 2025
commit a5c63dd5f1ad87e66238152c6ac9b021e203eb43
2 changes: 1 addition & 1 deletion src/cpp/src/visual_language/vision_encoder.cpp
Original file line number Diff line number Diff line change
@@ -992,7 +992,7 @@ ov::Tensor transpose_image_patches_qwen2vl(const ov::Tensor& reshaped_patches) {

return transposed_patches;
}
} // anonymous namespace
}

VisionEncoder::VisionEncoder(const std::filesystem::path& model_dir, const VLMModelType model_type, const std::string& device, const ov::AnyMap device_config) :
model_type(model_type) {