Skip to content
/ StreamChat Public

Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025

License

MIT license
13 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

hmxiong/StreamChat

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
freeva
freeva
 
 
kmeans_pytorch
kmeans_pytorch
 
 
llamavid
llamavid
 
 
llava
llava
 
 
llava_hound
llava_hound
 
 
llavanext
llavanext
 
 
llavavid
llavavid
 
 
longva
longva
 
 
pic
pic
 
 
previous_version
previous_version
 
 
rag_memory
rag_memory
 
 
test_other_models
test_other_models
 
 
tools
tools
 
 
torch_kmeans
torch_kmeans
 
 
vila
vila
 
 
LICENSE
LICENSE
 
 
Multimodal_RAG.py
Multimodal_RAG.py
 
 
README.md
README.md
 
 
calculate_avg_score.py
calculate_avg_score.py
 
 
calculate_class_score.py
calculate_class_score.py
 
 
calculate_score.py
calculate_score.py
 
 
delay.json
delay.json
 
 
ego_data.py
ego_data.py
 
 
eval_ego_streaming_with_llama3.py
eval_ego_streaming_with_llama3.py
 
 
eval_video_qa_with_llama3.py
eval_video_qa_with_llama3.py
 
 
eval_video_qa_with_llama3_ours.py
eval_video_qa_with_llama3_ours.py
 
 
filter_data.sh
filter_data.sh
 
 
inference_baseline_2.py
inference_baseline_2.py
 
 
inference_baseline_3.py
inference_baseline_3.py
 
 
inference_qa.py
inference_qa.py
 
 
inference_stream_chat_v0.3_longvila.sh
inference_stream_chat_v0.3_longvila.sh
 
 
inference_stream_chat_v0.3_longvila_chunk_40.sh
inference_stream_chat_v0.3_longvila_chunk_40.sh
 
 
inference_stream_chat_v0.3_vila.sh
inference_stream_chat_v0.3_vila.sh
 
 
inference_streamchat_v0.3.sh
inference_streamchat_v0.3.sh
 
 
inference_streaming_longva.py
inference_streaming_longva.py
 
 
inference_streaming_longva_fast.py
inference_streaming_longva_fast.py
 
 
inference_streaming_longva_offline.py
inference_streaming_longva_offline.py
 
 
inference_streaming_longva_sample.py
inference_streaming_longva_sample.py
 
 
inference_streaming_longvila_offline.py
inference_streaming_longvila_offline.py
 
 
inference_streaming_qwen_vl_offline.py
inference_streaming_qwen_vl_offline.py
 
 
inference_streaming_video.py
inference_streaming_video.py
 
 
inference_streaming_vila_offline.py
inference_streaming_vila_offline.py
 
 
inference_video_bench.py
inference_video_bench.py
 
 
inference_video_bench.sh
inference_video_bench.sh
 
 
ixc_utils.py
ixc_utils.py
 
 
multi_round_conv.py
multi_round_conv.py
 
 
requirement.txt
requirement.txt
 
 
streaming_demo.py
streaming_demo.py
 
 
streaming_demo.sh
streaming_demo.sh
 
 
streaming_demo_longvlm_ego.py
streaming_demo_longvlm_ego.py
 
 
streaming_demo_longvlm_ego_fast.py
streaming_demo_longvlm_ego_fast.py
 
 
test_longva.py
test_longva.py
 
 
test_openai_gemini.py
test_openai_gemini.py
 
 
test_phi.py
test_phi.py
 
 
test_thred.py
test_thred.py
 
 
test_tts.py
test_tts.py
 
 
utiles.py
utiles.py
 
 
video_data_filter.py
video_data_filter.py
 
 
video_envent.py
video_envent.py
 
 

Repository files navigation

StreamChat

Official repo for "[Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge]" ICLR2025🎉 Coming soon, stay tuned

🔥 News

[2025.11] 🔥 Release repo and test code.

TODO:

  • Test code.
  • [] Data for StreaBench.
  • [] Demo.

🚩 Approach

framework

🏃‍♂️ Getting Started

🌟 Citation

🤗 Acknowledgement

About

Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025

Resources

Readme

License

MIT license
Activity

Stars

13 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages