Inaccurate shot detection

[hkunzhe]

In some transitions, the current shot will include partial frames from both the previous shot and the next shot, as in MVq8Q9tKdfU.23_79_485.mp4.

[youthHan]

Do you mean this video?

https://huggingface.co/datasets/mhan/Shot2Story-134K/viewer/multi-shot/43k_human_train?q=MVq8Q9tKdfU&row=1

[youthHan]

It seems correct. It would be appreciated if you find any mistake and we can fix it. Thanks.

[hkunzhe]

@youthHan, Thanks for your reply! I downloaded original videos from #5 . For MVq8Q9tKdfU.23.mp4, I used the ffmpeg to cut MVq8Q9tKdfU.23_79_485.mp4 and MVq8Q9tKdfU.23_486_531.mp4 according to the start frame index and the end frame index.

ffmpeg -i MVq8Q9tKdfU.23.mp4 -vf "select='between(n\,79\,485)',setpts=PTS-STARTPTS" -af "aselect='between(n\,79\,485)',asetpts=PTS-STARTPTS" -vsync cfr MVq8Q9tKdfU.23_79_485.mp4
ffmpeg -i MVq8Q9tKdfU.23.mp4 -vf "select='between(n\,486\,531)',setpts=PTS-STARTPTS" -af "aselect='between(n\,486\,531)',asetpts=PTS-STARTPTS" -vsync cfr MVq8Q9tKdfU.23_486_531.mp4

As shown in two shot videos below, the current shot will include partial frames from both the previous shot and the next shot.

MVq8Q9tKdfU.23_79_485.mp4

MVq8Q9tKdfU.23_486_531.mp4

[youthHan]

This sometimes occurs. The frames are original from the videos, during the shot transitioning.