Add Caption Files to Section During Processing

[joncameron]

Description

Media files added to Avalon may contain caption data within. Right now if a user has a container file with captions, they must process the file to pull the caption data into a separate file, then attach the captions file to the record in Avalon.

See #2964 for a similar issue relating to pulling data/metadata from files upon ingest.

Caption Types

• There are many caption formats; to begin we can only support the existing supported formats. Having ffmpeg convert the existing embedded text into a VTT could also be a way to handle this.

Example File

This file contains Lunchroom Manners with the existing VTT for testing embedded into the container:

• https://drive.google.com/file/d/13KTK8LOrhp5c5n95wmqwHI0pJc8AZoRg/view?usp=drive_link

Active Encode will need to be updated to be able to pull out these supplemental files, and Avalon should be able to see that the data is there and create an Active Storage record for the data. One caveat is that this would be used for the ffmpeg adapter, but it might require extra effort for the AWS adapter. This could possibly be a feature that is restricted to the ffmpeg adapter, at least for the first pass.

Done Looks Like

• Active Encode looks for caption/subtitle data in in media files during processing
• Valid caption data is written to a caption file and attached to the media file in Avalon if present

[elynema]

Option for 8.0 release; depends on effort

[joncameron]

Poster and thumbnail would be a nice thing to have in addition; others would be spritemaps for trick mode, waveforms, etc.

[elynema]

Josh Bennett over at Media School is using Adobe Premier to create transcripts / captions for his media before uploading into MCO, so he is a potential collection owner who could test this out.