Video transcription

Video transcription enables you to automatically generate an audio transcript from a video file. You can use the resulting file can to display a full video transcript alongside your video, added as a text track for standard subtitles, or used for paced subtitles with the Cloudinary Video Player. Transcript generation identifies the language used in the audio and generates the transcript in the correct language.

Use the Cloudinary Video Transcription service to generate your transcripts during upload, via the explicit method on existing assets, trigger generation from the Video Player Studio, or directly from the video player when configuring text tracks. Use the transcript editor to easily edit and refine your generated transcripts.

Alternatively, you can use an add-on, either Google AI Video Transcription or Microsoft Azure Video Indexer.

Requesting transcription

To request transcription, set the auto_transcription boolean parameter to true as part of your upload request:

Auto transcription happens asynchronously after your original method call completes. Thus your original method call response displays a pending status:

When the request is complete (may take several seconds or minutes depending on the length of the video), a new raw file gets created in your product environment with the same public ID as your video or audio file and with the .transcript file extension.

For example:

my-video.transcript

If you also provided a notification_url in your method call, the specified URL then receives a notification when the process completes:

Requesting translation

As well as generating a transcript in the native language of the audio, you can also request to generate translated transcriptions. Each translated transcript gets generated alongside the main transcript file with the country and language code appended.

For example:

my-video.en-US.transcript

To trigger translation, set the auto_transcription parameter to an object containing a translate parameter with an array of country and language codes to translate to, for example to generate transcript translations into French, Spanish and German:

Auto transcription happens asynchronously after your original method call completes. Thus your original method call response displays a pending status:

Use your translated transcripts with the Cloudinary Video Player to provide subtitles in multiple languages for your videos.

Requesting transcription from the video player

You can also trigger automatic transcription directly from the Cloudinary Video Player when configuring text tracks without specifying a URL. When you set up subtitles or captions without providing a transcript file, the player can automatically generate one if you've enabled Auto transcription in your account's unsigned actions settings.

For example:

This approach is particularly useful for on-demand transcript generation when you want subtitles but haven't pre-generated the transcript files. For complete details on setting up AI generation from the player, see AI generation.

Cloudinary transcript files

The created .transcript file includes details of the audio transcription, for example:

Each excerpt of text has a confidence value, followed by a breakdown of individual words and their specific start and end times.

Displaying transcripts with the Cloudinary Video Player

You can display your generated transcripts as a text track for subtitles or captions using the Cloudinary Video Player. You can also make use of the advanced information generated to add paced subtitles or word highlighting. To add your transcript, set the textTracks parameter with the relevant configuration.

For transcripts, you don't need to provide a URL as the player assumes the transcript exists with the same public ID as the video. If you set the language, the player looks for the corresponding file with language code appended to the public ID, otherwise it falls back to the original. To control the number of words shown for each line of the transcript, use the maxWords parameter, as shown below.

Here's an example:

And here's an example using translated transcripts:

Transcript and Localization editor

The Transcript and Localization editor enables you to generate, edit, and manage transcripts and translations for videos in your Media Library. You can trigger generation of transcripts using the transcription service, edit the generated transcript to ensure the audio matches exactly with the text, and manage multilingual subtitles for your videos.

To open the editor, navigate to the Video Player Studio and select the Transcript and Localization section.

Editing transcripts

The editor supports adding and editing lines, as well as the individual words within each line. This allows you to refine the automatically generated transcript to ensure accuracy and proper timing.

Managing translations

Click the Manage button to access the language management interface for organizing and controlling multilingual subtitles. This interface provides comprehensive tools for managing your translated transcripts:

• Add translations - Generate new translations directly from the interface
• Reorder languages - Drag and drop subtitle languages to control the order they appear to viewers
• Toggle availability - Enable or disable translations for viewer access
• Set default language - Choose which language displays first when viewers load the video
• Export subtitles - Download any language in .vtt or .srt format with a single click

This centralized interface makes it easy to organize existing languages and control how multilingual subtitles get presented to viewers.