Programmable Media release notes: June 27, 2024

New features

AI Auto-Transcription

Automatically generate transcripts for your videos that you can use to show subtitles or captions using the Cloudinary Video Player. Our new auto-transcript feature uses OpenAI’s Whisper model, a state-of-the-art speech recognition implementation. By running this entirely on our infrastructure, we ensure that your videos are not sent to any third-party vendors.

While captions and subtitles are the most obvious uses for transcripts, their importance extends far beyond these functions:

• Transcripts allow the content to be searchable and discoverable and it’s imperative for efficient management and secure allocation of your valuable assets.
• Transcripts provide a text base that can be easily translated into multiple languages, making it simpler to localize content for global audiences.
• Transcripts allow for detailed analysis of spoken content, which can be useful for research, content evaluation, and extracting insights for business intelligence, educational materials, audit logs, and more.
• Having a transcript makes the editing process more efficient. Editors can identify sections that need trimming or enhancement without repeatedly watching the footage.

Upload your video via the upload API with the auto_transcription parameter set to true, and our system will handle the transcription process.

Alternatively, you can use an Upload Preset to enable auto transcription automatically during upload. For existing assets, apply auto transcription by setting the auto_transcription parameter using the explicit method.

The transcript will be generated and saved as a .transcript file with the same public ID as the video.

Learn more

AI Auto-Chaptering

Experience the magic of effortless video chapter creation using the new AI Chaptering feature. AI Chaptering is a shortcut to hassle-free video chapters so you can automate the creation of chapters on every video upload, using upload presets, or using the Upload API directly. You can also easily adjust the titles and timings to match your creative preferences, saving you time and simplifying your video workflow.

Upload your video via the upload API with the auto_chaptering parameter set to true, and our system will handle the chaptering process.

Alternatively, you can use an Upload Preset to enable auto chaptering automatically during upload. For existing assets, apply auto chaptering by setting the auto_chaptering parameter using the explicit method.

The chapters will be generated and saved as a .vtt file e.g <public_id>-chapters.vtt. Then, to enable chapters in the video player use chapters: true using the Video Player SDK:

Learn more

Announcements

JPEG2000 support deprecation

Apple has announced that there IOS 18 update will remove support for JPEG2000 (jp2) in the Safari browser, and because it is an older and less efficient format, this format will no longer be returned when using Cloudinary's automatic format selection (f_auto).

If needed, you can still explicitly generate an image in the .jp2 format using f_jp2 or setting jp2 as the extension for a delivery URL.

Announcements

2M Developers Campaign

If you’re reading this, you’re probably already one of the two million Cloudinary users taking advantage of our "bottomless toolkit" of image and video management and delivery API features!

To celebrate hitting this amazing milestone, Cloudinary's giving away 50 special campaign hoodies to users who share their favorite Cloudinary projects or platform features on LinkedIn, Twitter or Instagram until the 5th of July.

All you have to do to enter the draw, is to share your Cloudinary success story or project using the hashtag #2MCloudinaryDevs so we can celebrate your great work!

Learn more

Register for notifications

Make sure you always know when new release notes are published:

• Programmable Media release notes RSS feed: Grab this RSS link to watch for new Programmable Media release notes in your favorite RSS reader.

• Cloudinary Discord: Join the Cloudinary Discord server and keep an eye on the #cloudinary-news channel. Our RSS feeds will automatically be pushed there whenever new release notes are published.