Cloudinary Blog

Setting up Automatic AI Content-Recognition Tagging in the Cloudinary DAM

Auto AI Content Recognition Tagging in Cloudinary DAM

Automating the categorization of your images and videos can help democratize access to your organization's creative assets. Many teams throughout your organization have likely spent a lot of time and effort generating high-quality content, but it'd be all for naught if the content just ends up in some anonymous folder on somebody's hard drive or is randomly dropped into your cloud storage with no functional organizational strategy.

So, how do you efficiently organize your digital assets, making them easier to find, use, or repurpose? AI content-recognition tagging is a great way to add intelligence and categorize your assets. While not perfect, machine learning is becoming more robust and more accurate every day.

API-based Cloudinary can integrate with any AI tool. Additionally, Cloudinary offers powerful and effective direct integrations, which require no additional programming on your part. The steps below walk you through the process of setting up your Cloudinary account to automatically tag all your new digital assets—with no coding from you.

Step 1: Log in to the Cloudinary Console.

After logging in, you see your Dashboard, similar to this one:

Cloudinary Dashboard

Step 2: Click Add-ons in the top navigation.

Add-ons Link

You now see a list of Cloudinary's add-ons, which are services external to Cloudinary's core that we've integrated into our API workflow. Note the four options for AI tagging:

Relevant Add-ons

Click each of those options and then click Free under Plan to add the integrations to your Cloudinary account.

Subscription to the free Add-on tier

Even though the Free Plan allows only a limited number of categorizations for add-ons, it’s adequate for you to test the services against one another before deciding which one or ones to adopt. Each machine-learning add-on has strengths and weaknesses so it's important that you figure out which one works best for you.

Now that you’ve subscribed to the various AI tagging add-ons, configure your account to automatically tag newly uploaded assets. To do that, set up an upload preset for each of the services.

Step 3: Navigate to Settings.

Click this gear wheel near the top-right corner of the Cloudinary Dashboard:

Icon of the Settings Page

The Settings page is then displayed:

Settings Page

Step 4: Click the Upload tab.

Click the Upload tab near the top of the Settings page and then scroll down all the way to the Upload presets section.

Upload Presets

Your display might look different, depending on whether you have upload presets already set up.

Upload presets are operations you want Cloudinary to perform when an asset is uploaded. They are extremely useful: You can set them up to, for example, create image and video derivatives upon upload; send the derivatives to a moderation queue, a service, or both, for filtering out inappropriate or unwanted content; down-sample and compress assets before saving; and so forth. With upload presets in Cloudinary, you can also send assets through an AI content-recognition service and automatically tag them with the results.

Step 5: Click the Add upload preset link.

Creation of upload presets

Repeat steps 6 and 7 below for each AI-tagging vendor, after which you can easily switch between defaults.

Step 6: Create the upload preset.

In the first input field, type a descriptive name for the preset, such as AWS Rekognition Auto Tagging.

Next, scroll down to the bottom and click the Advanced Options link:

Advanced options for uploading presets

Scroll down more to the Categorization drop-down menu and choose Amazon Rekognition Tagging:

AI-categorization Options

Afterwards, define a confidence threshold in which to assign tags. The raw result returns a load of details, most of which I'd call "semi-educated guesses." To eliminate the clutter, filter only the tags that the AI understands. Do the following:

In the Auto tagging field, type 0.7 to denote 70-percent confidence, which means that Cloudinary adds, as a tag, all the assets that the machine-learning algorithm is over 70-percent confident are in the image.

Setup of a confidence level for AI tagging

Finally, scroll down all the way to the bottom and click Save. Cloudinary then returns you to the Settings page, on which your newly created upload preset is displayed in the Upload presets section.

Step 7: Make your upload preset the default.

In the Default upload preset drop-down menu, choose your newly-created upload preset and then click Save.

Setup and saving of your default upload preset

Tip: To play safe, test the above procedure in a separate subaccount before moving into your production cloud.

Note
If you exceed the free-tier quota for auto tagging, an error results upon upload and you must upgrade to the appropriate plan to proceed. Contact Cloudinary Support if you exceed the largest plan available.

From now on, all uploads into Cloudinary will be automatically tagged, organized for fast retrieval. Give it a whirl!

Recent Blog Posts

Mobile Optimization: Optimize Your Mobile-Web User Experience

TL;DR

We live in a visual world, often while on the go, and consumers expect media-rich web content. Accordingly, the loading speed of images and videos is a big factor in user experience. To optimize customer satisfaction with your mobile content, you must focus on the quality, format, and size of your digital assets. With Cloudinary, optimization is simple, not only enhancing your mobile web and app performance, but also upping your SEO game and boosting customer experience.

Read more
Multi Codec Adaptive Bitrate Streaming

In Part I of this series, we discussed the optimal way to deliver progressive video streams, taking advantage of modern, efficient codecs. That approach works great for short-form videos (under 20 seconds) and for videos that are displayed at a low resolution (such as ads and previews). But what if you're delivering videos that are longer than 20 seconds for a higher-resolution experience? You can certainly still deliver them as a single file (progressive streaming), but you might run into issues, such as buffering or too high a resolution.

Read more
Why Visual Storytelling Matters

In my communications role here at Cloudinary, I get to speak to a lot of experts across a variety of subject matter areas, technology and not, about what it takes to connect to today’s consumer. The power of images and other forms of digital content is often at the center of these conversations given our focus at Cloudinary. And as a hobbyist and professional photographer for more than 20 years, I care deeply about images and their role in creating authentic connections and engagement.

Read more
How to Automatically Generate alt Text for Images

Images and videos are critical for ensuring user engagement on the web. For instance, on a retail website, images of a product from different angles or a 360-degree video of the product can lead to higher conversion rates. For a news website, users are more likely to read articles with visual media accompanying the content. It has been reported that posts that include images produce a 650-percent higher user-engagement rate than text-only posts.

Read more