Cloudinary Blog

Setting up Automatic AI Content-Recognition Tagging in the Cloudinary DAM

Auto AI Content Recognition Tagging in Cloudinary DAM

Automating the categorization of your images and videos can help democratize access to your organization's creative assets. Many teams throughout your organization have likely spent a lot of time and effort generating high-quality content, but it'd be all for naught if the content just ends up in some anonymous folder on somebody's hard drive or is randomly dropped into your cloud storage with no functional organizational strategy.

So, how do you efficiently organize your digital assets, making them easier to find, use, or repurpose? AI content-recognition tagging is a great way to add intelligence and categorize your assets. While not perfect, machine learning is becoming more robust and more accurate every day.

API-based Cloudinary can integrate with any AI tool. Additionally, Cloudinary offers powerful and effective direct integrations, which require no additional programming on your part. The steps below walk you through the process of setting up your Cloudinary account to automatically tag all your new digital assets—with no coding from you.

Step 1: Log in to the Cloudinary Console.

After logging in, you see your Dashboard, similar to this one:

Cloudinary Dashboard

Step 2: Click Add-ons in the top navigation.

Add-ons Link

You now see a list of Cloudinary's add-ons, which are services external to Cloudinary's core that we've integrated into our API workflow. Note the four options for AI tagging:

Relevant Add-ons

Click each of those options and then click Free under Plan to add the integrations to your Cloudinary account.

Subscription to the free Add-on tier

Even though the Free Plan allows only a limited number of categorizations for add-ons, it’s adequate for you to test the services against one another before deciding which one or ones to adopt. Each machine-learning add-on has strengths and weaknesses so it's important that you figure out which one works best for you.

Now that you’ve subscribed to the various AI tagging add-ons, configure your account to automatically tag newly uploaded assets. To do that, set up an upload preset for each of the services.

Step 3: Navigate to Settings.

Click this gear wheel near the top-right corner of the Cloudinary Dashboard:

Icon of the Settings Page

The Settings page is then displayed:

Settings Page

Step 4: Click the Upload tab.

Click the Upload tab near the top of the Settings page and then scroll down all the way to the Upload presets section.

Upload Presets

Your display might look different, depending on whether you have upload presets already set up.

Upload presets are operations you want Cloudinary to perform when an asset is uploaded. They are extremely useful: You can set them up to, for example, create image and video derivatives upon upload; send the derivatives to a moderation queue, a service, or both, for filtering out inappropriate or unwanted content; down-sample and compress assets before saving; and so forth. With upload presets in Cloudinary, you can also send assets through an AI content-recognition service and automatically tag them with the results.

Step 5: Click the Add upload preset link.

Creation of upload presets

Repeat steps 6 and 7 below for each AI-tagging vendor, after which you can easily switch between defaults.

Step 6: Create the upload preset.

In the first input field, type a descriptive name for the preset, such as AWS Rekognition Auto Tagging.

Next, scroll down to the bottom and click the Advanced Options link:

Advanced options for uploading presets

Scroll down more to the Categorization drop-down menu and choose Amazon Rekognition Tagging:

AI-categorization Options

Afterwards, define a confidence threshold in which to assign tags. The raw result returns a load of details, most of which I'd call "semi-educated guesses." To eliminate the clutter, filter only the tags that the AI understands. Do the following:

In the Auto tagging field, type 0.7 to denote 70-percent confidence, which means that Cloudinary adds, as a tag, all the assets that the machine-learning algorithm is over 70-percent confident are in the image.

Setup of a confidence level for AI tagging

Finally, scroll down all the way to the bottom and click Save. Cloudinary then returns you to the Settings page, on which your newly created upload preset is displayed in the Upload presets section.

Step 7: Make your upload preset the default.

In the Default upload preset drop-down menu, choose your newly-created upload preset and then click Save.

Setup and saving of your default upload preset

Tip: To play safe, test the above procedure in a separate subaccount before moving into your production cloud.

Note
If you exceed the free-tier quota for auto tagging, an error results upon upload and you must upgrade to the appropriate plan to proceed. Contact Cloudinary Support if you exceed the largest plan available.

From now on, all uploads into Cloudinary will be automatically tagged, organized for fast retrieval. Give it a whirl!

Recent Blog Posts

Building a Live Feed of FIFA World Cup Moments

Widely acclaimed as the world’s biggest sporting event, the World Cup has established itself as the most captivating tournament to look forward to across the globe. Dating back to 1930, when the first World Cup was hosted in Uruguay, it has always engendered numerous moments of excitement, not only for the participating teams but also for the countries they ably represented. Little could anyone have anticipated that a game of 22 able-bodied men running to take possession of a leather ball could become so famous.

Read more
Capitol 360 Incubating New Waves of MusicTech

Last month, we had the pleasure of supporting Capitol Music Group’s first ever hackathon, the first in a series of hackathons as part of its newly launched Capitol360 Innovation Center, established to bridge the gaps between music and tech and make music better for everyone. We are proud to be a founding technology partner and were honored to play a part in Capitol’s first-ever 24-hour hack. And because so many of us are avid and longtime music fans we’re also personally thrilled to have the opportunity to work with one of the most influential leaders in music to foster these new and meaningful connections.

Read more
Headshot transformations from Fluent + Velocity 2018

On June 13-14, O'Reilly held its annual Fluent + Velocity conference in San Jose and it was great! Cloudinary set up a pretty incredible booth and brought in a professional photographer to take headshots of the attendees who stopped by. Once a photo was snapped, the raw camera file was immediately uploaded to our media library and transformed into something that can be posted right away on LinkedIn.

Read more
Reimaging DAM--The Next-Gen DAM for Marketing & Dev

There are great digital asset management (DAM) products out there for uploading, storing, managing, organizing, and sharing digital assets. With Cloudinary's new end-to-end DAM solution, you can also upload and manage your assets efficiently, but the journey doesn't end there. It continues on to the development and delivery stages, so that your assets can be seamlessly manipulated, optimized, and delivered to create an engaging user experience that will in turn, increase conversion and loyalty.

Read more
Integrating Cloudinary with Forestry’s Media Library

At Forestry, we believe that there is a bright future for static HTML sites built with tools like Jekyll and Hugo. These tools can create sites that run well, and are easy to host and maintain, because they don’t require any server-side code.

Read more