Cloudinary Blog

Setting up Automatic AI Content-Recognition Tagging in the Cloudinary DAM

Auto AI Content Recognition Tagging in Cloudinary DAM

Automating the categorization of your images and videos can help democratize access to your organization's creative assets. Many teams throughout your organization have likely spent a lot of time and effort generating high-quality content, but it'd be all for naught if the content just ends up in some anonymous folder on somebody's hard drive or is randomly dropped into your cloud storage with no functional organizational strategy.

Webinar
Marketing Without Barriers Through Dynamic Asset Management

So, how do you efficiently organize your digital assets, making them easier to find, use, or repurpose? AI content-recognition tagging is a great way to add intelligence and categorize your assets. While not perfect, machine learning is becoming more robust and more accurate every day.

API-based Cloudinary can integrate with any AI tool. Additionally, Cloudinary offers powerful and effective direct integrations, which require no additional programming on your part. The steps below walk you through the process of setting up your Cloudinary account to automatically tag all your new digital assets—with no coding from you.

Step 1: Log in to the Cloudinary Console.

After logging in, you see your Dashboard, similar to this one:

Cloudinary Dashboard

Step 2: Click Add-ons in the top navigation.

Add-ons Link

You now see a list of Cloudinary's add-ons, which are services external to Cloudinary's core that we've integrated into our API workflow. Note the four options for AI tagging:

Relevant Add-ons

Click each of those options and then click Free under Plan to add the integrations to your Cloudinary account.

Subscription to the free Add-on tier

Even though the Free Plan allows only a limited number of categorizations for add-ons, it’s adequate for you to test the services against one another before deciding which one or ones to adopt. Each machine-learning add-on has strengths and weaknesses so it's important that you figure out which one works best for you.

Now that you’ve subscribed to the various AI tagging add-ons, configure your account to automatically tag newly uploaded assets. To do that, set up an upload preset for each of the services.

Step 3: Navigate to Settings.

Click this gear wheel near the top-right corner of the Cloudinary Dashboard:

Icon of the Settings Page

The Settings page is then displayed:

Settings Page

Step 4: Click the Upload tab.

Click the Upload tab near the top of the Settings page and then scroll down all the way to the Upload presets section.

Upload Presets

Your display might look different, depending on whether you have upload presets already set up.

Upload presets are operations you want Cloudinary to perform when an asset is uploaded. They are extremely useful: You can set them up to, for example, create image and video derivatives upon upload; send the derivatives to a moderation queue, a service, or both, for filtering out inappropriate or unwanted content; down-sample and compress assets before saving; and so forth. With upload presets in Cloudinary, you can also send assets through an AI content-recognition service and automatically tag them with the results.

Step 5: Click the Add upload preset link.

Creation of upload presets

Repeat steps 6 and 7 below for each AI-tagging vendor, after which you can easily switch between defaults.

Step 6: Create the upload preset.

In the first input field, type a descriptive name for the preset, such as AWS Rekognition Auto Tagging.

Next, scroll down to the bottom and click the Advanced Options link:

Advanced options for uploading presets

Scroll down more to the Categorization drop-down menu and choose Amazon Rekognition Tagging:

AI-categorization Options

Afterwards, define a confidence threshold in which to assign tags. The raw result returns a load of details, most of which I'd call "semi-educated guesses." To eliminate the clutter, filter only the tags that the AI understands. Do the following:

In the Auto tagging field, type 0.7 to denote 70-percent confidence, which means that Cloudinary adds, as a tag, all the assets that the machine-learning algorithm is over 70-percent confident are in the image.

Setup of a confidence level for AI tagging

Finally, scroll down all the way to the bottom and click Save. Cloudinary then returns you to the Settings page, on which your newly created upload preset is displayed in the Upload presets section.

Step 7: Make your upload preset the default.

In the Default upload preset drop-down menu, choose your newly-created upload preset and then click Save.

Setup and saving of your default upload preset

Tip: To play safe, test the above procedure in a separate subaccount before moving into your production cloud.

Note
If you exceed the free-tier quota for auto tagging, an error results upon upload and you must upgrade to the appropriate plan to proceed. Contact Cloudinary Support if you exceed the largest plan available.

From now on, all uploads into Cloudinary will be automatically tagged, organized for fast retrieval. Give it a whirl!

Further Reading on Digital Asset Management

Recent Blog Posts

A New, Simple Tool for Creating Text Overlays for Images

Many Cloudinary users desire a UI for tasks like creating text overlays for images, which they then embed on webpages or download for marketing campaigns. Generating such overlays with the Cloudinary Media Library UI involves a bit of a learning curve, especially if they require multiple fonts or text lines, which even experienced users might find challenging to implement.

Read more
Transitioning JPEG-Based to JPEG XL-Based Images for Web Platforms

When the JPEG codec was being developed in the late 1980s, no standardized, lossy image-compression formats existed. JPEG became ready at exactly the right time in 1992, when the World Wide Web and digital cameras were about to become a thing. The introduction of HTML’s <img> tag in 1995 ensured the recognition of JPEG as the web format—at least for photographs. During the 1990s, digital cameras replaced analog ones and, given the limited memory capacities of that era, JPEG became the standard format for photography, especially for consumer-grade cameras.

Read more

Amplify Your Jamstack With Video

By Alex Patterson
Amplify Your Jamstack With Cloudinary Video

As defined by Amazon Web Services (AWS), Amplify is a set of products and tools with which mobile and front-end web developers can build and deploy AWS-powered, secure, and scalable full-stack apps. Also, you can efficiently configure their back ends, connect them to your app with just a few lines of code, and deploy static web apps in only three steps. Historically, because of their performance issues, managing images and videos is a daunting challenge for developers. Even though you can easily load media to an S3 bucket with AWS Amplify, transforming, compressing, and responsively delivering them is labor intensive and time consuming.

Read more
Cloudinary Helps Move James Hardie’s Experience Online

While COVID has affected most businesses, it has been particularly hard on those that sell products for the physical ‘brick and mortar’ world. One company that literally fits that bill is our Australian customer James Hardie, the largest global manufacturer of fibre cement products used in both domestic and commercial construction. These are materials that its buyers ideally want to see up close, in detail. When customers have questions, they expect personal service.

Read more