Cloudinary Blog

Setting up Automatic AI Content-Recognition Tagging in the Cloudinary DAM

Auto AI Content Recognition Tagging in Cloudinary DAM

Automating the categorization of your images and videos can help democratize access to your organization's creative assets. Many teams throughout your organization have likely spent a lot of time and effort generating high-quality content, but it'd be all for naught if the content just ends up in some anonymous folder on somebody's hard drive or is randomly dropped into your cloud storage with no functional organizational strategy.

So, how do you efficiently organize your digital assets, making them easier to find, use, or repurpose? AI content-recognition tagging is a great way to add intelligence and categorize your assets. While not perfect, machine learning is becoming more robust and more accurate every day.

API-based Cloudinary can integrate with any AI tool. Additionally, Cloudinary offers powerful and effective direct integrations, which require no additional programming on your part. The steps below walk you through the process of setting up your Cloudinary account to automatically tag all your new digital assets—with no coding from you.

Step 1: Log in to the Cloudinary Console.

After logging in, you see your Dashboard, similar to this one:

Cloudinary Dashboard

Step 2: Click Add-ons in the top navigation.

Add-ons Link

You now see a list of Cloudinary's add-ons, which are services external to Cloudinary's core that we've integrated into our API workflow. Note the four options for AI tagging:

Relevant Add-ons

Click each of those options and then click Free under Plan to add the integrations to your Cloudinary account.

Subscription to the free Add-on tier

Even though the Free Plan allows only a limited number of categorizations for add-ons, it’s adequate for you to test the services against one another before deciding which one or ones to adopt. Each machine-learning add-on has strengths and weaknesses so it's important that you figure out which one works best for you.

Now that you’ve subscribed to the various AI tagging add-ons, configure your account to automatically tag newly uploaded assets. To do that, set up an upload preset for each of the services.

Step 3: Navigate to Settings.

Click this gear wheel near the top-right corner of the Cloudinary Dashboard:

Icon of the Settings Page

The Settings page is then displayed:

Settings Page

Step 4: Click the Upload tab.

Click the Upload tab near the top of the Settings page and then scroll down all the way to the Upload presets section.

Upload Presets

Your display might look different, depending on whether you have upload presets already set up.

Upload presets are operations you want Cloudinary to perform when an asset is uploaded. They are extremely useful: You can set them up to, for example, create image and video derivatives upon upload; send the derivatives to a moderation queue, a service, or both, for filtering out inappropriate or unwanted content; down-sample and compress assets before saving; and so forth. With upload presets in Cloudinary, you can also send assets through an AI content-recognition service and automatically tag them with the results.

Step 5: Click the Add upload preset link.

Creation of upload presets

Repeat steps 6 and 7 below for each AI-tagging vendor, after which you can easily switch between defaults.

Step 6: Create the upload preset.

In the first input field, type a descriptive name for the preset, such as AWS Rekognition Auto Tagging.

Next, scroll down to the bottom and click the Advanced Options link:

Advanced options for uploading presets

Scroll down more to the Categorization drop-down menu and choose Amazon Rekognition Tagging:

AI-categorization Options

Afterwards, define a confidence threshold in which to assign tags. The raw result returns a load of details, most of which I'd call "semi-educated guesses." To eliminate the clutter, filter only the tags that the AI understands. Do the following:

In the Auto tagging field, type 0.7 to denote 70-percent confidence, which means that Cloudinary adds, as a tag, all the assets that the machine-learning algorithm is over 70-percent confident are in the image.

Setup of a confidence level for AI tagging

Finally, scroll down all the way to the bottom and click Save. Cloudinary then returns you to the Settings page, on which your newly created upload preset is displayed in the Upload presets section.

Step 7: Make your upload preset the default.

In the Default upload preset drop-down menu, choose your newly-created upload preset and then click Save.

Setup and saving of your default upload preset

Tip: To play safe, test the above procedure in a separate subaccount before moving into your production cloud.

Note
If you exceed the free-tier quota for auto tagging, an error results upon upload and you must upgrade to the appropriate plan to proceed. Contact Cloudinary Support if you exceed the largest plan available.

From now on, all uploads into Cloudinary will be automatically tagged, organized for fast retrieval. Give it a whirl!

Recent Blog Posts

 New Image File Format: FUIF:Lossy, Lossless, and Free

I've been working to create a new image format, which I'm calling FUIF, or Free Universal Image Format. That’s a rather pretentious name, I know. But I couldn’t call it the Free Lossy Image Format (FLIF) because that acronym is not available any more (see below) and FUIF can do lossless, too, so it wouldn’t be accurate either.

Read more
Optimizing Video Streaming and Delivery: Q&A with Doug Sillars

Doug Sillars, a digital nomad and a freelance mobile-performance expert, answers questions about video streaming and delivery, website optimization, and more.

Doug Sillars, a freelance mobile-performance expert and developer advocate, is a Google Developer Expert and the author of O’Reilly’s High Performance Android Apps. Given his extensive travels across the globe—from the UK to Siberia—with his wife, kids, and 11-year-old dog, Max, he has been referred to as a “digital nomad.” So far in 2018, Doug has spoken at more than 75 meetups and conferences!

Read more
Building a Music Discovery Service

In May 2018, Cloudinary sponsored Capitol Music Group’s first hackathon held by its new Capitol360 Innovation Center, which aims at connecting musicians and software technologists to facilitate and stimulate the creation of music. See this interview for details. As a starter project for the hackathon, we built a sample app called Music Discovery Service.

Read more
Once a Hackathon Participant, Now a Judge

Over the past several years, I've had a chance to participate in hackathons, as part of teams that developed a social payment app and helped users decide meals to cook. But it wasn't until last month that I got to experience a hackathon from the other side, as a judge.

Read more
10 Website Videos Mistakes and How to Solve Them

It should come as no surprise that video use on the internet is exploding. You can see the dramatic growth of video on the average site in this SpeedCurve blog post.

With the growth in video comes greater bandwidth use, which is not only costly for your IT budget, but for your visitors as well. Beyond the expense, there is the user experience to consider. The heavier the page, the longer it will take to load, and the greater likelihood visitors will abandon your site. Page load speed is also an important factor in SEO ranking, so clearly video is something we need to take seriously and get right. Video is challenging, presenting terms still unfamiliar to developers - like codecs, bitrate and adaptive bitrate streaming. As a result, mistakes are being made in video implementation.

Read more
Android Data Saver: Optimizing Mobile Data Usage with Cloudinary

Over the life of a mobile device, the cost of a cellular data plan often exceeds that of the device itself. To optimize data usage and purge useless data on their mobile devices, users can enable Data Saver from Android 7.0 (API level 24). To do so, users toggle Data Saver in quick settings under the Notification shade or under Settings > Data usage. With Data Saver enabled, apps that aren't whitelisted cannot use cellular data in the background. They are also directed to consume less data while active.

Read more