Cloudinary Blog

DAM for Developers: AI-Based Content Analysis

DAM for Developers: AI-Based Content Analysis

Content analysis on images based on artificial intelligence (AI) is yet another powerful feature of Cloudinary’s digital asset management (DAM) solution. This article explains the types of analysis Cloudinary DAM can perform for you.

To run an analysis on an image in your Media Library, click the image from the dashboard and then the Manage button near the top right corner. A pane then opens on the left with three tabs at the top: Summary, Metadata, and Analysis, as shown below:

Analysis Tab for an Image Analysis Tab for an Image

Click the Analysis tab for the related display: ai based analysis

Cloudinary already runs some basic, AI-based analysis on the images you’ve uploaded to your Cloudinary account’s Media Library. As the above screenshot shows, you must register for add-ons before certain types of analysis can occur.

Following are the analyses you can run for your images with Cloudinary DAM.


Marketing Without Barriers Through Dynamic Asset Management


Auto-Tagging

Thanks to deep-learning AI models, which categorize images’ object types, you can automate the process of marking each of those categories as tags for your images.

First, click Register under Free Registration for Amazon Rekognition, as shown here: Amazon Rekognition

Now run the analysis to show the objects in the image. See this example: Amazon analysis

You can then assign all those categories as tags to your images. What a time-saver!

Detection of Faces and Celebrities

Face Detection

By leveraging AI’s face-detection algorithms, Cloudinary can name the celebrities in an uploaded image. Each face- or celebrity-detection option displays in the preview pane on the right—in color-coded frames—the coordinates of the faces it finds. To show or hide those frames, click the Show or Hide button.

Also displayed is the accuracy and confidence level of the celebrities in the image.

To activate this feature, click Register under Free Registration for Amazon Rekognition: Celebrity Detection, like this:

Celebrity-Detection Activation of Celebrity-Detection Add-On

Now run the analysis to find out who the celebrity in the image is.

President Obama Detection of Celebrity

Sure enough, Cloudinary detected the celebrity as Barack Obama with 100-percent accuracy. Bravo!

Detection of Optical Characters

Cloudinary DAM can read the text in uploaded images by running an analysis of optical-character recognition (OCR) on them.

OCR Image With Text Before Cloudinary DAM’s OCR Analysis

To activate that feature, click Register under Free Registration for OCR Optical Character Recognition. Afterwards, run the OCR analysis. Here’s an example of the result:

text detection

Color Analysis

Subsequent to a color analysis that yields information about the main colors in an image, Cloudinary DAM can automatically add background padding to it in an attractive color.

Additionally, with the premium feature Image Analysis, an advanced Media Library search capability, you can search for images based on their predominant colors.

Color Analysis Color Analysis of an Image on Cloudinary DAM

Conclusion

Cloudinary DAM’s AI-based content analysis capability serves innumerable use cases for developers. Do share the creative ways you’re applying it to your projects. We can all learn from one another’s ideas. Check out my next post in the DAM for developers series about access control.


DAM for Developers: Series


Further Reading on Digital Asset Management

Recent Blog Posts

Transitioning JPEG-Based to JPEG XL-Based Images for Web Platforms

When the JPEG codec was being developed in the late 1980s, no standardized, lossy image-compression formats existed. JPEG became ready at exactly the right time in 1992, when the World Wide Web and digital cameras were about to become a thing. The introduction of HTML’s <img> tag in 1995 ensured the recognition of JPEG as the web format—at least for photographs. During the 1990s, digital cameras replaced analog ones and, given the limited memory capacities of that era, JPEG became the standard format for photography, especially for consumer-grade cameras.

Read more

Amplify Your Jamstack With Video

By Alex Patterson
Amplify Your Jamstack With Cloudinary Video

As defined by Amazon Web Services (AWS), Amplify is a set of products and tools with which mobile and front-end web developers can build and deploy AWS-powered, secure, and scalable full-stack apps. Also, you can efficiently configure their back ends, connect them to your app with just a few lines of code, and deploy static web apps in only three steps. Historically, because of their performance issues, managing images and videos is a daunting challenge for developers. Even though you can easily load media to an S3 bucket with AWS Amplify, transforming, compressing, and responsively delivering them is labor intensive and time consuming.

Read more
Cloudinary Helps Move James Hardie’s Experience Online

While COVID has affected most businesses, it has been particularly hard on those that sell products for the physical ‘brick and mortar’ world. One company that literally fits that bill is our Australian customer James Hardie, the largest global manufacturer of fibre cement products used in both domestic and commercial construction. These are materials that its buyers ideally want to see up close, in detail. When customers have questions, they expect personal service.

Read more
How to Build an Enhanced Gravatar Service, Part 2

Part 1 of this post defines the capabilities of an enhanced Gravatar service, which I named Clavatar, and describes the following initial steps for building it:

This post, part 2 of the series, explains how to make Clavatar work like Gravatar and to develop Clavatar’s capabilities of enabling requests for various versions of the images related to user accounts.

Read more