In 2024 we released an array of generative AI tools with capabilities ranging from enhancing workflows to boosting creativity – all delivering stunning visual content at scale.
In this blog, we’ll recap some of these advancements and offer up a look into the future of Cloudinary GenAI — including the impending rollout of improvements to our popular Background Removal feature and Generative AI Refiners Graphical User Interfaces (GUI), that improve generative AI outputs to ensure more precise results.
Managing large-scale visual media libraries can be overwhelming. AI Vision alleviates that “swamped in assets” feeling by automating and simplifying workflows.
- Custom taxonomy creation. Custom taxonomies you create with natural language prompts allow you to tailor your media libraries to meet unique organizational needs and align with your business rules. Make categorizing, searching, and discovering assets easier, saving time and reducing complexity.
- Granular analysis. Detect specific branding elements, flag sensitive or inappropriate material, and ensure brand integrity.
- Visual question answering (VQA). Ask your images complex, content-specific questions and get precise, actionable responses. Perfect for generating SEO-ready metadata or descriptive alt text.
AI Vision works seamlessly with our powerful APIs, SDKs, and/or Mediaflows tool. Learn more on the AI Vision Page.
- Improved Generative Fill. This popular “outpainting” feature adjusts aspect ratios while filling whitespace with contextually accurate generated content. We’ve upgraded the model to deliver sharper, more natural results for advanced image editing at scale.
- New! Generative Extract. Isolate specific elements within an image. This feature delivers greater flexibility when creating dynamic and customized visuals, especially when used alongside our image overlay feature.
- New! Background Replace. Introducing a new background for an existing image’s foreground. Automatically generate an original background based on the context of the image’s foreground or through custom natural language prompts.
- Improved Generative Upscale. Seamlessly expands image resolution without compromising quality or introducing artifacts. Ideal for high-resolution use cases and extends the use of undersized yet valuable images.
- New! Generative Enhance. Automatically refine image exposure and saturation. Used with Generative Restore, Enhance is a powerful, reliable tool for automatically improving image quality at scale – see it in action.
- New! AI-Generated Captions and Transcripts for Video. Cloudinary further streamlines video management tasks by introducing our AI-based video transcription and chaptering tools, available through our Video API and the Video Player Studio.
Our generative AI tools prioritize transparency and ethical use, enabling customers to adopt these robust solutions confidently. From automated content moderation to precision-driven enhancements and even the integration of C2PA practices, these tools empower creators while safeguarding brand and Intellectual Property (IP) safety. Please see our AI Trust and Safety page for our thoughts and policies around these issues.
The Background Removal tool will soon feature sharper detail handling and faster, more reliable performance at scale. These updates streamline workflows for e-commerce, creative campaigns, and more.
The roadmap for 2025 includes expanding and refining generative AI capabilities further. Updates such as Refiner interfaces for Generative Fill, Background Replace, and Background Removal tools as well as new AI-powered workflows in Assets, our AI-powered intelligent DAM, will make advanced media editing and management more accessible.
Try our generative AI tools today, and stay tuned for more exciting updates as we continue innovating in 2025. If you’re part of a larger enterprise, please get in touch with sales to see how your business can save time and money with Cloudinary AI.
And one last, vital thing: THANK YOU to our customers and the developers who use Cloudinary. We appreciate you trusting our AI solutions to power your visual media workflows and for the feedback you have provided. Your insights and use cases help us build a better suite of tools for you. There’s much more to come, so stay tuned as we continue to make Cloudinary AI essential for at-scale image and video editing and management!
