Cloudinary Blog

ReactNYC: Building Modern Media Experiences in React Apps

ReactNYC: Building Modern Media Experiences in React Apps

Summary

In this talk, the audience learns everything they will ever need to know about playback controls, offline media, image & video optimization and transformation, pre-loading, deep learning with Images, audio & improving web performance by using the right tools while dealing with media assets in their react apps.

Contents

0:05 - Intro
0:15 - Google Developer Expert
0:40 - Community Evangelist
1:15 - User experiences Across The World With Media on Web
3:16 - UX: Loading Video on a slow 3G network
3:35 - UX: Watching Man’s Not Hot when device goes offline
3:59 - UX: Accessing an Image on second load when it doesn’t come instantly
4:47 - After 2 secs of buffering users start dropping off at around 6% per second
5:29 - Modern Media
6:38 - Anatomy of Modern Media Experience
6:54 - Case studies - Modern Media Experience
8:25 - Building the Modern Media Experience… Your turn!
8:35 - Recommended Video players
10:00 - Fast playback with adaptive bitrate streaming
11:24 - Fast playback with video preload
13:47 - Smart video preload considerations
18:38 - Great UX
18:44 - Screen Orientation API
20:21 - Playground Playback & Page Visibility
21:28 - Intersection Observer API
23:07 - Media Session API
25:17 - Image & Video Transformations
29:28 - Offline
29:38- Background Sync
30:38 - Background Fetch
31:46 - Modern Media Experience Demo

Resources

Recent Blog Posts

Build a WhatsApp Clone with Automatic Image Optimization

In the previous post, we showed how to upload images to a Cloudinary server. In this part, we will play with some of the features we see on the WhatsApp technology. After you or your users have uploaded image assets to Cloudinary, you can deliver them via dynamic URLs. You can include instructions in your dynamic URLs that tell Cloudinary to manipulate your assets using a set of transformation parameters. All image manipulations and image optimizations are performed automatically in the cloud and your transformed assets are automatically optimized before they are routed through a fast CDN to the end user for an optimal user experience. For example, you can resize and crop, add overlays, blur or pixelate faces, apply a variety of special effects and filters, and apply settings to optimize your images and to deliver them responsively.

Read more
With automatic video subtitles, silence speaks volumes

The last time you scrolled through the feed on your favorite social site, chances are that some videos caught your attention, and chances are, they were playing silently.

On the other hand, what was your reaction the last time you opened a web page and a video unexpectedly began playing with sound? If you are anything like me, the first thing you did was to quickly hunt for the fastest way to pause the video, mute the sound, or close the page entirely, especially if you were in a public place at the time.

Read more
Impressed by WhatsApp Tech? Build WhatsApp Clone with Media Upload

With more than one billion people using WhatsApp, the platform is becoming a go-to for reliable and secure instant messaging. Having so many users means that data transfer processes must be optimized and scalable across all platforms. WhatsApp is touted for its ability to achieve significant media quality preservation when traversing the network from sender to receiver, and this is no easy feat to achieve.

Read more
New Google-powered add-on for auto video categories and tags

Due to significant growth of the web and improvements in network bandwidth, video is now a major source of information and entertainment shared over the internet. As a developer or asset manager, making corporate videos available for viewing, not to mention user-uploaded videos, means you also need a way to categorize them according to their content and make your video library searchable. Most systems end up organizing their video by metadata like the filename, or with user-generated tags (e.g., youtube). This sort of indexing method is subjective, inconsistent, time-consuming, incomplete and superficial.

Read more

iOS Developer Camp: The Dog House

By Shantini Vyas
iOS Developer Camp: The Dog House

Confession: I’m kind of addicted to hackathons. Ever since graduating from Coding Dojo earlier this year, I’ve been on the hunt for new places to expand my skills and meet new people in the tech space. iOS Developer Camp’s 10th Anniversary event bowled me over. Initially, because of its length. 48 hours? Yeesh. I had no idea that those 48 hours would change my life. But let’s first get a little backstory on my favorite topic: dogs.

Read more