Programmable Media

Custom focus areas

Last updated: Oct-10-2024

When cropping images, or placing layers, you may have certain areas of interest in the composition of the picture that you want to focus on. Although there are AI-based ways to focus on areas of an image, sometimes you need to ensure accuracy and consistency, so Cloudinary provides the capability to define and refine custom areas of an image.

Overlay to custom coordinates Use custom coordinates
for cropping
and overlays
Crop to custom regions Use custom regions
for cropping
Override face-detection coordinates Override coordinates for
face-detection based
transformations

This guide focuses on custom coordinates (including on-the-fly custom coordinates), custom regions and custom face coordinates, which allow you to define specific areas of an image to focus on (also known as gravity). You can learn more about gravity in Gravity positions for crops and Image layer placement. You may also be interested in Face-detection based transformations.

Custom coordinates

If you know which part of an image you want to focus on, you can specify the coordinates of its bounding box while uploading the image using the custom_coordinates parameter of the upload method. You can also set the custom_coordinates parameter for an existing image, either using the explicit method of the Upload API, or the update method of the Admin API.

The coordinates indicate a region contained in the image that can be used for cropping or adding layers using the custom gravity mode.

Specify the area by the X and Y coordinates of the top left corner and the width and height of the region, as a comma-separated list. For example, 225,230,250,240. In an SDK you can specify this as an array, for example, [225, 230, 250, 240].

The response includes the set coordinates:

Crop with custom coordinates

This is the uploaded image:

Original image of a bedroom


You can crop the image to the exact area defined by the custom coordinates using the crop mode and custom gravity (c_crop,g_custom):

Cropped image using crop, focussing on the custom coordinates

Custom coordinates with auto gravity

The custom coordinates override automatic gravity (g_auto), but if you don't want them to, then you can specify none for the gravity focal point:

g_auto (overridden by custom coordinates) g_auto
(overridden by custom coordinates)
g_auto:none (custom coordinates are ignored) g_auto:none
(custom coordinates are ignored)

If you want to weight the gravity towards the custom coordinates, but not override the automatic gravity entirely, then specify custom_no_override as a focal point. You can also take other objects into account, in addition to your custom coordinates, for example the bed:

Cropped image using automatic gravity, with custom coordinates and the bed as focal points

Overlay with custom coordinates

You can use custom coordinates to position overlays on an image by specifying custom gravity. In this example, the sale icon is scaled down to 75% of the custom area and overlaid in the center of that area:

Sale icon overlaid on area defined by custom coordinates

Custom coordinates on the fly

You can specify custom coordinates directly in the transformation URL using the aoi (area of interest) focal position of auto gravity.

Specify the area by the X and Y coordinates of the top left corner and the width and height of the region, joined with underscores: <top left x>_<top left y>_<width>_<height>.

Custom coordinates specified on the fly override any custom coordinates already specified for an image.

For example, automatically extract a 330 x 160 pixel area of an image, starting at (420, 230) (g_auto:aoi_420_230_330_160):

Auto cropping with custom coordinates

Note
On-the-fly custom coordinates can only be used for cropping, and not for overlays.

Custom regions

You can define custom regions in an image, which you can name, and use as gravity for cropping.

To define custom regions, set the regions parameter of the upload, explicit or update methods.

Each region is specified by a name (alphanumeric characters and hyphens permitted) and an array of at least two X,Y coordinate pairs, e.g., { "name1": [[1, 2], [3, 4]], "name2": [[5,6], [7,8], [9,10]] }. If two pairs are specified, these refer to the top left and bottom right coordinates of a rectangle. Otherwise, if more pairs are specified, they refer to the corners of a custom region.

The response includes the regions:

Crop with custom regions

This is the uploaded image:

Image with regions defined


You can use the named regions when defining gravity for a crop. For example, create a thumbnail of an image 150 pixels square while focusing on the region defined as shoes (c_auto,g_region_!shoes!,h_150,w_150):

Crop to 150x150 focusing on the region named shoes

And the same for the region named hat:

Crop to 150x150 focusing on the region named hat


See full syntax: g_region in the Transformation Reference.

Custom face coordinates

When images are uploaded to your product environment, Cloudinary automatically detects faces in the images and stores the coordinates of those faces for use with face-detection based transformations. For example, this image was uploaded with no special parameters, and yet you can specify c_crop,g_face to crop to the face:

Original image Original image Cropped to the face Cropped to the face

You can override these face coordinates, using the face_coordinates parameter of the upload method. You can also set the face_coordinates parameter for an existing image, either using the explicit method of the Upload API, or the update method of the Admin API.

Specify a face by the X and Y coordinates of the top left corner and the width and height of the region, as a comma-separated list. For example, 220,80,200,220. In an SDK you can specify this as an array, for example, [220, 80, 200, 220]. You can specify multiple faces by separating each list with a pipe, for example, 220,80,200,220|420,120,180,250, or as another array in SDKs: [[220, 80, 200, 220],[420, 120, 180, 250]].

In the request, you can set faces to true to return the coordinates of the faces.

The response includes the set coordinates:

This is the uploaded image:

Custom face coordinates


You can see the coordinates of the automatically detected faces that these custom face coordinates override, by uploading the same image without setting the coordinates (and with the faces parameter set to true):

Cropping around the faces, you can see the difference between the automatically determined coordinates and the custom face coordinates:

g_auto (overridden by custom coordinates) Automatically determined
face coordinates
g_auto:none (custom coordinates are ignored) Custom
face coordinates

Face-detection based transformations

Setting custom face coordinates means that any of the face-detection based transformations applied to the image will use those face coordinates instead of the automatically detected ones.

For example, pixelating the faces in the image uploaded with the custom face coordinates:

Custom face coordinates

✔️ Feedback sent!

Rate this page: