News I Tried the New Clean Up Tool in Apple Intelligence and My Disappointment Is Immense

Apple has showcased its AI features and we have already got access to some Apple Intelligence features in beta updates. Now, Apple is all set to roll out its AI features to general users with iOS 18.1. Amongst other new AI features, Apple has introduced a Clean Up feature in the Photos app that helps you remove unwanted objects or persons from photos. We got our hands on the Apple Intelligence Clean Up feature in beta and gave it a shot. Here’s how the Clean Up feature works.

Note:
This experience is based on Clean Up feature in iOS 18.1 developer beta 3 update.

Once you have updated your iPhone to iOS 18.1, the Clean Up tool will be available by default in the Photos app. When you start using it for the first time, the tool will be downloaded. Here’s how to use the Clean Up tool on iPhone to remove unwanted objects from photos.

  • Open a photo in the Photos app and tap on the edit button. Now, select Clean Up from the tools at the bottom.
I Tried the New Clean Up Tool in Apple Intelligence and My Disappointment Is Immense
  • You will be prompted to tap, circle, or brush on an object you want to remove. You can zoom in and out of the photo with the pinch gesture to use the tool properly.
I Tried the New Clean Up Tool in Apple Intelligence and My Disappointment Is Immense
  • The selected object will be highlighted with a cool animation and then it will be removed from the photo.
I Tried the New Clean Up Tool in Apple Intelligence and My Disappointment Is Immense
  • You can also blur a person’s face by scribbling on it.
I Tried the New Clean Up Tool in Apple Intelligence and My Disappointment Is Immense
  • To save the changes, tap on Done or you can choose Reset to revert the changes. There’s also an Undo arrow to undo the changes.
  • You can also tap on the three-dot button on the top right to save a copy.
I Tried the New Clean Up Tool in Apple Intelligence and My Disappointment Is Immense

First things first, the Clean Up tool in Apple Intelligence works completely on-device, unlike the equivalents by Google and Samsung which offer both cloud-based as well as on-device options. I tried comparing it with Google’s Magic Eraser and Samsung’s Object Eraser and the results were disappointing. While Clean Up detects objects in focus using depth mapping on all photos, the object segmentation is not up to the mark.

It works perfectly on simple images where unwanted objects are clearly visible or are not blending into the background, complex images are where it fails to shine. For example, I tried the Clean Up tool on a photo of a group of people and tried to remove one person from it but it botched the surroundings instead.

In comparison, the Magic Eraser and Object Eraser worked much better. One issue with the Clean Up tool is that the selection tool is too thick to select objects, especially if you want to select a small object.

Apple Intelligence Clean Up tool in Action (Before (L) and After (R)
Apple Intelligence Clean Up tool in Action (Before (L) and After (R))
Samsung Object Eraser
Samsung Object Eraser (Before (L) and After (R))
I Tried the New Clean Up Tool in Apple Intelligence and My Disappointment Is Immense
Apple Intelligence Clean Up (Before (L) and After (R))

After trying the tool on different images, the results were mostly underwhelming and the feature is buggy in its current state. One might argue that it’s a beta update and Apple Intelligence itself is in the beta phase currently, so to expect it to work as well as Magic Eraser and Object Eraser would not be fair.

I really hope that Apple polishes this feature to wrinkle out the pertaining bugs.

Leave a Reply