Viewed in isolation, these capabilities may seem like tasks within reach for anyone familiar with Photoshop or video editing software. However, the new Pixel phones are democratizing these features, making them accessible to everyone, which is both exciting and, in some ways, unsettling. Let's delve into these innovations:
Magic Editor
Google provided a glimpse of this feature during its developer conference in May. It represents a natural progression from Magic Eraser, introduced by Google a few years back. Magic Eraser allowed users to remove unwanted objects from photos, such as fire hydrants or background individuals. Magic Editor takes photo manipulation to a whole new level.
In a live demonstration, Google showcased an image of a girl running on a beach. Using Magic Editor within the Google Photos app, a spokesperson simply tapped on the subject, and the software accurately created a cutout. They could then relocate the subject anywhere in the image, with the software seamlessly filling the vacated space with appropriate content. While these were photos handpicked by Google, Magic Editor performed this task with remarkable precision. Magic Editor also grants the ability to alter the lighting conditions of a scene. For example, if you captured a photo under harsh noon sunlight, you can effortlessly transform it into a golden hour scene with warm evening hues or even add a picturesque sunset. In another example, a photo featured a kid about to take a basketball shot from the ground. The spokesperson effortlessly elevated the subject into the air, creating the illusion of a dunk, and casually remarked, "You can even move their shadow too!" Best Take We've all been in situations where group photos have someone looking away or blinking. Best Take is a lifesaver for parents dealing with active kids. Most smartphones capture multiple images at varying exposures when you take a photo, ensuring well-exposed pictures under different lighting conditions. Google's solution for correcting closed eyes is to select another frame from the series of images captured and replace the subject's closed eyes with open ones. This is similar to a feature Google introduced years ago called Top Shot, which suggests better frames from a series of photos taken when you tap the shutter button. However, Best Take can select a frame from a sequence of up to six photos taken in rapid succession, which is handy for moments when multiple shots are taken in quick succession. You can watch as the spokesperson selects a person's face and cycles through alternative versions from recent images and other frames. You simply pick the face you want to complete your perfect group photo. Google assures that it doesn't generate facial expressions but instead employs an on-device face recognition algorithm to match images. Audio Magic Eraser Magic Eraser isn't limited to visual elements; with the Pixel 8 series, it can also remove unwanted sounds from videos. In one demonstration, I watched a video of someone playing the cello in a park, with a distant siren wailing in the background (a typical New York City scene). Using Audio Magic Eraser, you can edit the clip and remove the siren's frequencies entirely, leaving only the cello's sounds. It's quite impressive, as it allows you to isolate and enhance specific audio elements. Google's system employs machine learning to identify up to five common sound types like sirens, animals, and crowds. While it's not flawless (a demo involving a man humming by the beach didn't completely eliminate ocean sounds), it offers significant audio control. Video Boost Video Boost, exclusive to the Pixel 8 Pro, is a less eerie but highly impressive feature. It allows you to enhance video clips shot in low light or during fast-paced action. When you activate Video Boost, a copy of your video, potentially up to 4K at 30 frames per second, is sent to Google's Cloud for processing. This process significantly improves stabilization, enhances clarity, reduces noise, and then sends the improved clip back to your device. The processing time varies depending on the video length, potentially taking minutes or overnight. In a side-by-side comparison with an iPhone 14 Pro, the results were astonishing. The Pixel 8 Pro's video shot in similar low light conditions was significantly clearer, brighter, more colorful, and better stabilized. However, it's important to note that this feature won't be available at the launch. While none of these features are entirely groundbreaking, the ability to democratize and make them accessible to the average smartphone user, without requiring technical expertise, is truly captivating. For more information on the Pixel 8, Pixel 8 Pro, and Pixel Watch 2, you can refer to Google's official announcement. These smart features represent just a fraction of the AI advancements discussed by Google, including the upgrade of Google Assistant with Bard.
Comments