part from having an excellent camera, Google’s Pixel lineup also offer many useful software features. Take ‘Hold For Me‘ as an example: This feature lets the Google Assistant take your home on a call while you’re waiting on hold for a business to urge back to you. When Google makes a replacement feature that leverages its existing services, the result are often phenomenal. For the upcoming Pixel 6 series, Google plans to try to to just that by integrating parts of Google Lens, Translate, Assistant, and Live Caption into one feature called Live Translate. because of our source who has access to the unreleased Pixel 6 Pro, XDA offers an exclusive first check out Live Translate through some screenshots of the feature.
Last week, a source with access to the Pixel 6 Pro reached bent XDA, allowing us to share some new details on the phone’s hardware. After speaking with our source, we discovered that their Pixel 6 Pro features an unreleased build of the Android System Intelligence app, which was previously called Device Personalization Services. This app is liable for providing several software features on Pixel phones, including Live Caption, Screen Attention, and more. As we previously discovered, this app also will contain the service for the new Live Translate feature, which can debut on the Pixel 6 series but can also come to older Pixel phones running Android 12.
Live Translate was one among the sole new software features that Google confirmed when it began its Pixel 6 marketing blitz last month. At the time, Google didn’t explicitly confirm the name of the new feature, but they did tell publications just like the Verge and therefore the Washington Post that the Pixel 6 are going to be ready to generate live, translated captions of content you’re watching or taking note of . The Verge was even ready to see a demo in-person of the feature transcribing then translating French to English in real time, but they sadly weren’t allowed to share any images or videos from the demo. We managed to urge the Live Translate feature to point out abreast of our own device, though, so we’re ready to share some screenshots.
Setting up Live Translate
Starting off with the setup flow for Live Translate, we will already see that there’s a facet to the present feature that went previously unreported. Live Translate won’t only allow you to translate captions into the language of your choice, but it’ll also translate messages, text detected within the camera viewfinder, and act as an interpreter, counting on the language you select .
After completing the initial setup process, Live Translate are often found under Settings > System. Here, you’ll be ready to toggle the feature, choose whether you would like to permit downloading language models over mobile data, choose the language you would like to translate to, and download new language models. The language models home in size from 50-200MB counting on the supported features. Choosing Japanese, for instance , will allow you to translate messages, captions, and text within the camera viewfinder, while choosing Mandarin will only allow you to translate messages and text within the camera.
we weren’t ready to get any of the below Live Translate features performing on our Pixel 3 XL, but our source told us it works just fine on their Pixel 6 Pro, as is predicted . consistent with Google, Live Translate works fully offline and is accelerated by the new Google Tensor contribute the Pixel 6 series, so it’s possible we’re missing a couple of things needed to urge it performing on Google’s Snapdragon-powered Pixel phones. Thus, we’re unable to share screenshots of the feature actually performing at the instant , but we do have more screenshots and knowledge that tell us tons about the feature.
In order for Live Translate to translate captions, you’ll first got to activate the Live Caption feature. this is often currently accessible under Settings > Sound & vibration on Android 12, but it seems that Google are going to be adding a replacement Settings entry titled “Languages & translation” where you’ll be ready to choose which languages you would like captioned and translated to. including the above list, this new settings page confirms that Live Caption will soon support additional languages beyond English. These new languages include French, German, Italian, Japanese, Portuguese, and Spanish. Live Caption on Chrome OS already supports these languages (save for Portuguese), so we’re unsurprised to expanded language support coming to Android.
We don’t know exactly how Live Translate will handle message translations, but a fast analysis of the new Android System Intelligence app reveals a couple of illuminating details. It seems like the feature will automatically detect when a message you receive is in another language, and when it does, it’ll show a sheet at rock bottom that says “get translations instantly as you chat. Translations happen on-device and are never sent to Google.” If you accept, the subsequent effect are going to be played (provided the Pixel 6 isn’t on mute):
