Skip to main content

Google Live Transcribe could be a big help for people who are deaf or hard of hearing

Google Live Transcribe could be a big help for people who are deaf or hard of hearing

/

It’s also releasing a Sound Amplifier feature — both only on Android

Share this story

Google is announcing two new features for Android phones today: Live Transcribe and Sound Amplifier. They’re both designed as accessibility features to help people who are deaf or hard of hearing.

Live Transcribe is an app that automatically transcribes speech in near-real time, allowing people to communicate in situations where they might not otherwise be able to. Sound Amplifier is designed for those with hearing loss, allowing you to tweak sound settings to improve your ability to hear — sort of like a hearing aid app for your phone. Sound Amplifier was originally announced back in May at Google I/O, but it’s finally shipping now.

Both will be available preinstalled on Pixel 3 phones in Accessibility Settings and also available via the Google Play Store for other phones. However, Live Transcribe is being released as a limited beta, and Sound Amplifier requires phones running Android 9 Pie, which limits their availability.

Of the two, I was more impressed with Live Transcribe. When you open the app, it simply starts writing out what it hears in large, easy-to-read text. It works remarkably well, including adding punctuation and even understanding some context. The example Google showed us is that it was able to correctly capitalize the phrase “I am buying a new jersey in New Jersey.” Unfortunately, it does require an internet connection to work.

Although it’s pretty straightforward, Live Transcribe does have some subtle features that make it a little easier to use in the moment. A blue circle in the corner pulses slightly to show the ambient noise level so that you can visually see if you need to move the microphone closer to the speaker for it to work. You can also hit a small button to bring up a keyboard to type out replies if you need to. Finally, if somebody starts speaking after a period of silence, Live Transcribe will vibrate the phone to let you know to look at it to see what is being said.

You can set a primary and secondary language, toggling between them with a quick tap — though, in my testing, Live Transcribe was able to correctly transcribe short phrases in another language without switching. It supports up to 70 different primary languages, and it’s relatively easy to switch between a dark and light theme and also change the text size. In Android, you can create a button for Accessibility that appears in the main button bar, giving quick access to settings and apps like Live Transcribe.

Google says that keeping it simple and easy-to-use was a major goal and one of the reasons it chose not to include the option to save transcriptions. I imagine privacy concerns may also have factored in. Google noted that, in addition to not saving transcripts, it’s also not storing audio or transcriptions on its servers, nor is it using any of that data to improve its algorithms.

The other feature Google is introducing is called Sound Amplifier. Inside Accessibility Settings, it’s a new option that takes you to a screen with a bunch of sliders for adjusting various sound settings. You plug in a pair of wired headphones (yes, it only works with wired headphones), and then the phone processes incoming audio to make it easier to hear.

Apple has a similar feature that works with AirPods, which would probably be more convenient because you can more easily set the phone next to the speaker since there are no wires involved. iPhones can also work directly with some hearing aids, allowing you to adjust settings on the phone.

Although there are just a few sliders — Boost, Fine tuning, Mic volume, and Sound reduction intensity, along with adjustments for left and right ears — Google says that behind them are “thousands of parameters.” It works locally, without the need for an internet connection

I am not hard of hearing (beyond the usual for a 40-year-old who used to go to rock concerts), so I had a difficult time adjusting the sliders to really dial in major improvements. But adjusting the various sliders did significantly change the sound profile of what I was hearing. You also have the option of using an external microphone if you need, and Google says that this feature will be available to developers to build into their own apps via the Dynamic Processing Effect API.

Google says that it hasn’t ruled out creating apps for iOS, but it’s focused on Android for now. Sound Amplifier should be available in the Play Store for Android today, and people who want to try out Live Transcribe will need to sign up to be notified when it’s more widely available.

Correction: the original version of this piece mischaracterized support for short phrases in other languages as “translate” instead of transcribe. We regret the error.

Today’s Storystream

Feed refreshed Sep 24 Striking out

E
External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.


A
Youtube
Andrew WebsterSep 24
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.


A
The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.


A
Andrew WebsterSep 24
Looking for something to do this weekend?

Why not hang out on the couch playing video games and watching TV. It’s a good time for it, with intriguing recent releases like Return to Monkey Island, Session: Skate Sim, and the Star Wars spinoff Andor. Or you could check out some of the new anime on Netflix, including Thermae Romae Novae (pictured below), which is my personal favorite time-traveling story about bathing.


A screenshot from the Netflix anime Thermae Romae Novae.
Thermae Romae Novae.
Image: Netflix
J
Twitter
Jay PetersSep 23
Twitch’s creators SVP is leaving the company.

Constance Knight, Twitch’s senior vice president of global creators, is leaving for a new opportunity, according to Bloomberg’s Cecilia D’Anastasio. Knight shared her departure with staff on the same day Twitch announced impending cuts to how much its biggest streamers will earn from subscriptions.


T
Twitter
Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.


A
External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.


A
External Link
Ford is running out of its own Blue Oval badges.

Running out of semiconductors is one thing, but running out of your own iconic nameplates is just downright brutal. The Wall Street Journal reports badge and nameplate shortages are impacting the automaker's popular F-series pickup lineup, delaying deliveries and causing general chaos.

Some executives are even proposing a 3D printing workaround, but they didn’t feel like the substitutes would clear the bar. All in all, it's been a dreadful summer of supply chain setbacks for Ford, leading the company to reorganize its org chart to bring some sort of relief.