Skip to main content

Nuance wants to build the power of Siri into every app

Nuance wants to build the power of Siri into every app


And every smart home product, too

Share this story

Smartphones let you control a lot using only your voice. Whether you're on an iPhone or an Android phone, you can ask for directions, perform a search, start a call, or dictate a message. But once you actually open up an app, voice control disappears: for the most part, apps all still work exclusively through touch.

Mix analyzes speech and translates it into an action

Nuance wants to change that. Nuance is the company behind the language detection software that powers Samsung's S Voice and, supposedly, Siri as well. It's now opening up that technology to all developers — big and small — allowing them to bake it into their apps.

It all works through a new tool, called Nuance Mix, that's supposed to give developers an easy way to build full voice control into their apps. For the most part, developers just have to tell Mix what kind of commands their users will give. Then when the app hears those commands, Nuance will be able to convert them into the specific actions that a person wants to perform and send that information back down to the app.

The idea is that someone could say to a social media app, "Update my status," "Post a new status," "Change my status," or even "I want to post something," and Nuance's technology will be able to figure out that they're all the same command. That's partly because developers are required to prime Mix with 15 to 20 samples of every command, but it's also because Mix will then generate alternatives on its own and continue to learn based on what people using the app actually end up saying.

Hardware is what makes Mix really interesting

Nuance Mix isn't limited to apps: it can be used on hardware, too, and that's where it really starts to get interesting. Mix could be used as the primary way for interacting with smart home products or Internet of Things devices. "A lot of these devices don't necessarily have a screen," says Kenn Harper, a senior director at Nuance. "So a thermostat may have a tiny screen or a couple of buttons, but if you want to tell if you're traveling for a couple of days ... how would you do that without speech?"

Right now, most smart home devices are controlled through smartphones, and it seems like that's unlikely to change. But Harper's vision is appealing. Why shouldn't you be able to dictate commands directly to a thermostat if you're in the same room as it? That makes even more sense as you start to consider interactions with devices outside your home, which won't be connected to your smartphone.

Can Nuance defeat existing voice assistants?

While Nuance is offering language processing here and now, it's worth questioning whether it'll really be the one to dominate voice control inside of apps and smart home devices in the future. Apple and Google could always open up Siri and Google Now directly, allowing their native tools to be used inside of apps, which may end up being easier for developers. Both Apple and Google are behind smart home platforms as well, and one could imagine their voice assistants extending there, too. (Apple is believed to use Nuance's technology at the moment, but that may not always be the case.)

Nuance Mix is launching today in beta. That'll give developers a chance to try it out, though most are going to want to wait before building it into anything. Nuance isn't disclosing pricing yet, but it's likely that many — if not most or all developers — will have to pay for Mix once it hits an official release. Pricing options are "not going to be a one size fits all" approach, however, so small developers will theoretically be able to pay less than big ones.

Today’s Storystream

Feed refreshed 7 minutes ago Not just you

External Link
Emma Roth7 minutes ago
We might not get another Apple event this year.

While Apple was initially expected to hold an event to launch its rumored M2-equipped Macs and iPads in October, Bloomberg’s Mark Gurman predicts Apple will announce its new devices in a series of press releases, website updates, and media briefings instead.

I know that it probably takes a lot of work to put these polished events together, but if Apple does pass on it this year, I will kind of miss vibing to the livestream’s music and seeing all the new products get presented.

External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.

The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.

Jay PetersSep 23
Twitch’s creators SVP is leaving the company.

Constance Knight, Twitch’s senior vice president of global creators, is leaving for a new opportunity, according to Bloomberg’s Cecilia D’Anastasio. Knight shared her departure with staff on the same day Twitch announced impending cuts to how much its biggest streamers will earn from subscriptions.

Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.

External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.

External Link
Ford is running out of its own Blue Oval badges.

Running out of semiconductors is one thing, but running out of your own iconic nameplates is just downright brutal. The Wall Street Journal reports badge and nameplate shortages are impacting the automaker's popular F-series pickup lineup, delaying deliveries and causing general chaos.

Some executives are even proposing a 3D printing workaround, but they didn’t feel like the substitutes would clear the bar. All in all, it's been a dreadful summer of supply chain setbacks for Ford, leading the company to reorganize its org chart to bring some sort of relief.