Skip to main content

Fujitsu wants to replace your scanner with an interface out of 'Minority Report'

Fujitsu wants to replace your scanner with an interface out of 'Minority Report'

Share this story

If you buy something from a Verge link, Vox Media may earn a commission. See our ethics statement.

fujitsu ui stock 1020
fujitsu ui stock 1020

Over the past year we’ve seen lots of experimentation around user interface, ranging from infrared eye tracking (which has already found its way into mainstream smartphones) to incredibly accurate 3D motion controls. Today, Japan’s Fujitsu is showing off its take on the nontraditional interface — a combination scanner and camera that is somewhere between one of those laser virtual keyboards and a tablet screen that it’s showing off under the lengthy moniker "Next-Generation UI Enabling Operations via Hand Gestures and Finger Movements."

Use a tap-and-drag gesture to "clip" pieces from a document

Fujitsu might not spring to mind as a hotbed of innovation, but the company hasn’t shied away from taking risks on out-there ideas, whether that’s palm-scanning laptops or cellphones that make it easier to sneak around on your significant other. The new project they’re showing off today lets users interact with real-life documents as though they were on a computer screen, helping to bridge the digital divide in a country that’s still surprisingly reliant on dead tree technology. A demo scrapbooking application let us use a tap-and-drag gesture to "clip" pieces from a document, saving images of our selections using the built-in camera. Another similar application lets you make digital copies of sticky notes, which you can then group and move around the table without having to peel the notes off every time. Presumably this will make it easier to brainstorm in a group, although the idea seemed more like an afterthought than a core function of the product.

Fujitsu

The device can also detect depth and can distinguish where your fingertips are and what kind of gestures you’re performing with your hands using a jumble of geometric lines and points. One simple app to demo the depth detection let us manipulate a CAD drawing of the device in 3D space. The demo wasn’t hugely intuitive, and the geometric models that the machine was building out of our hands on the nearby TV was more impressive from a technical standpoint, but it could be handy if you need a 3D mouse for something.

We wondered how useful it would be on those rare occasions when you don't have a paper map

The last demo Fujitsu had to show off was an imagined business scenario with a would-be tourist looking up different travel destinations. When you slide a brochure under the camera’s gaze, the projector highlights different parts of the document to tell you it has additional information. You can expand these points of interest to see photos or videos and save the interesting spots to your clipboard. Next, once you’ve saved everything that catches your eye, you can find out where the things are physically located by laying a map on the table, which Fujitsu’s machine then overlays the highlights on top of. We wondered how useful it would be on those rare occasions when you don't have a paper map at hand, but Fujitsu told us that it would be easy to add things like web links to the set of information on display, which would probably be a more realistic use case.

All in all, we thought the scrapbooking feature seemed like the most useful application of the bunch. A device that can quickly grab an important snippet from an image or text document without requiring you to scan and crop things separately on your computer could be a real time-saver for paper-laden business people. Fujitsu tells us that the finished product should be out sometime in 2014, and while the company doesn’t have a price to share today, a rep tells us that it’s built using readily available components, so we’re not expecting it to break the bank.

Sam Byford contributed to this report

Today’s Storystream

Feed refreshed Two hours ago Not just you

E
Twitter
Emma RothTwo hours ago
Rihanna’s headlining the Super Bowl Halftime Show.

Apple Music’s set to sponsor the Halftime Show next February, and it’s starting out strong with a performance from Rihanna. I honestly can’t remember which company sponsored the Halftime Show before Pepsi, so it’ll be nice to see how Apple handles the show for Super Bowl LVII.


E
Twitter
Emma RothTwo hours ago
Starlink is growing.

The Elon Musk-owned satellite internet service, which covers all seven continents including Antarctica, has now made over 1 million user terminals. Musk has big plans for the service, which he hopes to expand to cruise ships, planes, and even school buses.

Musk recently said he’ll sidestep sanctions to activate the service in Iran, where the government put restrictions on communications due to mass protests. He followed through on his promise to bring Starlink to Ukraine at the start of Russia’s invasion, so we’ll have to wait and see if he manages to bring the service to Iran as well.


E
External Link
Emma Roth5:52 PM UTC
We might not get another Apple event this year.

While Apple was initially expected to hold an event to launch its rumored M2-equipped Macs and iPads in October, Bloomberg’s Mark Gurman predicts Apple will announce its new devices in a series of press releases, website updates, and media briefings instead.

I know that it probably takes a lot of work to put these polished events together, but if Apple does pass on it this year, I will kind of miss vibing to the livestream’s music and seeing all the new products get presented.


E
External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.


Welcome to the new Verge

Revolutionizing the media with blog posts

Nilay PatelSep 13
A
Youtube
Andrew WebsterSep 24
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.


A
The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.


T
Twitter
Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.