Skip to main content

The Descriptive Camera turns your photos into someone else's words

The Descriptive Camera turns your photos into someone else's words

/

Matt Richardson has created the Descriptive Camera, a device that captures images and sends them out into the world, where they're rendered into short text descriptions via Amazon's Mechanical Turk API.

Share this story

The Descriptive Camera (MATT RICHARDSON)
The Descriptive Camera (MATT RICHARDSON)

While most camera innovations are aimed at higher megapixel counts or new image capturing techniques, Matt Richardson is taking an entirely different route with the Descriptive Camera: creating a device that turns your captured imagery into words. Designed as part of a class for New York University's Interactive Telecommunications Program, the camera consists of a USB webcam, a shutter button, a small thermal printer, and an ethernet connection. When a picture is "snapped," it's sent off to humans for analysis via Amazon's Mechanical Turk API. The human on the other end then creates a written description of the image, which is sent back to the camera. The resulting text is printed with the thermal printer, framed by a Polaroid-style photo outline (an example Richardson provides reads "It's a dark room with a window. The image is quite pixelated."

According to Richardson's post about the project, the Amazon Human Intelligence Task — or HIT — cost is about $1.25 for each image, with results usually taking between three to six minutes to return. An "accomplice mode" actually lets the camera send out links to the image via instant messenger, providing a cheaper option for human interpretation. While the device currently requires external power from a 5-volt source, Richardson does hope to make a version at some point that runs off self-contained batteries and can use wireless data. It's certainly an interesting project, and we won't deny that we're smitten with the idea of taking images out and about in the world, and seeing them perceived through someone else's eyes.

Today’s Storystream

Feed refreshed 48 minutes ago Dimorphos didn’t even see it coming

J
External Link
Jess Weatherbed48 minutes ago
Won’t anyone think of the billionaires?

Forbes reports that rising inflation and falling stock prices have collectively cost members of the Forbes 400 US rich list $500 billion in 2022 with tech tycoons suffering the biggest losses.

Jeff Bezos (worth $151 billion) lost $50 billion, Google’s Larry Page and Sergey Brin (worth a collective $182b) lost almost $60b, Mark Zuckerberg (worth $57.7b) lost $76.8b, and Twitter co-founder Jack Dorsey (worth $4.5b) lost $10.4b. Former Microsoft CEO Steve Ballmer (worth $83b) lost $13.5b while his ex-boss Bill Gates (worth $106b) lost $28b, albeit $20b of that via charity donations.


T
Thomas Ricker6:45 AM UTC
Check out this delightful DART Easter egg.

Just Google for “NASA DART.” You’re welcome.


M
The Verge
We’re about an hour away from a space crash.

At 7:14PM ET, a NASA spacecraft is going to smash into an asteroid! Coverage of the collision — called the Double Asteroid Redirection Test — is now live.


E
Twitter
Emma RothSep 26
There’s a surprise in the sky tonight.

Jupiter will be about 367 million miles away from Earth this evening. While that may seem like a long way, it’s the closest it’s been to our home planet since 1963.

During this time, Jupiter will be visible to the naked eye (but binoculars can help). You can check where and when you can get a glimpse of the gas giant from this website.


E
Twitter
Emma RothSep 26
Missing classic Mario?

One fan, who goes by the name Metroid Mike 64 on Twitter, just built a full-on 2D Mario game inside Super Mario Maker 2 complete with 40 levels and eight worlds.

Looking at the gameplay shared on Twitter is enough to make me want to break out my SNES, or at least buy Super Mario Maker 2 so I can play this epic retro revamp.


R
External Link
Russell BrandomSep 26
The US might still force TikTok into a data security deal with Oracle.

The New York Times says the White House is still working on TikTok’s Trump-era data security deal, which has been in a weird limbo for nearly two years now. The terms are basically the same: Oracle plays babysitter but the app doesn’t get banned. Maybe it will happen now, though?


R
Youtube
Richard LawlerSep 26
Don’t miss this dive into Guillermo del Toro’s stop-motion Pinocchio flick.

Andrew Webster and Charles Pulliam-Moore covered Netflix’s Tudum reveals (yes, it’s going to keep using that brand name) over the weekend as the streamer showed off things that haven’t been canceled yet.

Beyond The Way of the Househusband season two news and timing information about two The Witcher projects, you should make time for this incredible behind-the-scenes video showing the process of making Pinocchio.


R
External Link
Russell BrandomSep 26
Edward Snowden has been granted Russian citizenship.

The NSA whistleblower has been living in Russia for the 9 years — first as a refugee, then on a series of temporary residency permits. He applied for Russian citizenship in November 2020, but has said he won’t renounce his status as a U.S. citizen.


E
External Link
Emma RothSep 26
Netflix’s gaming bet gets even bigger.

Even though fewer than one percent of Netflix subscribers have tried its mobile games, Netflix just opened up another studio in Finland after acquiring the Helsinki-based Next Games earlier this year.

The former vice president of Zynga Games, Marko Lastikka, will serve as the studio director. His track record includes working on SimCity BuildIt for EA and FarmVille 3.


A
External Link
Vietnam’s EV aspirant is giving big Potemkin village vibes

Idle equipment, absent workers, deserted villages, an empty swimming pool. VinFast is Vietnam’s answer to Tesla, with the goal of making 1 million EVs in the next 5-6 years to sell to customers US, Canada and Europe. With these lofty goals, the company invited a bunch of social media influencers, as well as some auto journalists, on a “a four-day, multicity extravaganza” that seemed more weird than convincing, according to Bloomberg.