Skip to main content

The dean of UCLA Law explains the uncertain future of forensic science

The dean of UCLA Law explains the uncertain future of forensic science


Many of the techniques are faulty, but still admissible in court

Share this story

Cyber Security Concerns In The Global Wake of Hacking Threat
Photo by Leon Neal/Getty Images

Shows like Law and Order and CSI have taught a generation of Americans that blood spatters and handwriting analysis are crucial for catching criminals. The reality, says UCLA School of Law dean Jennifer Mnookin, is that many of these so-called pattern evidence techniques used in forensic science are faulty and not supported by evidence.

In fact, when it comes to wrongful conviction cases (where new DNA evidence proves that someone was innocent), bad forensic science is the second most frequent contributing factor, behind only eyewitness testimony. There are real, and harmful, consequences to forensic science in the courtroom.

The Verge spoke to Mnookin, who recently wrote a paper on the uncertain future of forensic science, about how forensic science is different from laboratory research, which techniques might be credible, and why she’s not optimistic that the system is going to change anytime soon. This interview has been lightly edited for clarity.

UCLA School of Law Dean Jennifer Mnookin
UCLA School of Law Dean Jennifer Mnookin
Photo: Courtesy of UCLA School of Law

Many people don’t realize that forensic science developed separately from laboratory science and is much less credible. How did that happen?

A lot of these traditional kinds of forensic science began outside of the university context and outside of any research framework. They each have an interesting history behind them. For example, let’s take handwriting identification evidence. Many of the early handwriting experts actually had previously been either bank tellers who were in the habit of looking at people’s handwriting to decide whether to honor checks, or clerks. For a long time, the profession of being a clerk and writing things down was a sort of honorable middle-class profession and the advent of the typewriter changed that and made it much less necessary, and some of these clerks went on to assert expertise in handwriting and some other techniques.

A lot of the early developments came from police-adjacent policies that wanted to figure out how to prove things better. There’s nothing wrong with any of these origin stories, except that they don’t develop in ways that invite careful scrutiny and scientific study. When you have a scientific crime detection lab adjacent to law enforcement trying to figure out how can we better solve cases, you’re not necessarily looking at how we can test these new techniques and make sure they’re valid.

If you have early handwriting examiners advertising their authority and hoping that lawyers will come to them for help, there may not be any situation where anyone’s doing careful scrutiny of whether they can really do what they claim to do. It’s not that anybody was trying to commit fraud or do something wrong, but these techniques did develop in ways that didn’t lead to them being tested carefully because the judges in these early cases didn’t require it. They just say, “you claim to be an expert? Sure.”

I’m sure that in the realm of forensic science, there are some forms of pattern evidence that are more credible and less credible. What are some examples of that?

Bite marks are, in my opinion, one of the most distressing forms of evidence that continues to be used right now. Not only do we not have good evidence to support the validity of bite mark identification, we actually have very good evidence to support that it’s not valid.

In some of the other techniques, we really don’t know if the validity is proven, but with bite marks there are numerous studies showing that bite mark identification experts have a distressing high error rate and can’t even accurately identify whether a mark left on a skin is a bite mark or not, much less whether it belongs to a particular person. So the fact that the courts haven’t consistently and loudly said that bite mark identification should not be permitted is both distressing and, I think, surprising. The Texas Forensic Science Commission has put a moratorium on bite mark evidence and others have expressed doubts, but there has not yet been a trial court that has excluded it from evidence on the grounds of it being insufficiently reliable, and that’s shocking.

On the other hand, fingerprint evidence has been used since the early 20th century and there was remarkably little serious study of its accuracy or error rates. That’s begun to change in the wake of the 2009 National Academy of Sciences report on forensic science. There has started to be meaningful evidence. It’s not as substantial as I wish it were, but it exists now in meaningful quantity and a number of studies are well-done. There’s pretty clear evidence that fingerprint experts are more accurate than lay people or novices. There is a craft knowledge.

There’s been some accuracy and error rate studies that show that, while fingerprint experts do make mistakes, those error rates appear not to be too high in many circumstances. I think fingerprint evidence carefully expressed and limited does have enough validity that it deserves to be a brick in the evidentiary wall. I’m not sure it’s enough to support a conviction without any other evidence.

What are the consequences of all this? I was surprised at the stat that forensic science is the second most frequently found contributing factor in certain wrongful conviction cases. Do we have numbers or a way to quantify what harm has been done?

It’s incredibly hard to get accurate numbers about wrongful conviction rate. It’s a heck of a lot higher than zero, but we don’t have any way of assessing it across all cases. That makes it very challenging to answer the question of how often forensic science evidence introduced in court is mistaken or erroneous because we don’t know how many mistakes we’re making overall.

That’s not an encouraging recipe for change

People have been sounding the alarm about faulty forensic science for years. Some hope that there will be widespread change, but you’re less optimistic. Why is that?

I’m not wildly optimistic. In the time since the National Academy of Sciences report was issued, we really have seen some important forms of engagement and some modest forms of change. It would be a mistake not to recognize and even celebrate that. There’s a new degree of engagement by forensic practitioners, even parts of the law enforcement community, by scholars, and by some judges to take these questions seriously.

At the same time, a lot of the changes seem pretty modest and there’s ways in which many judges are still exhibiting somewhat ostrich-like behaviors about forensic science and don’t seem interested in or willing to confront the hard questions that insufficiently validated forms of evidence raise.

Plus, we have no institutional space that has both authority and broad stakeholder engagement. I don’t believe there’s a lot of reason to think that we’re going to have a lot of force for change. This administration’s Justice Department has been less interested in thinking about these questions than the Obama administration, and frankly, the Obama administration wasn’t as interested in taking these questions seriously as I wish they would have been.

All this is related to my next question. Change is hard in general, but what are some specific factors that are keeping the courts from changing?

There are several factors. One is the power of precedent in legal decision-making. You have these techniques and some have been around for a long time, and there’s a bunch of judicial opinions that say they’re admissible and legitimate. They may not be well-reasoned. They may not be based on a thoughtful examination of the underlying validity of the science, but there they are. So you have busy trial court judges making admissibility decisions about techniques that have been around for a long time and the easy thing to do, no question, is to preserve the status quo.

Given that we have a system that emphasizes precedent, that’s an even easier thing for judges to do. Many judges have been reluctant to even hold hearings about the question of adequate reliability, or some who permit such hearings end up shrugging and saying, “it could go either way, but we’ve used it for a long time so it’s good enough.” It probably doesn’t help matters that more judges with criminal law backgrounds come from the prosecuting side than the defense side and these techniques feel like they’re in the realm of common sense.

That’s the judicial side. On the forensic science side, many don’t have any science background. They come to law enforcement and don’t necessarily have a college degree, either. Now many forensic departments do require an undergrad science degree, but it’s very rare to have PhD-level science training, and many forensic scientists are not themselves scientific researchers, so they’re not well-positioned to research their own discipline or think about it from a research perspective. That doesn’t mean they’re not professionals trying to do a good job, but they’re not well-situated to be engaged in the exercise of establishing validity or to deeply understand what that requires. There’s begun to be some spaces within universities looking at these questions, but still not a lot.

So we continue to have a sort of guild mentality with forensic science, judges who have institutional incentives not to look deeply, and prosecutors who often tend to have more resources than the defense attorneys. That’s not an encouraging recipe for change.

Today’s Storystream

Feed refreshed An hour ago The tablet didn’t call that play by itself

The Verge
Mary Beth GriggsAn hour ago
We’re about an hour away from a space crash.

At 7:14PM ET, a NASA spacecraft is going to smash into an asteroid! Coverage of the collision — called the Double Asteroid Redirection Test — is now live.

Emma RothTwo hours ago
There’s a surprise in the sky tonight.

Jupiter will be about 367 million miles away from Earth this evening. While that may seem like a long way, it’s the closest it’s been to our home planet since 1963.

During this time, Jupiter will be visible to the naked eye (but binoculars can help). You can check where and when you can get a glimpse of the gas giant from this website.

Asian America learns how to hit back

The desperate, confused, righteous campaign to stop Asian hate

Esther Wang12:00 PM UTC
Emma Roth7:16 PM UTC
Missing classic Mario?

One fan, who goes by the name Metroid Mike 64 on Twitter, just built a full-on 2D Mario game inside Super Mario Maker 2 complete with 40 levels and eight worlds.

Looking at the gameplay shared on Twitter is enough to make me want to break out my SNES, or at least buy Super Mario Maker 2 so I can play this epic retro revamp.

External Link
Russell Brandom7:13 PM UTC
The US might still force TikTok into a data security deal with Oracle.

The New York Times says the White House is still working on TikTok’s Trump-era data security deal, which has been in a weird limbo for nearly two years now. The terms are basically the same: Oracle plays babysitter but the app doesn’t get banned. Maybe it will happen now, though?

Richard Lawler6:54 PM UTC
Don’t miss this dive into Guillermo del Toro’s stop-motion Pinocchio flick.

Andrew Webster and Charles Pulliam-Moore covered Netflix’s Tudum reveals (yes, it’s going to keep using that brand name) over the weekend as the streamer showed off things that haven’t been canceled yet.

Beyond The Way of the Househusband season two news and timing information about two The Witcher projects, you should make time for this incredible behind-the-scenes video showing the process of making Pinocchio.

External Link
Russell Brandom4:29 PM UTC
Edward Snowden has been granted Russian citizenship.

The NSA whistleblower has been living in Russia for the 9 years — first as a refugee, then on a series of temporary residency permits. He applied for Russian citizenship in November 2020, but has said he won’t renounce his status as a U.S. citizen.

External Link
Emma Roth4:13 PM UTC
Netflix’s gaming bet gets even bigger.

Even though fewer than one percent of Netflix subscribers have tried its mobile games, Netflix just opened up another studio in Finland after acquiring the Helsinki-based Next Games earlier this year.

The former vice president of Zynga Games, Marko Lastikka, will serve as the studio director. His track record includes working on SimCity BuildIt for EA and FarmVille 3.

External Link
Andrew J. Hawkins3:37 PM UTC
Vietnam’s EV aspirant is giving big Potemkin village vibes

Idle equipment, absent workers, deserted villages, an empty swimming pool. VinFast is Vietnam’s answer to Tesla, with the goal of making 1 million EVs in the next 5-6 years to sell to customers US, Canada and Europe. With these lofty goals, the company invited a bunch of social media influencers, as well as some auto journalists, on a “a four-day, multicity extravaganza” that seemed more weird than convincing, according to Bloomberg.

James Vincent3:17 PM UTC
Today, 39 years ago, the world didn’t end.

And it’s thanks to one man: Stanislav Petrov, a USSR military officer who, on September 26th, 1983, took the decision not to launch a retaliatory nuclear attack against the US. Petrov correctly guessed that satellite readings showing inbound nukes were faulty, and so likely saved the world from nuclear war. As journalist Tom Chivers put it on Twitter, “Happy Stanislav Petrov Day to those who celebrate!” Read more about Petrov’s life here.

Soviet Colonel who prevented 1983 nuclear response
Photo by Scott Peterson/Getty Images
The Verge
James Vincent3:03 PM UTC
Deepfakes were made for Disney.

You might have seen the news this weekend that the voice of James Earl Jones is being cloned using AI so his performance as Darth Vader in Star Wars can live on forever.

Reading the story, it struck me how perfect deepfakes are for Disney — a company that profits from original characters, fans' nostalgia, and an uncanny ability to twist copyright law to its liking. And now, with deepfakes, Disney’s most iconic performances will live on forever, ensuring the magic never dies.

External Link
Elizabeth Lopatto2:41 PM UTC
Hurricane Fiona ratcheted up tensions about crypto bros in Puerto Rico.

“An official emergency has been declared, which means in the tax program, your physical presence time is suspended,” a crypto investor posted on TikTok. “So I am headed out of the island.” Perhaps predictably, locals are furious.

The Verge
Richard Lawler2:09 PM UTC
Teen hacking suspect linked to GTA 6 leak and Uber security breach charged in London.

City of London police tweeted Saturday that the teenager arrested on suspicion of hacking has been charged with “two counts of breach of bail conditions and two counts of computer misuse.”

They haven’t confirmed any connection with the GTA 6 leak or Uber hack, but the details line up with those incidents, as well as a suspect arrested this spring for the Lapsus$ breaches.