AI researchers sometimes refer to machine learning technology as “brittle.” By this, they mean that artificial intelligence lacks a human’s understanding of real world complexities, with the end result being that AI systems sometimes break in quick and unexpected ways.
For a more practical illustration of what “brittleness” means, though, simply consider the case of the AI camera operator deployed by Scottish soccer team Inverness Caledonian Thistle FC. When the pandemic stopped fans attending matches, the club announced it would live stream its games, using an automatic camera system with “in-built, AI, ball-tracking technology” to make sure people always get the best view of the action.
But, during a recent live stream of matches, the AI camera operator repeatedly (and to great effect) confused a linesman’s bald head for the soccer ball itself. In a compilation video below with an excellent soundtrack you can see the end result. It’s like the AI has a crush on the linesman, and can’t help but zoom in on his beautiful, gleaming bonce.
Pixellot, the company that makes the camera technology used by Inverness Caledonian Thistle, confirmed to The Verge that the problem was caused by visual similarities between the linesman’s head and the soccer ball. They noted that the angle of the camera didn’t help, as it made it seem as if the linesman’s head was inside the boundaries of the pitch, and the game ball itself was yellow, which added to the confusion. The company said the error was fixed shortly after the game ended.
“Last month we produced 105,000 hours of live sports without any staff at the venue. That’s roughly about 50,000 games,” said the spokesperson. “In one of the games there was indeed a tracking problem that was addressed.”
But again, this is why AI is sometimes called brittle. A human being would never make this mistake, but a machine learning system with limited understanding of both soccer balls and human anatomy would. And while this particular example is very funny, these sorts of mistakes can happen to any AI system. This error is oddly similar, for example, to some mistakes made by self-driving cars that have caused fatal crashes. In one case, Tesla’s “autopilot” software failed to distinguish between the white side of a truck and the sky.
Inverness Caledonian Thistle don’t employ a cameraman as their camera is programmed to follow the ball throughout the match. The commentator had to apologise today as the camera kept on mistaking the ball for the linesman’s head... pic.twitter.com/LeKsc2bEj7— Tom Cox (@seagull81) October 24, 2020
Yeah missed our goal my team Ayr Utd kept thinking the Lino bald head was the ball— Scott K.⚽️ (@skayr100) October 26, 2020
According to tweets from the match itself (seen via IFLScience), the situation was so bad that the game’s commentator had to apologize for the malfunctioning camera at one point. One fan even said he missed watching his team score because of the AI’s lack of focus.
Update November 5th, 4:30AM ET: Story updated with confirmation from Pixellot about the nature of the error.