As facial recognition spreads across police forces and retail stores, UK biometrics commissioners are warning that national oversight is lagging far behind the technology’s rapid expansion.
Last year, the Home Office admitted facial recognition cameras were more likely to incorrectly identify black and Asian people than their white counterparts, and women more than men, and there have been conflicting studies on their overall accuracy.
99.98% accuracy of the people it flags as shoplifters or 99.98% accuracy overall? And if the latter then what proportion of the population are even shoplifters? Could you achieve similar levels of “accuracy” by saying nobody is a shoplifter? Maybe throw in a few positives here and there to make it look like your product does something other than harass the public?
You’re right to question this.
In machine learning Accuracy means the correct % of overall classifications. There’s some other terms like:
So in the case of classification of shoplifters ideally you would focus on Precision as false positives are undesired, but if a company doesn’t care about false positives as much as getting the shoplifters they’d focus on Recall. In either event, Accuracy is a poor metric to use or advertise in an imbalanced data set like shoplifting as most customers are not shoplifters so even if the model didn’t classify anyone as a shoplifter they’d still be 99+% accurate.