Lawyers and academics have heavily criticised Australia\u2019s first live AI face scanning trial, warning there are serious concerns around privacy, misidentification, and even potential for racial profiling.<\/p>\n
Western Australia Police began the five-month trial in June, where marked vans, mounted with cameras, scanned faces of people in real time and matched them against a watchlist of around 4,000 people. <\/p>\n
During the trial, 130,000 faces were scanned in the first week, leading to 33 alerts and 18 arrests in the state\u2019s capital. Two false alerts were also recorded during the same week. <\/p>\n
<\/p>\n
Legal experts argued there are serious ethical and legal concerns with the use of a technology in the public space that accesses sensitive personal data on a large scale. <\/p>\n
\u201cThere is a tendency on the part of police to then use it to surveil and monitor activity of people who might be going about their lawful business,\u201d Australian Lawyers Alliance spokesperson Greg Barns SC warned. <\/p>\n
\u201cFor example, people attending protests, people who are simply congregating with other people in a public setting.<\/p>\n
\u201cIt\u2019s sort of surveillance without a need for a warrant, which you would normally need in order to surveil a person.\u201d <\/p>\n
What makes Australia more vulnerable compared to other countries that are using this technology is weaker privacy laws, Mr Barns told news.com.au. <\/p>\n
\u201cIf your privacy is breached, it\u2019s far from clear that the law will protect you and that you can seek damages, which of course, in the UK, you can,\u201d Mr Barns said. <\/p>\n
If for any reason, innocent people are misidentified and wrongly accused of criminal offences, Australian laws are too restricted to give them any chance of suing for damages.<\/p>\n
\u2018Lack of transparency\u2019<\/p>\n
The lawyer also slammed the \u201clack of transparency\u201d around the program, saying there were questions to be asked. <\/p>\n
\u201cThis is a sort of mass surveillance gathering exercise with very little accountability attached to it,\u201d he said. <\/p>\n
University of Western Australia legal academic Anna Zenz found it \u201cstriking\u201d that WA Police did not even formally consult the state\u2019s own privacy watchdog, the Office of the Information Commissioner, before starting the trial. <\/p>\n
Ms Zenz echoed privacy concerns, saying technologies like this not only eroded personal privacy but also our collective privacy. <\/p>\n
\u201cIf you feel like you are constantly being watched in a public space and essentially the amount of public spaces that are not impacted by these technologies are becoming less and less, society\u2019s behaviour changes,\u201d she said. <\/p>\n
\u201cYour behaviour in moving around in public changes, and trust levels fall.\u201d <\/p>\n
These technologies have a tendency to creep outside their initial use, something Ms Zenz described as \u201cFunction Creep\u201d, where a trial could become permanent and overt use could become covert use, and the context of use could change.<\/p>\n
Despite WA Police saying no data is recorded or kept, Ms Zenz argued data security and hacking were still valid concerns. <\/p>\n
\u201cBecause it is such sensitive, highly personal data security concerns, cyber security risks are really consequential,\u201d Ms Zenz warned. <\/p>\n
Experts are also concerned that the AI model is not trained on the diversity of the Australian population and, based on evidence, puts minority groups at a higher risk of misidentification. <\/p>\n
If a specific group is already overrepresented within policing and the criminal justice system, this technology will merely replicate and potentially amplify the already existing biases, Ms Zenz said. <\/p>\n
People from diverse or historically overpoliced backgrounds are forced to bear an added layer of fear in their daily life.<\/p>\n
Evidence from countries like the USA and the UK has shown the technology targets particular minority groups like black people. <\/p>\n
In Australia, that could translate into targeting and overpolicing of the indigenous communities.<\/p>\n
Do the concerns outweigh the benefits of this tool?<\/p>\n
WA police commissioner Col Blanch has argued the system is a policing tool rather than a general surveillance network. <\/p>\n
\u201cLive Facial Recognition is about protecting people, not watching people. It is another tool to help police find the right people, at the right time, for the right reasons,\u201d the commissioner said in a statement. <\/p>\n
This technology is often sold to organisations, particularly police forces, as a cost-effective solution to better use their resources, Australian National University digital sociologist Jessamy Perriam said. <\/p>\n
\u201cI think there is a desire in the community for the police to be seen\u2026 and public places feel safe for people, but it has to be done in a way that\u2019s appropriate and respects people\u2019s privacy and boundaries,\u201d she said. <\/p>\n
The experts have all called for greater transparency from WA Police and an independent oversight into the use of this technology to protect public rights. <\/p>\n","protected":false},"excerpt":{"rendered":"Lawyers and academics have heavily criticised Australia\u2019s first live AI face scanning trial, warning there are serious concerns…\n","protected":false},"author":2,"featured_media":70115,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[94857,41606,68628,94828,94788,94805,94829,42937,83072,94858,48894,94818,80535,48811,94827,94846,63538,94835,40365,94859,94791,94843,80198,94844,37726,94856,66931,60091,65454,94845,36956,31226,36871,94836,94831,94848,43057,52658,94819,22,7776,23,50036,94825,94814,94811,21,94817,28761,62508,94804,94832,94849,37643,94803,94842,94862,94786,94798,94822,10485,28795,48864,6168,94797,5683,36788,9211,37678,68003,94824,30147,94799,94853,94854,94840,94826,94800,37007,94855,50134,48831,37915,94792,94785,7350,94852,94847,1047,94810,30419,33000,94809,12263,94801,56139,3481,16460,93700,48915,94796,94813,40750,94806,15263,5953,62463,52913,94839,94833,94837,94834,40064,75792,37538,46306,55727,62090,76310,64488,48807,94830,94789,41212,46333,34680,40685,42211,37121,41308,94787,38149,94795,66510,68351,37964,41531,45053,38363,37041,94816,39522,94823,94850,94815,94802,94807,94793,45045,94861,28435,8962,16755,48875,3921,94821,94860,94820,94838,3746,94808,94812,94794,22441,94841,8670,94851,94790],"class_list":["post-70114","post","type-post","status-publish","format-standard","has-post-thumbnail","category-australia","tag-mass-surveillance-exercise","tag-s-behaviour","tag-s-capital","tag-s-first-live-ai-face","tag-s-own-privacy-watchdog","tag-function-creep","tag-000-faces","tag-000-people","tag-83072","tag-18-arrests","tag-33-alerts","tag-a-cost-effective-solution","tag-a-desire","tag-a-general-surveillance-network","tag-a-higher-risk","tag-a-large-scale","tag-a-need","tag-a-new-range","tag-a-person","tag-a-policing-tool","tag-a-public-setting","tag-a-public-space","tag-a-sort","tag-a-specific-group","tag-a-statement","tag-a-technology","tag-a-tendency","tag-a-trial","tag-a-warrant","tag-a-watchlist","tag-a-week","tag-academics","tag-activity","tag-an-added-layer","tag-android-based-biometric-payment-terminals","tag-another-tool","tag-any-chance","tag-any-reason","tag-around-4","tag-au","tag-aus","tag-australia","tag-australian-laws","tag-australian-lawyers-alliance-spokesperson-greg-barns-sc","tag-australian-national-university-digital-sociologist-jessamy-perriam","tag-australian-streets","tag-austrlia","tag-black-people","tag-cameras","tag-countries","tag-covert-use","tag-criminal-offences","tag-cyber-security-risks","tag-damages","tag-damages-lack","tag-data-security-and-hacking","tag-diverse-or-historically-overpoliced-backgrounds","tag-eftpos-new-zealand","tag-essentially-the-amount","tag-even-potential","tag-evidence","tag-experts","tag-faces","tag-fear","tag-highly-personal-data-security-concerns","tag-innocent-people","tag-june","tag-lawyer","tag-lawyers","tag-lawyers-and-academics","tag-leading-lawyers-and-academics","tag-live-facial-recognition","tag-marked-vans","tag-mass-surveillance-gathering-exercise","tag-minority-groups","tag-misidentification","tag-mr-barns","tag-ms-zenz","tag-news-com-au","tag-no-data","tag-organisations","tag-other-countries","tag-other-people","tag-our-collective-privacy","tag-particular-minority-groups","tag-people","tag-permanent-and-overt-use","tag-personal-privacy","tag-police","tag-police-forces","tag-policing","tag-privacy","tag-privacy-concerns","tag-protests","tag-public-changes","tag-public-places","tag-public-spaces","tag-questions","tag-racial-profiling","tag-real-time","tag-sensitive","tag-sensitive-personal-data","tag-serious-concerns","tag-serious-ethical-and-legal-concerns","tag-shoppers","tag-society","tag-sort","tag-surveillance","tag-technologies","tag-the-ai-model","tag-the-already-existing-biases","tag-the-australian-population","tag-the-benefits","tag-the-commissioner","tag-the-community","tag-the-concerns","tag-the-context","tag-the-criminal-justice-system","tag-the-diversity","tag-the-first-week","tag-the-five-month-trial","tag-the-indigenous-communities-do","tag-the-information-commissioner","tag-the-lack","tag-the-launch","tag-the-law","tag-the-office","tag-the-part","tag-the-police","tag-the-program","tag-the-public-space","tag-the-right-people","tag-the-right-reasons","tag-the-right-time","tag-the-same-week","tag-the-state","tag-the-system","tag-the-technology","tag-the-trial","tag-the-uk","tag-the-usa","tag-the-use","tag-their-daily-life-evidence","tag-their-faces-or-palms-legal-experts","tag-their-initial-use","tag-their-lawful-business","tag-their-resources","tag-these-technologies","tag-this-technology","tag-this-tool","tag-transparency","tag-trial","tag-trust-levels","tag-two-false-alerts","tag-university","tag-valid-concerns","tag-vans","tag-verifone-victa","tag-very-little-accountability","tag-wa-police","tag-wa-police-ai-facial-recognition-trial","tag-wa-police-commissioner-col-blanch","tag-weaker-privacy-laws","tag-wednesday","tag-western-australia-legal-academic-anna-zenz","tag-western-australia-police","tag-your-behaviour","tag-your-privacy"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/posts\/70114","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/comments?post=70114"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/posts\/70114\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/media\/70115"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/media?parent=70114"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/categories?post=70114"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/australia\/wp-json\/wp\/v2\/tags?post=70114"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}