Information and Privacy Commissioner for British Columbia Michael McEvoy during a news conference in Vancouver, Tuesday, Nov. 26, 2019. THE CANADIAN PRESS/Darryl Dyck

Information and Privacy Commissioner for British Columbia Michael McEvoy during a news conference in Vancouver, Tuesday, Nov. 26, 2019. THE CANADIAN PRESS/Darryl Dyck

Canada crawling toward AI regulatory regime, but experts say reform is urgent

Clearview AI said in July it will no longer provide facial recognition services in Canada

On Thursday, privacy watchdogs revealed that five million images of shoppers’ faces were collected without their consent at a dozen of Canada’s most popular malls.

Real estate company Cadillac Fairview embedded cameras equipped with facial-recognition technology, which draws on machine-learning algorithms, in digital information kiosks to discern shoppers’ ages and genders, according to an investigation by the federal, Alberta and B.C. privacy commissioners.

But the commissioners had no authority to levy fines against the firm, or any companies that violate Canadians’ personal information, an “incredible shortcoming of Canadian law that should really change,” B.C. information and privacy commissioner Michael McEvoy said in an email.

The revelation shines a light on the legal void around algorithmic technology. Despite its status as an artificial-intelligence hub, Canada has yet to develop a regulatory regime to deal with problems of privacy, discrimination and accountability to which AI systems are prone, prompting renewed calls for regulation from experts and businesses.

“We are now being required to expect systematic monitoring and surveillance in the way that we walk down the road, drive in our cars, chat with our friends online in small social-media bubbles. And it changes the way that public life occurs, to subject that free activity to systematic monitoring,” said Kate Robertson, a Toronto-based criminal and constitutional lawyer.

At least 10 Canadian police agencies, including the RCMP and Calgary and Toronto police services, have used Clearview AI, a facial-recognition company that scraped images from the Internet for use in law enforcement investigations across the continent, according to a report co-written by Robertson.

Other Ontario police forces also may be “unlawfully intercepting” private conversations in online chat rooms via “algorithmic social-media surveillance technology,” according to the September report from the University of Toronto’s Citizen Lab and International Human Rights Program.

Clearview AI said in July it will no longer provide facial recognition services in Canada, but many companies offer similar services.

“We have seen the lack of clear limits and focused regulation leaving an overly broad level of discretion in both the public and police sectors that is a call to action for governments across the country,” Robertson said in a phone interview.

Canada needs to roll out concrete rules that balance privacy and innovation, said Carolina Bessega, co-founder and chief scientific officer of Montreal startup Stradigi AI.

Public trust in artificial intelligence becomes increasingly crucial as machine-learning companies move from the conceptual to the commercial stage, she said. “And the best way to trust AI is to have clear regulations.”

The regulatory vacuum also discourages businesses from deploying AI, holding back innovation and efficiency — particularly in hospitals and clinics, where the implications can be life or death.

“Right now it’s like a grey area, and everybody’s afraid making the decision of, ‘OK, let’s use artificial intelligence to improve diagnosis, or let’s use artificial intelligence to help recommend a treatment for a patient,’” Bessega said.

Innovation Minister Navdeep Bains tells The Canadian Press that an update to 20-year-old privacy legislation is due “in the coming weeks” to address gaps in personal-data protection, but refused to nail down a timeline.

The would-be law should “empower Canadians to have better accountability and to promote responsible innovation,” he said.

Bains pointed to the European Union’s General Data Protection Regulation from 2018 as a model that hands citizens more control over their privacy and digital information through “clear enforcement mechanisms,” he said.

The absence of an AI legal framework has implications for Canadians in areas ranging from law enforcement to immigration.

So-called predictive policing — automated decision-making based on data that predicts where a crime will occur or who will commit it — has had a disproportionate impact on racialized communities, said Robertson of Citizen Lab.

Examples include a now-abandoned Chicago police initiative where the majority of people on a list of potential perpetrators were Black men who had no arrests or shooting incidents to their names, as well as a scuttled Los Angeles police strategy that saw officers targeting possible crime hot spots based on information gleaned from utility bills, foreclosure records and social-service files.

Since 2015, police departments in Vancouver, Edmonton, Saskatoon and London, Ont. have implemented or piloted predictive policing.

The federal immigration and refugee system also relies on algorithm-driven decisions to help determine factors such as whether a marriage is genuine or if someone should be designated as a “risk,” according to another Citizen Lab study, which found the practice threatens to violate human-rights law.

AI testing and deployment in Canada’s military prompted Canadian deep-learning pioneers Geoffrey Hinton and Yoshua Bengio to warn about the dangers of robotic weapons and outsourcing lethal decisions to machines, and to call for an international agreement on their deployment.

The federal government launched the Advisory Council on Artificial Intelligence in May 2019, and Canada was among the first states to develop an official AI research plan, unveiling a $125-million strategy in 2017. But the focus of both is largely scientific and commercial.

The advisory council, which includes a working group that aims to “foster trust” in the technology, has yet to produce a public report.

In June, Canada, France and 13 other countries launched an international AI partnership to guide policy development with an eye to human rights, with its working group on responsible AI co-chaired by Bengio (who also co-chairs the advisory council). But drafting laws is beyond its mandate.

“Canada’s approach to AI appears to be focused on funding research as opposed to developing regulations and governance structures,” according to a U.S. Library of Congress report from January 2019.

Until legislation arrives in Parliament, experts say the observation still holds true.

Christopher Reynolds, The Canadian Press


Like us on Facebook and follow us on Twitter.

Want to support local journalism during the pandemic? Make a donation here.

Technology

Get local stories you won't find anywhere else right to your inbox.
Sign up here

Just Posted

Alberta’s chief medical officer of health Dr. Deena Hinshaw and Premier Jason Kenney say the province would look at adding additional COVID-19 measures in the coming weeks if the virus continues to spread. (Photo by Government of Alberta)
Walk-in COVID-19 vaccination clinic to open in Red Deer

Alberta adds 1,345 new cases of the virus

Public health restrictions on non-essential travel and vacation bookings are being increased in B.C. (B.C. government)
COVID-19: B.C. announces signage along Alberta border to discourage non-essential travel

B.C. extends COVID-19 indoor dining, group fitness ban until May 25

Damien Kurek
MP Damien Kurek reflects on newly-released federal budget

‘Further, they recycle old promises they have consistently failed to deliver on’

A vial of some of the first 500,000 of the two million AstraZeneca COVID-19 vaccine doses that Canada has secured through a deal with the Serum Institute of India in partnership with Verity Pharma at a facility in Milton, Ont., on Wednesday, March 3, 2021. THE CANADIAN PRESS/Carlos Osorio - POOL
Alberta begins rolling out AstraZeneca COVID vaccine for those aged 40 or older

There are more than 70 pharmacies offering AstraZeneca, including 26 offering walk-in appointments

In this image from NASA, NASA’s experimental Mars helicopter Ingenuity lands on the surface of Mars Monday, April 19, 2021. The little 4-pound helicopter rose from the dusty red surface into the thin Martian air Monday, achieving the first powered, controlled flight on another planet. (NASA via AP)
VIDEO: NASA’s Mars helicopter takes flight, 1st for another planet

The $85 million helicopter demo was considered high risk, yet high reward

FILE - Dan Smyers, left, and Shay Mooney from the band Dan + Shay perform on NBC's Today show in New York on June 28, 2019. The duo will perform at Sunday's Academy of Country Music Awards. (Photo by Charles Sykes/Invision/AP, File)
Luke Bryan wins top ACM Award, but female acts own the night

Luke Bryan wins top ACM Award, but female acts own the night

In this undated photo provided by John-Paul Hodnett are a row of teeth on the lower jaw of a 300-million-year-old shark species named this week following a nearly complete skeleton of the species in 2013 in New Mexico. Discoverer Hodnett says it was the short, squat teeth that first alerted him to the possibility that the specimen initially dubbed "Godzilla Shark" could be a species distinct from it's ancient cousins, which have longer, more spear-like teeth. The image was taken using angled light techniques that reveal fossil features underneath sediment. (John-Paul Hodnett via AP)
‘Godzilla’ shark discovered in New Mexico gets formal name

The ancient chompers looked less like the spear-like rows of teeth of related species

sign
Alberta Biobord Corp. recently hosted a virtual open house from Stettler

The company plans to develop a fuel pellet and medium density fibre board (MDF) plant near the community

The Rogers logo is photographed in Toronto on Monday, September 30, 2019. THE CANADIAN PRESS/Tijana Martin
Rogers investigating after wireless customers complain of widespread outage

According to Down Detector, problems are being reported in most major Canadian cities

People are shown at a COVID-19 vaccination site in Montreal, Sunday, April 18, 2021, as the COVID-19 pandemic continues in Canada and around the world. THE CANADIAN PRESS/Graham Hughes
Nothing stopping provinces from offering AstraZeneca vaccine to all adults: Hajdu

Health Canada has licensed the AstraZeneca shot for use in people over the age of 18

Deputy Prime Minister and Minister of Finance Chrystia Freeland responds to a question during Question Period in the House of Commons Tuesday December 8, 2020 in Ottawa. The stage is set for arguably the most important federal budget in recent memory, as the Liberal government prepares to unveil its plan for Canada’s post-pandemic recovery even as a third wave of COVID-19 rages across the country. THE CANADIAN PRESS/Adrian Wyld
Election reticence expected to temper political battle over federal budget

Opposition parties have laid out their own demands in the weeks leading up to the budget

Most Read