Guest on AI with Sach

Allison Cohen

Senior applied AI project manager, AI for Humanity team, Mila

Episode with Allison

Allison Cohen speaking on AI with Sach, episode 17Episode 17 · November 2024AI for Humanity: A Conversation with Allison CohenAllison Cohen of Mila explains why socially beneficial AI needs slower timelines, community-defined success metrics and wider access to AI education.Allison CohenSenior applied AI project manager, AI for Humanity team, Mila

In Allison’s words

The AI industry says move fast. A Mila project lead says that's how AI for good fails.

And what I've realized in doing this work is that if we are going to be successful in deploying AI tools that have the type of impact that we're looking to see, we need to kind of move slowly because we need to build trusting relationships with the community groups and individuals who will be adopting this technology
Allison Cohen
Allison explains why the race to ship AI quickly conflicts with building tools that marginalized communities will trust.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 7:28

Measure clicks and you will build clickbait. The metric is a design decision.

And how you measure success will end up, of course, having a big impact on how you build these tools. If you're measuring click rate, you may optimize for, um, you know, click bait titles or manipulative tactics. And we don't want to do that.
Allison Cohen
Allison explains why academic and Silicon Valley metrics like citations and click-through rates can distort how AI tools are designed.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 10:20

The barrier to an AI career can start with a school that has no science teacher.

I also heard how, you know, in certain indigenous schools, there was no science teacher, for example. And so if you're not getting that kind of exposure early on or if you're not socialized to believe you can have a career in this field, there's going to be a number of people that are sort of left behind at that stage.
Allison Cohen
Allison describes how barriers to an AI career begin in primary and secondary schools for some Indigenous communities.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 17:30

If police used this AI tool the most, would that count as success? Not for this team.

But because we have decided that the values and priorities of this project are more to serve survivors of human trafficking and support them in rebuilding their lives than it is to support law enforcement agents looking to intervene in a human trafficking case, we've really defined success in terms of community trust and community uptake of the tool.
Allison Cohen
Allison describes how a human trafficking tool measures success by survivors' trust, not usage by police.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 20:30

She studied development interventions that backfired. That's why she approaches AI the way she does.

because so much of my training coming from that social science background was around interventions that were incredibly harmful. And so I saw its potential, but I also saw AI's potential for harm.
Allison Cohen
Allison explains how studying international development shaped how she looks at AI, as a non-technical person.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 3:45

Everyone wants to be the first mover in AI. Allison explains what that costs.

there's a lot of interest in moving fast and breaking things, as we know, is the motto that has sort of come out of Silicon Valley. And given how how much of an impact is likely to have and given how scalable that impact really is, there's there's almost this desire to be the first mover to have secured that kind of impact as quickly as possible.
Allison Cohen
Allison explains why balancing AI excitement with responsibility is hard.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 6:32

Responsible AI needs a structure that lets teams pause, not just good intentions.

the only way to do that is to make sure you have an organizational structure or set of incentives that allows you to pause and allows you to, for example, work with someone who is specialized in AI ethics
Allison Cohen
Allison explains how to address AI risk at each phase of development in practice.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 11:40

AI that reads emotions from faces assumes everyone shows emotion the same way. They don't.

There is, of course, plenty of controversy around emotional interpretation using artificial intelligence, because what kind of data set are you using and does it predominantly contain instances of white men and women, for example, or men and women from Canada, but then can't generalize to other cultures where emotion might be expressed very differently.
Allison Cohen
Allison lists the problems with using AI to read emotions on faces, including biased data and cultural differences.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 23:23

Some AI is sold as social good but does more harm than good. How do you tell?

So this is sort of when you start peeling back the layers of whether the tool is going to be human rights respecting in practice, whether it is really AI for humanity or whether it is disguised as being socially oriented, but in reality creates harms that are much more detrimental than the benefits.
Allison Cohen
Reacting to Sach's example of AI helping police de-escalate arrests, Allison asks whether a tool labelled as beneficial really is.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 24:29

AI may not replace lawyers or therapists, but it could make them affordable.

maybe, you know, the technology won't replace these professionals fully, but maybe it actually can drive down the cost significantly so that more people can gain access to important services.
Allison Cohen
Looking five to ten years ahead, Allison considers AI as therapist or lawyer substitutes and the access question.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 25:37

Who gets to be the spokesperson for AI? Allison says to question the story you're told.

But I think it's always important to make sure that we are staying very critical of the narrative that's being put forward. Because, again, we know how exclusionary the field is, and we know how exclusionary it is to sort of be the spokesperson for the field.
Allison Cohen
Asked for a final message, Allison urges listeners to question who is telling the AI story.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 26:54

The people who label AI's data have been left out of the AI story for years.

I'm thinking about all the examples of the exploitation of data workers and the fact that that's sort of been swept under the rug for a really long time. But I really hope that people start to get more engaged in the field and the barriers to entry start lowering because it's going to continue to have such a dramatic effect on our world.
Allison Cohen
In her closing message, Allison points to data workers' exploitation as something the AI narrative has hidden.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 27:27

Is human-rights-first AI a Canadian idea? Mila's story suggests it is.

I think, to some extent, there's something somewhat Canadian about wanting the technology that we're building to be incredibly human rights respecting.
Allison Cohen
Allison explains why Mila emphasizes AI for Humanity, linking it to Canadian values and its origins.
Said on AI with Sach · Ep. 17 · Nov 2024 · at 4:31