Alvaro Oleart on the instrumentalisation of EU participation processes & limits of AI for democracy
Ep. 55

Alvaro Oleart on the instrumentalisation of EU participation processes & limits of AI for democracy

Episode description

Alvaro Oleart is an academic researcher based in Brussels at the Université Libre de Bruxelles. His work focuses on social movements, EU participatory practices, democratic innovation, and the political economy of technology. In this conversation, he offers a critical perspective on citizen assemblies, arguing that they can depoliticize democracy when they bypass collective actors such as trade unions, political parties, civil society organizations, and social movements. We also discuss Big Tech, AI, the industry of participation, technology in deliberation, the agentic state, and why democratic innovation should focus more on collective power than on small groups of selected individuals.

Download transcript (.srt)
0:00

Welcome to another episode of the Democracy Innovative Podcast and

0:02

our guest of today is Alvaro Oleanoff.

0:05

Thank you, Alvaro, for your time.

0:08

Thanks, Alexander, for the invitation.

0:10

Would you like to tell us something about you,

0:13

your academic background or also your personal background?

0:18

Yeah, so I am an academic researcher based in Brussels at the Université Libre

0:23

de Bruxelles and I have worked a lot on social movements.

0:27

did my PhD on the TTIP contestation and debates,

0:32

the EU-US trade agreement that was negotiated about 10 years ago by the

0:36

EU with the US. So I was very much interested in the relation between conflict

0:39

and democracy. And more recently,

0:42

I worked a lot on

0:43

the participatory practices of the EU more concretely looking

0:47

at European Citizens Initiative,

0:49

the Conference on the Future of Europe or the European Citizen Panels.

0:55

OK. And what have you discovered while you were working

1:01

on these topics?

1:02

Yeah, well, mean, I am quite, I mean,

1:06

maybe disappointed is not the right question because maybe I

1:08

was not necessarily expecting a lot from the EU in regards to participation.

1:12

But it remains quite shocking the citizen watching practices that

1:17

the ~ EU mobilizes in regards to participation.

1:21

So how there is a very strategic deployment

1:26

of so-called democratic innovations.

1:29

to basically whitewash the policies that are mostly decided beforehand.

1:34

And in this kind of process, there's actually not really much possibility

1:39

of shaping the underlying philosophy with which these processes

1:43

and policies are built.

1:46

But where do you identify like the main issue?

1:49

in the, because I can see the fact that just a

1:55

few people are involved in citizen assemblies or maybe also the fact that

2:01

the commitment. the output of a citizen assembly not always become,

2:05

let's say the input of a policy.

2:09

So I think that there's a problem with the process,

2:13

not only with the output. I know that there's a lot of colleagues that have been

2:16

making the argument about how,

2:18

for example, citizens' assemblies need to be sort of like the output needs

2:22

to be binding, right? And if the outcome is binding,

2:25

then this will improve the democratic legitimacy of these processes.

2:29

I am really not convinced about this because the process itself

2:33

and underlying philosophy with which citizen assemblies are conceived

2:37

I think is problematic because it's in most of the cases,

2:40

beginning from a very depoliticized conception of democracy that sidelines

2:47

the actors that I think are central to any democratic process,

2:50

which are collective actors, trade unions,

2:53

mass political parties, and mass politics more generally.

2:56

And I think in most of these citizen assemblies,

2:59

and I have studied primarily the ones taking place at the European level,

3:03

So I know that the citizen assemblies taking place at the national level,

3:07

sometimes there are some specificities that make them ~ a little

3:11

bit more legitimate. Like I'm thinking,

3:13

for example, about the French Convention,

3:15

Citizen Convention on Climate,

3:16

that actually triggered quite a lot of public debate.

3:19

And I thought that was very interesting.

3:20

So to me, the assembly itself was good in so far,

3:24

it was able to have an impact in public debates.

3:27

~

3:28

But in most of the cases, these citizen assemblies go completely under

3:32

the radar of public debates and are simply used by institutions

3:36

to legitimize their positions,

3:38

which I find very deeply problematic.

3:42

And so how can be this problem fixed?

3:46

Because you mentioned that the process is the problem.

3:49

so connecting the Citizen Assembly maybe to some social movement,

3:53

you mentioned, I don't know, maybe political parties,

3:56

maybe...

3:59

Yeah, I am not particularly favorable to the idea of citizen assembly,

4:03

so I am not sure that the fix is how to connect better citizen assemblies

4:07

to social movements. I think to begin as thinking that citizen assemblies

4:12

are the solution is part of the problem.

4:14

And I think, okay, what are the real or what are the kind of causes that

4:21

we have ~ in which

4:23

We see that democracy ~ is at risk or that we have democratic regression.

4:29

What are the causes? Is the cause that there are no citizen assemblies

4:32

or that there are no more citizen assemblies?

4:34

I am not really convinced about that.

4:36

Is the cause more related to, for instance,

4:40

the ~ political infrastructure of political parties,

4:43

of trade unions? I think that is where I start seeing a little bit some

4:48

of the problems.

4:49

Therefore, of course, the kind of structural racism,

4:53

structural sexism that operates,

4:55

and of course, the role of private kind of corporations that are clearly playing

5:00

an important role in democratic regression.

5:03

Are citizen assemblies able to kind of address any of those things?

5:07

I am really not convinced. And actually,

5:09

the argument that I have been making is that actually,

5:11

citizen assemblies have the potential to make it worse.

5:14

especially on the first point,

5:16

because a lot of citizen assemblies are based on this sort of disintermediation.

5:20

So basically, it's an attempt where institutions often relied

5:25

on intermediary bodies to connect with citizens,

5:27

right? So, you know, there was not a direct relation between citizens

5:31

and public institutions, but there were many intermediary bodies,

5:35

trade unions, mass political parties,

5:37

civil society organizations.

5:39

that play this intermediary role,

5:41

right? And with the citizen assemblies,

5:45

there's an attempt to kind of construct a more direct relation between public

5:49

authorities and citizens and basically sidelining all these mediators and say,

5:54

you know, we don't need them. They don't represent,

5:56

trade unions don't represent people.

5:58

~ Civil society does not represent people.

6:00

Let's just construct a direct relation and let's use sortition as a way

6:05

to ~ basically get what they call ~ descriptive representation,

6:09

which I think is deeply problematic among other things for this reason.

6:14

And in doing so, it actually weakens the legitimacy of these intermediary actors

6:20

that are not only not invited,

6:22

they're just not even considered to be part ~ of the discussion.

6:26

in some ways, think citizen assemblies may be

6:29

more part of the problem than of the solution.

6:32

So that's a little bit the kind of starting point from which I kind of see them.

6:38

And you see some other participatory practice that can be used.

6:45

Like I'm thinking technology can be used in politics.

6:48

And also like it's also what we mean with citizen assembly thinking.

6:55

Because ~ if it is a citizen assembly organized by the AU...

7:00

and there are, I don't know, just 100 people randomly extracted,

7:04

then of course it's not very significant.

7:09

I'm thinking which kind

7:09

Okay.

7:15

of practice can be used in relation to technology and politics

7:19

to understand what citizens want.

7:22

So there are two things in your question.

7:24

The first one is what about the practices?

7:26

But of course, when I think about democracy,

7:29

democracy is not just kind of a set of best practices,

7:32

right? It's also the possibility to contest the foundations of society.

7:37

And ~ to me, then it is not just about sort of what are the best.

7:42

practices, but what's the end game?

7:46

What kind of society do we want?

7:48

And these type of debates, of course,

7:51

there are some forums that are better suited to have these debates.

7:55

But I think it is important to have these debates and not to have them

7:58

as individuals, like me as Albert or you as Alessandro,

8:02

but to have them through collective actors.

8:04

we as workers in a trade union,

8:06

we as people that share particular ideology and so on.

8:09

So that's the starting point to me is the importance of collective actors

8:14

in challenging what we think our society,

8:18

how our society should be organized.

8:21

Because often the best practices is a way of kind of narrowing a

8:24

lot of the discussion. It's like,

8:26

OK, let's have a

8:28

you know, citizen assembly about,

8:30

~ like for example, the European Union organized the commission on food waste.

8:33

Let's, you know, have some very concrete recommendations about food waste.

8:36

Yeah, but if you do that, you're taking away,

8:39

you're depoliticizing the process by taking away the possibility

8:42

of asking some fundamental kind of questions.

8:45

And basically you end up with,

8:47

okay, you know, how best to, you know,

8:50

recycle as individuals and how best not to,

8:52

you know, you know, this literally a suggestion from by someone.

8:56

that was part of the expert group of the European Commission on the Citizen Panel

9:00

on Foodways that basically recommended to go to the shopping store with shopping

9:06

lists because if you have a shopping list then you don't buy more than you need.

9:10

Therefore, it's this very individual perspective.

9:12

So the first part is about, okay,

9:14

we need more collective actors.

9:16

I can already tell you I don't have a very concrete institutional proposal about

9:21

how best to kind of organize ~ participation.

9:25

And then the second dimension of your question was about technology.

9:29

And I find this really interesting and this way we have also,

9:33

I have also worked with some colleagues on this.

9:35

So notably with Perel Petit, we wrote a paper on the citizen washing

9:41

of EU tech policies by the EU in which we looked at the panels that

9:46

the EU organized in regards to technology.

9:48

So basically technology as an object of deliberation.

9:53

And then I worked on another paper with Nicolas Palomo

9:57

on basically how technology is increasingly seen as ~ a

10:03

way to improve deliberation. So technology as an instrument that might help

10:09

to get deliberation, right? And in this context,

10:13

I find problematic to see first technology as necessarily a positive kind

10:18

of solution to something. It's like,

10:20

well, OK.

10:21

~ We first have to diagnose what the problem is in order to then find

10:25

a solution When technology is used as as a means to improve the liberation?

10:30

We don't or you know the the the organizations that are mobilizing kind

10:35

of This logic I think have a very technocratic understanding of deliberation,

10:39

you know because they say okay,

10:40

you know you know AI can help us to you know,

10:44

take notes and you know make a

10:47

you know, moderation easier and things like that.

10:50

you know, the problem is not just the technocratic one of,

10:54

know, solving some kind of things that ~ organizers deal with,

10:59

but there's a more fundamental problem.

11:01

And then there's a deeper question about technology,

11:04

which is, okay, who is controlling technology?

11:06

Because technology is not just a neutral kind of ~ tool,

11:10

but has a philosophy embedded in it.

11:14

And here is where I think the role of big tech companies is very relevant because

11:18

they are increasingly being precisely part of the problem,

11:22

right? And we see the role of tech oligarchs that are having

11:26

an increasingly important role in democratic regression,

11:29

supporting far-right parties everywhere,

11:31

and shaping a lot of the conversations.

11:34

So that's why I like to see as well technology both as an object

11:38

of deliberation but also

11:39

as a means to improve the liberation.

11:41

And when looking at that, we really need to look at the underlying kind

11:45

of political economy of technology and the political economy of society more broadly

11:49

and question it.

11:52

I think the problem can be the fact that the citizen assembly is

11:58

not organized by the citizens.

12:00

Because I'm thinking if, I don't know,

12:03

like in a town, citizens could organize a citizen assembly by themselves,

12:08

choosing the topic and so on, or like also,

12:10

I don't know, in different cities to propose something to change the law,

12:17

then...

12:17

maybe could be different.

12:19

I mean, I am not convinced either about the possibility of citizens organizing their

12:24

own, but I do think that as you're already hinting at,

12:28

there is an important question in analyzing who is organizing citizen assemblies

12:33

because we are also seeing a massive increase of the industry of participation.

12:37

So there is increasingly basically private companies that are whose

12:42

job is to organize citizen assemblies.

12:44

you know, even if

12:45

many of them have this kind of rhetoric and discourse about improving democracy

12:51

and so on. Ultimately, they are also private consultancies and companies that their

12:58

products, the products they sell are citizen assemblies.

13:01

This is what's happening. And we cannot disentangle this from also

13:06

the relation they have to, for example,

13:08

in the case of technology, with some private companies.

13:10

and private tech companies more concretely because it's not by chance that there's

13:14

a lot of tech companies that are increasingly interested

13:17

in citizen participation precisely because they see their objects of they

13:22

are blamed for lack of democracy and so on.

13:25

Obviously that's obviously accurate.

13:29

But we see for example in the US the Stanford Deliberative Democracy Lab.

13:34

that is, I think, was headed by James Fishkin,

13:37

a well-known academic in the field of deliberative democracy,

13:40

is increasingly making ~ projects with Meta.

13:45

I remember one on AI agents that I think was last year.

13:48

Or there are also some other colleagues that have cooperated with ~ OpenAI.

13:53

I am thinking here of Helen Landemore that I think...

13:56

~

13:57

~ was part of the grants program of OpenAI,

14:01

I think in 2023 or so on.

14:04

So, you know, there's a very close entanglement between some of

14:08

the organizers of some of these citizen assemblies with some of

14:12

the companies that are providing some of the infrastructure,

14:16

the tech infrastructure, right?

14:18

So it's not by chance, for instance,

14:19

in the paper we wrote with Nicolas,

14:21

we also looked at the Habermas machine.

14:23

that was created by Google DeepMind.

14:26

And of course, they think that AI can be super helpful to find

14:30

and create consensus ~ across different groups.

14:34

So I think it is important to look precisely at,

14:37

OK, these processes are not just neutral processes.

14:41

They are led by some very specific groups and interests.

14:45

And ~ while I'm not discarding the idea that deliberation is important,

14:50

like, OK.

14:51

who is organizing this deliberation and who is deciding how this is organized.

14:55

So, yeah.

15:01

A lot of things and Big Techs are in some way an issue.

15:07

I'm also thinking that maybe it could be something that can

15:13

be done step by step. now we are experimenting and using technologies from

15:20

Big Techs. Maybe in the future some open source models can be used.

15:27

But also, I'm thinking regarding what we were saying before,

15:31

like if we really need technology in politics,

15:34

because actually I also think that we do not need it.

15:37

mean, also without technology,

15:40

there are a lot of improvement that we could do in politics.

15:44

Then what I'm thinking is that technology maybe could allow,

15:48

let's say, direct democracy without technology would not be possible.

15:52

Or maybe yes, I don't know.

15:54

What do you think?

15:56

Yeah, so I'm not against technology.

15:58

I think that it needs to, we need to be clear about what sort

16:02

of technology we're using and what the purpose of that technology is.

16:05

And I think there is a risk in further normalizing.

16:09

So I think already, unfortunately,

16:11

you know, all these different AI applications have been largely normalized across

16:17

society in multiple ways.

16:18

And I find that deeply troubling for many reasons,

16:21

like the labor exploitation that is required for AI to be possible,

16:26

mostly with labor in the global south,

16:27

the environmental costs of this,

16:30

the increasing amounts of data centers being built everywhere.

16:34

So I think that is very troubling that we,

16:36

even in the field of democracy,

16:38

I I remember there was the like.

16:40

for example, a citizen assembly,

16:42

I think was in Finland on energy,

16:45

where they were using AI. Let's do a citizen assembly on energy efficiency.

16:50

And at the same time, let's use AI to help deliberation.

16:54

I mean, even in that sort of context,

16:57

there's, I think, little awareness of the dangers of it.

17:00

Now, that said, think technology,

17:03

it is important to, you

17:05

both communicate and organize.

17:07

So I think that there is a point in having technology.

17:10

And I would not make an argument that we should just get rid of all technology,

17:14

but we should democratize it. And this does not mean democratizing AI

17:19

to just make it wrong by the state,

17:21

but make technology first publicly controlled or public democratically controlled.

17:28

So far, it's just private companies developing whatever they want.

17:31

And second, we would have to see what sort of applications we want to use.

17:34

mean, with the ChatGPT or things like that,

17:38

there's no democratic legitimacy to simply ~ throwing all these tools to society.

17:44

And I mean, no one has been asked whether ChatGPT was a good idea to begin with,

17:51

right? They just launched it there.

17:52

and then suddenly millions of people started using it.

17:54

And now it's very difficult to roll back,

17:57

right? Because once you roll something in,

17:59

it's very difficult to roll back.

18:00

But rolling it in in the first place is also a political decision,

18:04

right? ~ A political decision that has been taken by a private company.

18:08

So I think we would have to see what sort of technologies and means we need

18:13

in a democratic society. And that's why I advocate for kind of strong

18:18

collective actors that are able precisely to take into account

18:21

the various risks that exist when normalizing or integrating

18:25

new types of technology.

18:29

Also controlling the technology,

18:30

I think, is something very hard.

18:32

Unfortunately also because there is no way to know what is running on the server.

18:38

Like I'm thinking also about open source software.

18:41

You can check maybe the GitHub repo,

18:43

you can check the code, but then you don't know if the code on

18:47

the server is modified or not.

18:50

And so I'm a little bit skeptical sometimes about

18:54

The regulation that cannot be made.

18:56

not against regulation. It's something just in relation to technology that sometimes

19:02

is not because sometimes you you say,

19:04

okay, we regulated and we're happy.

19:06

then it doesn't mean that something is happening in the black box.

19:10

guess the question here is not so much about regulation,

19:13

although there is a dimension of it,

19:15

but about, for example, the introduction of some of this new technology.

19:20

say that now we have AI tools,

19:24

like chatbots and things like that,

19:26

that basically are able to do almost anything.

19:29

So it's like general purpose.

19:31

this I think creates a very important problem because they are general purpose.

19:36

These companies say, well, in order to develop this general purpose technology,

19:41

we need as much data as we can.

19:43

Because without as much data, which by the way,

19:45

there are a lot of problems with the ways in which they took the data

19:49

to train their AI models to begin with.

19:51

But that's a different question.

19:53

But OK, now.

19:55

If you were to say, no, but at the same time,

19:58

AI is very important because that's how we are able to cure cancer

20:02

or identify cancer and so on. It's like,

20:06

maybe we could think of ways to,

20:09

OK, we want a technology that is targeted and specific to cure cancer

20:15

or to identify cancer. Well, OK,

20:17

maybe that's great.

20:18

And then we only need data that is specific to that purpose.

20:22

And this is the exact opposite to what is happening now.

20:25

That we have AI models that are,

20:26

for example, all encompassing.

20:28

They just take all the data that there is in order to be able to try to

20:32

do sort of almost everything. And I think this creates a very big tension that,

20:37

yeah, I think instead of having the new level that you have the AI Act,

20:42

which is like a risk-based

20:43

approach, but maybe it would be kind of like the opposite logic of saying,

20:48

okay, you you want an AI application,

20:49

show me what the purpose is, and then maybe,

20:53

you know, we can develop and maybe it should be publicly developed.

20:56

And in the case of deliberation,

20:58

that is the case, you know, there are some actors are just taking

21:02

AI because it saves them a little bit of time.

21:05

And I think are making deliberation even worse.

21:08

to be honest, in addition of this logic of,

21:10

you know, they are trying to, okay,

21:12

can we really use the master's tools to dismantle the master house

21:15

to like quote Audre Lorde, like can we use the very same technology that

21:20

is developed by those actors that are responsible for democratic regression

21:24

in order to counter democratic regression?

21:26

I'm not sure you can be both the problem and the solution at the same time.

21:31

Let's say open questions. mean a lot of issues and...

21:38

I think so. You that.

21:41

I is also a political tool, something like that.

21:46

And so it should be. And I basically a private company decided to release

21:50

a tool to the people. mean customers and also people that are giving away

21:57

the data because then there are.

21:59

retraining the models. And so if

22:04

the state has to actually authorize or deny

22:09

if a new model is released,

22:14

because right now it's not working in this way.

22:16

So this is what you're suggesting.

22:18

So that there is a, let's say a more collective decision.

22:22

Or is it the state that decides,

22:25

okay, this technology is good for society or not good for society,

22:29

right?

22:30

Yes, well, at there should be some,

22:31

you know, collective discussions about these things.

22:34

And of course, there are also problematic uses of AI by the state,

22:38

you know, and, you know, it's clear that,

22:41

you know, the states are not innocent in a lot of these things.

22:45

I mean, we see how, you know, increasingly states are making deals with companies

22:50

like Palantir or, you know, also with OpenAI or,

22:56

or Anthropic and so on. So

23:00

Yes, states are not innocent and they are not just the only,

23:04

they are not just the solution,

23:05

right? But precisely, I think that we need some democratic legitimacy

23:10

and collective decision making to decide about these technologies

23:14

in the first place. I don't have a very concrete kind of recommendation about

23:19

the process of how that should work.

23:21

And I would not want to get entangled in very technocratic kind of logics.

23:25

But I think that's definitely the case.

23:27

And a lot of

23:28

actors within the deliberative democracy community on the grounds of,

23:31

you we need to scale democratic innovations,

23:34

you know, on those grounds, they are very,

23:37

yeah, problematically just normalizing these types of technologies without,

23:43

I think, necessary reflection about the embedded philosophy

23:47

in this these technologies.

23:51

Okay, because I agree about the collective discussion

23:56

so that we understand if something is positive or negative for society.

24:00

But then I wonder how to make it happen,

24:04

let's say, without technology.

24:06

Because I see maybe in this I have some faith

24:12

that maybe technology could be helpful.

24:15

to actually do what you are suggesting because it

24:19

is easier sometimes to,

24:23

I don't know if we are thousands and thousands of people to vote on

24:27

an issue and decide if we want something or we do not want something else.

24:34

No, yeah, I agree. I mean,

24:37

there's some excellent work by colleagues like Rafael Groman,

24:42

who has worked, for example, on cooperatives,

24:45

like organizations that use technology and that develop technology as cooperatives.

24:49

So I do think that technology is some potential,

24:52

and I don't want to situate myself as necessarily anti-technology.

24:55

But I am certainly anti certain types of technology that

24:59

are entrenching certain political social relations that

25:03

I find deeply problematic. I think it's I mean,

25:08

technology can be a source to organizing and so on.

25:13

But we can also, you know, I think that look at social media.

25:17

mean, social media started 2010,

25:19

2011 Occupy, Arab Spring, Indignados Movement.

25:23

And Twitter was a very common space for these kind of logics,

25:27

right? And develop narratives that countered ~ governments and so on.

25:32

But what I think, or Facebook,

25:35

very few people or some people,

25:37

but not a lot, maybe did not analyze as well the political economy that

25:42

was operating at the time. while these spaces were being used

25:46

for organizing and activism.

25:49

These companies were extracting all the data that was later used

25:53

to basically first to Target ads because that's how they make money and that's

25:58

how I Expect AI to make money.

26:01

They would just input ads into chat GPT,

26:04

know So you will be doing something and they will just because they know everything

26:07

you like So if you understand like football you will get football ads And so

26:13

technology is necessary and these spaces are necessary.

26:16

I think a space like what used to be Twitter is helpful.

26:21

The question is, okay, who is in control of these?

26:25

What is the structure of these processes?

26:27

And I have little hope that these spaces,

26:30

if controlled by a political economy that is dominated by a few corporations,

26:35

can ultimately, I mean, they can just switch it off.

26:38

They can ~ shadow ban people.

26:42

So we need to think as well of alternatives.

26:46

Yeah, mean, absolutely. think that Big Tech represent a problem.

26:52

Also, like in Italy, a couple of days ago in a municipality,

26:57

there was a miller that basically put an

27:03

AI agent as part of the municipality.

27:09

I'm interested in the experiment.

27:10

the same time, I wonder if they use some technology,

27:14

let's say open source technology hosted inside the municipality,

27:18

or if they are using, I don't know,

27:21

charge GPT or Claude, because that means,

27:23

okay, one, let's say politician in Italy that is using open AI is not a problem.

27:29

But then let's say that there is one or more in every Italian municipality

27:33

and then maybe inside the parliament.

27:35

then as you can see they can switch it off and

27:39

Yeah, I think they are these tech companies are increasingly making

27:44

us dependent on them. I mean, now,

27:45

if you look at, for example, universities,

27:47

they most of them have agreements with Microsoft,

27:49

right? And it's not just for AI is like for outlook,

27:52

like emails and words and stuff like that,

27:55

right? And now they just integrated copilot within it.

27:58

And what is happening is that increasingly more sectors

28:03

of society are integrating

28:05

these technologies in their day to day.

28:07

Initially, I would imagine for not a lot of money,

28:10

but the moment that they become very dependent,

28:13

then suddenly they can just raise the prices ~ as much as they want because

28:18

it would be very difficult to move away from them because you just become dependent,

28:23

you just integrated in your daily work.

28:26

If I would start...

28:28

now writing with Chagy Pt. What would happen is that in two years time,

28:31

I would just not know how to write or it would be very difficult,

28:34

you know, and like this is happening a little bit in a lot of sectors.

28:38

So this gains them, gains these companies a lot of leverage towards public

28:44

authorities, towards other companies and towards citizens in general.

28:47

So that's why I think, yeah, keeping an eye and especially when

28:52

we think of democracy and how to improve

28:55

deliberation and so on. We also keep in mind as well the infrastructure upon which

29:00

deliberation devices are built.

29:04

Absolutely. I am in also relation to this.

29:07

I mean that university are using Google and Microsoft.

29:11

I remember then I was at the University of of Milan.

29:16

And I think it was during COVID times that or just after that they switched from

29:23

let's say self hosted email from so they were hosted inside the university

29:27

or like something like that.

29:29

to and it has to Microsoft and actually interviewed

29:33

the leader of the technical department

29:37

and he explained me very well how before the war like I don't know five

29:44

people that were managing the email accounts and so it was way cheaper

29:50

to give it Microsoft but then of course you're also giving the data and

29:55

in the long term I think is not cheaper.

29:59

I'm

30:03

No, sorry. And then another thing is that if the infrastructure

30:09

of the university run, let's say on Microsoft Teams,

30:12

then I wonder what is then the university because then Microsoft will just add,

30:19

I don't know, some classes there and then Microsoft became the university.

30:25

there's increasingly involvement of ~ Google and Microsoft

30:29

in educational processes like in schools and universities and so on.

30:34

yeah, and indeed what you're saying is really accurate in the sense that there

30:40

is a cost to it that is not just economic,

30:42

but it's also a democratic one.

30:44

And the more spaces that rely on these companies,

30:48

well, the more leverage these companies will have and the more power they will gain

30:53

in society.

30:54

So yeah, and that's why I'm quite critical of the idea that technology

31:00

can be a solution for lot of democratic deliberation.

31:03

Because it's a very technosolutionist kind of logic,

31:06

where you think that technology is the solution,

31:08

but then you identify the problem in sort of very small kind of ways.

31:13

It's like looking at the trees instead of looking at the forest.

31:16

And then, OK, I have this small thing with the moderator.

31:19

Maybe if I use technology, then I can sort it out.

31:23

But we lose track of the forest and the more systemic kind of problems that

31:29

may arise from it.

31:31

I don't know if you have seen like the agentic state initiative.

31:35

Okay. I will describe briefly the concept that

31:38

is citizens now are used to services that

31:45

are very fast and efficient. So let's say I order something on Amazon,

31:49

it arrives in some hours.

31:53

or I do something on Google and it's free and they provide it in a,

31:59

let's say efficient way while the state is slower usually.

32:04

I mean, way, way, slower. And so basically the concept is if

32:09

the state doesn't become efficient and fast

32:13

as private companies are,

32:16

people will just use private companies and the state will

32:20

not exist anymore. This is more or less what I understood.

32:24

Yeah, but it is so scary. mean,

32:26

because all this, especially the agentic kind of AI logics,

32:31

it's a very dehumanizing process because we are increasingly where,

32:37

I mean, with the emergence of the iPhones and smartphones and so on,

32:41

we have already, you you go, I don't know,

32:43

public transport and most of the people is with their phone,

32:45

right? But now this is just...

32:47

get a new step in this kind of dehumanization and individualization logic where

32:52

you're just having a relation to other people through the technology.

32:58

instead of, ~ mean, here, of course,

33:00

it's paradoxical that we are doing this through Google Meets.

33:04

in some ways, OK, you can say,

33:06

OK, at least we are having a direct conversation.

33:09

You're not an AI agent, I am not either.

33:12

But what is increasingly happening is that ~ this is taking place.

33:17

you will stay. I mean, it's already the case,

33:19

but it will be multiplied by a lot.

33:20

You go to do a shopping in the store,

33:23

and you don't even speak to the cashier because either it will

33:27

be straight inputted or you have this kind of self-checkout,

33:32

where you're not even talking to anyone.

33:35

And this is the same logic with the state.

33:36

Like, OK, you don't go to talk to people in the union to say,

33:41

OK, what about these unemployment documents or so on?

33:44

You will just face an agentic AI.

33:48

And this is happening across kind of dimensions.

33:51

Like, even I saw that there are some romantic AIs,

33:56

like AIs that do therapy. So this is increasing.

34:00

our individualization and dehumanization by making us dependent

34:05

on the technology that is at the same time separating us from other people

34:10

and other humans. And if for me technology is helpful,

34:13

it's precisely as a way to connect to other people.

34:16

Whereas here it's used to do precisely the opposite,

34:20

being used to disconnect people from other people.

34:23

And increasingly we think of us as uniquely individuals,

34:27

not as part of bigger groups of

34:30

as workers, parts of a bigger community.

34:34

Yeah, I think also like without technology,

34:37

we will not be able to talk and probably we would have talked with someone near us.

34:44

And so is the disconnecting but also I think connecting on the...

34:51

on the longer

34:53

Yeah, but here's where you can see,

34:55

what sort of technology is contributing to connect people and what sort

35:00

of technology is contributing to disconnect people.

35:03

And I think, you know, to me, it is very clear that a lot of these AI chatbots are,

35:08

mean, to me, they should be banned ~ because they are precisely really used

35:13

to disconnect people, to make us,

35:15

you know, enter into much more individual ways of thinking about the world.

35:20

Whereas there are other technologies,

35:22

like the one that we're using to talk to each other,

35:24

that can be helpful. And there is a point in having video conferences

35:30

and having phones to connect. mean,

35:32

of course, that can be helpful.

35:34

But that's why we should make an analysis.

35:37

OK, what technologies? What is the philosophy embedded with some technologies?

35:42

And how can we promote

35:44

the uses of one and restrict the ones that are contributing to make

35:50

our society more individualistic and less connected.

35:55

And if we think about the future,

35:58

let's say, I know, in 10, 20 years,

36:00

how do you imagine society if it goes in the way it is going now?

36:06

And then also,

36:10

how it could be society if it goes in a different way,

36:15

so something more like something that you wish maybe.

36:22

Yeah, look, I don't have a clear imaginary

36:28

of how it should look like, but I do think that a

36:32

key element in building a more democratic future is to

36:38

try to understand the connections that exist between different

36:42

but related struggles. And by this I mean,

36:45

okay, you know, the question of technology,

36:47

which I think is central to a lot of the questions about democracy,

36:51

needs to be connected to, for example,

36:53

anti-colonial movements like we're seeing in Palestine,

36:56

where Israel is using technology in the violence that they are exerting,

37:00

but it's also used, for example,

37:03

in pursuing sexist violence, right,

37:06

through a lot of, you know, social media,

37:08

vitality, reproducing kind of stereotypes,

37:15

and so on.

37:17

It's also clearly used for discrimination and racism.

37:20

We see that, for example, technology is being used to discriminate against migrants.

37:26

Frontex is using lot of drones and other types of technology to basically make

37:31

it as difficult as possible for migrants to enter the EU in the first place

37:35

and so on. So that's why we need to see

37:39

trace the connections and only by tracing these connections,

37:42

I think we can build a better future together.

37:45

So I'm hesitating to give you like a very,

37:47

you know, okay, what's me as Alvaro,

37:50

you know, think of the future,

37:52

but I'm thinking of the ways in which we can collectively imagine

37:56

a more democratic future. And I think this begins by acknowledging

38:00

the structural inequalities and injustices that exist in our society.

38:06

and doing something about it together.

38:08

And I don't know, for example,

38:09

in terms of technology, it is interesting that ~ some content moderators that were

38:13

working for Meta, not directly,

38:16

but through a contractor in Kenya,

38:18

sued Meta because of unfair labor conditions.

38:22

And this triggered as well that they unionized together with other content

38:26

moderators, most of which are based in the global south,

38:29

like Madagascar, Philippines, Venezuela.

38:32

So they created ~ a global union of content moderators.

38:35

I don't know how far it will go,

38:37

but I think it's good starting point to think as well about

38:41

the workers' rights dimension.

38:43

Also the environmental struggles.

38:46

So my pledge would be not so much about a very concrete type of future,

38:52

but at least about how to think about imagining about the future.

38:57

And if we want to think about that,

38:58

we need to think about political economy.

39:01

We need to think about the miners that are extracting the lithium in Bolivia,

39:05

Chile and Venezuela. We need to think about the content moderators.

39:08

We need to think about oppressed peoples,

39:10

mostly in the global south, et cetera,

39:11

et cetera. And only by seeing and tracing all these different communities that

39:17

are affected, among other things,

39:19

by technology, we will be able to imagine

39:22

and deliver a better future, a more democratic one.

39:26

Absolutely,

39:27

because this all those...

39:32

It's visible to the citizens, to the user that use the platform.

39:36

So just use Facebook and they seems nice.

39:40

Then we are not aware of all the people that maybe have to see horrible videos

39:45

and check it or approve it or deny it.

39:49

I don't know because I think that

39:58

There is maybe a sort of tension.

40:01

As I said, we do not need technology.

40:06

There are lots of political innovation.

40:08

are lots of... Also, let's say that technology do not exist.

40:12

I mean, the technology that we know now,

40:14

that we are used to use. We could do a lot for everything you mentioned.

40:21

We could try to make the world a better place to make...

40:27

in a way that people do not suffer or die or are exploited.

40:33

And actually, as I said, maybe I have a little bit of faith because

40:39

if I'm not sure, it means that I am faithful.

40:42

And so it's also maybe a sort of way similar to religion has also ideologies could

40:48

be. That maybe technology could help in...

40:51

~

40:54

coordinating maybe in terms of coordination.

41:00

Okay.

41:01

I agree. think it can help in terms of coordination,

41:04

it needs to be clear. think that technology itself is not the solution

41:09

to almost anything. It can be a means or it can help to coordinate.

41:15

But that's why I am advocating for a kind of targeted usage

41:21

of technology and targeted thinking of technology.

41:24

I think there's a problem with this kind of...

41:27

general purpose logic with which technology operates.

41:29

Let's just use technology for everything.

41:32

I think there are some uses that can be helpful for democracy and I think

41:36

we should foster them, but I think technology by itself will not be

41:41

the solution to almost anything.

41:46

Absolutely. So it could be, mean,

41:47

not a, not the solution. I wonder like you mentioned self-check in supermarket.

41:54

Do you see them as something, let's say positive because,

41:58

~ so a human doesn't have to stay there doing something that now a machine can do,

42:04

or do you see it as negative because it,

42:07

let's say, steal, the job to a person.

42:13

I I guess it depends. I don't have a direct answer on that specific kind of example.

42:19

What I notice is the kind of bigger trends

42:23

of individualizing society by preventing or making it more difficult

42:29

to make connections between different people.

42:31

I think there can be problems with

42:35

with self-checks, but not just because of that.

42:36

there's here, and I don't want to insist too much,

42:40

but I think it's a reality. also have to look at also the political economy

42:44

of most shopping stores, the Carrefour's and the,

42:47

you know, so the problem is not so much whether I think this is,

42:53

you know, there are cashiers or they are not cashiers.

42:55

The problem is, okay, it's again,

42:56

who is controlling, you know, is this accountable?

42:59

So this, for example, I find very interesting and I haven't looked too much into it,

43:03

but I would like to. Zoran Mandani,

43:05

the mayor of New York, I think promised and I think he delivered creating

43:09

a publicly owned shopping store.

43:12

And I found that really interesting.

43:14

And I think there might be some interesting solutions.

43:18

And beginning from that, maybe you can have interesting conversations around

43:23

OK, should we have cashiers? If so,

43:26

in what role? And so on and so forth.

43:28

So I think this is much bigger conversation that this is not just,

43:32

OK, the machines are replacing humans,

43:36

because it's not entirely true.

43:37

What is happening is that other humans are replacing humans.

43:40

So for example, you might have less cashiers,

43:42

but you know what you have more?

43:43

You have more people hired.

43:46

in Madagascar, for example, doing video surveillance,

43:49

like at a distance, you know. So you may have less,

43:53

you know, workers there, but you have more.

43:55

So, you know, it's a complex kind of thing that I think the only way to solve

44:00

it is not just by saying, OK, I have this very specific solution,

44:03

but think, OK, first, what is the political economy,

44:06

you know, who is controlling and have collective discussions about

44:09

how should we organise it otherwise?

44:12

So it should not be up to me to decide,

44:14

okay, you know, it's better to self-checkout or not,

44:17

but more, okay, you know, what's,

44:19

you know, how do we work to organize these stores?

44:22

And not just leave it up to Carrefour to decide whether,

44:26

you know, they would have self-checkouts because it just saves them money.

44:33

I absolutely agree about having,

44:35

let's say, collective discussion.

44:37

This will be very important. And I think that...

44:42

So in some way I'm also skeptical as I say regarding two small citizen assemblies

44:47

that are done, I don't know, one time and the topic is decided by someone that maybe

44:53

has some interest and so.

44:57

But I wonder, because I see that a lot of people do not participate in politics,

45:04

in their political life. Also,

45:06

if they have something in their small town that doesn't work,

45:09

they could, let's say, send an email to the mayor.

45:12

They could, let's say, organize a very small movement of 20 people.

45:19

But they don't do it. I mean, there are movements.

45:22

There are people that send emails.

45:25

But I will say that maybe they are just a small minority.

45:28

wonder if these maybe, let's say,

45:31

citizen assembly, but then it depends what we mean with citizen assembly.

45:34

Or like other things could be maybe a sort of a sort

45:40

of exercise to actually understand how people could have power.

45:46

I don't know.

45:47

Yeah, I my suggestion would be to not think so much of citizens as individuals,

45:52

that they should be sending emails to the mayor.

45:55

But how can we democratize collective actors?

45:59

How can we democratize trade unions?

46:01

How can we democratize political parties so that more people are part of them?

46:05

And instead of, you know, me as an individual sending a letter to the mayor,

46:11

that I am part of a union and then there is an issue with something and then

46:15

I can raise it to the union and the union or you know a political party

46:19

or civil society or you know an activist social movement group would be

46:24

the one that would be sort of having this more direct relation with

46:28

the public authorities because I think it's not just about

46:31

the relation of individuals to public authorities but more the relation of

46:35

collective actors to public authorities that I think matters crucially

46:39

for democracy. Of course, there are important individual rights that have

46:44

to be respected, but I think that ultimately when we have had advances in democracy,

46:50

it's because people organize collectively.

46:51

It's because people, know, how did women,

46:54

you know, get the right to vote because

46:57

women organized? How did workers rights get 40 hours weeks?

47:02

Because they organized and they organized protests

47:04

and they organized demonstrations.

47:06

And ~ if we do not organize collectively and raise these things in this way,

47:12

it will be very easy for states to divide and conquer.

47:16

And you should just think about yourself as an individual.

47:20

instead of thinking of ourselves as part of bigger groups and operate politically.

47:30

That is hard to do it as a group,

47:35

But that's

47:36

why, rather than thinking about citizen assemblies,

47:38

I would rather advocate, how can we think of democratizing collective actors?

47:43

Why instead of just organizing a citizen assembly about food waste like

47:48

the commission did, or AI or whatever,

47:50

why are we not pushing for having bigger unions with more members,

47:55

but that they are also more democratic?

47:56

It's true that there are some undemocratic tendencies in most unions

48:01

or political parties. So they are,

48:04

of course, not absent of some authoritarian dynamics.

48:07

But I see more hope in trying to democratize them and mobilizing

48:11

and organizing with people that are like-minded to do that rather than,

48:17

OK, just to me,

48:19

What Cristina Lafont says in that sense is correct in the sense that

48:23

a lot of citizen assemblies are a shortcut.

48:24

It's like, OK, you know, it's very difficult to organize and so on.

48:28

Let's just do a citizen assembly and then,

48:29

hey, we have the democratic legitimacy.

48:31

But that's a shortcut that is,

48:32

in my view, actually quite undemocratic.

48:37

And do you have a message to the people that

48:42

are working in the field of democratic innovation,

48:46

maybe also on citizen assessment,

48:48

maybe on different things regarding democratic innovation?

48:52

yeah,

48:55

if you have a message to them,

48:57

for them.

49:00

Yeah, mean, my main message is,

49:02

yeah, let's focus on collective actors.

49:05

Let's focus on those actors that have historically been able

49:09

to make democracy better. And we have not done that quietly.

49:14

We have done that by making noise,

49:16

by organizing, by going to protests.

49:19

~

49:20

and by building strong collective movements that ~ have been able

49:24

to represent white constituencies rather than focusing uniquely on a small group

49:30

of individuals. So that is sort of my plea and yeah,

49:35

let's make the connections that exist and try to connect those struggles that might

49:40

be different because I do not have the same struggles as some migrant women might

49:44

have. But nonetheless,

49:46

my struggles are also connected to people that are struggling in different ways.

49:51

And we should find ways ~ and spaces to discuss those

49:56

~ struggles and act politically together as much as it is possible.

50:03

Thank you, Aldaro. And Adonai,

50:05

should like to add anything else?

50:08

No, I'm not sure I have anything more to say.

50:13

yeah, thanks a lot, Alessandro.

50:14

It was really a pleasure to have this discussion.

50:17

Thank you. Also for me.