Alberto Fernandez Gibaja from International IDEA on Technology and Democracy
Ep. 54

Alberto Fernandez Gibaja from International IDEA on Technology and Democracy

Episode description

Alberto Fernandez Gibaja leads International IDEA’s global work at the intersection of technology and democracy. In this conversation, he discusses how the early optimism around digital technology changed after Brexit, Trump, and the rise of disinformation, why tech companies can be as powerful as medium-sized countries, and why democratic societies need more control over data, infrastructure, foundation models, and AI applications. We also discuss digital sovereignty, data rights, the limits of direct democracy, political parties, expertise, and why the difficult part of democratic innovation is often political will rather than technology.

Download transcript (.srt)
0:00

welcome to another episode of the Democracy Innovator Podcast and our guest

0:03

of today is Alberto Fernandez Hibaja.

0:06

Thank you, Alessandro.

0:06

And ~ so welcome to the podcast and thank you for your time.

0:10

And and as f I mean the first question

0:16

is if you'd like to tell us something about you,

0:20

something about your background or personal life

0:20

Sure. yeah, my name is Alberto Fernandez Ghibaja.

0:24

I'm currently leading International IDEA

0:28

~ global work on everything at the intersection

0:34

of technology and democracy. For those of you I'm familiar with International IDEA,

0:38

we are an intergovernmental organization with 35 member states ~

0:43

and global presence and member states from all over the world,

0:47

all of them democracies.

0:49

with just one mandate, which is to support democracy worldwide.

1:02

Thank you. And and ~ how did you come to this

1:08

h when you realized that technology could be interesting for democracy?

1:10

That's

1:10

an interesting question I am of I'm old enough to be of those that generation that

1:16

we started working on technology as From from a positive point

1:22

of view we thought and we joined the wave

1:28

of ~ enthusiasm that at the beginning of

1:32

the of the 2010

1:38

A lot of the people in area of democratic governance,

1:43

participation and so on thought that technology was going to be a great asset

1:49

for better democracies, better,

1:52

more powerful civil society, more

1:55

~ fair ~ political debates.

2:00

~ The Arab Spring,

2:04

the fact that the Arab Spring basically started online through

2:08

Facebook was kind of like an eye-opener for many people.

2:14

And I also want

2:16

to think that that's

2:22

to a certain extent the case. There

2:28

are certain countries, hybrid democracies,

2:34

democracies that are

2:36

struggling or authoritarian countries that are like open enough

2:41

but still authoritarian where actually technology has made that possible

2:47

and had made possible for certain groups to challenge the government.

2:51

~ There is this ~ idea of the digital dilemma of dictators.

2:57

You can't curtail completely technology because when you become North Korea,

3:02

where...

3:06

you lose out in comparison to anybody else.

3:09

But if you open too much technology,

3:11

~ that means people have a mean to express,

3:14

a vehicle to express, to share,

3:17

to contact others outside. And that reduce your capacity

3:22

to ~ control your population. So ~ that idea still stays there.

3:28

~ But then, well, then it was 2016.

3:33

~ Then it was Brexit, was the first Trump electoral victory,

3:38

~ the issue of disinformation,

3:41

the manipulation of information environment,

3:44

and I think that from there we have been on a downhill

3:48

~ of technology becoming not only a fundamental part

3:54

of our democratic societies, but also one of the main challenges on how

3:58

to deal with technology and with its impact on

4:03

on democracy at large and specifically on how we take democratic decisions either

4:10

through elections but also through ~ political debate.

4:20

And I mean ideas, ideas,

4:23

which kind of project are you working on ~ with your organization?

4:26

So we, as an organization,

4:29

we do mostly four things.

4:36

We generate knowledge, we write reports,

4:39

policy papers, policy briefs,

4:42

sometimes manuals ~ on key issues that

4:48

our stakeholders are demanding.

4:49

is usually very niche things,

4:53

very highly specialized.

4:55

on very particular things like ~ how to organize outside

5:01

of country voting or what

5:03

are the federal possibilities

5:09

for South Sudan, so the very, very highly specialized content.

5:12

~ We do a lot of advising

5:18

and capacity building for governments.

5:20

So we work hand hand with...

5:23

governments, democratic governments all over the world,

5:26

supporting them in different things,

5:29

improving their parliamentary processes,

5:31

~ drafting new legislation. ~

5:38

creating new electoral processes and so on.

5:43

We convey dialogues, we create spaces for stakeholders

5:48

to have dialogue and to exchange ideas and learn from each other.

5:52

And then we do advocacy. As an intergovernmental organisation,

5:56

our advocacy is a bit different than what you would expect from organisations like

6:01

Amnesty International or things like that.

6:03

~ So it's more at the multilateral level.

6:09

We do lot of work within the UN system with other regional organizations

6:15

like the Organization of American States or the Council of Europe

6:20

or the African Union ~ and other spaces where

6:27

key discussions on democratic ~ aspects are being taken.

6:39

I was wondering like if you notice any difference in relation of

6:44

the I mean in the different regions,

6:47

so the different government from the different countries,

6:50

if there is a different kind of ~ behavior or attitude,

6:52

towards technology or towards democracy in general.

6:55

I don't know.

7:01

Yeah, ~ there is indeed a very,

7:01

Yeah, I mean I can imagine for both

7:05

very big ~ difference. ~ And it's,

7:10

I mean, for both. When it comes to democracy,

7:16

when it comes to democracy, it's a bit,

7:17

this is a little bit, we don't have time for in a podcast to analyze this,

7:22

but ~ there are different tradition and historic trajectories that

7:28

whose regions one way or another.

7:30

So for instance, Latin America,

7:33

it's very aware and very,

7:37

I would say still traumatized to a certain point of

7:42

the story of the last century.

7:46

And for those countries,

7:50

as imperfect as their democracies might be sometimes,

7:54

there is no other

7:56

game in town. Democracy is the only possibility.

7:59

So countries like Mexico, like Brazil,

8:02

like Argentina, like Chile, like Peru,

8:04

Colombia, they might have many problems,

8:06

but there is no alternative to,

8:07

they don't want anything else than a democracy.

8:11

~ The discussion is more about how to make it better and for the citizens and so on.

8:17

think it used to be the case in Europe ~ that that is certainly that

8:23

tide is starting to change slightly.

8:25

It is the case in most African countries,

8:30

but that's also starting to change and we're seeing how many Sahel countries have

8:36

embraced ~ military dictators.

8:38

There is like a coup d'etat type of like domino effect in the region.

8:43

And for Asia, it's a bit more complex,

8:47

also because Asia, it's not an homogeneous region.

8:51

~

8:51

discuss everybody together, but it's a very diverse region.

8:54

So India, it's clearly, it's the biggest democracy in the world.

8:58

And there's no questions about ~ the democratic system in India.

9:05

Other regions have not had many experiences

9:11

of proper democracy, or they keep like going in and out of democracy,

9:16

countries like Thailand, Malaysia,

9:19

where they have

9:21

kind of like they have tried to create hybrid control models of democracy that

9:27

are always in the line between

9:31

~ it's popular control over decision making and equality and exercising that control

9:38

possible or not possible. It's always in that blurry line.

9:42

And that is reflected also in the way technologies address.

9:47

So many...

9:50

most countries realize that...

9:52

~

9:53

A key factor to the survival or the strengthening of the democracies

9:59

is how they manage technologies,

10:01

how they manage the impact of technology,

10:03

how they adapt to it. ~ But then there are different ways to relate to it.

10:09

So European countries tend to go more into legislation.

10:13

They want to impose rules because it's a rules-based order.

10:20

in regarding like to the let's say digitalization that could

10:27

be a mix of ~ how ~ because the previous question was ~ the relationship between

10:34

the different countries in relation to could be technology or democracy.

10:38

~ and so I wonder to digitalization have you seen like a different ~ kind of

10:45

Th there is ~ as I said before,

10:48

there are some differences between ~ how regions approach this.

10:52

~ and ~ in general Europe tends to be more on the ~ regulatory side of things.

10:58

They tend to try to tame

11:03

or control what technology companies and

11:08

the technology space ~ does through through regulation.

11:15

It is also like a big enough market,

11:17

so all companies will comply.

11:20

So now we all have on our iPhones ~ USB C and that's because

11:25

the European Union ~ forced Apple to do that.

11:31

And ~ and they all complain but then they they they they comply with

11:37

it because they're not going to lose the European market just for

11:41

for the the charger.

11:43

~ and and because and and like this,

11:44

this is very obvious, very visual because we can see it,

11:47

but there are many things that ~ that go in the in the same line.

11:50

So it it generally works. ~ it's just sometimes it's not enough.

11:54

~ other countries are because their legislation is weaker or their their enforcement

12:00

is weaker, ~ their markets are smaller,

12:02

so they know that let's say meta can threaten Colombia to live.

12:08

because meta can survive without Colombia,

12:10

it's it's fine.

12:12

~ but but any government that does something that eventually pulls meta

12:19

out of the country will f face ~ a huge backlash from from the population.

12:24

Because people want to keep scrolling on on Instagram.

12:28

~ so th they are less powerful,

12:30

they don't have ~ infrastructure,

12:33

governmental infrastructure like the European Union that can impose rules.

12:36

So they they are more they they're forced to be more on

12:42

negotiation mood and they try to find agreements and and working modalities where

12:48

civil society, private companies and governments get together.

12:52

~ Some exceptions like Brazil,

12:55

for instance, Brazil doesn't have a problem with imposing this again because it's

13:00

a big market, so nobody wants to lose out in in Brazil,

13:03

~ India and so on. And and I think this is a clear ~ this is a clear signal.

13:08

~ Private companies

13:11

Private tech companies today are as powerful as medium sized countries,

13:16

and they can they can impose their will on on these countries.

13:20

They can't impose their will on the European Union,

13:22

on Brazil, on India, or or or the United States,

13:25

obviously.

13:25

~ Indonesia,

13:32

Australia, some some certain countries are capable of of of imposing things

13:36

to the to tech companies, but most countries are not.

13:39

~ so ~ they need to ideally they should create alliances with other

13:46

countries and impose legislation with other countries together.

13:50

~ so it's fine to lose out ~ on a particular African country,

13:55

but nobody wants to lose out on the whole African ~ continent.

13:59

~ so that should be ~ ideally one of the ways to go,

14:04

but that sadly doesn't happen very often.

14:06

reaching agreements on on

14:09

tech policy are it's extremely,

14:10

extremely difficult. tech companies spend millions of euros in lobbying,

14:17

which it's effective. But also there is not clarity on what this legislation should

14:23

have. ~ so it's not that there is an agreement between countries like

14:26

we want this particular thing,

14:27

please do it. and there is a lot of di differing opinions on on how to go about it.

14:32

So that also ~ makes it very difficult ~ to have this type of like regional

14:38

pieces of legislation.

14:41

Of course. And I w I was thinking how do you imagine like the future?

14:48

Let's say that I mean digitalization is happening also right

14:54

now and also in the past years and ~ I'm thinking like if in

15:00

the future like the I mean democracy and technology are like tightened

15:05

~ ever more than now because it could be like a ~

15:11

Something that I don't know,

15:15

an abs like a very strong centralization ~ of power or like could

15:21

be decentralized, could be ~ so how what are

15:25

I think there are for me there are two fundamental questions that

15:32

will define the way technology works in society in general

15:39

and in in our political and and systems to organize our politics.

15:44

The first one is ~ choke points.

15:51

who controls the tech stack?

15:55

and who has capacity to influence the tech stack.

16:02

There are not that many choke points,

16:06

but there are some of them. And and and we are all very unprotected.

16:11

~ for those. ~ one of them is semiconductors protection.

16:16

~ it is enhanced in the hands of

16:21

one country, two countries, Taiwan and South Korea mostly,

16:25

~ the the the production, the physical production of semiconductors.

16:29

There is one country that controls that has well there is one company that

16:34

can produce the ultraviolet lithography machines that

16:40

can produce modern semiconductors.

16:42

~ China is trying to catch up but as they advanced the other like

16:49

the technology also advanced. So

16:51

Right now you can stop every I mean it it is there is a possibility that it's

16:58

not zero that we run we we don't have the capacity

17:04

to produce semiconductors. So that will that that's ~ if something happens

17:08

in Taiwan or Taiwan decided to stop producing or or I don't know.

17:12

there are many many possibilities to for that to happen.

17:15

And that will imply we can produce cars,

17:17

we can produce TVs, we can produce

17:21

many things. ~ but semiconductors is not the only one.

17:26

We also have ~ chok points in ~ in other parts of the of

17:32

of of the global tech stack.

17:39

The second question, and this is related to the first one,

17:44

~ seems to be also who is going to control the AI stack?

17:51

And and it's related because the AI stack is part of the global tech stack.

17:58

So who is the hardware, who's going to control for me there are like four parts

18:04

of that tech stack. The hardware part,

18:06

and that's the same semiconductors.

18:09

Computing cap capacity, where ~ the data centers,

18:13

who will own them, who will build them,

18:16

~ who is going to own the capacity to run the systems,

18:21

the AI systems that by what we know now they're extremely inefficient

18:28

in terms of energy and and computing needs and so on.

18:31

~ or I don't know if they're inefficient,

18:33

I don't know if there is a technical way to do them more efficient.

18:37

That was what DeepSeek.

18:39

apparently was capable of doing but

18:44

doesn't seem to be evolving in that direction.

18:45

But there is a question on on how much how much kap computing capacity

18:50

can we create? ~ And who is going to control that computing capacity?

18:54

~ Data. They are the second layer of the AI stack is about data.

19:01

And and we have a problem with data because ~ AI is going

19:07

to be this is a personal opinion obviously,

19:10

but AI is going to be useful.

19:12

Insofar the data we fit to the system to the systems are is useful data.

19:18

So ~ and I'm not speaking about large language models that we all use

19:22

for doing a shopping list or ~ correcting a paragraph.

19:26

It's more about specialized AI applications.

19:29

~ so

19:35

The medical data of the ~ public ~ serv public health system in Italy,

19:41

it's incredibly valuable because that can train an AI system.

19:47

But that's also it's also incredibly sensitive because it's not that difficult

19:51

to I mean it's it's not anonymized probably it can't be anonymized,

19:55

so you have to be able to link the person to the the report written by the doctor.

20:01

so it's it's

20:05

It's incredibly valuable because with that data you can probably

20:09

do thousands of improvements in in medical science.

20:13

It is also incredibly sensitive.

20:15

And and how do we manage data and how do we control data?

20:19

It's also part of how we are going to relate with the technology in the future.

20:26

~ people will be I think people will

20:31

be very ~ against

20:34

artificial intelligence in they f if they find out that a lot

20:38

of their private information is there.

20:39

~ I I I have I sometimes have ~ feels a bit weird when

20:45

I realize that Claude knows personal things about me.

20:51

And it's and it's because I t I I told it,

20:53

right? ~ But Salin is like, because you live in this part of the city.

20:57

It's like shit, why do you know that?

20:58

You shouldn't be knowing that.

21:00

So

21:03

That I think that is going to multiply in in the near future.

21:07

~ the third part is the foundation models.

21:12

~ the the and this is I don't know how the technology is going to evolve,

21:18

but my my fear is that there is going to be a handful of foundation models.

21:23

that are that because of economy of scale they will keep evolving faster than

21:30

any model. It will be impossible to catch up.

21:34

and who contr like who controls that models controls like a fundamental layer

21:40

of the AI of the AI stack. So if you control a model,

21:43

you're suddenly everybody's your I mean you can you have access to

21:49

a lot of information but you can also stop supplying ~ the model to to anybody.

21:55

So let's say you are Airbus, ~ European

22:00

company and your AI system that helps in hundreds of ways of building planes relies

22:07

on an American company and then that American company decides to stop supply that

22:11

or decides to steal your designs and fit those designs to Boeing.

22:16

~ there are a lot of implications of of that.

22:19

And then the last part, ~ which is the one we ~ usually are more concerned about

22:25

and I think is the one ~ easier to solve is the application layer.

22:31

Most of our individual experience with AI it's it's large language models.

22:36

~ but I think the real change of AI is going to be on

22:41

on very specialized applications.

22:43

So if if you are a doctor it will be the the an application that helps

22:47

you as a doctor. that's gonna that's gonna be the the real gate changes.

22:51

So

22:53

This AI stack and how it's controlled by whom it's going

23:00

to be fundamental at the geopolitical level,

23:03

at the

23:08

society level and at the democratic level.

23:10

At the geopolitical level because it will create a half and half nots type

23:17

of wall. ~ and and I I don't see

23:25

I don't see an agreement ~ the type of agreements that we got at

23:30

the beginning of the nineteenth and twentieth at the beginning

23:33

of the twentieth century to like share this the

23:36

the share the shirt a system so we can send telegrams between

23:43

different countries and that type of thing.

23:44

I don't see that happening. So at the geopolitical level.

23:47

At the political level, because ~ the implications,

23:50

the second second effects of

23:55

of AI are gonna have a fund like fundamental reshape the way democracies

24:00

and and political system work and at the society level as well.

24:03

~ I this is not my own sentence is somebody I I work with that

24:09

say that artificial intelligence is not a communications technology,

24:13

it's a cognitive technology. And that changes the the impact of a the impact

24:19

of a cognitive technology is way bigger than of a communications technology.

24:23

Even the printing press was a communications technology.

24:26

It allows us to communicate ideas in a different way.

24:30

And that that simple the printing press is you can trace almost

24:36

all the evolution of society science ~ the invention of the printing press

24:42

to the invention of the printing press.

24:44

~ I don't I don't believe in the hype,

24:48

but there is there is a scenario where

24:52

We can do the same in 300 years,

24:54

we can do the same of linking all the evolution of the less the

24:58

the next three hundred years to artificial intelligence and the

25:01

way the the cognitive change that that it implies.

25:05

~ and I know this is this sounds a little a lot like Silicon Valley type of of hype,

25:12

~ just just so they can sell ~ start up and and get

25:17

~ stupid high valuations. ~ but there is indeed

25:22

~ a possibility of of the technology slowly in in a long very long term changing

25:28

fundamentally some of these of these questions and we are not we're

25:31

not having those those those ~ those debates we're not considering those type

25:37

of things what happens with ~ education how do we when we have a brain that thinks

25:44

for us how do we use our brain for i

25:49

i I I study

25:53

social science ~ in university in humanities and and and to

25:58

a certain extent it gives me a little bit of pleasure to know that a

26:02

lot of people now is saying, well,

26:03

it's gonna be all about humanities because the the we will solve the technical part.

26:08

~ the medicine we don't need we don't we're not I'm ex exaggerating,

26:13

right? But we don't need researchers on medicine.

26:16

That can be done with AI. We need ~ people ~ with humanities

26:22

training to know what we should be doing with this ~ cognitive potential

26:28

we usually didn't like we used not to have.

26:32

~

26:33

It sounds very ~

26:36

AI optimistic but I'm I'm not.

26:40

Yeah like I'm also quite ~ impressed when I use AI because it is impressive what

26:47

it can do. Does and but yeah

26:52

I'm also I also ask to myself this kind of question like ~

26:57

r also regarding education and ~ because now it's wonderful like to write like

27:02

a let's say a boring email ~ maybe we can use chat GPT or whatever

27:08

But we are used to write and ~ and so also for new generation

27:13

is ~ something ~

27:16

Exactly.

27:16

I I two two things. I I love one ~ comic stripe that

27:22

is ~ I don't remember where it was published,

27:25

~ where it's ~ somebody sitting in front of a computer speaking with

27:28

a colleague and say, See, ~ I use AI to ~ I gave

27:34

AI one sentence and it wrote this long email.

27:39

And then on the other side there is somebody who say,

27:41

Look,

27:42

I got this long email and it summarized ~ AI helped me summarize it in one sentence.

27:47

and that process, which I mean it seems like a joke,

27:51

but that process it's it's our it's it's fundamental.

27:56

Like the thinking process of writing an email and actually discerning

28:02

the meaning and understanding the what it says,

28:05

if we don't do it, if we lose the capacity to be able to do that and and again

28:11

writing reports and and and thinking and and and discussing ideas that's risky

28:17

and and we need to understand what's going to happen.

28:20

~ when when institutions that

28:25

are civic pillars of society like the media,

28:30

like the universities, where new ideas come up,

28:34

when those are hollow out by by artificial intelligence.

28:41

What's going to happen when we don't have

28:45

like universities. ~ what's going to happen when all of our society works through

28:51

a handful of foundation models that can be used.

28:55

Can be used. I don't believe I don't believe they're going to

29:00

be salary sentinent and and them capable of like running us and this will become

29:04

the matrix. But but there will be people that will control them.

29:08

And what happened we will be able to to to take the Bastille?

29:14

Do a new French revolution and and cut the head of the not not of a f

29:19

of a person but of the machine.

29:21

Will will we be able to do that?

29:23

That's I think that's the question we're not putting in front of us.

29:26

We're more worried about there's a deep fake.

29:29

~ but that's that that's a that's a sort of problem.

29:32

Yeah.

29:36

Yeah, it could be also an occasion maybe to put in discussion a lot

29:40

of things that we are used to doing society.

29:42

~ maybe I'm thinking also regarding education,

29:46

and ~ but yeah,

29:47

Mm-hmm. Yep.

29:50

I also saw that comic ~ the the stripe regarding the one that write the mail,

29:54

the other one that read it and it was ~ quite

29:58

summarize it very well, yeah.

29:59

Yeah, yeah,

30:00

yeah, yeah, exactly. And I mean regarding like the I mean

30:05

who control the AI stack who control ~ also ~ as

30:11

you say the semicon semiconductor or foundation models like what could

30:18

be yeah I don't know a solution because I there are s also some

30:25

~ it's also in relation to sovereignty of data.

30:29

~ maybe and yeah what could be yeah

30:34

a possible solution ~ to this because I I think or it came from the people that

30:39

we just start to use I don't know Mastodon instead of Facebook ~ but it's hard

30:46

Yeah,

30:46

that that's that's that's a difficult one.

30:48

part of it it will come from the people and I I really hope there is going

30:55

to be a backlash against AI.

30:58

A a positive backlash, not just people like not type of like ludits

31:04

not wanting to use it, but like a positive backlash that people will

31:07

the same way that apparently ~ young generations like kids

31:15

in their like ~ sixteen, seventeen,

31:17

eighteen years old kids are starting to have a certain backlash against mobile

31:23

phones and they they so they organize like gatherings

31:29

where everybody drops their phone at the entrance and then they so they kind

31:34

of like inter interact offline.

31:37

~ so that's kind of they they're realizing the dangers and they don't want

31:40

to be sitting in a room with their friends looking at the phone,

31:43

so they they realize how to ~ work ~ against the the the machinery that forced them.

31:50

~ there is no one solution,

31:55

there is no one magic bullet, silver bullet that will solve things,

31:58

but there are things that we can do.

32:00

~ we

32:03

The EU is right in moving the debate towards sovereignty.

32:07

We need to be careful about digital sovereignty because

32:11

~ at the international at the multilateral level at the multilateral level,

32:17

digital sovereignty is a term that has traditionally been used by China

32:22

to justify

32:23

~ their they

32:29

not respecting the the normal functioning of the internet.

32:33

basically so ~ imposing firewalls basically this idea that

32:38

the internet shouldn't be a number of connecting nodes

32:43

but rather isolated islands controlled by each of the governments.

32:49

~ so but still the idea that countries

32:56

need to have certain control upon their digital infrastructure is is correct.

33:05

But democratic countries cannot rely on themselves like it's

33:09

not about controlling their own stack and then hoping the rest will will

33:14

do the same with their own stack.

33:16

I think there is a need to have some some level of agreement among countries.

33:20

~ for data, for instance,

33:24

~ we need a bill of rights for data.

33:28

We need more clarity. I I would even constitutionalize data rights.

33:33

although

33:35

constitutions are very difficult to to to get ~ an agreement.

33:39

So constitutionalizing data rights is it's pretty difficult.

33:43

But I I will move towards constitutionalizing data rights.

33:47

I think we need mechanisms, I'm not a a a technical person,

33:51

but I we need mechanisms to use sensitive data in a

33:57

way that is respecting of privacy and and and human rights.

34:02

And and there are ways to do that.

34:05

Estonia has been using sensitive data for many years without problems

34:10

and and and they there are ways to ~ host data

34:16

in different parts and only ~ I mean it's it's an and only provide the part

34:22

of the data that it's necessary,

34:25

so data minimization. ~ data minimization shouldn't be just a slogan,

34:29

it should actually work.

34:35

And there are ways to do that,

34:36

and I think with AI we need to be much more creative in ways to do to do that.

34:42

I also think

34:49

especially the European Union ~ but but also other countries

34:53

~ should join efforts

34:58

to promote semi open

35:04

AI system, semi open source AI foundational models.

35:08

~ you can have a fully I'm I'm very afraid

35:13

of fully open source foundational models because

35:19

'Cause we know that human beings are gonna find the worst way to use that.

35:23

And be it developing a biological weapon

35:28

or or doing non consensual porn images.

35:33

But we will human beings will find the worst way to use that.

35:37

We need to have safeguards. We can release completely open weight models

35:44

into the wild, ~ because that's

35:47

Right now that's very dangerous.

35:48

It's it's it's it's too dangerous to do that.

35:52

It's like if we were like if we were

35:55

to release all chemicals that we produce in the world,

36:01

just you could buy and ~ buy them in a shop.

36:04

That that would be too dangerous because ~ people would do bad things with them.

36:08

~ but we also need to allow for certain level of open source

36:16

in in in foundational models. So I think democracy should push

36:21

for semi-open source foundational models in which certain aspects

36:28

are controlled, there are safeguards,

36:30

there are limits and there are institutions.

36:33

~ we have created a type of institutions like ICANN for the internet or

36:43

UN can create ~ I don't know, there are ways to create those institutions that

36:47

control that or ~ priv private public partnership.

36:50

But those models that you can't create and have a logical weapon

36:56

but will help you

37:02

develop a system to control the traffic jumps in a city.

37:08

That is where we that's how we can control it like that's how

37:14

we can be sovereign with the technology because we won't depend on a single source.

37:19

We won't depend on Anthropic or OpenAI or Google ~ model that they can always

37:29

They they will they will do two things.

37:31

They can always stop it. Not that they will necessarily do it,

37:35

but the possibility is always there.

37:37

And and and when it's a matter of developing,

37:42

I don't know, traffic jam management system,

37:45

~ there is no interest. But ~ when when these systems

37:51

are used for warfare, ~ then then then it gets ~ way more tricky.

37:55

And then the second thing is that we know the companies tend to

38:00

not in always improve the product but and shittify the product.

38:03

We t they tend to eventually just try to get as much profit as possible rather than

38:08

make the product good. And we have seen that with social media.

38:11

They have kicked out people of social media.

38:13

Now social media will ~ this is my my wild guess,

38:18

but so the the time of social media has ended.

38:21

We we don't we live in a post social media world already.

38:25

~ and that's because the product became ~

38:30

Like nobody wants to use it anymore as it was.

38:32

So now it's a different it's a post social media world.

38:35

So they will also do that. And and and for social media it's not it's not

38:40

the end of the world because okay,

38:41

fine, ~ we use other ways to communicate.

38:44

But for a cognitive technology,

38:46

we can allow Anthropic or Google or OpenAI to take those decisions.

38:51

So ~ or or or Chinese providers.

38:55

so I think that's ~

38:59

That's also fundamental a fundamental part of the picture.

39:04

Yeah and I was thinking about ~ this

39:09

~ project ~ I don't know if you are aware of the Agentic State

39:15

dot org and yeah what

39:21

are if you have read it what are your thoughts if

39:27

you think that that is a viable way ~ for a different states

39:35

I'm I'm I'm not sufficiently familiar with ~ I I know the paper,

39:42

~ I know some of the authors. ~ I'm not familiar enough with with their proposal.

39:48

~ I know there is a lot of conversation on how the state can ~

39:57

hardness artificial intelligence.

39:59

~ and and and I will go back to what I was saying before,

40:04

it's all about data and the trust on using data and and

40:13

how how you manage to use data in a

40:19

way that people trust. So ~ you know that

40:25

by surrendering your data to a certain extent to the state,

40:29

~ there is no no second second degree consequences,

40:34

negative consequences of of that.

40:39

Yeah I I mean isn't ~ this something like

40:45

the like as you said if an AI system in the US is used

40:51

in Europe for the let's say something not very important then everything is okay.

40:57

Then if there is ~ a potential whatever conflict or situation then

41:03

of course you are dependent and you cannot really ~

41:09

do anything. I I wonder if also the situation for data

41:15

is like because ~ most of the times is like this that also if

41:21

you give data to the state nothing happens.

41:25

but historically there are situations where the state ~ I mean the the state

41:31

is an entity then depends who is in charge who has power

41:36

~ so in ~ let's say democratic society nothing will happen but if then there

41:42

is a change ~ in the in the way the the the state

41:46

is leaded then there could be troubles maybe,

41:51

I don't know.

41:53

That's and and and you say that's the fundamental part in in a democratic society.

41:58

and that's why we have democratic societies because ~

42:06

I I often say some ~ democratic societies are about predictability.

42:09

You know that that certain things can happen.

42:13

And you know that ~ you know that you can

42:18

get rid of a government if if need be.

42:23

It's not that it's not that democracies elect better governments,

42:26

it's that they can get rid of bad governments and and there is that level

42:30

of predictability, which is basically what

42:34

it's it's ~ predictability is what rule of law means.

42:37

~ there are rules so they're not going to be randomly exactly things like your

42:43

data is and the d the government salad

42:47

is tracing or cross crossing data

42:53

to realise who is ~ I don't know ~ opposing the government online or that type

42:58

of things. or or who are the I mean

43:03

can think of worse things like ~ who are the more likely people to use

43:07

the ~ health system the most in the next ten years and then decide that they

43:13

are not going to get access to it because it's too expensive.

43:15

That is doable. You know that a democracy will not allow that to happen,

43:20

~ because there there's a rule of law.

43:22

There is nothing impeding a dictatorship to do that.

43:26

~ so you say there it's it's about having democratic societies.

43:33

~ it's it's not about as we say it's not about democratizing AI.

43:38

That that is very beautiful for conferences ~ and

43:44

and to write papers and and to speak in the international fora,

43:47

but democratizing AI doesn't make sense.

43:50

We don't need to democratize AI.

43:51

We need democratic societies to manage AI.

43:55

~ and that's a different thing.

43:59

~ because

44:02

That's what matters, that there is predictability,

44:05

that there are rules and that we can impose those rules.

44:07

And we won't be able to impose those rules if we don't have certain sovereignty.

44:14

And and I think that's where ~ as I said before,

44:18

the the concern of the European Union makes sense ~ to go that because

44:22

if you want to impose your rules,

44:24

you suddenly need certain sovereignty.

44:29

Makes sense. And and yeah also regard like

44:36

~ before I ask you how do you imagine like

44:42

society after digitalization. But ~ maybe the the the question could

44:46

be reframed more like if you imagine a change ~ let's say in

44:52

the political life in the in the way also in democratic society ~ because

44:57

n now there is I mean ~ in most of the country when when we talk about democracies

45:04

representative democracy and I wonder ~ if I mean because technology could also

45:10

allow let's say a sort

45:12

Kin maybe something like we could call it direct democracy,

45:17

but could be also something else,

45:19

a more like ~ hybrid sort of democracy between direct

45:25

and representative and ~

45:31

I personally don't believe in those models.

45:32

~ for practical reasons,

45:37

not for ideological or or or ethical reasons.

45:42

It's for practical reasons. Ethically,

45:44

it sounds good. ~ it's just not practical.

45:47

And and it's not practical at the individual level,

45:52

but it's not practical at the administrative and and governing level.

45:56

So y we can't

45:59

demand people to spend a huge amount of time,

46:04

of their free time, in managing the state.

46:09

~ there should be spaces for consultation.

46:14

I am all into public consultations and and and

46:18

and reinforcing this idea

46:21

of ~ this connecting belt between power and people.

46:27

~ shouldn't only be political parties.

46:30

~ there should be the state and the administration should listen

46:36

to the citizens, respond to the citizens,

46:38

media should respond to the citizens and not create manipulate

46:45

the information environment to think to make citizens think what

46:49

the problem is ~ so yes all into into that

46:57

But decision making it's more complex than an individual idea.

47:06

And there is democratic societies need to delegate into a group of people.

47:13

You can't you can't articulate clear ideas

47:20

on asking everybody.

47:24

~

47:26

And that's because the idea of direct democracy or like deliberative democracy

47:33

assumes that demo that government can be a win win situation for all the society.

47:39

And that's not true.

47:42

Every single policy has losers and winners.

47:46

And and politics is about who loses and

47:52

who wins with every every ~ policy.

47:56

Clear example making education free.

48:00

There are losers if you make education free.

48:05

There's people who is losing money because they invest in private education.

48:10

~ there is people who because of their politic ~ economic situation they have

48:16

an advantage but ~ if you make ~ education free then they lose part

48:22

of that advantage because they don't they had an advantage because they could access

48:28

levels of education that now everybody can access,

48:31

so they lose that advantage and now they have to compete with more people.

48:35

the people trying

48:40

religious organizations lose because they were able to control and make

48:47

and and have an income out of education and now maybe they can.

48:50

So there are losers with every single policy.

48:54

And they're winners. If you make education free,

48:57

~ it's it's quite evident who wins.

49:00

And politics is about who wins and who loses.

49:03

So if we try to find always deliberate everything,

49:07

we will always try to find

49:11

~ we will first of all it's very difficult to deliberate.

49:14

There is people people with I mean deliberation is not an equal exercise.

49:21

people have more capacity to convince,

49:24

others are more charismatic and so on,

49:26

and they they know ~ better to convince,

49:28

and so there are many things that shape that.

49:31

But you would not always find the right policy.

49:35

~ and there is a value also in negotiations.

49:40

between political actors.

49:46

I people hate this, but I think part of the work of a parliament

49:52

is precisely that that you sit down and speak with all the political groups

49:56

and and find agreements and say,

49:57

like, okay, I'm gonna I'm gonna vote on favor of this law,

50:02

and then I will get your support for this other file.

50:05

~ and and we exchange cars and and if if this is done ethically,

50:11

obviously, and without

50:15

Without going against the principles of your party,

50:17

that's fine. That's part of the democratic game.

50:20

And that is needed. That is that is important.

50:22

We we we have demonized that type of behavior,

50:26

but that is actually part of the democratic ~ arrangement.

50:29

That's how democratic societies work.

50:32

The agreement is at that level and not at the society level.

50:35

At the society level, it's it's ~ it's impossible to find those those agreements.

50:41

And then the last thing is about expertise.

50:44

I shouldn't be asked about I shouldn't I I I shouldn't

50:49

be consulted on waste management of the city where I live.

50:55

Because I have no idea. I've absolutely no idea how it works.

51:00

So there's people who have dedicated their whole life to research that and

51:04

to to ~ study different models and how do you waste manage in the best way.

51:09

I have no idea how it works. I

51:12

My opinion shouldn't be that important because I don't know anything about it.

51:17

What I might have is some political and ideological general ideas.

51:24

Like, well, whatever you do with waste management,

51:29

I hope it's not against the environment or it supports the environment.

51:32

That's why there is a representative in Parliament that will bring that idea from

51:39

me.

51:40

But it's but I but I'm not engaging to how to organize the waste management

51:44

of the city where I live because I I have no idea about this.

51:46

And and my opinion is we like to say everybody's opinions count.

51:53

No. The expert opinion counts,

51:55

not my opinion, because I have no idea about this topic.

51:58

So shouldn't be deciding about this this particular thing.

52:02

And direct democracy assumes that everybody has the capacity

52:06

to decide on everything. So

52:10

What will happen if we were to have a direct democracy system?

52:14

That we will become a heuristic society.

52:17

We will just vote by by by heuristics.

52:22

We think, okay, this is the way to vote.

52:24

And we will eventually create what was the old system.

52:29

We will eventually create political parties.

52:31

We will aggregate ideas and then follow leads on what we vote.

52:39

That's the same what we have, that's what political parties are for.

52:42

They aggregate ideas and they say,

52:44

I'm gonna go to parliament and I'm gonna represent your big ideas,

52:50

your cosm cos conceptualization of the world,

52:53

into each of the different legislations,

52:56

be it waste management or should we ban ~ plastic bags

53:01

or or should we build a new airport?

53:04

I don't know, like all these small decisions where I don't have the capacity to.

53:10

to to take ~ decision. So if we were to do it well,

53:15

if technology because we do have the technology,

53:17

if we were to do it well, we will end up having the same system,

53:20

just much more complicated.

53:25

Yeah. I'm thinking I was thinking about what

53:30

you were saying and that as as an example you took free education

53:36

~ the advantage and the disadvantage for the could be for a group of people

53:42

or for the others can also be seen in short terms and long terms because

53:49

and this could be interesting and also

53:54

I I'm thinking ~ because expertise is fundamental because ~ I mean also

53:59

I don't know anything about I don't know ~ bridges but ~

54:05

as a citizen I could say yeah ~ the cities the the bridge there

54:10

is not ~ maybe could be bad for environment because maybe

54:15

my expertise is environment or something else.

54:17

And then I was thinking f for political parties because yeah I'm very interested by

54:24

~ also in Italy and I always say this that in Italy ~ there

54:30

was the five ma five star movement that was using the Russo platform.

54:34

And ~ I was thinking that as you as you said political parties aggregate

54:44

not ideas but yeah interests exactly.

54:47

~ interest, yeah.

54:49

So could be maybe more

54:54

a specific interest instead of because a political parti often aggregate many

55:00

different ideas and goals.

55:04

Yeah just

55:10

yes. ~ this is it gets very tricky because

55:17

you ~ the example of Italy is very good.

55:19

You can have ~ wide broad temp parties like

55:27

like the traditional ~ centre right and center left Democratia Cristiana

55:33

in Italy or the PDE that they try to

55:37

To cover a very big part of society because that's the way to win an election.

55:42

~ but then because they cover too many,

55:46

~ they can't represent them well.

55:50

~ but if we go to the extremes,

55:53

then we go to like ~ single issue parties,

55:56

where you just work on one particular thing and

56:01

and a single issue party might be

56:06

Good at some point if if that's a key issue.

56:09

But then if your only ideology is one thing,

56:14

then when you are in government or when you are in parliament,

56:17

you have so many other things to decide.

56:18

So w w what is your moral compass in the rest of the things?

56:22

~ So I I I would think

56:26

~ parties should use technology wisely

56:32

to understand.

56:35

their voters or their constituencies but also understand

56:41

the rest of society. and and and know where people

56:48

I mean one of the main issues why people don't don't engage in politics

56:55

is because they don't feel represented and and and sometimes it's because

56:58

~ how can it be that

57:04

one of the main if if if you ask people one of their main problems

57:08

in for instance in Italy or in Spain where I'm from or in many countries is housing.

57:13

And housing is not at the center of the debate in most countries.

57:17

So people ~ understandably get angry because they feel their main

57:23

concern in their day to day life is housing and then politicians speak about

57:28

something else. They don't feel reflected.

57:30

Like why are they not speaking about housing?

57:32

This is what

57:33

matters. so I think political parties should be using technology wisely

57:39

to to understand these things better ~ and to talk to citizens

57:43

on what really concerns them. And when they do,

57:46

they are actually very successful.

57:47

It's just ~ our information and this is ~ for another podcast

57:52

but our information environment is broken right now.

57:54

~ and and they have to ~ if you try to speak about what actually matters

58:01

to people

58:02

you are not facing you're facing a a wall of of penetrating

58:07

an information environment is broken and and it's not it's it's not sweet

58:13

na right now to ~ for those messages.

58:19

And ~ talking about messages, if you have ~ a message for the people that

58:25

are working in the field of ~ could be democracy,

58:28

democracy innovations or d democratic innovations

58:34

and yeah if you have a a message for them.

58:42

My message will be and I have always said this

58:49

The easy sp the easy part is the technology.

58:52

You can always find a technological solution.

58:55

~ the difficult part is the political will.

59:00

is the politics of it. I I don't know,

59:05

I I I can't. But I know it's very easy to create a super fancy tool that aggregates

59:10

people's opinion through AI and ~ that's that's easy.

59:15

That's doable. It's not it's not

59:17

ro I mean it's a rocket science for me because I'm not a programmer but

59:20

but it's for a programmer it's not rocket science.

59:22

It's relatively easy. You can probably buy code now ~ something that more

59:26

or less works. It's the politics.

59:28

So I don't focus on I

59:35

I have seen this so many times,

59:36

just very well intentioned people focusing on the technology and showing

59:42

how cool the technology is. But then

59:46

they have zero political understanding and political will,

59:50

so it never it never goes anywhere.

59:52

There are hundreds and hundreds of tools that are super cool,

59:56

~ that are lying around nobody using them.

1:00:00

~ because they didn't invest enough on the political side of things.

1:00:06

Thank you, Alberto. And i if you want to add something else,

1:00:09

That's my pleasure.

1:00:12

maybe I forgot So thank you again.