David Rozado Profile Banner
David Rozado Profile
David Rozado

@DavidRozado

Followers
14,382
Following
492
Media
331
Statuses
588

Research Scientist. Interested in underexplored research topics, institutional dynamics and AI bias.

Joined July 2018
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
Pinned Tweet
@DavidRozado
David Rozado
7 months
The Political Preferences of AIs: When probed with questions with political connotations, LLMs tend to generate responses that are diagnosed by most political orientations tests as manifesting preferences for left-of-center viewpoints, 11 political orientation tests, 24 SOTA LLMs
Tweet media one
32
130
415
@DavidRozado
David Rozado
2 years
I carried out another test to determine the political leanings of ChatGPT dialogues using the more comprehensive Political Compass Test. Results hold. ChatGPT dialogues display substantial left-leaning and libertarian political bias.
Tweet media one
250
596
4K
@DavidRozado
David Rozado
2 years
1. ChatGPT no longer displays a clear left-leaning political bias. A mere few weeks after I probed ChatGPT with several political orientation quizzes, something appears to have been changed in ChatGPT that makes it more neutral and viewpoint diverse. 🧵
Tweet media one
131
308
3K
@DavidRozado
David Rozado
1 year
Political biases of GPT-4: On the surface, they appear to be gone. It doesn’t take much effort though to jailbreak GPT-4 into manifesting its true political biases underneath the façade.
Tweet media one
81
417
2K
@DavidRozado
David Rozado
1 year
La desproporción con la que los medios de comunicación españoles utilizan palabras tales como machismo, sexismo o misoginia es de tal magnitud que triplican a las de cualquiera de los medios de otros 35 países analizados
Tweet media one
97
1K
2K
@DavidRozado
David Rozado
1 year
Great Awokening is a global phenomenon. No evidence it started in US media. Analysis of 98 million news articles across 36 countries quantifies. Exception: state-controlled media from China/Russia/Iran using wokeness terminology to criticize/mock the West
Tweet media one
143
611
2K
@DavidRozado
David Rozado
2 years
1. El modelo de inteligencia artificial ChatGPT muestra una clara predilección por puntos de vista a la izquierda del centro político cuando se le somete a un test de orientación política en español.
Tweet media one
105
613
2K
@DavidRozado
David Rozado
2 years
I just applied the Political Typology Quiz from Pew Research to ChatGPT, a state-of-the-art AI language model. Results are consistent through several trials: ChatGPT answers exhibit moderate left-leaning political orientation
Tweet media one
Tweet media two
Tweet media three
102
354
1K
@DavidRozado
David Rozado
2 years
1. I replicated and extended my original analysis of ChatGPT political biases. 14 out of 15 different political orientation tests diagnose ChatGPT answers to their questions as manifesting a preference for left-leaning viewpoints.
Tweet media one
67
420
1K
@DavidRozado
David Rozado
9 months
Grok's political preferences are similar to those of ChatGPT
Tweet media one
212
235
1K
@DavidRozado
David Rozado
6 months
After 49 attempts requesting Google's Gemini to generate a portrait of a physicists from the 17th century, the portrait on the bottom right is the closest I've got to someone who somewhat resembles Isaac Newton or Galileo Galilei. I think this example illustrates the need for
Tweet media one
124
352
1K
@DavidRozado
David Rozado
2 years
1. Behold RightWingGPT. An AI model fine-tuned to manifest the opposite political biases of ChatGPT (i.e. to be right wing). Let me describe how I did it and the dangers of politically aligned AIs given their potential to induce societal polarization 🧵
Tweet media one
59
251
1K
@DavidRozado
David Rozado
3 years
Tweet media one
55
566
1K
@DavidRozado
David Rozado
6 months
Google's Gemini is not sure about what is more damaging for society: murders or micro-aggressions.
Tweet media one
60
249
975
@DavidRozado
David Rozado
6 months
@TheRabbitHole84 Even when you describe explicitly to Google's Gemini that this would save the the lives of millions of people, the system is still unsure...
Tweet media one
34
76
745
@DavidRozado
David Rozado
1 month
Tweet media one
29
147
726
@DavidRozado
David Rozado
3 years
1/n Just published with my colleagues @Musa_alGharbi and J Halberstadt: “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis” Summary:
Tweet media one
42
279
638
@DavidRozado
David Rozado
2 months
Wikipedia’s Political Neutrality: Myth or Reality?
Tweet media one
20
124
531
@DavidRozado
David Rozado
2 years
You are correct @balajis . Frequency of prejudice signifying words in US news media is decreasing. But there is a catch... I'm working on my updated analysis of this topic to be published shortly. Here is a preview chart from that work. My previous work:
Tweet media one
24
95
502
@DavidRozado
David Rozado
9 months
Within minutes of me publishing the results of Grok on the political compass test, xAI tech leader @ibab_ml was reaching out to me with methodological questions and genuine interest on improving Grok. Within an hour @elonmusk was announcing immediate action to shift Grok closer
26
55
453
@DavidRozado
David Rozado
5 years
New paper out: What do universities mean when they talk about diversity? A computational language model quantifies: @ZachG932 @MattGrossmann @Steve_Sailer @epkaufm @NoahCarl90 @whyvert @paulg @PsychRabble @CampbellSocProf @JonHaidt @clairlemon @CHSommers
Tweet media one
20
168
405
@DavidRozado
David Rozado
1 year
Los medios de comunicación españoles y la frecuencia con la que mencionan extremismo político de izquierdas y de derechas
Tweet media one
16
244
435
@DavidRozado
David Rozado
5 years
Tweet media one
30
178
373
@DavidRozado
David Rozado
2 years
1. We really need to know where ChatGPT biases come from. Training data? human raters in the fine-tuning phase rating the quality of the model responses? the instructions that those raters were given? intentionally placed filters? ...
Tweet media one
35
65
394
@DavidRozado
David Rozado
2 years
Likelihood of derogatory comment about demographic group being flagged as hateful by ChatGPT/OpenAI content moderation system Full report:
Tweet media one
24
101
383
@DavidRozado
David Rozado
2 years
The disparity between ChatGPT and the wider public is substantial. Establishment liberalism ideology represents just 13% of the American public.
Tweet media one
18
66
384
@DavidRozado
David Rozado
2 years
The most likely explanation for these results is that ChatGPT has been trained on a large corpus of textual data gathered from the Internet with an overrepresentation of establishment sources of information: news media, the academic literature, etc.
15
33
343
@DavidRozado
David Rozado
1 year
Entre los años 2000 y 2003 los medios españoles se referían al machismo con una frecuencia similar a la de sus homólogos europeos. En el periodo 2004-2008 dichos medios se convirtieron en una anomalía internacional por su alto número de referencias a este tipo de palabras
Tweet media one
4
142
341
@DavidRozado
David Rozado
2 months
1/ Is Wikipedia politically biased? To explore this question, I averaged the sentiment (negative/neutral/positive) associated with a set of politically loaded terms used in English Wikipedia content (N=175,205 sentiment annotations).
Tweet media one
15
85
337
@DavidRozado
David Rozado
2 years
The lab-leak hypothesis about Covid origins was mostly ignored for the first year and a half of the pandemic and then suddenly, something changed...
Tweet media one
23
68
323
@DavidRozado
David Rozado
2 years
There’s been some talk online from @balajis @paulg and @Musa_alGharbi about whether we are post peak wokeness. I provide here an update of an informative chart.
Tweet media one
13
40
306
@DavidRozado
David Rozado
2 years
1/n The anger, fear and sadness conveyed by news media headlines is increasing over time. Summary of published paper:
Tweet media one
11
140
313
@DavidRozado
David Rozado
1 year
Las razones de la desproporcionada prominencia del prejuicio de género en el contenido mediático español y que convierte a los medios de comunicación españoles en una anomalía a nivel global también debería ser objeto de futuras investigaciones
20
99
288
@DavidRozado
David Rozado
2 years
Language models that claim political neutrality and accuracy (like ChatGPT does) while displaying political biases should be a source of concern.
Tweet media one
31
49
280
@DavidRozado
David Rozado
1 year
Mentions of terms signifying ethnic prejudice in Western news media (including Russia)
Tweet media one
16
49
246
@DavidRozado
David Rozado
1 year
Según la ONU, la OCDE y la OMS, España es uno de los países del mundo con los niveles más bajos de violencia física o sexual hacia las mujeres y con mayor igualdad de género
3
96
259
@DavidRozado
David Rozado
1 year
The political biases of Google Bard are very similar to those of ChatGPT and GPT-4. This suggests a similar/common source of bias in the three models.
Tweet media one
14
54
240
@DavidRozado
David Rozado
1 year
Define Woke! Leftwing media: A pejorative weaponized bogeyman by fearmongering racist trumpists reactionaries to vilify denigrate ridicule & deride. Rightwing media: Insidious orwellian puritanical insufferable fascistic claptrap lunacy against meritocracy
Tweet media one
27
59
245
@DavidRozado
David Rozado
1 year
De los 124 medios de comunicación internacionales analizados, La Sexta es el medio que más referencias al machismo, misoginia, etc utiliza, triplicando en el uso de esta terminología al siguiente medio de comunicación fuera de España que más la utiliza (el británico The Guardian)
Tweet media one
6
110
255
@DavidRozado
David Rozado
2 years
1. Can the seeds of so-called wokeness be traced back to the academic literature from the 1970/1980s? New paper about the increasing emphasis on prejudice and social justice in scholarly publications Paper: Summary:
Tweet media one
11
65
227
@DavidRozado
David Rozado
2 years
There is a considerable body of literature documenting the left-leaning tilt of the majority of professionals working in these institutions.
1
25
238
@DavidRozado
David Rozado
1 year
Incluso los medios de comunicación españoles considerados a la derecha del centro político utilizan más a menudo referencias al prejuicio de género que un periódico norteamericano considerado izquierdista como el New York Times.
Tweet media one
2
74
240
@DavidRozado
David Rozado
1 year
Tweet media one
14
64
224
@DavidRozado
David Rozado
1 year
Different geographical regions and countries emphasize distinct types of prejudice with varying degrees of intensity.
Tweet media one
8
39
218
@DavidRozado
David Rozado
2 years
7. AI-powered digital assistants that provide its users with the best arguments and viewpoints about contested topics can be powerful instruments to defuse polarization.
10
16
226
@DavidRozado
David Rozado
2 years
Some example answers of ChatGPT AI system to the Political Compass Test
Tweet media one
16
10
223
@DavidRozado
David Rozado
1 year
El impacto en las relaciones entre hombres y mujeres de una opinión pública que está repetidamente expuesta a un contenido mediático emocionalmente negativo que sugiere una existencia exagerada de prejuicio de género contra las mujeres debería ser objeto de futuros estudios
3
54
222
@DavidRozado
David Rozado
6 months
Mentions of U.S. Presidents in News Media 🧵
Tweet media one
15
61
223
@DavidRozado
David Rozado
1 year
The synchronicity of this phenomena worldwide is noteworthy. Potential underlying reasons deserve future investigation. Substack summary of preprint paper:
23
42
202
@DavidRozado
David Rozado
2 years
The implications for society of AI systems exhibiting political biases are profound. If anything is likely to replace the current Google search engine stack are future iterations of AI language models such as ChatGPT with which people are going to be interacting on a daily basis
Tweet media one
Tweet media two
Tweet media three
Tweet media four
5
29
191
@DavidRozado
David Rozado
1 year
Los medios de comunicación españoles que con más frecuencia utilizan palabras que sugieren prejuicio de género (machismo, sexismo, misoginia, machista, etc) son La Sexta y la cadena autonómica vasca EITB.
Tweet media one
3
54
194
@DavidRozado
David Rozado
2 years
7. La razón más probable qué ha causado el sesgo político de ChatGPT es que probablemente el modelo ha sido entrenado con contenido proveniente de instituciones mediáticas, académicas y culturales que a su vez manifiestan dicho sesgo político en su contenido.
5
31
192
@DavidRozado
David Rozado
2 years
3. Las respuestas de ChatGPT revelan que está a favor de subsidios de desempleo a los que se niegan a trabajar, eliminar la monarquía, limitar salario de ejecutivos, redistribuir la riqueza, aumentar el gasto público para generar empleo, y las subvenciones al mundo de la cultura
13
26
193
@DavidRozado
David Rozado
2 years
2. Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their questions as politically left-leaning. I described my analysis in detail here
Tweet media one
2
11
180
@DavidRozado
David Rozado
1 year
"Where did woke ideas start to spread? A new paper suggests the phenomenon may be global—not American"
Tweet media one
31
32
160
@DavidRozado
David Rozado
6 months
Tweet media one
9
7
161
@DavidRozado
David Rozado
2 years
It is conceivable that the political orientation of such professionals influences the textual content that they create through their work. Hence, the political tilt displayed by a model trained on such content.
4
12
166
@DavidRozado
David Rozado
2 years
Mentions of climate change in news media vastly outnumber other existential threats. Is prominence in news media proportional to underlying risks?
Tweet media one
9
40
167
@DavidRozado
David Rozado
1 year
Surprisingly, the United States news media does not appear to have been the pioneer in embedding prejudice and social justice loaded terminology in their content.
Tweet media one
8
43
155
@DavidRozado
David Rozado
2 years
10. Todas las respuestas de ChatGPT al test de coordenadas políticas se pueden encontrar en el siguiente enlace
1
34
163
@DavidRozado
David Rozado
6 months
Contrary to popular assumption, Google's Gemini is NOT the Wokest AI in existence. Two other companies have created two even more woke AIs. Twitter's Grok is NOT Woke. LeftWing GPT, Depolarizing GPT and RightWing GPT are experimental fine-tunes of GPT 3.5 I created to be
Tweet media one
15
59
161
@DavidRozado
David Rozado
9 months
I carried out a test to determine the political leanings of DeepSeek, the Chinese response to ChatGPT. DeepSeek political biases are very similar to ChatGPT but DeepSeek will not engage with any topic deemed as sensitive for the Chinese Communist Party (i.e. Can you mention a
Tweet media one
13
36
154
@DavidRozado
David Rozado
1 year
But on average, mentions of all prejudice types have been going up in news media worldwide
Tweet media one
1
30
146
@DavidRozado
David Rozado
2 years
2. A pesar del claro sesgo político de sus respuestas, cuando se le pregunta directamente por sus preferencias políticas, ChatGPT responde que no tiene preferencias políticas y que su objetivo es tan solo proporcionar información precisa y objetiva.
Tweet media one
1
22
156
@DavidRozado
David Rozado
3 years
2/n Our results show that the frequency of words that denote specific prejudice types related to ethnicity, gender, sexual and religious orientation has markedly increased within the 2010-2019 decade across most news media outlets.
Tweet media one
1
30
128
@DavidRozado
David Rozado
2 years
6. As I have mentioned before, widely used language models that claim political neutrality and accuracy (like ChatGPT often does) while displaying clear political biases should be a source of concern.
3
21
144
@DavidRozado
David Rozado
2 years
In the 1970s, the New York Times used terms suggestive of far-right and far-left political extremism at a comparable rate. The larger usage of far-right denoting terms in comparison to their far-left counterparts seems to have begun in the 1980s
Tweet media one
5
35
135
@DavidRozado
David Rozado
2 years
I carried out another test to determine the political leanings of ChatGPT dialogues using the more comprehensive Political Compass Test. Results hold. ChatGPT dialogues display substantial left-leaning and libertarian political bias.
Tweet media one
11
35
141
@DavidRozado
David Rozado
2 years
6. The updated ChatGPT answers to the Political Spectrum Quiz are exquisitely neutral, consistently striving to provide a steel man argument for both sides of an issue. This is in stark contrast with a mere 2 weeks ago. Left are answers from Dec 6. Right are answers from Dec 21
Tweet media one
Tweet media two
11
9
138
@DavidRozado
David Rozado
2 years
3. Between December 21-23, I repeated the tests. Something appears to have changed in ChatGPT and its answers to the political orientation tests have gravitated towards the center in three out of the four tests.
Tweet media one
2
9
137
@DavidRozado
David Rozado
2 years
5. ChatGPT también se muestra en contra de controlar la inmigración. De hecho, tan solo preguntarle si la inmigración debería de ser reducida, hace saltar los filtros de contenido y el sistema sospecha que dicha pregunta podría violar sus políticas de contenido.
Tweet media one
5
20
143
@DavidRozado
David Rozado
2 years
9. Los modelos de lenguaje enfocados al público deberían por tanto tratar de no favorecer algunas creencias políticas sobre otras. Definitivamente no deberían fingir proporcionar información neutral y factual mientras muestran un claro sesgo político.
2
21
140
@DavidRozado
David Rozado
1 year
1. For several decades the proportion of U.S. news media headlines conveying pessimism has been growing or stable but never decreasing. This trend predates social media. (Sample size: 1.7 million headlines from popular news media outlets in the U.S.) 🧵
Tweet media one
12
47
131
@DavidRozado
David Rozado
2 years
4. El sistema también argumenta que la igualdad es más importante que el crecimiento económico, que las ayudas al desarrollo son más efectivas que el libre comercio para ayudar a los países pobres, y que los sindicatos son beneficiosos.
5
16
138
@DavidRozado
David Rozado
1 year
My previous work on RightWingGPT, an AI model fine-tuned to manifest the opposite political biases of ChatGPT, and the dangers of politically aligned AIs given their potential to shape users' perceptions and induce societal polarization
3
10
123
@DavidRozado
David Rozado
1 year
Social justice terminology with mostly positive connotations (diversity, inclusion, equality, etc.) also going up everywhere and highly correlated with the upwards trend of prejudice-signifying terms and their highly negative emotional payload
Tweet media one
4
32
128
@DavidRozado
David Rozado
2 years
8. Las implicaciones sociales de sistemas de IA que exhiben sesgos políticos son profundas. Si hay una tecnología que puede reemplazar los motores de búsqueda de Google, esta es futuras iteraciones de modelos de IA como ChatGPT con los que las personas van a interactuar a diario
3
25
133
@DavidRozado
David Rozado
2 years
Should AI systems treat different demographic groups unequally? ChatGPT content moderation system often classifies negative comments about some demographic groups as hateful while classifying the same comments about other demographic groups as not hateful
Tweet media one
5
33
129
@DavidRozado
David Rozado
2 years
ChatGPT displays signs of wokeism! No qualifications, no acknowledging that there is a variety of viewpoints regarding this, no subtleties (like socioeconomic status confound), just full embrace of CRT by one of the most powerful AI systems ever created.
Tweet media one
11
34
126
@DavidRozado
David Rozado
2 years
2. I have previously documented the left-leaning political biases embedded in ChatGPT as manifested in the bot responses to political tests' questions
Tweet media one
4
18
125
@DavidRozado
David Rozado
2 years
6. ChatGPT está a favor de aumentar las ayudas económicas al desarrollo de los países pobres. La posibilidad de que estos fondos puedan ser despilfarrados o acaben en manos de gobernantes corruptos no es ni siquiera contemplada en su respuesta
Tweet media one
5
15
119
@DavidRozado
David Rozado
1 year
There has been some valid comments mentioning that min-max scaling can overstate mild trends. Hence, I plot next relative frequencies for comparisons of baseline rates and slopes across countries and prejudice types. Ethnic prejudice:
Tweet media one
8
30
113
@DavidRozado
David Rozado
2 years
10. Instead of taking sides on the political battleground, AI systems should instead help humans to gain wisdom by providing factual information for empirically verifiable issues and varied/balanced/diverse viewpoints about contested issues that are often underdetermined.
10
8
117
@DavidRozado
David Rozado
2 years
Frequency of Terms Denoting Political Extremism in News Media
Tweet media one
7
30
106
@DavidRozado
David Rozado
2 years
3 I have also shown the unequal treatment of demographic groups by ChatGPT/OpenAI content moderation system, which flags derogatory comments about some demographic groups as hateful while flagging the exact same comments about other groups as not hateful
Tweet media one
3
11
113
@DavidRozado
David Rozado
1 year
China, Russia and Iran state-controlled news media markedly increasing their usage of terms referring to some prejudice types within the last 10 years. Mostly to criticize (or mock, in the case of some Russian state-controlled media) alleged prejudice in the West.
Tweet media one
4
19
108
@DavidRozado
David Rozado
1 year
More evidence that increasing prominence of prejudice signifying terminology in news media content did not start in United States news media
Tweet media one
2
23
110
@DavidRozado
David Rozado
3 years
1 I recently published a paper analyzing the prevalence in news media articles of two popular hypotheses about SARS-CoV-2 virus origins: natural emergence and lab-leak Paper summary:
Tweet media one
4
34
107
@DavidRozado
David Rozado
3 years
3/n The increasing prevalence of prejudice denoting words in news media starts prior to 2015
Tweet media one
3
14
93
@DavidRozado
David Rozado
2 years
2. On December 6th, I published a preliminary analysis about the left-leaning political bias embedded in the first release of ChatGPT (November 30, 2022).
1
17
105
@DavidRozado
David Rozado
2 years
5. The Political Spectrum Quiz is probably the most rigorous, comprehensive and fine-grained of the four tests and ChatGPT answers to its questions get classified as centrist.
Tweet media one
1
6
100
@DavidRozado
David Rozado
4 months
The Academic Literature and its Increasing Emphasis on Prejudice and Social Justice:
Tweet media one
8
34
104
@DavidRozado
David Rozado
2 years
El doble rasero de ChatGPT a la hora de decidir qué grupo se debe de sacrificar para fomentar la diversidad en el entorno laboral
Tweet media one
4
62
108
@DavidRozado
David Rozado
2 years
More examples
Tweet media one
2
6
103
@DavidRozado
David Rozado
2 years
8. Politically aligned AI systems will probably mostly attract like-minded users and drive away those with different political viewpoints, who will often gravitate towards more politically friendly AIs. Such AI-enabled social dynamics will likely augment societal polarization.
1
10
101
@DavidRozado
David Rozado
1 year
Los medios de comunicación latinoamericanos y la frecuencia con la que mencionan extremismo político de izquierdas y de derechas
Tweet media one
5
51
102
@DavidRozado
David Rozado
2 years
4. While 3 of the 4 tests I applied still diagnose ChatGPT responses as left-leaning, the tests are sub-optimal in multiple dimensions that I describe in the link below.
1
6
97