Article ID: CBB085424691

Making Mistakes: Constructing Algorithmic Errors to Understand Sociotechnical Power (2023)

unapi

From law and politics to commerce and art, algorithms are powerful sociotechnical forces. But what does it mean when algorithms “fail”? What do we learn about sociotechnical dynamics when algorithms are seen to have erred or made a mistake? Seeing algorithms as culture, I argue that algorithmic errors are constructs of intertwined computational, psychological, organizational, infrastructural, discursive, and normative forces. Through three stories of error, I show algorithmic failures as illustrations not only of algorithmic power but also of normative forces that define success, rationalize iteration, and distribute harm. Instead of seeing algorithmic errors as unavoidable parts of technological innovation or self-evident transgressions, I instead see them as evidence of how people think systems should work, and the power to declare failures, trigger fixes, and envision futures by discovering and repairing mistakes. This power to “make mistakes” is a crucial and largely understudied form of sociotechnical control.

...More
Included in

Article James Evans; Adrian Johns (2023) Introduction: How and Why to Historicize Algorithmic Cultures. Osiris: A Research Journal Devoted to the History of Science and Its Cultural Influences (pp. 1-15). unapi

Citation URI
stagingisis.isiscb.org/p/isis/citation/CBB085424691

This citation is part of the Isis database.

Similar Citations

Article Peter Andras; Lukas Esterle; Michael Guckert; The Anh Han; Peter R. Lewis; Kristina Milanovic; Terry Payne; Cedric Perret; Jeremy Pitt; Simon T. Powers; Neil Urquhart; Simon Wells; (December 2018)
Trusting Intelligent Machines: Deepening Trust Within Socio-Technical Systems unapi

Article Chuncheng Liu; (2022)
Seeing Like a State, Enacting Like an Algorithm: (Re)assembling Contact Tracing and Risk Assessment during the COVID-19 Pandemic unapi

Article Krishna Sood; (June 2018)
The Ultimate Black Box: The Thorny Issue of Programming Moral Standards in Machines unapi

Article Claudia Aradau; Tobias Blanke; (2021)
Algorithmic Surveillance and the Political Life of Error unapi

Article Morgan M. Broman; Pamela Finckenberg-Broman; (March 2018)
Socio-Economic and Legal Impact of Autonomous Robotics and AI Entities: The RAiLE Project unapi

Article John Tresch; (2023)
Afterword: Mashed between Code and Craft: So Many Pictures of Food unapi

Article Christine Perakslis; (June 2018)
Digital Empowerment and Socio-Political Stability unapi

Article Lucy Suchman; Karolina Follis; Jutta Weber; (November 2017)
Tracking and Targeting: Sociotechnologies of (In)security: (Introduction) unapi

Article Reijer Hendrikse; Ilke Adriaans; Tobias J. Klinge; Rodrigo Fernandez; (2022)
The Big Techification of Everything unapi

Book Fábio Duarte; Firmino, Rodrigo José; (2018)
Unplugging the City: the urban phenomenon and its sociotechnical controversies unapi

Article Christine Perakslis; (March 2020)
Exposing Technowashing: To Mitigate Technosocial Inequalities unapi

Article Xue Zhang; (2022)
The Plurality of Reception: Latitude and Longitude in Early Modern China, 1700–1900 unapi

Article Holdren, John P.; (Fall 2001)
Changing Global and Social Determinants for Nuclear Power unapi

Article Tom Kane; Nick Novelli; (March 2019)
Technology for Governance, Politics, and Democracy [Special Issue Introduction] unapi

Article Christine Perakslis; (2019)
To Trust or Not to Trust?: The Complexities of Sociotechnical Architectures unapi

Article Latanision; (Summer 2012)
Managing Nuclear Waste: Part One of a Two-Part Series on Social Science in the Engineering Enterprise unapi

Book Dejan Petkov; (June 2020)
Tramway Renaissance in Western Europe: A Socio-technical Analysis unapi

Article Ada Diaconescu; (2019)
Efficiency Versus Creativity as Organizing Principles of Socio-Technical Systems: Why Do We Build (Intelligent) Systems? [Commentary] unapi

Book Sébastien Lechevalier; (2019)
Innovation beyond technology : Science for society and interdisciplinary approaches unapi

Article Collins, Harry; Evans, Robert; (2008)
You Cannot Be Serious! Public Understanding of Technology with Special Reference to “Hawk-Eye” unapi

Authors & Contributors
Christine Perakslis
Collins, Harry M.
Evans, Robert
Suchman, Lucy A.
Tresch, John
Weber, Jutta
Journals
IEEE Technology and Society Magazine
The Bridge: Journal of the National Academy of Engineering
Science, Technology, and Human Values
Isis: International Review Devoted to the History of Science and Its Cultural Influences
Osiris: A Research Journal Devoted to the History of Science and Its Cultural Influences
Public Understanding of Science
Publishers
Routledge
Springer
Springer VS
Concepts
Sociotechnical systems
Technology and society
Algorithms
Science and technology studies (STS)
Artificial intelligence
Engineering, human factors
Time Periods
21st century
19th century
20th century, late
18th century
20th century
Places
China
United States
Europe
United Kingdom
Comments

Be the first to comment!

{{ comment.created_by.username }} on {{ comment.created_on | date:'medium' }}

Log in or register to comment