Algorithms

Invisible, Irreversible, and Infinite

Diana Daly

Key points

  • Computers execute tasks through simple step-by-step instructions, breaking down complex actions.
  • Human adaptability contrasts with computers’ literal interpretation, evident in the need for explicit instructions.
  • Human software developers significantly shape the capabilities of modern computers.
  • Programming languages reflect biases, affecting the diversity of computer programming practitioners.
  • The Three I’s – Invisible, Irreversible, and Infinite – pose challenges in algorithmic decision-making, leading to opaque, permanent, and extensive biases.

In this chapter

Student insights: First experience with technology (video by Blaze Mutware, Spring 2021)

 

Section 4: How can computers carry bias?

Many people think computers and algorithms are neutral – racism and sexism are not programmers’ problems. In the case of Tay’s programmers, this false belief enabled more hate speech online and led to the embarrassment of their employer. Human-crafted computer programs mediate nearly everything humans do today, and human responses are involved in many of those tasks. Considering the near-infinite extent to which algorithms and their activities are replicated, the presence of human biases is a devastating threat to computer-dependent societies in general and to those targeted or harmed by those biases in particular.

A white man wearing a pair of Google Glass smart glasses. The glasses have a sleek, modern design with a small rectangular display over the right eye. The background is blurred, focusing attention on the glasses and the person's face.
Google Glass was considered by some to be an example of a poor decision by a homogenous workforce.

Problems like these are rampant in the tech industry because there is a damaging belief in the US (and some other) societies that the development of computer technologies is antisocial, and that some kinds of people are better at it than others. As a result of this bias in tech industries and computing, there are not enough kinds of people working on tech development teams: not enough women, not enough people who are not white, not enough people who remember to think of children, not enough people who think socially.

Remember Google Glass? You may not; that product failed because few people wanted interaction with a computer to come between themselves and eye contact with humans and the world. People who fit the definition of “tech nerd” fell within this small demographic, but the sentiment was not shared by the broader community of technology users. Critics labeled the unfortunate people who did purchase the product as “glassholes.”

 

Section 5: Exacerbating Bias in Algorithms: The Three I’s

In its early years, the internet was viewed as a utopia, an ideal world that would permit a completely free flow of all available information to everyone, equally. John Perry Barlow’s 1996 Declaration of the Independence of Cyberspace represents this utopian vision, in which the internet liberates users from all biases and even from their own bodies (at which human biases are so often directed). Barlow’s utopian vision does not match the internet of today. Our social norms and inequalities accompany us across all the media and sites we use, and worsened in a climate where information value is determined by marketability and profit, as Sociologist Zeynep Tufecki explains in this Ted Talk.

Because algorithms are built on human cooperation with computing programs, human selectivity and human flaws are embedded within algorithms. Humans as users carry our own biases, and today there is particular concern that algorithms pick up and spread these biases to many, many others. They even make us more biased by hiding results that the algorithm calculates we may not like. When we get our news and information from social media, invisible algorithms consider our own biases and those of friends in our social networks to determine which new posts and stories to show us in search results and news feeds. The result for each user can be called their echo chamber or as author Eli Pariser describes it, a filter bubble in which we only see news and information we like and agree with, leading to political polarization.

Although algorithms can generate very sophisticated recommendations, algorithms do not make sophisticated decisions. When humans make poor decisions, they can rely on themselves or on other humans to recognize and reverse the error; at the very least, a human decision-maker can be held responsible. Human decision-making often takes time and critical reflection to implement, such as the writing of an approved ordinance into law. When algorithms are used in place of human decision-making, I describe what ensues as The three I's: Algorithms’ decisions become invisible, irreversible, and infinite. Most social media platforms and many organizations using algorithms will not share how their algorithms work; for this lack of transparency, they are known as black box algorithms.

 

Student Insights: microcelebrity in the age of algorithms (writing by Lily, Spring 2021)

 

Respond to this case study: how might a creator change their content to affect a platform’s algorithm? How can creators and users learn more about the algorithms affecting them? How might platforms benefit from sharing more information about their algorithms? Why might they want to keep some things hidden from users?

 

 

Exposing Invisible Algorithms: Pro Publica

Journalists at Pro Publica are educating the public on what algorithms can do by explaining and testing black box algorithms. This work is particularly valuable because most algorithmic bias is hard to detect for small groups or individual human users. Studies like ProPublica’s presented in the “Breaking the Black Box” series (below) have been based on groups systematically testing algorithms from different machines, locations, and users.

Want to see more? There are four episodes in this series, available in full here. Following are links to these episodes with captions: Episode 2Episode 3Episode 4.

Section 6: Fighting Unjust Algorithms

Algorithms are laden with errors. Some of these errors can be traced to the biases of those that developed them, as when a facial recognition system meant for global implementation is only trained using data sets from a limited population (say, predominantly white or male). Algorithms can become problematic when they are hacked by groups of users, as Microsoft’s Tay was. Algorithms are also grounded in the values of those who shape them, and these values may reward some involved while disenfranchising others.

Despite their flaws, algorithms are increasingly used in heavily consequential ways. They predict how likely a person is to commit a crime or default on a bank loan based on a given data set. They can target users with messages on social media that are customized to fit their interests, their voting preferences, or their fears. They can identify who is in photos online or in recordings of offline spaces.

Confronting the landscape of increasing algorithmic control is activism to limit the control of algorithms over human lives. Below, read about the work of the Algorithmic Justice League and other activists promoting bans on facial recognition. And consider: What roles might algorithms play in your life that may deserve more attention, scrutiny, and even activism?

 

The Algorithmic Justice League vs facial recognition tech in Boston

MIT Computer Scientist and “Poet of Code” Joy Buolamwini heads the Algorithmic Justice League, an organization making remarkable headway into fighting facial recognition technologies, whose work she explains in the first video below. On June 9th, 2020, Buolamwini and other computer scientists presented alongside citizens at the Boston City Council meeting in support of a proposed ordinance banning facial recognition in public spaces in the city. Held and shared by live stream during COVID-19, footage of this meeting offers a remarkable look at the value of human advocacy in shaping the future of social technologies. The second video below should be cued to the beginning of Buolamwini’s testimony half an hour in. Boston’s City Council subsequently voted unanimously to ban facial recognition technologies by the city.

 

 

Click here for a captioned version of this video.

 

Parasocial and Parasitical — Social Media and Ourselves podcast

Parasocial and Parasitical

Release date: September 1st, 2021

An interview with Dr. Victor Braitberg about the machinations by social media platforms that help us form online relationships – and help them profit from it all. Is this good? Bad? Or The Truman Show? Produced by Jacquie Kuru and Gabe Stultz.

LISTEN   •   LISTEN WITH TRANSCRIPT

Respond to this podcast episode…How did the podcast episode “Parasocial and Parasitical” use interviews, student voices, or sounds to demonstrate a current or past social trend phenomenon? If you were making a sequel to this episode, what voices or sounds would you include to help listeners understand more about this trend, and why?

 

Core Concepts and Questions

Core Concepts

algorithm

a step-by-step set of instructions for getting something done to serve humans, whether that something is making a decision, solving a problem, or getting from point A to point B (or point Z)

biases

assumptions about a person, culture, or population

black box algorithms

the term used when processes created for computer-based decision-making is not shared with or made clear to outsiders

filter bubble

a term coined by Eli Pariser, also called an echo chamber. A phenomenon in which we only see news and information we like and agree with, leading to political polarization

The three I's

algorithms’ decisions can become invisible, irreversible, and infinite

why computers seem so smart today

cooperation from human software developers, and cooperation on the part of users

 

 

Core Questions

A. Questions for qualitative thought:

  1. Write and/or draw an algorithm (or your best try at one) to perform an activity you wish you could automate. Doing the dishes? Taking an English test? It’s up to you.
  2. Often there are spaces online that make one feel like an outsider, or like an insider. Study an online space that makes you feel like one of these – how it that outsider or insider status being communicated to you, or to others?
  3. Consider the history of how you learned whatever you know about computing. This could mean how you came to understand key terms, searching online simple programs, coding, etc. Then, reinvent that history if you’d learned all you wish you knew about computing at the times and in the ways you feel you should have learned them.

B. Review: Let’s test how well you’ve been programmed. (Mark the best answers.)

C. Game on!

 

Related Content

Hear It: Electronic Freedom Foundation’s “Algorithms for a Just Future”

EPISODE SUMMARY

The United States already has laws against redlining, but companies can still use other data to advertise goods and services to you—which can have big implications for the prices you see.

EPISODE NOTES

One of the supposed promises of AI was that it would be able to take the bias out of human decisions, and maybe even lead to more equity in society. But the reality is that the errors of the past are embedded in the data of today, keeping prejudice and discrimination in. Pair that with surveillance capitalism, and what you get are algorithms that impact the way consumers are treated, from how much they pay for things, to what kinds of ads they are shown, to if a bank will even lend them money. But it doesn’t have to be that way, because the same techniques that prey on people can lift them up. Vinhcent Le from the Greenlining Institute joins Cindy and Danny to talk about how AI can be used to make things easier for people who need a break. In this episode you’ll learn about: 

    • Redlining—the pernicious system that denies historically marginalized people access to loans and financial services—and how modern civil rights laws have attempted to ban this practice.
    • How the vast amount of our data collected through modern technology, especially browsing the Web, is often used to target consumers for products, and in effect recreates the illegal practice of redlining.
    • The weaknesses of the consent-based models for safeguarding consumer privacy, which often mean that people are unknowingly waving away their privacy whenever they agree to a website’s terms of service.
    • How the United States currently has an insufficient patchwork of state laws that guard different types of data, and how a federal privacy law is needed to set a floor for basic privacy protections.
    • How we might reimagine machine learning as a tool that actively helps us root out and combat bias in consumer-facing financial services and pricing, rather than exacerbating those problems.
    • The importance of transparency in the algorithms that make decisions about our lives.
    • How we might create technology to help consumers better understand the government services available to them.

This podcast is supported by the Alfred P. Sloan Foundation’s Program in Public Understanding of Science and Technology. This work is licensed under a Creative Commons Attribution 4.0 International License.

Additional music is used under creative commons license from CCMixter includes:

http://dig.ccmixter.org/files/djlang59/37792

Drops of H2O ( The Filtered Water Treatment ) by J.Lang (c) copyright 2012 Licensed under a Creative Commons Attribution (3.0) license.http://dig.ccmixter.org/files/djlang59/37792 Ft: Airtone

http://dig.ccmixter.org/files/zep_hurme/59681

Come Inside by Zep Hurme (c) copyright 2019 Licensed under a Creative Commons Attribution (3.0) license. http://dig.ccmixter.org/files/zep_hurme/59681 Ft: snowflake

http://dig.ccmixter.org/files/admiralbob77/59533

Warm Vacuum Tube  by Admiral Bob (c) copyright 2019 Licensed under a Creative Commons Attribution (3.0) license. http://dig.ccmixter.org/files/admiralbob77/59533 Ft: starfrosch

http://dig.ccmixter.org/files/airtone/59721

reCreation by airtone (c) copyright 2019 Licensed under a Creative Commons Attribution (3.0) license. http://dig.ccmixter.org/files/airtone/59721 

 

 

 

Read it: Social media algorithms warp how people learn from each other, research shows

A picture of a darkened room and a blurred profile of a person looking at an illuminated laptop screen of a Twitter page with a news media photo in the center.
Social media pushes evolutionary buttons.
AP Photo/Manish Swarup

William Brady, Northwestern University

People’s daily interactions with online algorithms affect how they learn from others, with negative consequences including social misperceptions, conflict and the spread of misinformation, my colleagues and I have found.

People are increasingly interacting with others in social media environments where algorithms control the flow of social information they see. Algorithms determine in part which messages, which people and which ideas social media users see.

On social media platforms, algorithms are mainly designed to amplify information that sustains engagement, meaning they keep people clicking on content and coming back to the platforms. I’m a social psychologist, and my colleagues and I have found evidence suggesting that a side effect of this design is that algorithms amplify information people are strongly biased to learn from. We call this information “PRIME,” for prestigious, in-group, moral and emotional information.

In our evolutionary past, biases to learn from PRIME information were very advantageous: Learning from prestigious individuals is efficient because these people are successful and their behavior can be copied. Paying attention to people who violate moral norms is important because sanctioning them helps the community maintain cooperation.

But what happens when PRIME information becomes amplified by algorithms and some people exploit algorithm amplification to promote themselves? Prestige becomes a poor signal of success because people can fake prestige on social media. Newsfeeds become oversaturated with negative and moral information so that there is conflict rather than cooperation.

The interaction of human psychology and algorithm amplification leads to dysfunction because social learning supports cooperation and problem-solving, but social media algorithms are designed to increase engagement. We call this mismatch functional misalignment.

Why it matters

One of the key outcomes of functional misalignment in algorithm-mediated social learning is that people start to form incorrect perceptions of their social world. For example, recent research suggests that when algorithms selectively amplify more extreme political views, people begin to think that their political in-group and out-group are more sharply divided than they really are. Such “false polarization” might be an important source of greater political conflict.

https://youtube.com/watch?v=WLfr7sU5W2E%3Fwmode%3Dtransparent%26start%3D0
Social media algorithms amplify extreme political views.

Functional misalignment can also lead to greater spread of misinformation. A recent study suggests that people who are spreading political misinformation leverage moral and emotional information – for example, posts that provoke moral outrage – in order to get people to share it more. When algorithms amplify moral and emotional information, misinformation gets included in the amplification.

What other research is being done

In general, research on this topic is in its infancy, but there are new studies emerging that examine key components of algorithm-mediated social learning. Some studies have demonstrated that social media algorithms clearly amplify PRIME information.

Whether this amplification leads to offline polarization is hotly contested at the moment. A recent experiment found evidence that Meta’s newsfeed increases polarization, but another experiment that involved a collaboration with Meta found no evidence of polarization increasing due to exposure to their algorithmic Facebook newsfeed.

More research is needed to fully understand the outcomes that emerge when humans and algorithms interact in feedback loops of social learning. Social media companies have most of the needed data, and I believe that they should give academic researchers access to it while also balancing ethical concerns such as privacy.

What’s next

A key question is what can be done to make algorithms foster accurate human social learning rather than exploit social learning biases. My research team is working on new algorithm designs that increase engagement while also penalizing PRIME information. We argue that this might maintain user activity that social media platforms seek, but also make people’s social perceptions more accurate.

The Research Brief is a short take on interesting academic work.

William Brady, Assistant Professor of Management and Organizations, Northwestern University

This article is republished from The Conversation under a Creative Commons license. Read the original article.

 

 

Media Attributions

definition

About the author

Dr. Diana Daly of the University of Arizona is the Director of iVoices, a media lab helping students produce media from their narratives on technologies. Prof Daly teaches about qualitative research, social media, and information quality at the University of Arizona.

definition

License

Icon for the Creative Commons Attribution 4.0 International License

Humans R Social Media - 2024 "Living Book" Edition Copyright © 2024 by Diana Daly is licensed under a Creative Commons Attribution 4.0 International License, except where otherwise noted.

Share This Book