Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.
Invisible, Irreversible, and Infinite
Nearly any software platform you use performs its work based on algorithms, which enable it to make rapid decisions and respond predictably to stimuli. An is a step-by-step set of instructions for getting something done, whether that something is making a decision, solving a problem, or getting from point A to point B (or point Z). In this chapter, we will look into how computing algorithms work, who tends to create them, and how that affects their outcomes. We will also consider whether certain algorithms should be used at all.
(Anti-)Social Media Algorithms
Student Content, Fall 2020
Social Media During School
: A platform where it is relatively difficult to maintain a viewership compared to, say, something like Instagram
: ease at which one can go from one piece of media to the next, on the same platform
: the degree of freedom one has to go from one piece of media to the next while doing the least physical work possible. example: the suggested videos on youtube (not all the videos as that is not least work as you’d have to search it up)
Growing up in the age of technology there was something really compelling to me about not joining a lot of the mainstream social media platforms. The only platforms I used were the ones with substantial barriers, or barrier SMP’s, as I like to call them, like YouTube, which basically is the type of media where it is hard for small start-up users to maintain a healthy and large channel. On IG or tiktok, the same is much easier, which is proved by the fact that a whole lot of your friends will maintain their social media presence on IG rather than YouTube. Honestly, I can’t tell you why, I just felt that I couldn’t be trusted if I had something like Instagram or tiktok on my phone; I would use it whenever I had the slightest whim.
I feel like in the last year of high school I was this non-participating observer of the effects of social media use in school (especially in my group of friends). There was this very odd escapism about it. When we stopped talking to each other to just stare down into our phones, it seemed to me that the hyperbolic technological deterministic line of kids’ brains being trashed because of their phones had some weight to it.
Commonly enough, it’d always be Instagram or tiktok. Almost never anything else. The reason I think this is so is because of the fact that these two social media platforms have a really high hookability and the media pieces were very short.
Hookability refers to the ease at which one can go from one piece of media to the next, on the same platform. It is not an affordability, as it has nothing to do with how people communicate, and it has everything to do with addictivity. If paired up with the right algorithms, a high hookability measure can make almost anyone addicted to the platform. Hookability measures, say, the ease to go from one video on YouTube to the next.
But the problem with IG and tiktok was that, despite the high hookability, the media pieces were of a much shorter duration. So instead of just watching one five-minute YouTube video, you have to go through nearly ten times as many tiktoks or scroll through quite a few more IG posts. The addictive nature of the media platform is reduced by this, as you’d get fatigued quicker. So the fatigue combats the high hookability to reduce overall addictivity.
This idea of branchability exists too, and again depends on the algorithm, and the greater the branching choices, the better audience retention. But it’s tricky with shorter media items. More choice will lead to more fatigue, so that could be a negative effect, but also if you don’t have enough choices then how are you going to keep them watching? You can’t have them searching for the next video every time, can you?
It seems like there exists a problem of optimization with constraints. To get the maximum amount of people addicted, which as you could imagine would be the only aim for platforms (as they’d get more profits), they have to consider a plethora of variables, which is in no sense easy.
And the amazing thing here is that in school, we have an option to do something better! Many a times we find ourselves really fatigued but we just keep scrolling through, because of our inertia, and though we’d much rather do something else, we don’t have any other feasible thing to do, so we just stick to doing what we were doing. But in school, we look up from our phones and see our friends, so this inertia is much, much easier to break than if you were sitting all alone at home and were bored as frick.
I think it’s important to say that I haven’t done any rigorous research on this, but I feel like it really makes sense and I see these patterns in nearly all the social groups that I’m in.
About the Author
Omar Amanullah is a freshman at UofA. On a sunny day, he likes to stay inside and eat mac n cheese with chicken nuggets. A not very well known fact is that he graduated high school. But of course he did.
Humans make computers what they are.
Most platforms have many algorithms at work at once, which can make the work they do seem so complex it’s almost magical. But all functions of digital devices can be reduced to simple steps if needed. The steps have to be simple because computers interpret instructions very literally.
Computers don’t know anything unless someone has already given them instructions that are explicit, with every step fully explained. Humans, on the other hand, can figure things out if you skip steps, and can make sense of tacit instructions. But give a computer instructions that skip steps or include tacit steps, and the computer will either stop working or get the process wrong without human intervention.
Here’s an example of the human cooperation that goes into the giving and following of instructions, demonstrated with a robot.
As an instructor, I can say to human students on the first day of class, “Let’s go around the room. Tell us who you are and where you’re from.” Easy for humans, right? But imagine I try that in a mixed human/robot classroom, and all goes swimmingly with the first two [human] students. But then the third student, a robot with a computer for a brain, says, “I don’t understand.” It seems my instructions were not clear enough. Now imagine another [human] student named Lila tells the robot helpfully, “Well first just tell us your name.” The robot still does not understand. Finally, Lila says, “What is your name?”
That works; the robot has been programmed with an algorithm instructing it to respond to “What is your name?” with the words, “My name is Feefee,” which the robot now says. Then Lila continues helping the robot by saying, “Now tell us where you’re from, Feefee.” Again the robot doesn’t get it. At this point, though, Lila has figured out what works in getting answers from this robot, so Lila says, “Where are you from?” This works; the robot has been programmed to respond to “Where are you from?” with the sentence, “I am from Neptune.”
In the above example, human intelligence was responsible for the robot’s successes and failures. The robot arrived with a few communication algorithms, programmed by its human developers. Feefee had not been taught enough to converse very naturally, however. Then Lila, a human, figured out how to get the right responses out of Feefee by modifying her human behavior to better match behavior Feefee had learned to respond to. Later, the students might all run home and say, “A robot participated in class today! It was amazing!” They might not even acknowledge the human participation that day, which the robot fully depended on.
Two reasons computers seem so smart today
What computers can do these days is amazing, for . The first is cooperation from human software developers. The second is cooperation on the part of users.
First, computers seem so intelligent today because human software developers help one another teach computers. Apps that seem groundbreaking may simply include a lot of instructions. This is possible because developers have coded many, many algorithms, which they share and reuse on sites like Github. The more a developer is able to copy the basic steps others have already written for computers to follow, the more that developer can then focus on building new code that teaches computers new tricks. The most influential people known as “creators” or “inventors” in the tech world may be better described as “tweakers” who improved and added to other people’s code for their “creations” and “inventions.”
The second reason computers seem so smart today is because users are teaching them. Algorithms are increasingly designed to “learn” from human input. New algorithms automatically plug input into new programs, then automatically run those programs. This sequence of automated learning and application is called artificial intelligence (AI). AI essentially means teaching computers to teach themselves directly from their human users.
If only humans were always good teachers.
Teaching machines the best and worst about ourselves
In 2016, Microsoft introduced Tay, an AI online robot they branded as a young female. Their intention was for Tay to learn to communicate from internet users who conversed with her on Twitter – and learn she did. Within a few hours, Tay’s social media posts were so infected with violence, racism, sexism, and other bigotry that Microsoft had to take her down and apologize.
Tay was an embarrassment for Microsoft in the eyes of many commentators. How could they not have predicted and protected her from bad human teachers? Why didn’t Tay’s human programmers teach her what not to say? It certainly involved a lack of research, since bots like @oliviataters have been more successful and even benefited from a shared list of banned words that could easily be added to their algorithms.
In addition to these oversights, Tay’s failure may also have been caused by a lack of diversity in Microsoft’s programmers and team leaders.
Programming and bias
Humans are at the heart of any computer program. Algorithms for computers to follow are all written in programming languages, which translate instructions from human language into the computing language of binary numerals, 0’s and 1’s. Algorithms and programs are selective and reflect personal decision-making. There are usually different ways they could have been written.
Computer programming languages like Python, C++, and Java are written in source code. Writing programs, sometimes just called “coding,” is an intermediary step between human language and the binary language that computers understand. Learning programming languages takes time and dedication. To learn to be a computer programmer, you either have to feel driven to teach yourself on your own equipment, or you have to be taught to program – and this is still not common in US schools.
Because computer programmers are self-selected this way, and because many people think of the typical tech geeks as white and male (as suggested by the Google Image search to the right), people who end up learning computer programming in the US are more likely to be white than any other race, and are more likely to identify as male than any other gender.
How can computers carry bias?
Many people think computers and algorithms are neutral – racism and sexism are not programmers’ problems. In the case of Tay’s programmers, this false belief enabled more hate speech online and led to the embarrassment of their employer. Human-crafted computer programs mediate nearly everything humans do today, and human responses are involved in many of those tasks. Considering the near-infinite extent to which algorithms and their activities are replicated, the presence of human is a devastating threat to computer-dependent societies in general and to those targeted or harmed by those biases in particular.
Problems like these are rampant in the tech industry because there is a damaging belief in US (and some other) societies that the development of computer technologies is antisocial, and that some kinds of people are better at it than others. As a result of this bias in tech industries and computing, there are not enough kinds of people working on tech development teams: not enough women, not enough people who are not white, not enough people who remember to think of children, not enough people who think socially.
Remember Google Glass? You may not; that product failed because few people wanted interaction with a computer to come between themselves and eye contact with humans and the world. People who fit the definition of “tech nerd” fell within this small demographic, but the sentiment was not shared by the broader community of technology users. Critics labeled the unfortunate people who did purchase the product as “glassholes.”
social media analytics across continents
I was born and raised in a small town in the county of Kent in England. In 2012, through my father’s company, my mother, my father, my brother, my two dogs and I moved to Los Gatos, California. Five years prior to me moving to the United States, the first iPhone came out on June 29th, 2007. I got my first phone at around age ten and my first iPhone at around age twelve. Once I got my first iPhone, I downloaded KIK, Facebook, Instagram, and Snapchat. I fell in love with these social media apps. I would spend hours every day using these apps to talk to friends, see what others were doing, post funny memes, and so much more. I thought this was the only side to social media and this was everything to see on social media. Little did I know, that moving to the United States would expose me to a completely who knew side of social media.
My own personal and cultural knowledge of social media that makes me different from others is living in two different countries and experiencing the two different cultures on social media. While residents in England and America speak the same language, the two cultures are very different. Due to this difference in the culture I have been exposed to different trends, different purposes for using social media, different apps, and more. Through experiencing social media in both countries, I now have a more cultured knowledge of social media.
Social media in England and the United States are very different. These differences are caused by algorithms. Because the cultures are different, users are going to like, dislike, comment, subscribe, etc.. to different things and different people. These differences will affect algorithms and continue to show users similar to social media content. Owners of these social media apps use what is called. is defined as data that is collected from social media websites and apps that give a clear picture of your online actions and presence. Everyone’s are different. As I live in California in the United States some of my may be similar to someone else who is from California as we are exposed to similar cultures. If you were to compare my to someone living in England, there would be similarities but also a lot of differences as we are exposed to different cultures.
When I first moved to the United States, I did not understand a lot about social media. The humor was different, trends were different, the way people represented themselves online was different. It took adjusting, but now I fully understand the humor, the trends, the way people represent themselves, and more. I have now lived in the United States for 8 years now and I can fully say I have adapted to the culture here. If I was to look at social media in England, even though that was my first time on social media, it would be different and harder for me to understand.
About the author
Issy Brooker was born and raised in Kent, England. She moved to the United States in 2012. Issy Brooker is currently 19 years old and a first year student at the University of Arizona.
Below is the trailer for the film. The film is available through most University Libraries and outlets that rent and sell feature films, and through Finish Line Features.
Exacerbating Bias in Algorithms: The Three I’s
In its early years, the internet was viewed as a utopia, an ideal world that would permit a completely free flow of all available information to everyone, equally. John Perry Barlow’s 1996 Declaration of the Independence of Cyberspace represents this utopian vision, in which the internet liberates users from all biases and even from their own bodies (at which human biases are so often directed). Barlow’s utopian vision does not match the internet of today. Our social norms and inequalities accompany us across all the media and sites we use, and worsened in a climate where information value is determined by marketability and profit, as Sociologist Zeynep Tufecki explains in this Ted Talk.
Because algorithms are built on human cooperation with computing programs, human selectivity and human flaws are embedded within algorithms. Humans as users carry our own biases, and today there is particular concern that algorithms pick up and spread these biases to many, many others. They even make us more biased by hiding results that the algorithm calculates we may not like. When we get our news and information from social media, invisible algorithms consider our own biases and those of friends in our social networks to determine which new posts and stories to show us in search results and news feeds. The result for each user can be called their echo chamber or as author Eli Pariser describes it, a in which we only see news and information we like and agree with, leading to political polarization.
Although algorithms can generate very sophisticated recommendations, algorithms do not make sophisticated decisions. When humans make poor decisions, they can rely on themselves or on other humans to recognize and reverse the error; at the very least, a human decision-maker can be held responsible. Human decision-making often takes time and critical reflection to implement, such as the writing of an approved ordinance into law. When algorithms are used in place of human decision-making, I describe what ensues as : Algorithms’ decisions become invisible, irreversible, and infinite. Most social media platforms and many organizations using algorithms will not share how their algorithms work; for this lack of transparency, they are known as .
Exposing Invisible Algorithms: Pro Publica
Journalists at Pro Publica are educating the public on what algorithms can do by explaining and testing black box algorithms. This work is particularly valuable because most algorithmic bias is hard to detect for small groups or individual human users. Studies like ProPublica’s presented in the “Breaking the Black Box” series (below) have been based on groups systematically testing algorithms from different machines, locations, and users. Using investigative journalism, Pro Publica has also found that algorithms used by law enforcement are significantly more likely to label African Americans as High Risk for reoffending and white Americans as Low Risk.
Fighting Unjust Algorithms
Algorithms are laden with errors. Some of these errors can be traced to the biases of those of developed them, as when a facial recognition system meant for global implementation is only trained using data sets from a limited population (say, predominantly white or male). Algorithms can become problematic when they are hacked by groups of users, like Microsoft’s Tay was. Algorithms are also grounded in the values of those who shape them, and these values may reward some involved while disenfranchising others.
Despite their flaws, algorithms are increasingly used in heavily consequential ways. They predict how likely a person is to commit a crime or default on a bank loan based on a given data set. They can target users with messages on social media that are customized to fit their interests, their voting preferences, or their fears. They can identify who is in photos online or in recordings of offline spaces.
Confronting the landscape of increasing algorithmic control is activism to limit the control of algorithms over human lives. Below, read about the work of the Algorithmic Justice League and other activists promoting bans on facial recognition. And consider: What roles might algorithms play in your life that may deserve more attention, scrutiny, and even activism?
The Algorithmic Justice League vs facial recognition tech in Boston
MIT Computer Scientist and “Poet of Code” Joy Buolamwini heads the Algorithmic Justice League, an organization making remarkable headway into fighting facial recognition technologies, whose work she explains in the first video below. On June 9th, 2020, Buolamwini and other computer scientists presented alongside citizens at Boston City Council meeting in support of a proposed ordinance banning facial recognition in public spaces in the city. Held and shared by live stream during COVID-19, footage of this meeting offers a remarkable look at the value of human advocacy in shaping the future of social technologies. The second video below should be cued to the beginning of Buolamwini’s testimony half an hour in. Boston’s City Council subsequently voted unanimously to ban facial recognition technologies by the city.
Core Concepts and Questions
a step-by-step set of instructions for getting something done to serve humans, whether that something is making a decision, solving a problem, or getting from point A to point B (or point Z)
cooperation from human software developers, and cooperation on the part of users
assumptions about a person, culture, or population
a term coined by Eli Pariser, also called an echo chamber. A phenomenon in which we only see news and information we like and agree with, leading to political polarization
the term used when processes created for computer-based decision-making is not shared with or made clear to outsiders
algorithms’ decisions can become invisible, irreversible, and infinite
A. Questions for qualitative thought
Write and/or draw an algorithm (or your best try at one) to perform an activity you wish you could automate. Doing the dishes? Taking an English test? It’s up to you.
Often there are spaces online that make one feel like an outsider, or like an insider. Study an online space that makes you feel like one of these – how it that outsider or insider status being communicated to you, or to others?
Consider the history of how you learned whatever you know about computing. This could mean how you came to understand key terms, searching online simple programs, coding, etc. Then, reinvent that history if you’d learned all you wish you knew about computing at the times and in the ways you feel you should have learned them.
B. Review: Let’s test how well you’ve been programmed. (Mark the best answers.)
Hear It: Rabbit Hole
How might algorithms have helped lead to the polarization of societies and the information we believe in? In the podcast series Rabbit Hole, New York Times tech reporter Kevin Roose explores how powerful algorithms developed by YouTube and other platforms learn what users like, then direct them toward endless streams of content that is similar, but in some cases more extreme or radicalized.
Listen to / read the transcripts of the NYTimes podcast Rabbit Hole. In particular:
Then, consider your own history of use of YouTube through 2018 (before the platform stated they would change their recommender algorithms in early 2019.) Did the recommending algorithms have an impact on your ideology? If so, how? If not, how might YouTube’s recommendation algorithms have changed the world around you by affecting other users?
a step-by-step set of instructions for getting something done to serve humans, whether that something is making a decision, solving a problem, or getting from point A to point B (or point Z).
A platform where it is relatively difficult to maintain a viewership compared to, say, something like Instagram (Student-Contributed term)
ease at which one can go from one piece of media to the next, on the same platform (Student-Contributed term)
the degree of freedom one has to go from one piece of media to the next while doing the least physical work possible. example: the suggested videos on youtube (not all the videos as that is not least work as you'd have to search it up) (Student-Contributed term)
cooperation from human software developers, and cooperation on the part of users.
assumptions about a person, culture, or population
also called an echo chamber, this is a phenomenon in which we only see news and information we like and agree with, leading to political polarization. (Term coined by Eli Pariser.)
Algorithms' decisions become invisible, irreversible, and infinite.
The term used when processes created for computer-based decisionmaking is not shared with or made clear to outsiders.