A flow chart showing the decisions made by a recommendation engine, c. 2001[1]
Part of a series on
Artificial intelligence
Major goals
Artificial general intelligence
Recursive self-improvement
Planning
Computer vision
General game playing
Knowledge reasoning
Machine learning
Natural language processing
Robotics
AI safety
Approaches
Symbolic
Deep learning
Bayesian networks
Evolutionary algorithms
Situated approach
Hybrid intelligent systems
Systems integration
Applications
Projects
Deepfake
Machine translation
Generative AI
Art
Audio
Music
Healthcare
Mental health
Government
Industry
Earth sciences
Bioinformatics
Physics
Philosophy
Chinese room
Friendly AI
Control problem/Takeover
Ethics
Existential risk
Turing test
Regulation
History
Timeline
Progress
AI winter
AI boom
AI era
Glossary
Glossary
v
t
e
Algorithmic bias describes systematic and repeatable errors in a computer system that create "unfair" outcomes, such as "privileging" one category over another in ways different from the intended function of the algorithm.
Bias can emerge from many factors, including but not limited to the design of the algorithm or the unintended or unanticipated use or decisions relating to the way data is coded, collected, selected or used to train the algorithm. For example, algorithmic bias has been observed in search engine results and social media platforms. This bias can have impacts ranging from inadvertent privacy violations to reinforcing social biases of race, gender, sexuality, and ethnicity. The study of algorithmic bias is most concerned with algorithms that reflect "systematic and unfair" discrimination. This bias has only recently been addressed in legal frameworks, such as the European Union's General Data Protection Regulation (2018) and the proposed Artificial Intelligence Act (2021).
As algorithms expand their ability to organize society, politics, institutions, and behavior, sociologists have become concerned with the ways in which unanticipated output and manipulation of data can impact the physical world. Because algorithms are often considered to be neutral and unbiased, they can inaccurately project greater authority than human expertise (in part due to the psychological phenomenon of automation bias), and in some cases, reliance on algorithms can displace human responsibility for their outcomes. Bias can enter into algorithmic systems as a result of pre-existing cultural, social, or institutional expectations; by how features and labels are chosen; because of technical limitations of their design; or by being used in unanticipated contexts or by audiences who are not considered in the software's initial design.[2]
Algorithmic bias has been cited in cases ranging from election outcomes to the spread of online hate speech. It has also arisen in criminal justice, healthcare, and hiring, compounding existing racial, socioeconomic, and gender biases. The relative inability of facial recognition technology to accurately identify darker-skinned faces has been linked to multiple wrongful arrests of black men, an issue stemming from imbalanced datasets. Problems in understanding, researching, and discovering algorithmic bias persist due to the proprietary nature of algorithms, which are typically treated as trade secrets. Even when full transparency is provided, the complexity of certain algorithms poses a barrier to understanding their functioning. Furthermore, algorithms may change, or respond to input or output in ways that cannot be anticipated or easily reproduced for analysis. In many cases, even within a single website or application, there is no single "algorithm" to examine, but a network of many interrelated programs and data inputs, even between users of the same service.
^Jacobi, Jennifer (September 13, 2001). "Patent #US2001021914". Espacenet. Retrieved July 4, 2018.
^Suresh, Harini; Guttag, John (November 4, 2021). "A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle". Equity and Access in Algorithms, Mechanisms, and Optimization. EAAMO '21. New York, NY, USA: Association for Computing Machinery. pp. 1–9. doi:10.1145/3465416.3483305. ISBN 978-1-4503-8553-4. S2CID 235436386.
Algorithmicbias describes systematic and repeatable errors in a computer system that create "unfair" outcomes, such as "privileging" one category over...
then the algorithm may cause discrimination. Fairness in machine learning is the study of how to prevent the harm caused by algorithmicbias. It has become...
Algorithmic attention rents Algorithmic radicalization Ambient awareness Influence-for-hire Social bot Social data revolution Social influence bias Social...
the MIT Media Lab. She founded the Algorithmic Justice League (AJL), an organization that works to challenge bias in decision-making software, using art...
paradigms: data model and algorithmic model, wherein "algorithmic model" means more or less the machine learning algorithms like Random Forest. Some statisticians...
with women and engineers or CEOs with men. Political bias refers to the tendency of algorithms to systematically favor certain political viewpoints,...
accountability in AI, including algorithmicbias, algorithmic decision-making, algorithmic governance, and algorithmic auditing. Additionally there is...
The inductive bias (also known as learning bias) of a learning algorithm is the set of assumptions that the learner uses to predict outputs of given inputs...
Government by algorithm (also known as algorithmic regulation, regulation by algorithms, algorithmic governance, algocratic governance, algorithmic legal order...
on algorithmicbias, AI accountability, and algorithmic auditing. Raji has previously worked with Joy Buolamwini, Timnit Gebru, and the Algorithmic Justice...
similar level of precision. The GRE has also been subjected to the same racial bias criticisms that have been lodged against other admissions tests. In 1998...
confirming evidence. In social media, confirmation bias is amplified by the use of filter bubbles, or "algorithmic editing", which display to individuals only...
Algorithmic radicalization is the concept that recommender algorithms on popular social media sites such as YouTube and Facebook drive users toward progressively...
that are considered to have particular ethical stakes. This includes algorithmicbiases, fairness, automated decision-making, accountability, privacy, and...
different layers to the algorithmicbiases formed by search engines. By outlining crucial points and theories throughout the book, Algorithms of Oppression is...
right enjoys higher algorithmic amplification than the political left in six out of seven countries studied. In the US, algorithmic amplification favored...
scientist who works in the fields of artificial intelligence (AI), algorithmicbias and data mining. She is an advocate for diversity in technology and...
Cognitive biases are systematic patterns of deviation from norm and/or rationality in judgment. They are often studied in psychology, sociology and behavioral...
surrounded genetically modified organisms, the use of robotic soldiers, algorithmicbias, and the issue of aligning AI behavior with human values. Technology...
search the web for real-time data. Training data also suffers from algorithmicbias, which may be revealed when ChatGPT responds to prompts including descriptors...
Banaji and Anthony Greenwald in 1995. Psychology portal Algorithmicbias List of cognitive biases Detection theory Evidence Falsity Impartiality Metascience...
at the intersection of complex adaptive systems, machine learning, algorithmicbias, and critical race studies. Birhane's work with Vinay Prabhu uncovered...
two topics of ethical concern for AIM. Those are of privacy, and algorithmicbiases. Currently privacy concerns from customers pertain to how technology...
Global Information
