Strong AI
Strong AI means a machine with a genuine mind, the claim Searle's Chinese Room attacks, or human-level general AI (AGI). Both senses and the debate.
Strong AI has two meanings. In philosophy of mind, it is John Searle's name for the claim that an appropriately programmed computer would literally have a mind and understand what it processes, the position his 1980 Chinese Room argument was written to refute. In modern technical usage, strong AI is a synonym for artificial general intelligence (AGI): a hypothetical system that matches people across virtually all cognitive tasks. The contrasting term, weak AI, now usually means the narrow, task-specific artificial intelligence (AI) in use today, and no existing system is accepted as strong AI in either sense.
Searle's Strong AI Hypothesis#
Searle introduced both labels in "Minds, Brains, and Programs", published in Behavioral and Brain Sciences. Weak AI, in his usage, holds that computers are powerful tools for simulating and studying the mind. Strong AI goes further: "the appropriately programmed computer really is a mind, in the sense that computers given the right programs can be literally said to understand and have other cognitive states." The hypothesis follows from computationalism, the view that thinking is computation, so any machine running the right program would think, whatever it is made of.
The Chinese Room Argument#
Searle's Chinese Room argument imagines a person who speaks no Chinese locked in a room with a rulebook written in English. Questions in Chinese arrive through a slot, the person matches the characters against the rules and copies out the characters the rules specify, and the answers convince native speakers outside that someone in the room understands Chinese. The person understands nothing, and Searle argued that a computer running a program is in the same position: it manipulates symbols by their shape, and syntax alone is not sufficient for meaning. Critics answered with replies that Searle then rebutted:
- Systems reply: The person is only one part of a system that includes the rulebook and scratch paper, and the whole system understands. Searle answered that he could memorize the rules and do everything in his head and still understand no Chinese.
- Robot reply: Put the program inside a robot with cameras and motors, so its symbols connect to things in the world. Searle answered that sensor readings reach the program as more symbols to manipulate. A robot whose camera feed runs through an Ultralytics YOLO26 detector receives class index 0 with a confidence score and box coordinates when a person walks into view, which on Searle's account adds data and no understanding. Stevan Harnad later framed the underlying question as the symbol grounding problem: how symbols can acquire meaning through a system's own perception of and action in the world.
- Brain simulator reply: Let the program simulate every neuron firing in a Chinese speaker's brain. Searle answered with a man operating a vast system of water pipes and valves that mirrors those firings, which would understand no more than the man does, because a simulation of a brain is not a brain.
- Other minds reply: People attribute understanding to one another only from behavior, so the same evidence should count for computers. Searle answered that the question is what understanding is, not how we come to know that someone has it.
Strong AI vs. AGI, the Turing Test, and Consciousness#
- AGI: A question of capability, measured by what a system can do. Searle's strong AI is a question of inner understanding, and on his view a machine could pass every behavioral test and still understand nothing. Futurists such as Ray Kurzweil use "strong AI" to mean human-level AGI, the sense most technical writing adopts today, including discussions of strong AI's potential applications and challenges.
- Turing test: Alan Turing proposed in 1950 to replace the question "Can machines think?" with an imitation game judged on conversation alone. The Chinese Room targets exactly the step from passing such a test to genuine understanding.
- Consciousness: Strong AI in Searle's sense implies mental states, which many philosophers tie to subjective experience. A 2023 report by 19 researchers checked AI systems against indicator properties drawn from neuroscientific theories of consciousness and concluded that "no current AI systems are conscious" but that there are "no obvious technical barriers" to building systems that satisfy the indicators.
Strong AI and Language Models#
Large language models (LLMs) revived the debate, since they converse fluently in Chinese and many other languages much as the room does. Emily Bender and Alexander Koller argued in a 2020 paper that a system trained only on linguistic form cannot learn meaning, while others point to evidence of internal world models. In "Emergent World Representations" (ICLR 2023), researchers trained a GPT model only on sequences of legal Othello moves, found that probes could read the current board state from its activations, and showed that editing that internal board state changed the moves the model predicted.










