Editing Commonsense reasoning

{{Short description|Branch of artificial intelligence aiming to create AI systems with "common sense"}}
In [[artificial intelligence]] (AI), '''commonsense reasoning''' is a human-like ability to make presumptions about the type and essence of ordinary situations humans encounter every day. These assumptions include judgments about the nature of physical objects, taxonomic properties, and peoples' intentions. A device that exhibits commonsense reasoning might be capable of drawing conclusions that are similar to humans' [[folk psychology]] (humans' innate ability to reason about people's behavior and intentions) and [[naive physics]] (humans' natural understanding of the physical world).<ref name="Davis Marcus">{{Cite magazine|author1=Ernest Davis|author2=Gary Marcus|date=2015|title=Commonsense Reasoning and Commonsense Knowledge in Artificial Intelligence|url=http://cacm.acm.org/magazines/2015/9/191169-commonsense-reasoning-and-commonsense-knowledge-in-artificial-intelligence/fulltext|magazine=Communications of the ACM|volume=58|pages=92–103|doi=10.1145/2701413|number=9}}</ref>

== Definitions and characterizations ==
Some definitions and characterizations of common sense from different authors include:
* "Commonsense knowledge includes the basic facts about events (including actions) and their effects, facts about knowledge and how it is obtained, facts about beliefs and desires. It also includes the basic facts about material objects and their properties."<ref>McCarthy, John. "Artificial intelligence, logic and formalizing common sense." Philosophical logic and artificial intelligence. Springer, Dordrecht, 1989. 161-190.</ref>
* "Commonsense knowledge differs from encyclopedic knowledge in that it deals with general knowledge rather than the details of specific entities."<ref>{{cite journal |last1=Tandon |first1=Niket |last2=Varde |first2=Aparna S. |last3=de Melo |first3=Gerard |title=Commonsense Knowledge in Machine Intelligence |journal=ACM SIGMOD Record |date=22 February 2018 |volume=46 |issue=4 |pages=49–52 |doi=10.1145/3186549.3186562}}</ref>
* Commonsense knowledge is "real world knowledge that can provide a basis for additional knowledge to be gathered and interpreted automatically".<ref>Matuszek, Cynthia, et al. "Searching for common sense: Populating cyc from the web." UMBC Computer Science and Electrical Engineering Department Collection (2005).</ref>
* The commonsense world consists of "time, space, physical interactions, people, and so on".<ref name="Davis Marcus"/>
* Common sense is "all the knowledge about the world that we take for granted but rarely state out loud".<ref>{{cite magazine |title=How to Teach Artificial Intelligence Some Common Sense |url=https://www.wired.com/story/how-to-teach-artificial-intelligence-common-sense/ |access-date=11 February 2021 |magazine=Wired |date=13 November 2018 |language=en-us}}</ref>
* Common sense is "broadly reusable background knowledge that's not specific to a particular subject area... knowledge that you ought to have."<ref name=quanta/>

NYU professor Ernest Davis characterizes commonsense knowledge as "what a typical seven year old knows about the world", including physical objects, substances, plants, animals, and human society. It usually excludes book-learning, specialized knowledge, and knowledge of conventions; but it sometimes includes knowledge about those topics. For example, knowing how to play cards is specialized knowledge, not "commonsense knowledge"; but knowing that people play cards for fun does count as "commonsense knowledge".<ref>{{cite journal |last1=Davis |first1=Ernest |title=Logical Formalizations of Commonsense Reasoning: A Survey |journal=Journal of Artificial Intelligence Research |date=25 August 2017 |volume=59 |pages=651–723 |doi=10.1613/jair.5339|doi-access=free }}</ref>

== Commonsense reasoning problem ==
[[File:Détection de personne - exemple 3.jpg|thumb|A self-driving car system may use a neural network to determine which parts of the picture seem to match previous training images of pedestrians, and then model those areas as slow-moving but somewhat unpredictable rectangular prisms that must be avoided.]]
Compared with humans, existing AI lacks several features of human commonsense reasoning; most notably, humans have powerful mechanisms for reasoning about "[[naïve physics]]" such as space, time, and physical interactions. This enables even young children to easily make inferences like "If I roll this pen off a table, it will fall on the floor". Humans also have a powerful mechanism of "[[folk psychology]]" that helps them to interpret natural-language sentences such as "The city councilmen refused the demonstrators a permit because they advocated violence". (A generic AI has difficulty discerning whether the ones alleged to be advocating violence are the councilmen or the demonstrators.)<ref name="Davis Marcus"/><ref>{{cite news|title=Cultivating Common Sense {{!}} DiscoverMagazine.com|url=http://discovermagazine.com/2017/april-2017/cultivating-common-sense|access-date=24 March 2018|work=Discover Magazine|date=2017|archive-url=https://web.archive.org/web/20180325045222/http://discovermagazine.com/2017/april-2017/cultivating-common-sense|archive-date=25 March 2018|url-status=dead}}</ref><ref>{{cite journal |last1=Winograd|first1=Terry|title=Understanding natural language|journal=Cognitive Psychology|date=January 1972|volume=3|issue=1|pages=1–191|doi=10.1016/0010-0285(72)90002-3}}</ref> This lack of "common knowledge" means that AI often makes different mistakes than humans make, in ways that can seem incomprehensible. For example, existing self-driving cars cannot reason about the location nor the intentions of pedestrians in the exact way that humans do, and instead must use non-human modes of reasoning to avoid accidents.<ref>{{cite news|title=Don't worry: Autonomous cars aren't coming tomorrow (or next year)|url=http://autoweek.com/article/technology/fully-autonomous-vehicles-are-more-decade-down-road|access-date=24 March 2018|work=Autoweek|date=2016|archive-date=25 March 2018|archive-url=https://web.archive.org/web/20180325052230/http://autoweek.com/article/technology/fully-autonomous-vehicles-are-more-decade-down-road|url-status=live}}</ref><ref>{{cite news|last1=Knight|first1=Will |title=Boston may be famous for bad drivers, but it's the testing ground for a smarter self-driving car |url=https://www.technologyreview.com/s/608871/finally-a-driverless-car-with-some-common-sense/ |access-date=27 March 2018|work=MIT Technology Review|date=2017|archive-date=22 August 2020|archive-url=https://web.archive.org/web/20200822201548/https://www.technologyreview.com/2017/09/20/149046/finally-a-driverless-car-with-some-common-sense/|url-status=live}}</ref><ref>{{cite journal|last1=Prakken|first1=Henry |title=On the problem of making autonomous vehicles conform to traffic law|journal=Artificial Intelligence and Law|date=31 August 2017|volume=25|issue=3|pages=341–363 |doi=10.1007/s10506-017-9210-0 |doi-access=free}}</ref>

Overlapping subtopics of commonsense reasoning include quantities and measurements, time and space, physics, minds, society, plans and goals, and actions and change.<ref>{{Cite journal |last=Thomason |first=Richmond |date=2003-08-27 |title=Logic and Artificial Intelligence |url=https://plato.stanford.edu/archives/sum2020/entries/logic-ai/}}</ref>

== Commonsense knowledge problem ==
{{Main|Commonsense knowledge (artificial intelligence)}}
The commonsense knowledge problem is a current project in the sphere of artificial intelligence to create a database that contains the general knowledge most individuals are expected to have, represented in an accessible way to artificial intelligence programs<ref>{{Cite web|url = http://www.journals.elsevier.com/artificial-intelligence/|title = Artificial intelligence Programs}}</ref> that use natural language. Due to the broad scope of the commonsense knowledge, this issue is considered to be among the most difficult problems in AI research.<ref>{{Cite web|url = https://www.udacity.com/course/intro-to-artificial-intelligence--cs271|title = Artificial intelligence applications}}</ref> In order for any task to be done as a human mind would manage it, the machine is required to appear as intelligent as a human being. Such tasks include [[object recognition]], machine translation and [[text mining]]. To perform them, the machine has to be aware of the same concepts that an individual, who possess commonsense knowledge, recognizes.

== Commonsense in intelligent tasks ==
In 1961, [[Yehoshua Bar-Hillel|Bar Hillel]] first discussed the need and significance of practical knowledge for natural language processing in the context of machine translation.<ref>{{Cite web|url = https://www.theguardian.com/technology/artificialintelligenceai|title = Bar Hillel Artificial Intelligence Research Machine Translation| website=[[TheGuardian.com]] }}</ref> Some ambiguities are resolved by using simple and easy to acquire rules. Others require a broad acknowledgement of the surrounding world, thus they require more commonsense knowledge. For instance, when a machine is used to translate a text, problems of ambiguity arise, which could be easily resolved by attaining a concrete and true understanding of the context. Online translators often resolve ambiguities using analogous or similar words. For example, in translating the sentences "The electrician is working" and "The telephone is working" into German, the machine translates correctly "working" in the means of "laboring" in the first one and as "functioning properly" in the second one. The machine has seen and read in the body of texts that the German words for "laboring" and "electrician" are frequently used in a combination and are found close together. The same applies for "telephone" and "function properly". However, the statistical proxy which works in simple cases often fails in complex ones. Existing computer programs carry out simple language tasks by manipulating short phrases or separate words, but they don't attempt any deeper understanding and focus on short-term results.

=== Computer vision ===
Issues of this kind arise in computer vision.<ref name="Davis Marcus"/><ref>Antol, Stanislaw, et al. "[https://www.cv-foundation.org/openaccess/content_iccv_2015/papers/Antol_VQA_Visual_Question_ICCV_2015_paper.pdf Vqa: Visual question answering]." Proceedings of the IEEE international conference on computer vision. 2015.</ref> For instance when looking at a photograph of a bathroom some items that are small and only partly seen, such as facecloths and bottles, are recognizable due to the surrounding objects (toilet, wash basin, bathtub), which suggest the purpose of the room. In an isolated image they would be difficult to identify. Movies prove to be even more difficult tasks. Some movies contain scenes and moments that cannot be understood by simply matching memorized templates to images. For instance, to understand the context of the movie, the viewer is required to make inferences about characters’ intentions and make presumptions depending on their behavior. In the contemporary state of the art, it is impossible to build and manage a program that will perform such tasks as reasoning, i.e. predicting characters’ actions. The most that can be done is to identify basic actions and track characters.

=== Robotic manipulation ===
The need and importance of commonsense reasoning in [[autonomous robot]]s that work in a real-life uncontrolled environment is evident. For instance, if a robot is programmed to perform the tasks of a waiter at a cocktail party, and it sees that the glass he had picked up is broken, the waiter-robot should not pour the liquid into the glass, but instead pick up another one. Such tasks seem obvious when an individual possesses simple commonsense reasoning, but to ensure that a robot will avoid such mistakes is challenging.<ref name="Davis Marcus"/>

== Successes in automated commonsense reasoning ==
Significant progress in the field of the automated commonsense reasoning is made in the areas of the taxonomic reasoning, actions and change reasoning, reasoning about time. Each of these spheres has a well-acknowledged theory for wide range of commonsense inferences.<ref>{{Cite web|url = http://www.encyclopedia.com/doc/1O11-commonsensereasoning.html|title = Taxonomy}}</ref>

=== Taxonomic reasoning ===
Taxonomy is the collection of individuals and categories and their relations. Three basic relations are:
* An individual is an instance of a category. For example, the individual ''Tweety'' is an instance of the category ''robin''.
* One category is a subset of another. For instance ''robin'' is a subset of ''bird''.
* Two categories are disjoint. For instance ''robin'' is disjoint from ''penguin''.
Transitivity is one type of inference in taxonomy. Since ''Tweety'' is an instance of ''robin'' and ''robin'' is a subset of ''bird'', it follows that ''Tweety'' is an instance of ''bird''. Inheritance is another type of inference. Since ''Tweety'' is an instance of ''robin'', which is a subset of ''bird'' and ''bird'' is marked with property ''canfly'', it follows that ''Tweety'' and ''robin'' have property ''canfly''. When an individual taxonomizes more abstract categories, outlining and delimiting specific categories becomes more problematic. Simple taxonomic structures are frequently used in AI programs. For instance, [[WordNet]] is a resource including a taxonomy, whose elements are meanings of English words. Web mining systems used to collect commonsense knowledge from Web documents focus on taxonomic relations and specifically in gathering taxonomic relations.<ref name="Davis Marcus"/>

=== Action and change ===
The theory of action, events and change is another range of the commonsense reasoning.<ref>{{Cite web|url = http://www-formal.stanford.edu/jmc/someneed/node3.html|title = Action and change in Commonsense reasoning}}</ref> There are established reasoning methods for domains that satisfy the constraints listed below:
* Events are atomic, meaning one event occurs at a time and the reasoner needs to consider the state and condition of the world at the start and at the finale of the specific event, but not during the states, while there is still an evidence of on-going changes (progress).
* Every single change is a result of some event
* Events are deterministic, meaning the world's state at the end of the event is defined by the world's state at the beginning and the specification of the event.
* There is a single actor and all events are their actions.
* The relevant state of the world at the beginning is either known or can be calculated.

=== Temporal reasoning ===
{{further|Spatial–temporal reasoning}}
Temporal reasoning is the ability to make presumptions about humans' knowledge of times, durations and time intervals. For example, if an individual knows that Mozart was born after Haydn and died earlier than him, they can use their temporal reasoning knowledge to deduce that Mozart had died younger than Haydn. The inferences involved reduce themselves to solving systems of linear inequalities.<ref>{{Cite web|url = http://www-formal.stanford.edu/leora/commonsense/|title = Temporal reasoning}}</ref> To integrate that kind of reasoning with concrete purposes, such as [[natural-language understanding|natural language interpretation]], is more challenging, because natural language expressions have context dependent interpretation.<ref>Liu, Hugo, and Push Singh. "[http://larifari.org/_/writing/KES2004-CommonSenseNL.pdf Commonsense reasoning in and over natural language] {{Webarchive|url=https://web.archive.org/web/20170809032506/http://larifari.org/_/writing/KES2004-CommonSenseNL.pdf |date=2017-08-09 }}." International Conference on Knowledge-Based and Intelligent Information and Engineering Systems. Springer, Berlin, Heidelberg, 2004.</ref> Simple tasks such as assigning timestamps to procedures cannot be done with total accuracy.

=== Qualitative reasoning ===
Qualitative reasoning<ref>{{Cite web|url = https://techcrunch.com/2014/08/09/guide-to-common-sense-reasoning-whos-doing-it-and-why-it-matters/|title = Qualitative reasoning}}</ref> is the form of commonsense reasoning analyzed with certain success. It is concerned with the direction of change in interrelated quantities. For instance, if the price of a stock goes up, the amount of stocks that are going to be sold will go down. If some ecosystem contains wolves and lambs and the number of wolves decreases, the death rate of the lambs will go down as well. This theory was firstly formulated by Johan de Kleer, who analyzed an object moving on a roller coaster. The theory of qualitative reasoning is applied in many spheres such as physics, biology, engineering, ecology, etc. It serves as the basis for many practical programs, analogical mapping, text understanding.

== Challenges in automating commonsense reasoning ==
As of 2014, there are some commercial systems trying to make the use of commonsense reasoning significant. However, they use statistical information as a proxy for commonsense knowledge, where reasoning is absent. Current programs manipulate individual words, but they don't attempt or offer further understanding. According to Ernest Davis and [[Gary Marcus]], five major obstacles interfere with the producing of a satisfactory "commonsense reasoner".<ref name="Davis Marcus"/>

* First, some of the domains that are involved in commonsense reasoning are only partly understood. Individuals are far from a comprehensive understanding of domains such as communication and knowledge, interpersonal interactions or physical processes.

* Second, situations that seem easily predicted or assumed about could have logical complexity, which humans’ commonsense knowledge does not cover. Some aspects of similar situations are studied and are well understood, but there are many relations that are unknown, even in principle and how they could be represented in a form that is usable by computers.

* Third, commonsense reasoning involves plausible reasoning. It requires coming to a reasonable conclusion given what is already known. Plausible reasoning has been studied for many years and there are a lot of theories developed that include probabilistic reasoning and [[non-monotonic logic]]. It takes different forms that include using unreliable data and rules, whose conclusions are not certain sometimes.

* Fourth, there are many domains, in which a small number of examples are extremely frequent, whereas there is a vast number of highly infrequent examples.

* Fifth, when formulating presumptions it is challenging to discern and determine the level of abstraction.

Compared with humans, as of 2018 existing computer programs perform extremely poorly on modern "commonsense reasoning" benchmark tests such as the [[Winograd Schema Challenge]].<ref>{{cite web|title=The Winograd Schema Challenge|url=https://cs.nyu.edu/faculty/davise/papers/WinogradSchemas/WS.html|website=cs.nyu.edu|access-date=9 January 2018}}</ref> The problem of attaining human-level competency at "commonsense knowledge" tasks is considered to probably be "[[AI complete]]" (that is, solving it would require the ability to synthesize a [[artificial general intelligence|human-level intelligence]]).<ref>Yampolskiy, Roman V. "AI-Complete, AI-Hard, or AI-Easy-Classification of Problems in AI." MAICS. 2012.</ref><ref>Andrich, C, Novosel, L, and Hrnkas, B. (2009). [https://web.archive.org/web/20180109181028/https://pdfs.semanticscholar.org/59e3/495f4f1e70629e17ddbbce06834626b2a363.pdf Common Sense Knowledge]. Information Search and Retrieval, 2009.</ref> Some researchers believe that [[supervised learning]] data is insufficient to produce an artificial general intelligence capable of commonsense reasoning, and have therefore turned to less-supervised learning techniques.<ref>{{cite news |last1=Smith |first1=Craig S. |title=Computers Already Learn From Us. But Can They Teach Themselves? |url=https://www.nytimes.com/2020/04/08/technology/ai-computers-learning-supervised-unsupervised.html |access-date=3 May 2020 |work=The New York Times |date=8 April 2020}}</ref>

== Approaches and techniques ==
Commonsense's reasoning study is divided into knowledge-based approaches and approaches that are based on machine learning over and using a large data corpora with limited interactions between these two types of approaches {{citation needed|date=February 2021}}. There are also crowdsourcing approaches, attempting to construct a knowledge basis by linking the collective knowledge and the input of non-expert people. Knowledge-based approaches can be separated into approaches based on mathematical logic {{citation needed|date=February 2021}}.

In knowledge-based approaches, the experts are analyzing the characteristics of the inferences that are required to do reasoning in a specific area or for a certain task. The knowledge-based approaches consist of mathematically grounded approaches, informal knowledge-based approaches and large-scale approaches. The mathematically grounded approaches are purely theoretical and the result is a printed paper instead of a program. The work is limited to the range of the domains and the reasoning techniques that are being reflected on. In informal knowledge-based approaches, theories of reasoning are based on anecdotal data and intuition that are results from empirical behavioral psychology. Informal approaches are common in computer programming. Two other popular techniques for extracting commonsense knowledge from Web documents involve [[Web mining]] and [[Crowd sourcing]].

COMET (2019), which uses both the [[OpenAI]] [[GPT-3|GPT]] language model architecture and existing commonsense knowledge bases such as [[ConceptNet]], claims to generate commonsense inferences at a level approaching human benchmarks. Like many other current efforts, COMET over-relies on surface language patterns and is judged to lack deep human-level understanding of many commonsense concepts. Other language-model approaches include training on visual scenes rather than just text, and training on textual descriptions of scenarios involving commonsense physics.<ref name=quanta>{{cite news |last1=Pavlus |first1=John |title=Common Sense Comes to Computers |url=https://www.quantamagazine.org/common-sense-comes-to-computers-20200430/ |access-date=3 May 2020 |work=Quanta Magazine |date=30 April 2020 |language=en}}</ref><ref>Bosselut, Antoine, et al. "Comet: Commonsense transformers for automatic knowledge graph construction." arXiv preprint arXiv:1906.05317 (2019).</ref>

== References ==
{{Reflist}}
*{{Cite book
| last = Davis
| first = Ernest
| title = Representations of Commonsense Reasoning
| publisher = Morgan Kaufmann
| year = 1990
| location = San Mateo, Calif.
| url = https://archive.org/details/representationso0000davi
| isbn = 1-55860-033-7
| url-access = registration
}}{{Dead link|date=November 2019 |bot=InternetArchiveBot |fix-attempted=yes }}
*{{Cite book
| last = McCarthy | first = John 
| author-link = John McCarthy (computer scientist)
| title = Formalizing Common Sense
| url = https://archive.org/details/formalizingcommo00mcca | url-access = registration | publisher = Ablex
| location = Norwood, N.J.
| year = 1990
| isbn = 1-871516-49-8
}}
*{{Cite book
| last = Minsky | first = Marvin
| author-link = Marvin Minsky
| title = The Society of Mind
| year = 1986
| publisher = Simon and Schuster
| location = New York
| isbn = 0-671-60740-5
| title-link = Society of Mind theory
}}
*{{Cite book
| last = Minsky
| first = Marvin
| author-link = Marvin Minsky
| title = The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind
| url = https://archive.org/details/emotionmachineco00mins
| year = 2006
| publisher = Simon and Schuster
| location = New York
| isbn = 0-7432-7663-9
| url-access = registration
}}
*{{Cite book
| last = Mueller | first = Erik T.
| title = Commonsense Reasoning: An Event Calculus Based Approach
| edition = 2nd
| publisher = Morgan Kaufmann/Elsevier
| location = Waltham, Mass.
| year = 2015
| isbn = 978-0128014165
}}
* edX, (2014). ''Artificial Intelligence''. [online] Available at: <nowiki>https://www.edx.org/course/artificial-intelligence-uc-berkeleyx-cs188-1x</nowiki> [Accessed 5 Nov. 2015].
* Encyclopedia.com, (2015). "commonsense knowledge." ''A Dictionary of Sociology'' | Encyclopedia.com: FREE online dictionary. [online] Available at: <nowiki>http://www.encyclopedia.com/doc/1O88-commonsenseknowledge.html</nowiki> [Accessed 13 Aug. 2017].
* Hageback, Niklas. (2017). The Virtual Mind: Designing the Logic to Approximate Human Thinking (Chapman & Hall/CRC Artificial Intelligence and Robotics Series) 1st Edition. {{ISBN|978-1138054035}}.
* Intelligence, A. (2015). ''Artificial Intelligence''. [online] Elsevier. Available at: <nowiki>http://www.journals.elsevier.com/artificial-intelligence/</nowiki> [Accessed 5 Nov. 2015].
* Leaderu.com, (2015). ''ARTIFICIAL INTELLIGENCE AS COMMON SENSE KNOWLEDGE''. [online] Available at: <nowiki>http://www.leaderu.com/truth/2truth07.html</nowiki> [Accessed 5 Nov. 2015].
* Lenat, D., Prakash, M. and Shepherd, M. (1985). [http://www.aaai.org/ojs/index.php/aimagazine/article/view/510 CYC: Using Common Sense Knowledge to Overcome Brittleness and Knowledge Acquisition Bottlenecks]. ''AI Magazine'', 6(4), p.&nbsp;65.
* Levesque, H. (2017). [https://books.google.com/books?id=ZYA1DgAAQBAJ Common Sense, the Turing Test, and the Quest for Real AI]. MIT Press.
* Lieto, A., Radicioni, P. and Rho, V. (2015). A Common-Sense Conceptual Categorization System Integrating Heterogeneous Proxytypes and the Dual Process of Reasoning ''[[IJCAI]] 2015'', [online]. Available at: <nowiki>http://www.aaai.org/ocs/index.php/IJCAI/IJCAI15/paper/view/10872</nowiki> [Accessed 19 Dec. 2016].
* Psych.utoronto.ca, (2015). ''Artificial Intelligence | The Common Sense Knowledge Problem''. [online] Available at: <nowiki>http://psych.utoronto.ca/users/reingold/courses/ai/commonsense.html</nowiki> [Accessed 5 Nov. 2015].
* {{cite web|url=http://www.sensesoftware.com/knowledge_management/CommonSense_KMS.htm|website=Sensesoftware.com|date=2015|title=CommonSense - Knowledge Management Overview|access-date=5 Nov 2015|archive-url=https://web.archive.org/web/20150717214150/http://www.sensesoftware.com/knowledge_management/CommonSense_KMS.htm|archive-date=17 July 2015|url-status=dead}}.
* the Guardian, (2015). ''Artificial intelligence (AI) | Technology | The Guardian''. [online] Available at: <nowiki>https://www.theguardian.com/technology/artificialintelligenceai</nowiki> [Accessed 5 Nov. 2015].
* Udacity.com, (2015). ''Intro to Artificial Intelligence Course and Training Online''. [online] Available at: https://www.udacity.com/course/intro-to-artificial-intelligence--cs271
* W3.org, (2015). ''Computers with Common Sense''. [online] Available at: <nowiki>http://www.w3.org/People/Raggett/Sense/</nowiki> [Accessed 5 Nov. 2015].

== External links ==
* [http://commonsensereasoning.org Commonsense Reasoning Web Site]
* [http://www-formal.stanford.edu/leora/commonsense Commonsense Reasoning Problem Page]
* [http://csc.media.mit.edu Media Lab Commonsense Computing Initiative]
* [http://www.cs.rochester.edu/research/epilog/ The Epilog project at the University of Rochester] 
* [http://people.seas.harvard.edu/~valiant/fsttcs08.pdf Knowledge Infusion: In Pursuit of Robustness in Artificial Intelligence]

{{Automated reasoning}}

[[Category:Reasoning]]
[[Category:Automated reasoning]]