{"id":259,"date":"2023-12-31T19:05:25","date_gmt":"2023-12-31T19:05:25","guid":{"rendered":"https:\/\/alandix.com\/aibook\/?page_id=259"},"modified":"2023-12-31T19:05:25","modified_gmt":"2023-12-31T19:05:25","slug":"chap16","status":"publish","type":"page","link":"https:\/\/alandix.com\/aibook\/second-edition\/toc2e\/chap16\/","title":{"rendered":"Chapter 16 \u2013 Agents"},"content":{"rendered":"<div class=\"embedurl\" data-url=\"https:\/\/alandix.com\/books\/aibook\/content\/chaps\/chap16.html\" ><!--  Chapter 16 Agents  -->\n\n<script>\nvar chapnos = 16;\nvar json_url = \"https:\\\/\\\/alandix.com\\\/books\\\/aibook\\\/content\\\/chaps\\\/chap16.json\";\n<\/script>\n\n\n\n\n\t<object style=\"width:100%; aspect-ratio: 10 \/ 7;\" type=\"application\/pdf\" data=\"https:\/\/alandix.com\/books\/aibook\/content\/slides-pdf\/AI-chap-16.pdf\"><\/object>\n\t<p> Download <a href=\"https:\/\/alandix.com\/books\/aibook\/content\/slides-pptx\/AI-chap-16.pptx\" download>chapter slides<\/a><\/p>\n\n\n<h3> Contents <\/h3>\n<div class=\"toc\">\n<dl>\n<dt>16.1&nbsp;&nbsp;Overview<\/dt>\n<dt>16.2&nbsp;&nbsp;Software Agents<\/dt><dd><dl>\n<dt>16.2.1&nbsp;&nbsp;The Rise of the Agent<\/dt>\n<dt>16.2.2&nbsp;&nbsp;Triggering Actions<\/dt>\n<dt>16.2.3&nbsp;&nbsp;Watching and Learning<\/dt>\n<dt>16.2.4&nbsp;&nbsp;Searching for Information<\/dt>\n<\/dl><\/dd>\n<dt>16.3&nbsp;&nbsp;Reinforcement Learning<\/dt><dd><dl>\n<dt>16.3.1&nbsp;&nbsp;Single Step Learning<\/dt>\n<dt>16.3.2&nbsp;&nbsp;Choices during Learning<\/dt>\n<dt>16.3.3&nbsp;&nbsp;Intermittent Rewards and Credit Assignment<\/dt>\n<\/dl><\/dd>\n<dt>16.4&nbsp;&nbsp;Co-operating Agents and Distributed AI<\/dt><dd><dl>\n<dt>16.4.1&nbsp;&nbsp;Blackboard Architectures<\/dt>\n<dt>16.4.2&nbsp;&nbsp;Distributed Control<\/dt>\n<\/dl><\/dd>\n<dt>16.5&nbsp;&nbsp;Larger Collectives<\/dt><dd><dl>\n<dt>16.5.1&nbsp;&nbsp;Emergent Behaviour<\/dt>\n<dt>16.5.2&nbsp;&nbsp;Cellular Automata<\/dt>\n<dt>16.5.3&nbsp;&nbsp;Artificial Life<\/dt>\n<dt>16.5.4&nbsp;&nbsp;Swarm Computing<\/dt>\n<dt>16.5.5&nbsp;&nbsp;Ensemble Methods<\/dt>\n<\/dl><\/dd>\n<dt>16.6&nbsp;&nbsp;Summary<\/dt>\n<\/dl><\/div>\n\n\n<h3> Glossary items referenced in this chapter <\/h3>\n<div class=\"toc\">\n<a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents\">agents<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents%21action\">agents!action<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents%21email%20filtering\">agents!email filtering<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents%21embodied\">agents!embodied<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents%21intelligent%20filtering\">agents!intelligent filtering<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents%21machine%20learning\">agents!machine learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents%21messages\">agents!messages<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/agents%21methods\">agents!methods<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/artificial%20life\">artificial life<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/artificial%20society\">artificial society<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/bayesian%20methods\">Bayesian methods<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/bibliographic%20database\">bibliographic database<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/bibliographic%20search\">bibliographic search<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/blackboard%20architecture\">blackboard architecture<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/boosting\">boosting<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/cellular%20automata\">cellular automata<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/clippy\">Clippy<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/computer%20chess\">computer chess<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/concept%20learning\">concept learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/conway%2C%20john\">Conway, John<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/cooperating%20agents\">cooperating agents<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/cost-benefit\">cost&amp;ndash;benefit<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/counterfactual%20reasoning\">counterfactual reasoning<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/credit%20assignment\">credit assignment<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/database\">database<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/decision%20tree\">decision tree<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/deepseek\">DeepSeek<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/deterministic\">deterministic<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/distributed%20ai\">distributed AI<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/distributed%20cognition\">distributed cognition<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/eager\">EAGER<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/emergent%20behaviour\">emergent behaviour<\/a><\/strong>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/ensemble%20methods\">ensemble methods<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/ensemble%20methods%21heterogeneous\">ensemble methods!heterogeneous<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/ensemble%20methods%21homogeneous\">ensemble methods!homogeneous<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/event\">event<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/exploration-exploitation%20trade-off\">exploration-exploitation trade-off<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/flocking%20behaviour\">flocking behaviour<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/game%20of%20life\">Game of Life<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/google\">Google<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/google%20alerts\">Google alerts<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/heuristic%20evaluation%20function\">heuristic evaluation function<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/home%20automation\">home automation<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/human-computer%20interaction\">Human&amp;nbsp;Computer Interaction<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/hypertext\">hypertext<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/ifttt\">IFTTT <\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/image%20processing\">image processing<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/immune%20system\">immune system<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/intermittent%20rewards\">intermittent rewards<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/internet%20of%20things\">internet of things<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/knowledge%20base\">knowledge base<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/large%20language%20model\">large language model<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/local%20maximum\">local maximum<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/machine%20learning\">machine learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/macro%20languages\">macro languages<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/mixture-of-experts\">mixture-of-experts<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/network%20routing\">network routing<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/neural%20network\">neural network<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/newwave\">NewWave<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/object-oriented%20architecture\">object-oriented architecture<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/object-oriented%20programming\">object-oriented programming<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/observation-action%20mapping\">observation&amp;ndash;action mapping<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/obstacle%20avoidance\">obstacle avoidance<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/optimal%20route\">optimal route<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/overfitting\">overfitting<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/pagerank\">PageRank<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/pavlov%2C%20ivan\">Pavlov, Ivan<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/pogoing%20robots\">Pogoing robots<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/pole%20balancing\">pole balancing<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/prisoner%27s%20dilemma\">prisoner&#039;s dilemma<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/privacy\">privacy<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/programming-by-demonstration\">programming-by-demonstration<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/random%20forest\">random forest<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/regret\">regret<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/reinforcement%20learning\">reinforcement learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/reservoir%20computing\">reservoir computing<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/robotic%20process%20automation\">robotic process automation<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/robotics\">robotics<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/robotics%21practical\">robotics!practical<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/route%20planning\">route planning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/script\">script<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/search%20engine\">search engine<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/self-organising%20map\">self-organising map<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/similarity%20measure\">similarity measure<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/single%20step%20learning\">single step learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/skinner%2C%20bf\">Skinner, B. F.<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/social%20media\">social media<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/status%20change%20event\">status change event<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/stemming\">stemming<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/strong%20learner\">strong learner<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/supervised%20learning\">supervised learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/support%20vector%20machine\">support vector machine<\/a>, <strong><a href=\"https:\/\/alandix.com\/glossary\/aibook\/swarm%20computing\">swarm computing<\/a><\/strong>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/system%20event\">system event<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/timed%20event\">timed event<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/trigger\">trigger<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/unsupervised%20learning\">unsupervised learning<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/user%20event\">user event<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/user%20interface%20agent\">user interface agent<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/weak%20learners\">weak learners<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/wisdom%20of%20the%20crowds\">wisdom of the crowds<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/wizard\">wizard<\/a>, <a href=\"https:\/\/alandix.com\/glossary\/aibook\/world%20wide%20web\">World Wide Web<\/a><\/div>\n\n\n\n<h3> Prolog examples (from 1st ed.) <\/h3>\n<!--  Chapter 16 - Agents  -->\n\n<table class=\"prolog-listing\">\n\n<tr valign=\"top\"><td class=\"filename\"><a href=\"https:\/\/alandix.com\/code\/ai96\/prolog\/view\/ch10\/blackboard.p\">blackboard.p<\/a><\/td><td>blackboard architecture<\/td>\n<\/tr><tr valign=\"top\"><td class=\"filename\"><a href=\"https:\/\/alandix.com\/code\/ai96\/prolog\/view\/ch10\/life.p\">life.p<\/a><\/td><td>Conways game of Life<\/td>\n<\/tr>\n\n<\/table>\n<\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":2,"featured_media":0,"parent":221,"menu_order":16,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_themeisle_gutenberg_block_has_review":false,"footnotes":""},"class_list":["post-259","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/259","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/comments?post=259"}],"version-history":[{"count":3,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/259\/revisions"}],"predecessor-version":[{"id":306,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/259\/revisions\/306"}],"up":[{"embeddable":true,"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/pages\/221"}],"wp:attachment":[{"href":"https:\/\/alandix.com\/aibook\/wp-json\/wp\/v2\/media?parent=259"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}