<?xml version="1.0" encoding="UTF-8"?><!-- generator="wordpress/2.1.3" -->
<rss version="2.0" 
	xmlns:content="http://purl.org/rss/1.0/modules/content/">
<channel>
	<title>Comments on: Artificial Intelligence, Cognitive Biases, and Global Risk</title>
	<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/</link>
	<description>The Singularity Institute exists to confront the challenge of powerful AI, both the opportunity and the risk.</description>
	<pubDate>Thu, 04 Dec 2008 01:16:20 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.1.3</generator>

	<item>
		<title>By: Nick Gogerty</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-15</link>
		<author>Nick Gogerty</author>
		<pubDate>Tue, 05 Jun 2007 14:25:52 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-15</guid>
					<description>A very well constructed essay and very important.  Unfortunately too many of us reach for simple math models or our "all to flawed" gut instinct when it comes to risk. It would be nice to see more collected articles about the dangers of being "exactly wrong" either via individuals or via group think.</description>
		<content:encoded><![CDATA[<p>A very well constructed essay and very important.  Unfortunately too many of us reach for simple math models or our &#8220;all to flawed&#8221; gut instinct when it comes to risk. It would be nice to see more collected articles about the dangers of being &#8220;exactly wrong&#8221; either via individuals or via group think.</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: Soren</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-25</link>
		<author>Soren</author>
		<pubDate>Fri, 08 Jun 2007 17:57:24 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-25</guid>
					<description>I largely agree with going on in this summary, but as a unix geek and artist who has his own theories that dip into the realm of physics, I do take issue with some of the biases the article itself displays – specifically, the dismissive tone of those who would dare to theorize without the proper credentials.

Clearly, I am not a theoretical physicist or an AI specialist, but I have been following advancements in these areas since I was a kid.  I’m not suggesting that I know how to create a theory on physics, but I do know how to watch the arc of a scientific field’s development.  Just like Kurzweil can take statistical data points and show exponential growth, writers and other creative voices are often able to see patterns and suggestions of possibility from outside the scientific community that are harder to perceive from inside the community.  Science Fiction writers have certainly been limited in their success of predicting the future, but they often have had a prescient view into inevitable, upcoming advancements in science and technology.

I think my creative imagination is what allows me to understand, all too well, the possible impact of blindly stomping forward in AI, without regard to the existential risks associated with the changes.  As it is, I see businesses, relationships, governmental policies and more that aren’t keeping up with what is happening in technology.  Structurally, these systems aren’t designed with the flexibility that will be required to deal with the implications of strong AI.  

I think that AI does have the potential for wide ranged devastation.  However, even in best-case scenarios, it will fundamentally alter our understanding of civilization – likely over the course of just a few years.  Most people, companies, and countries are not aware of how ill prepared they are for a world that complex.  

As for the AI community – I applaud the epiphany of understanding just how remarkably complex AI actually is.  I also hope that they are aware that sometimes their linear, scientific models unnecessarily limit the possible solutions.  I think we’re starting to see that this is way more complicated than pure, hard science can accomplish alone.  This is a creative venture at its core, so a certain amount of unconventional creative thought will be required to keep up.</description>
		<content:encoded><![CDATA[<p>I largely agree with going on in this summary, but as a unix geek and artist who has his own theories that dip into the realm of physics, I do take issue with some of the biases the article itself displays – specifically, the dismissive tone of those who would dare to theorize without the proper credentials.</p>
<p>Clearly, I am not a theoretical physicist or an AI specialist, but I have been following advancements in these areas since I was a kid.  I’m not suggesting that I know how to create a theory on physics, but I do know how to watch the arc of a scientific field’s development.  Just like Kurzweil can take statistical data points and show exponential growth, writers and other creative voices are often able to see patterns and suggestions of possibility from outside the scientific community that are harder to perceive from inside the community.  Science Fiction writers have certainly been limited in their success of predicting the future, but they often have had a prescient view into inevitable, upcoming advancements in science and technology.</p>
<p>I think my creative imagination is what allows me to understand, all too well, the possible impact of blindly stomping forward in AI, without regard to the existential risks associated with the changes.  As it is, I see businesses, relationships, governmental policies and more that aren’t keeping up with what is happening in technology.  Structurally, these systems aren’t designed with the flexibility that will be required to deal with the implications of strong AI.  </p>
<p>I think that AI does have the potential for wide ranged devastation.  However, even in best-case scenarios, it will fundamentally alter our understanding of civilization – likely over the course of just a few years.  Most people, companies, and countries are not aware of how ill prepared they are for a world that complex.  </p>
<p>As for the AI community – I applaud the epiphany of understanding just how remarkably complex AI actually is.  I also hope that they are aware that sometimes their linear, scientific models unnecessarily limit the possible solutions.  I think we’re starting to see that this is way more complicated than pure, hard science can accomplish alone.  This is a creative venture at its core, so a certain amount of unconventional creative thought will be required to keep up.</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: Nick Hay</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-26</link>
		<author>Nick Hay</author>
		<pubDate>Sat, 09 Jun 2007 11:52:24 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-26</guid>
					<description>Theorizing without credentials isn't the problem.  The problem is acting without expertise.  Putting a device into motion without understanding exactly what it will do.

For most computer programs this isn't a serious problem.  You have a bug, it annoys a few people, you fix it (maybe).  But as you mention, with strong AI you have the potential to threaten humanity's existence.  One must be extremely careful as bugs can be fatal.  

There are certain classes of mistakes humans reliably make.  This is an artifact of how our brains works.  We use heuristics to quickly arrive at generally good answers.  But these heuristics aren't perfect, they have systematic biases, as detailed further in the paper.  The field of heuristics and biases studies exactly this.  As a result it can tell you how to avoid a bunch of predictable mistakes.

If you plan to work with AI you should at least understand the basics of this field to avoid the obvious mistakes.</description>
		<content:encoded><![CDATA[<p>Theorizing without credentials isn&#8217;t the problem.  The problem is acting without expertise.  Putting a device into motion without understanding exactly what it will do.</p>
<p>For most computer programs this isn&#8217;t a serious problem.  You have a bug, it annoys a few people, you fix it (maybe).  But as you mention, with strong AI you have the potential to threaten humanity&#8217;s existence.  One must be extremely careful as bugs can be fatal.  </p>
<p>There are certain classes of mistakes humans reliably make.  This is an artifact of how our brains works.  We use heuristics to quickly arrive at generally good answers.  But these heuristics aren&#8217;t perfect, they have systematic biases, as detailed further in the paper.  The field of heuristics and biases studies exactly this.  As a result it can tell you how to avoid a bunch of predictable mistakes.</p>
<p>If you plan to work with AI you should at least understand the basics of this field to avoid the obvious mistakes.</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: Warren Bonesteel</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-28</link>
		<author>Warren Bonesteel</author>
		<pubDate>Sun, 10 Jun 2007 20:38:07 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-28</guid>
					<description>I can live with doubt and uncertainty and not knowing. I think it is much more interesting to live not knowing than to have answers that might be wrong. 
- Richard Feynman

 Whether we be "amateur" or expert, when we substitute what we wish to be true for what *is* true (factual and repeatedly verifiable in its nature), we have made a grievous error in judgment. 

 When we a priori dismiss the work of the amateur for the opinion of the expert who *knows* what is true we may have made a similar error in judgment. 

 Our biases (our *knowing*) often affect our judgment in ways that blind us to the truth, to the facts, and to the evidence.</description>
		<content:encoded><![CDATA[<p>I can live with doubt and uncertainty and not knowing. I think it is much more interesting to live not knowing than to have answers that might be wrong.<br />
- Richard Feynman</p>
<p> Whether we be &#8220;amateur&#8221; or expert, when we substitute what we wish to be true for what *is* true (factual and repeatedly verifiable in its nature), we have made a grievous error in judgment. </p>
<p> When we a priori dismiss the work of the amateur for the opinion of the expert who *knows* what is true we may have made a similar error in judgment. </p>
<p> Our biases (our *knowing*) often affect our judgment in ways that blind us to the truth, to the facts, and to the evidence.</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: Artificial Intelligence, Cognitive Biases, and Global Risk &#171; plausible futures</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-29</link>
		<author>Artificial Intelligence, Cognitive Biases, and Global Risk &#171; plausible futures</author>
		<pubDate>Mon, 11 Jun 2007 11:03:33 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-29</guid>
					<description>[...] Via the SIAI blog. [...]</description>
		<content:encoded><![CDATA[<p>[&#8230;] Via the SIAI blog. [&#8230;]</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: Yehuda Draiman</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-23510</link>
		<author>Yehuda Draiman</author>
		<pubDate>Wed, 02 Jan 2008 14:15:17 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-23510</guid>
					<description>The Survival of Humankind, and Improving the World, Society, and Yourself!

Yet who can the world trust to be idealistic and moral enough to help all of humanity and the environment, and at the same time, be practical enough to make extremely difficult decisions that can and will harm a great deal of people?

Humanitism is a philosophy for the continued survival and perpetuation of the human race. Humanitists (people who believe in humanitism) do not have the luxury of trying again after failing. Humanitists must be more vigilant than environmentalists, because we will not have a second chance at survival. 

The survival of humanity is more important than the well being of our environment; however the environment is necessary for humanity to survive. That does not give the right for big businesses to continue doing whatever they want with only minimal or no consideration for the environment, so long as our surroundings support human life. We need to protect the environment for the continued survival and future well being of humanity. Keep in mind that without the human race, there would be no one and no need to protect the environment. Therefore, humanitism is more important than environmentalism.

It seems that in the past 50 years the human race has pursued the money train, that such desire for financial gain has caused society to ignore and abandon honesty, values, morality and candidness etc.

The race to financial gain has caused our leaders and the executives of the corporate world to disregard laws, ethics and the caring for each other and humanity as a whole. Deception, fraud and outright theft are their new motto all for the sake of financial gain, fame and success.

It seems that for the sake of success and profit people will step on anybody, family friends, co-workers and anyone who stands in their way or take advantage of anyone that could help them achieve what they want.

That is not to say that honest and compassionate people who care do not exist, where honesty and integrity is a way of life for them, but they are a very small minority.

As we begin the year 2008, we should all look at the past and decide with determination that everyone will from now on contribute to the betterment of humanity, society and mankind.

We should all learn to live with each other and respect each other for the sustainability of mankind.

Compiled by: Yehuda Draiman – 1/1/2007</description>
		<content:encoded><![CDATA[<p>The Survival of Humankind, and Improving the World, Society, and Yourself!</p>
<p>Yet who can the world trust to be idealistic and moral enough to help all of humanity and the environment, and at the same time, be practical enough to make extremely difficult decisions that can and will harm a great deal of people?</p>
<p>Humanitism is a philosophy for the continued survival and perpetuation of the human race. Humanitists (people who believe in humanitism) do not have the luxury of trying again after failing. Humanitists must be more vigilant than environmentalists, because we will not have a second chance at survival. </p>
<p>The survival of humanity is more important than the well being of our environment; however the environment is necessary for humanity to survive. That does not give the right for big businesses to continue doing whatever they want with only minimal or no consideration for the environment, so long as our surroundings support human life. We need to protect the environment for the continued survival and future well being of humanity. Keep in mind that without the human race, there would be no one and no need to protect the environment. Therefore, humanitism is more important than environmentalism.</p>
<p>It seems that in the past 50 years the human race has pursued the money train, that such desire for financial gain has caused society to ignore and abandon honesty, values, morality and candidness etc.</p>
<p>The race to financial gain has caused our leaders and the executives of the corporate world to disregard laws, ethics and the caring for each other and humanity as a whole. Deception, fraud and outright theft are their new motto all for the sake of financial gain, fame and success.</p>
<p>It seems that for the sake of success and profit people will step on anybody, family friends, co-workers and anyone who stands in their way or take advantage of anyone that could help them achieve what they want.</p>
<p>That is not to say that honest and compassionate people who care do not exist, where honesty and integrity is a way of life for them, but they are a very small minority.</p>
<p>As we begin the year 2008, we should all look at the past and decide with determination that everyone will from now on contribute to the betterment of humanity, society and mankind.</p>
<p>We should all learn to live with each other and respect each other for the sustainability of mankind.</p>
<p>Compiled by: Yehuda Draiman – 1/1/2007</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: Yehuda Draiman</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-27944</link>
		<author>Yehuda Draiman</author>
		<pubDate>Tue, 22 Jan 2008 02:29:20 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-27944</guid>
					<description>American economy in crises - a long time coming

When a country and its society import more than they export for over a quarter of a century, it is bound to erod the economy to its primate state.

We have only ourselves to blame, what goods and products are we exporting, what goods and services are produced in the USA, the answer is very little by comparison.

In the past 50 years as our population has increased, technology advanced, we have become a nation that consumes enormous amounts of resources, we shop for competitive prices. Corporate America is constantly looking to increase the bottom line.

Most of the goods for and by Americans and its companies are produced overseas and in the past decade with the advancement of telecommunications, many of the services sector are also imported.

The increased costs of energy over the past 10 years, has affected the economy to unimaginable comprehension.

This economic activity has eroded our economy to its core. It seems that the situation is getting worse every year. American debts are increasing beyond our wildest dreams, endangering the future economic vitality of our future generation.

I hope it is not too late for our society to recognize the graveness of our economic predicament and its resolve to take appropriate action to stem the tide of our economic downturn.

Americans are a nation of great technology and knowhow. We must utilize that technology and our resources to find new means to regain our economic independence.

We must face and implement fiscal responsibility, both by the government and the population with its infrastructure of corporate America.

It is no longer an option, it is a must if we as a nation want to survive and retain our way of life and economic vitality.

Inflation, recession and financial crises are here. Let us take the bull by the horn, initiate immediate actions to minimize and hopefully reverse our economic crises.

Yehuda Draiman, Northridge, CA. 1-22-2007

PS
The US economy has enormous momentum. Metaphorically speaking, if someone turned off the locomotive that drives the US economy, the economy would go on for miles before anyone would likely notice something was wrong. But something has been wrong for many years. Is there really hope for the future? Maybe. But the terrible truth is that no one really knows. But if there is hope, we're already on the wrong track. And that has to change.</description>
		<content:encoded><![CDATA[<p>American economy in crises - a long time coming</p>
<p>When a country and its society import more than they export for over a quarter of a century, it is bound to erod the economy to its primate state.</p>
<p>We have only ourselves to blame, what goods and products are we exporting, what goods and services are produced in the USA, the answer is very little by comparison.</p>
<p>In the past 50 years as our population has increased, technology advanced, we have become a nation that consumes enormous amounts of resources, we shop for competitive prices. Corporate America is constantly looking to increase the bottom line.</p>
<p>Most of the goods for and by Americans and its companies are produced overseas and in the past decade with the advancement of telecommunications, many of the services sector are also imported.</p>
<p>The increased costs of energy over the past 10 years, has affected the economy to unimaginable comprehension.</p>
<p>This economic activity has eroded our economy to its core. It seems that the situation is getting worse every year. American debts are increasing beyond our wildest dreams, endangering the future economic vitality of our future generation.</p>
<p>I hope it is not too late for our society to recognize the graveness of our economic predicament and its resolve to take appropriate action to stem the tide of our economic downturn.</p>
<p>Americans are a nation of great technology and knowhow. We must utilize that technology and our resources to find new means to regain our economic independence.</p>
<p>We must face and implement fiscal responsibility, both by the government and the population with its infrastructure of corporate America.</p>
<p>It is no longer an option, it is a must if we as a nation want to survive and retain our way of life and economic vitality.</p>
<p>Inflation, recession and financial crises are here. Let us take the bull by the horn, initiate immediate actions to minimize and hopefully reverse our economic crises.</p>
<p>Yehuda Draiman, Northridge, CA. 1-22-2007</p>
<p>PS<br />
The US economy has enormous momentum. Metaphorically speaking, if someone turned off the locomotive that drives the US economy, the economy would go on for miles before anyone would likely notice something was wrong. But something has been wrong for many years. Is there really hope for the future? Maybe. But the terrible truth is that no one really knows. But if there is hope, we&#8217;re already on the wrong track. And that has to change.</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: Henri</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-59568</link>
		<author>Henri</author>
		<pubDate>Sun, 22 Jun 2008 02:01:04 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-59568</guid>
					<description>The very dim outline of just how badly we have handled the the art of rational thinking is coming into view. When fully disclosed, I fear that a worldwide gasp of horror will be heard, nearly too late to matter.
The greater error may be the error of assuming that the twenty-first century ( and indeed the late 20th century also) was or is  being guided by insightful, "Nobles". Hindsight must inform those who are having a difficult time of imagining life beyond 2015,  that no Nobles exist. Those who claimed to be so were simply the early ancestors of today's "mortgage bankers".
There is a war going on at this very minute that puts humanity on the endangered species list. The combatants seem to be clashing cultures and ill-informed national and religio-cultural leaders all bent on shaping the world in their narrowly defined image(s). The third combatant is the earth itself, as it speaks out with loud voices in many places almost daily. Tornados, Tsnumis, earthquakes, widespread food shortages that we will  see developing in America's flood ravaged heartland.
We cannot afford to not look at everything we do now, the future may still seem bright but errors, biases, and political miscalculation  loom larger than ever.</description>
		<content:encoded><![CDATA[<p>The very dim outline of just how badly we have handled the the art of rational thinking is coming into view. When fully disclosed, I fear that a worldwide gasp of horror will be heard, nearly too late to matter.<br />
The greater error may be the error of assuming that the twenty-first century ( and indeed the late 20th century also) was or is  being guided by insightful, &#8220;Nobles&#8221;. Hindsight must inform those who are having a difficult time of imagining life beyond 2015,  that no Nobles exist. Those who claimed to be so were simply the early ancestors of today&#8217;s &#8220;mortgage bankers&#8221;.<br />
There is a war going on at this very minute that puts humanity on the endangered species list. The combatants seem to be clashing cultures and ill-informed national and religio-cultural leaders all bent on shaping the world in their narrowly defined image(s). The third combatant is the earth itself, as it speaks out with loud voices in many places almost daily. Tornados, Tsnumis, earthquakes, widespread food shortages that we will  see developing in America&#8217;s flood ravaged heartland.<br />
We cannot afford to not look at everything we do now, the future may still seem bright but errors, biases, and political miscalculation  loom larger than ever.</p>
]]></content:encoded>
				</item>
	<item>
		<title>By: nico martirelli</title>
		<link>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-99293</link>
		<author>nico martirelli</author>
		<pubDate>Tue, 18 Nov 2008 13:44:38 +0000</pubDate>
		<guid>http://www.singinst.org/blog/2007/06/04/ai-cognitive-biases-global-risk/#comment-99293</guid>
					<description>very well written article, indeed. Almost nothing to add, perhaps except that I miss a bit an outlook to a solution. As it is written above, simply proposing "we are humans with an analog brain" appears to defensive for me. What about risk training in schools for kids of any age, but not only for kids, but also those guys at the LHC at he CERN? They are agressively defending their naturalist fallacy, completely entangled in circularity of their arguments, which results in a deeply unethical attitude. The problematics as stated may be reformulated thus a bit. (1) it is an insight of own value to recognize the problem of risk. There is no "natural" habit to deal with it. research for any kind of Lebenswelt should be started concerning risk behavior, not just, but emphasizing existential risks (2) We need political instances for that problematics. I do NOT mean herds of politicians by that. We all can not again delegate in this case. What we would need is some kind of re-instation of the Agora, that is a conscious political behavior deserved to discuss risks in a fair manner, without domain specific egoisms like the physicists exhibit nowadays. (3) Along with developing political consciousness we have to develop consciousness about thinking itself, about the deep structures which do NOT concern the nuronal level, but the philosophical level, ie. following and extending Deleuze and Foucault. That concsciousness results in an emerging attitude towards a politically conscious design, so to say xDesign, as it is called by Buhlmann in her book "prespecifics". 

It is definitely NOT about statistics, about mathematics, about psychology or any other empirical analytic science. As important as they are, what is necessary is a thinking about  responsible synthesis, which of course is singular as any emergent phenomenon. Just the opposite the tribe at CERN is demonstrating with their vastly  expensive toy (LHC).</description>
		<content:encoded><![CDATA[<p>very well written article, indeed. Almost nothing to add, perhaps except that I miss a bit an outlook to a solution. As it is written above, simply proposing &#8220;we are humans with an analog brain&#8221; appears to defensive for me. What about risk training in schools for kids of any age, but not only for kids, but also those guys at the LHC at he CERN? They are agressively defending their naturalist fallacy, completely entangled in circularity of their arguments, which results in a deeply unethical attitude. The problematics as stated may be reformulated thus a bit. (1) it is an insight of own value to recognize the problem of risk. There is no &#8220;natural&#8221; habit to deal with it. research for any kind of Lebenswelt should be started concerning risk behavior, not just, but emphasizing existential risks (2) We need political instances for that problematics. I do NOT mean herds of politicians by that. We all can not again delegate in this case. What we would need is some kind of re-instation of the Agora, that is a conscious political behavior deserved to discuss risks in a fair manner, without domain specific egoisms like the physicists exhibit nowadays. (3) Along with developing political consciousness we have to develop consciousness about thinking itself, about the deep structures which do NOT concern the nuronal level, but the philosophical level, ie. following and extending Deleuze and Foucault. That concsciousness results in an emerging attitude towards a politically conscious design, so to say xDesign, as it is called by Buhlmann in her book &#8220;prespecifics&#8221;. </p>
<p>It is definitely NOT about statistics, about mathematics, about psychology or any other empirical analytic science. As important as they are, what is necessary is a thinking about  responsible synthesis, which of course is singular as any emergent phenomenon. Just the opposite the tribe at CERN is demonstrating with their vastly  expensive toy (LHC).</p>
]]></content:encoded>
				</item>
</channel>
</rss>
