Comments on: On Becoming a Neuron http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/ The Singularity Institute exists to confront the challenge of powerful AI, both the opportunity and the risk. Wed, 17 Mar 2010 19:13:25 +0000 http://wordpress.org/?v=2.1.3 By: Nato Welch http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9730 Nato Welch Mon, 29 Oct 2007 19:38:51 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9730 <em>"All these points need addressing in great detail by an informed and intelligent and relevantly educated community"</em> Why not the rest of us? I don't think consent in matters like these can seriously be limited those who are "informed, intelligent, and relevantly educated". “All these points need addressing in great detail by an informed and intelligent and relevantly educated community”

Why not the rest of us? I don’t think consent in matters like these can seriously be limited those who are “informed, intelligent, and relevantly educated”.

]]> By: Nato Welch http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9731 Nato Welch Mon, 29 Oct 2007 19:46:17 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9731 Regarding the linked article: it seems to be an unrealized argument for free and open source development, lest our "universal mind" fall under the potentially coercive control of the likes of Google, Apple, Microsoft, and AT&T. Regarding the linked article: it seems to be an unrealized argument for free and open source development, lest our “universal mind” fall under the potentially coercive control of the likes of Google, Apple, Microsoft, and AT&T.

]]> By: Michael http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9739 Michael Mon, 29 Oct 2007 22:54:36 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9739 I think Ben is saying that the community needs to be educated about this so they can make an informed decision. He is including everyone. He is calling for community involvement, a.k.a. "The rest of us.". I think Ben is saying that the community needs to be educated about this so they can make an informed decision.

He is including everyone. He is calling for community involvement, a.k.a. “The rest of us.”.

]]> By: Michael Gusek http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9793 Michael Gusek Tue, 30 Oct 2007 13:26:27 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-9793 They are the means, not the ends, of our ascent. Humanity has consistantly chosen freedom through scientific research over control, coersion, and war due to the potential for a zero-sum reality. If I am smart enough to understand that now, corporations will have no chance coercing me post-mod. They are the means, not the ends, of our ascent.

Humanity has consistantly chosen freedom through scientific research over control, coersion, and war due to the potential for a zero-sum reality.

If I am smart enough to understand that now, corporations will have no chance coercing me post-mod.

]]> By: UgoTrade » Blog Archive » What The Metaverse Can Teach The Paraverse: Don’t be boring! http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-13066 UgoTrade » Blog Archive » What The Metaverse Can Teach The Paraverse: Don’t be boring! Tue, 13 Nov 2007 17:24:21 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-13066 [...] - human and machine the “high noon” of the metaverse? Or as Ben Goetzel writes here in his post on Global Brain Memes. ” I think this ties in with Ray Kurzweil’s point [...] […] - human and machine the “high noon” of the metaverse? Or as Ben Goetzel writes here in his post on Global Brain Memes. ” I think this ties in with Ray Kurzweil’s point […]

]]> By: complexitystudies » Blog Archive » On Becoming a Neuron http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-14639 complexitystudies » Blog Archive » On Becoming a Neuron Mon, 19 Nov 2007 16:00:11 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-14639 [...] The Singularity Institute Blog : Blog Archive : On Becoming a Neuron Bookmark to:          [...] […] The Singularity Institute Blog : Blog Archive : On Becoming a Neuron Bookmark to:          […]

]]> By: Jeremy P. Brody http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-16040 Jeremy P. Brody Sat, 24 Nov 2007 21:02:47 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-16040 Is the world really coming around? Or was Brooks just joking? Is the world really coming around? Or was Brooks just joking?

]]> By: Grant Czerepak http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-17943 Grant Czerepak Sat, 01 Dec 2007 10:07:17 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-17943 Before any of this takes place I hope that we fully contain the first AGI and architect it to permit a controlled ascent. We have to view AGI as a potential hazard in the same way Nuclear, Chemical or Biological agents are a hazard. Sure give them access to the web, but to a copy of the web cut off from the outside world. Google has a complete snapshot on its servers. For a Manhattan Project like a superhuman AI a comparable infrastructure is justifiable. The romantic notions of hard takeoff AGI have to be abandoned completely. Before any of this takes place I hope that we fully contain the first AGI and architect it to permit a controlled ascent.

We have to view AGI as a potential hazard in the same way Nuclear, Chemical or Biological agents are a hazard.

Sure give them access to the web, but to a copy of the web cut off from the outside world. Google has a complete snapshot on its servers. For a Manhattan Project like a superhuman AI a comparable infrastructure is justifiable.

The romantic notions of hard takeoff AGI have to be abandoned completely.

]]> By: metavalent http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-18084 metavalent Sun, 02 Dec 2007 02:03:25 +0000 http://www.singinst.org/blog/2007/10/29/on-becoming-a-neuron/#comment-18084 having listened to a fair number of leading voices on the subject, i think it's safe to generalize that the community of serious AGI developers totally agrees with grant's caution ... we've all seen enough mixed technological blessings and curses in the past to know better than to expect only goodness and light. of course, just because i can't imagine a serious worker in the field harboring romanticism over any particular AGI takeoff scenario, doesn't mean it isn't possible. as i understand it, guarding against such risks is precisely the role of the lifeboat foundation; to create a space within which to flesh out the risks, and to the extent we're able, avoid them in the first place, or at the very least mitigate chances of harm to humans and our environment. having listened to a fair number of leading voices on the subject, i think it’s safe to generalize that the community of serious AGI developers totally agrees with grant’s caution … we’ve all seen enough mixed technological blessings and curses in the past to know better than to expect only goodness and light. of course, just because i can’t imagine a serious worker in the field harboring romanticism over any particular AGI takeoff scenario, doesn’t mean it isn’t possible. as i understand it, guarding against such risks is precisely the role of the lifeboat foundation; to create a space within which to flesh out the risks, and to the extent we’re able, avoid them in the first place, or at the very least mitigate chances of harm to humans and our environment.

]]>