SIAI Newsletter June-July 2010
August 23rd, 2010 –
Where to Find Us
The Singularity Institute has been extending its web and outreach presence these past two months. As always, you can find us at the SIAI homepage and at the SIAI blog.
Hip readers may want to follow us via Twitter (@singinst) or Facebook Causes. Recently, we have set up a Crowdrise crowdsourcing and crowdfunding account for volunteers and fellows and a YouTube channel to host our collection of videos – with a few future surprises.
New Leadership in the Visiting Fellows Program
The Institute’s team of Visiting Fellows is under new management. Former Visiting Fellow Jasen Murray replaced Anna Salamon as Program Manager of the Visiting Fellows Program, with Louie Helm serving as his Deputy Program Manager.
Anna Salamon spent the past year managing the expanding Visiting Fellows Program. Freed from logistics and management, she aims to spend more time on her duties as a Research Fellow, writing research papers and engaging Visiting Fellows and other visiting academics in relevant research. She is also helping Visiting Fellows develop their rationality and their understanding of the existential risks landscape through individual tutoring and group workshops.
Jasen Murray founded the New York Less Wrong meet-up group and spent two years researching gene therapy and personalized medicine before joining the Visiting Fellows Program. His focus as program manager is on identifying individuals’ unique strengths, and on creating the institutions and skills that can let Fellows coordinate well, build effective teams, and get their strengths in contact with academic research, IA projects, and other action toward a positive Singularity.
Louie Helm is the founder of the Seventeen or Bust distributed computing project and an internet entrepreneur. As Deputy Program Manager, he manages programming projects, outreach projects, grant writing, and team-building for the Visiting Fellows. Louie also manages the SIAI volunteer program and is always looking for more online volunteers to assist SIAI in its various projects: reach him at louie.helm@singinst.org.
FQXi Grant Proposals Submitted
SIAI submitted three grant proposals for a total of $183,000 to the Foundational Questions Institute (FQXi). FQXi allocates grants to research projects that it believes will tackle “questions at the foundations of physics and cosmology, particularly new frontiers and innovative ideas integral to a deep understanding of reality but unlikely to be supported by conventional funding sources.”
These grants, if awarded, would allow SIAI to fund research in several topics of longstanding interest. Among these topics are a developed timeless decision theory (TDT) that can be viewed as a proper alternative to causal decision theory (CDT), an exploration of fundamental priors and the mechanics of the Universal Distribution with Absolute Self-Sampling Assumption (UDASSA), and the implications of the simulation hypothesis on cosmology and fundamental physics.
New Program Manager Jasen Murray has promised that the institution’s grant-writing project will be the first of many whole-team projects within the Visiting Fellows program. Discussed possibilities for the future are an electroencephalograph-building (EEG) project, a book planning project, and various IA experiments.
Research: ECAP Papers and Presentations
SIAI continues to contribute to the field of AI safety and to exchange dialogue, via published papers and presentations, with other scholars and students in the field. These past two months have been particularly busy with academic work.
Carl Shulman (currently in Australia) gave two academic presentations on what the evolution of intelligence implies about the feasibility of AI, with special attention devoted towards anthropic arguments. The first was an hour-long talk at the Australian National University; the second was a conference talk at the Association of Australian Philosophers.
The European Conference on Computing and Philosophy (ECAP) accepted Anna Salamon’s newest conference paper, written in conjunction with Research Fellow Steve Rayhawk and Visiting Fellow Janos Kramar, “How Intelligible is Intelligence? Implications for AI Development Trajectories.” In this paper, they propose that one factor that can usefully constrain models of AI development and takeoff trajectories is the “intelligibility of intelligence”—the extent to which efficient algorithms for general intelligence follow from simple general principles, as in physics, rather than being necessarily a conglomerate of special case solutions.
Visiting fellow Kaj Sotala also had his conference paper, “From Mostly Harmless to Civilization-Threatening: Pathways to Dangerous Artificial Intelligences,” accepted by ECAP. Kaj’s paper discusses the threat level of three possible pathways for AI development: through advanced hardware capabilities, through the capability of software self-improvement, and through multiple copies of a digital AI. He will be editing his completed paper the following month in his native Finland.
Three additional SIAI-affiliated papers have been accepted by ECAP: Anders Sandberg and Carl Shulman’s “Implications of a Software-Limited Singularity”; Steven Kaas, Peter Salamon, and Steve Rayhawk’s “Economic Implications of Software Minds”; and Joshua Fox and Carl Shulman’s “Superintelligence Favors Cooperation, but not Benevolence.” Steven Kaas is an alumnus of the summer 2009 Visiting Fellows program, Carl Shulman continues to work on SIAI research and projects in Australia, and Joshua Fox is a long-time supporter of SIAI and of efforts to create a positive Singularity.
Michael Anissimov’s presentation proposal “Public Scholarship for Global Catastrophic Risks” was accepted by the Society for Risk Analysis conference, to be held in Salt Lake City in December.
The Visiting Fellows Program: Bigger, Faster, Better!
The SIAI Visiting Fellows Program has grown over the past two months. Since the beginning of June, seven new Visiting Fellows have entered through the doors of the program: Peter de Blanc, Dennis Fan, Shaneal Manek, Frank Adamek, Abraham Wolk, Tim Czech, and Stanislas Sochacki. We expect to welcome eight more fellows over the course of the summer.
Currently, the new fellows are filming a Less Wrong lecture series, assisting in SIAI outreach efforts, and spending time learning from the Visiting Fellows curriculum. For more information on each individual fellow and his/her interests, visit the Visiting Fellows page.
Next time…
Look forward to more exciting developments from SIAI in the following newsletter… a Less Wrong YouTube lecture series is in the works by Visiting Fellows Peter de Blanc, Dennis Fan, and Frank Adamek… and even more Visiting Fellows will be trickling in.














