[Fair Use: For Education and Research Only]

New Technologies Imperil Humanity - U.S. Scientist

Story Filed: Monday, March 13, 2000 4:36 PM EST

SAN FRANCISCO (Reuters) - The co-founder of one of Silicon Valley's top technology companies believes scientific advances may be ushering humanity into a nightmare world where supersmart machines force mankind into extinction.

In a heartfelt appeal published in the April issue of Wired magazine, Sun Microsystems Inc. chief scientist Bill Joy urges technologists to reconsider the ethics of the drive toward constant scientific innovation.

``We are being propelled into this new century with no plan, no control, no brakes,'' Joy writes. ``The last chance to assert control -- the fail-safe point -- is rapidly approaching.''

Joy's article comes as a rare cry of caution in an industry that thrives on relentless and often unplanned advances and is now riding the boom of a ``new economy'' expansion attributed to technological progress.

The warning is all the more disturbing because of the author's own impressive tech credentials. A leading computer researcher who developed an early version of the Unix operating system, Joy has more recently pioneered the development of software technologies like Java and was co-chairman of a presidential commission on the future of information technology.

Joy's fears focus on three areas of technology undergoing incredibly rapid change.

THINKING, BREEDING ROBOTS

The first, robotics, involves the development of ''thinking'' computers that within a matter of three short decades could be as much as a million times more powerful than those currently available. Joy sees this as setting the groundwork for a ``robot species'' of intelligent robots that create evolved copies of themselves.

The second, genetics, deals with scientific breakthroughs in manipulating the very structure of biological life. While Joy says this has led to benefits such as pest-resistant crops, it also has set the stage for new, man-made plagues that could literally wipe out the natural world.

The third, nanotechnology, involves the creation of objects on an atom-by-atom basis, which before long could be harnessed to create smart machines that are microscopically small.

All three of these technologies share one characteristic absent in earlier dangerous human inventions such as the atomic bomb: They could easily replicate themselves, creating a cascade effect that could sweep through the physical word in much the same way that a computer virus spreads through the cyberworld.

``It is no exaggeration to say we are on the cusp of the further perfection of extreme evil,'' Joy writes. ``An evil whose possibility spreads well beyond that which weapons of mass destruction bequeathed to nation states on to surprising and terrible empowerment of extreme individuals.''

KACZYNSKI'S IDEAS

Joy says his new, darker vision of the potential threat to humanity posed by technology -- one he notes is shared in part by convicted Unabomber Theodore Kaczynski -- has led him to reconsider his own contributions to the field.

``I have always believed that making software more reliable, given its many uses, will make the world a safer place,'' Joy writes. ``If I were to come to believe the opposite, then I would be morally obligated to stop this work. I can now imagine such a day may come.''

Joy does hold out some hope, saying humanity's effort to control the threat of nuclear and biological weapons was evidence of the strength of the species' self-preservation instinct.

But he urges a wider dialogue on the implications of new technological advances and specifically asks that they be incorporated into the program at the annual Pugwash Conferences, which began in 1957 as a forum for scientists to discuss the threat posed by nuclear weapons.

``The experiences of the atomic scientists clearly show the need to take personal responsibility, the danger that things will move too fast, and the way in which the process can take on a life of its own,'' Joy says.

``We can, as they did, create insurmountable problems in almost no time flat. We must do more thinking upfront if we are not to be similarly surprised and shocked by the consequences of our inventions.''

Copyright ) 2000 Reuters Limited. All rights reserved.

http://library.northernlight.com/HC20000313160000022.html?cb=200&dx=2006&sc=1#doc

Portions of above Copyright ) 1997-2000, Northern Light Technology Inc. All rights reserved.

-- (Dee360Degree@aol.com), March 13, 2000