Theory of mind - on the computer. a bit funny (or not)
Yeah, if you screw that up, then you've just created a Mind of Infinite Pain. Of course, you can easily "delete" said mind and try again, but then there are the ethical implications (much like I could "delete" someone with a gun). Embodiment is a major problem in robotics as well -- that's why we have AI that can beat human chess masters but can't walk down to the kitchen and make a damned peanut butter and jelly sandwich. (Though now it could order one from Subway.) Rolf Pfeifer is doing really interesting work in this area -- much more realistic than Yudkowskian fantasies as well. (Sorry, couldn't resist.)
oh man. so if you make a "new" brain, and turn it on for even 10 seconds, it is in a very real way, "alive", and fully new. turning it off would be turning of a distinct life with distinct ideas.
If it's a genuine facsimile of a human brain with subjective experience (or qualia if you want to go there, but I really hate that term), then, yeah, I don't see how "turning off" the brain would be any different than just going out and killing someone, at least in an instantaneous way.
Or what if it happens accidentally?
Speaking of the oddball fantasies, is it just me or are conscious facsimile human brains and super intelligent singularity spawning computers two totally different things. I mean, there's hardly any worry in letting the former "out of the box" is there, since we have 7 billion of those fuckers already.
True, but you don't need to be smart to do some damage.
This discussion is sorta freaky, in that as a 44 year old, i think about what "existence" means more and more. And here you are talking making clones of brains which upon activation are actually "live" in a very real sense, and whic can be turned off with a blink. Tanya on, Tanya off - with no trace of awareness that you were ever 'on'.
It's that simple. And that very ego bashing (pouts). Sometimes i hate being an atheist. ;-)
Why? It's pretty great as long as your death is quick and painless. As Mark Twain (allegedly) said: "I do not fear death. I had been dead for billions and billions of years before I was born, and had not suffered the slightest inconvenience from it." (I'm sure he never really said most of the things he said, though.)
No, I don't particular fear death either. Though I can think of numerous processes that move us from the one case of affairs to the other case of affairs that I am very much shit scared of.
It's an ego thing, not a fear thing. The fact that you will not exist, adn there's no you to even know existed. it's freaky.
But there'd be no you to give a fuck. :p
of course there wouldn't, and that's what annoying. Non existence is a bitch, man. I want to exist!
Fear isn't about what you will really experience, it's about how you feel in the now, about who you are, and where you will be, duh. ;-)