Thread:User talk:Nebuchadnezzar/Theory of mind - on the computer. a bit funny (or not)/reply (12)

Yeah, if you screw that up, then you've just created a Mind of Infinite Pain. Of course, you can easily "delete" said mind and try again, but then there are the ethical implications (much like I could "delete" someone with a gun). Embodiment is a major problem in robotics as well -- that's why we have AI that can beat human chess masters but can't walk down to the kitchen and make a damned peanut butter and jelly sandwich. (Though now it could order one from Subway.) Rolf Pfeifer is doing really interesting work in this area -- much more realistic than Yudkowskian fantasies as well. (Sorry, couldn't resist.)