

IDK. I get really uneasy about claims that a computer or AI can never be intelligent or self-aware. Sure, it’s “just” circuits, but your brain is “just” cells passing information between each other. An individual cell is no more intelligent or self-aware than an individual transistor is. It’s deeply unscientific to believe there is some magic voodoo involved in biology that can’t be reproduced in a machine.
Exactly. We are beings of atoms and matter. If you want to believe in some immaterial soul, fine. But if you’re a materialist, then everything we are is atoms. We know atoms in one configuration can produce true intelligence. And there are likely many possible arrangements of atoms that can reproduce this effect. And since artificial minds are not subject to most of the constraints of biological minds, an artificial superhuman intelligence should be possible. Hell, even if biology was the only way to make it possible, you could always build an artificial biological brain and just make it a lot bigger than a human one. Even if human neurology really is the limit of what this universe allows for in terms of intelligence, we could best it by just making a bigger one.