I've been pondering on this quote: "Given the opportunity, players will optimize the fun out of a game", and how it is applicable to so many areas of human life.

Let's take programming, for example. AI is fun. AI writing shit code is not. Optimizing AI to write code as close to my handwritten code as possible is fun.

However the end result of such optimization is something that isn't me, yet writes code exactly like me. Now that's awkward, because that would make a part of my hard skills obsolete.

I feel like we are optimizing humanity away. I don't really see a problem with it, since I can't even prove I am not a p-zombie. But it does make me wonder how it feels for people who think humanity be-all and end-all.