I think a lot about what it's going to mean when Google gets so good at predicting things about us that they really can finish our sentences. I think about it a lot when I'm texting, because sometimes when I'm in the middle of a text, the next word I was going to write pops up, so I click it. Then the next one pops up, too, so I click that. Then, a word that isn't the next word I was going to write, but is pretty close, pops up. And I click that.
Once in a while, I get all the way to the end of the sentence I was going to write, and Google suggests a period, so I click that. And I wonder, when Google gets better at predictive technology, when it's able to quickly and easily digest the entirety of
(a.) My history of online and textual communication
(b.) The recorded history of my relationship with the person I'm texting
(c.) The stuff I've been doing lately and my approximate mood and energy,
what's Google going to write?
Now, I don't think that Google is ever going to reach a point where it can perfectly predict everything I was going to say. That's past superintelligent and into brain-scanning. But I do suspect that eventually Google will hit a point where they have the technology to carry on a conversation as if it were me talking. Or, a version of me. The version of me that is averaged with the rest of Google-using humanity (which would notably skew white, male, cisgender, heterosexual, and so on) and then applied to this conversation.
Would Google Me swear?
Would Google Me be more insensitive to the people I care about? Or less insensitive?
Would I risk drifting out of consciously experiencing my conversations? If I'm busy or distracted, would I just autofill whole chats and read them later? Or forget to read them later? Or assume that Google covered the important points?
What's more likely, I think, is that Google will step a little too close to acting like this, and there will be a huge ick-factor backlash (which I think would be justified in that case) and they'd dial back the functionality of their service until it didn't make people question their humanity and individuality.