Based on the mathermatical probablility on what should come next based on the training they've been given.
No. They aren't given any "training". Everything they do is based on mathematical probability. Their world is a world of zeros and ones, and only that. They do learn how to translate that into what we consider to be language.