He has plenty of other ways to indicate he's not interested in what I'm saying, but they tend to be more of the staying silent/not responding variety. I don't think of it as rude as much as, well, married people can't be interested in everything the other party has to say. :)