"Just...think before you flirt while drinking, yes?" He says nothing of how it makes him feel, because it was done while drunk and that was how HE happened to the boys and-

It went without discussing that he would rather not see himself replaced. Especially when he knows it will not come to pass.