What is He Jin's problem? He is always blaming other people for his problems. They are not even stunning him. For him to say they all look down on him is crazy.
Now Yotsuya knows it had nothing to do with the Face-off rules. He probably wanted to sleep with Shido since high school and used the fact he won the face-off to make the rule for the loser to do whatever the winner says and sleep with him, because there's no way he just wanted to sleep with him all of a sudden, he must have always wanted to.