Why is it that after working so hard to convince me to have an affair, he now refuses to take me?

He had no intension to cheat from the beginning. He wanted to see if he still got the charisma at this age, he got you naked to prove his point. You got carried away and almost ruined your marriage. You are just 24, you've to learn self control if you want a healthy guilt free marriage.