Need some advice on guys and affection?

Sounds to me he's ambivalent about the relationship, as he is clearly holding back, like driving a car with both the accelerator pedal and the brake pedal down at the same time. As you say, you are both sleeping together, and you do need to communicate more. Saying he wouldn't be here if he didn't want to be is NOT a positive pro-active answer. You need more information - and make sure he gives you this more information OUTSIDE the bedroom!