What can we say... this guy is (ahem) a jerk. He doesn't know how to treat a girl and he's not really interested in respecting your feelings. You can do so much better... trust us!
This is a part-time thing for now. This guy is not the worst, but he's not serious about being your boyfriend either. You should keep looking - even if he's just immature, this guy is not ready for what you have to give.
It must be love or something like it! Your guy seems to treating you the way you should be treated. No question about it, he is the one for you. Keep him around!