What should I do? Relationship advice?

I've been with this guy for almost a month now, and he's already told me that he doesn't like my situation (long story) and he considers me 'immature' for whatever reason, and we don't get to see each other that much because he's in college and I babysit for my parents...(that's his problem) I understand us not seeing each other that much, I would love to see him more, and after he complained I've been trying to see him every single day. But he's always got like homework or whatever. I understand that. He has stopped being affectionate towards me and stuff, so I asked why. He tells me because we don't get to see each other much and it's been bothering him. I feel that that's not a good enough reason, (but I haven't told him that) I told him that I will try and see him more because I miss the old him. There was also a misunderstanding where I thought he broke up with me, but he didn't. I messed up and cussed him out an stuff...it was bad. lol But my point is, I'm trying to make our relationship work, but he isn't cooporating with anything I do, and he is STILL not giving me the affection he used to. I don't want to jump to conclusions and assume he's cheating either. After talking to him over and over again, he insists that we are together, and that he wants to be with me and if he wanted to break up with me, he will let me know. So I just let it go. It isn't bothering me as much as it was before...I'm so ready to just break it off because he's irritating me, but on the other hand, he seems like he likes me because he insists on being with me. I DO say I want to be with him, but I don't tell him: ';OH PLEASE DON'T BREAK UP WITH ME'; or anything. If he wanted to break up, of course it will hurt, but it's not like I'm in love or anything, I just like him a lot, and I liked the way it was before, but he refuses to treat me like that again. It's been like this for like 2 weeks now. What should I do?What should I do? Relationship advice?
He's obviously not taking this relationship as seriously as you do.


What you do about it I'll leave in your hands.