How do you know if he's really in love or just trying to get in your pants?

I have a male friend he always sends me mixed signals. We fight all the time argue so on so forth, it never gets physical. Yet he says he loves me and then when he's around me he picks on all my flaws, its aggravating. He's supposed to be 23 years old and he acts like he just left middle school. One moment he's all over me with email and then when we are in person he changes everything. Meaning when we talk and text he says he wants me and he's begging to be with me, and I always tell him no because I know I'm not good enough for him. I only say this cause he's in a higher class bracket. 7 cars, 1 house, condo, you name it he has it. And I don't have a job I'm completely broke. Sounds like a fairy tail right? Wrong. When we are in person we play his favorite sports even thou i suck and he laughs at me because hey lets face it the only sport i'll ever be good at is soccer and he likes basketball. We have nothing in common, he admits he wants to sleep with me and says he doesn't want to be with me. He constantly tells me all the girls he gets in bed just to make me jealous. I blew him off so many times, acted like I had better things to worry about then a relationship or even give him the slightest hint I want him because I'm not sure what he wants from me. He does some sweet things for me he worries about me and I blow him off. Am I wrong to do so? At first he constantly wanted to see me when I was sick he begged me to get out of bed to come see him. I did because I wanted to see him but on the other hand I really didn't. When he's drunk he spills his "undying love" for me out. That oh he can't live without me. Then when he's sober he pokes and prods at every single emotion i have trying to figure out if I will eventually snap. Oh how I wish I would. I thought I hated him, yet I'm still here wondering why I come back. He's everything I do not want and I'm everything he hates so what are we doing? Is he another *** hole trying to get in my pants or is he really in love with me as he says because either way I don't understand and I'd love to.