Should I break up with him before it gets any further?

Well, if he seems to be in love with you and you don't feel the same way maybe you should just tell him and avoid having him realize it on his own. Let him know that you really regret having to hurt him but it's just to save him from even more pain in the future. Don't drag it out, just slowly start to distance yourself and then tell hm how you really feel. If he really loves you he'll understand and let you go. After that I wouldn't recommend continuing to see him for a while, use the distance to your advantage. Hope I could help at all.