What exactly went wrong here?

His calling and wanting to hang out with you doesn't mean anything. Guys will still do boyfriend/girlfriend things with a girl who makes herself available to them, even if they don't like them that way. They enjoy the and companionship and don't need to have romantic feelings for that. If a guy tells you, you shouldn't be falling for him, you should take his word for it.