I agree with most here who say that you should NEVER disregard your values for a relationship (or for much of anything, for that matter). You will soon find yourself more miserable than you thought possible if you do that. If you're not into pot, for instance, it would be best not to date someone who is. Eventually his pot use would probably really bother you and then everything just becomes a living nightmare.
It really sounds as if the two of you are not compatible. The zero sexual tension thing is a big red flag. Not that people can't have a healthy, happy relationship without a fantastic sex life, but in my opinion, it is important. Physical intimacy is really good for the mind and emotional state, and it enhances other forms of intimacy.
That said, I took a chance on my boyfriend who has "flaws" that I thought really bothered me. For example, he can be really lazy, sort of a quitter, not very motivated. But the more I get to know him, the more I see his many beautiful qualities, such as being very caring, very smart in a practical manner (which I am not), thoughtful, sweet, generous, and more. These things make his "flaws" matter less and less. And it took time for me to see how lovely he is. So try to keep expectations reasonable, and if something tells you to give someone a chance even though they don't live up to all your expectations, go for it. People can really surprise you. And if they don't, and it turns out that you're not happy, move on.