Becoming a wizard is more true than you may realize. In olden times, people who renounced worldly things and took to a life of quiet contemplation were venerated, respected, and sought out for advice. These were the sages, the ascetics, the yogis, the Desert Fathers, the wise men of the woods. It is only by removing oneself from society that one can observe it clearly. Your lack of desire for the things that most people lust after is not a weakness, it is a strength. It means that you have the freedom to do only what truly pleases you, and not be distracted by frivolities.
I'm a lot like you, even though I have a partner I intend to stay with & I've found work that I like to do, that I can do alone, and that pays well - it occupies a lot of my hours, but other than that, I like to be alone in the woods & code weird little games for nobody. I don't have a car or a big house, even though I could afford them. But it does run in my family - I have two uncles that dropped out of college, one to build a house alone in the woods and live off the kindness of local old ladies in return for handyman work, and one to become a hare krishna (although later on he became a full time live in aide for a disabled person, but he is still, shall we say very spiritual).
You needn't force yourself to do anything you don't really like. Eventually, you'll find something you like enough to do. Interests are not something you can find by looking, they simply happen - if it hasn't happened yet, don't worry. You are already so much wiser than people who fill that perceived void with sex, thrills, video game autism, et cetera - not that there's anything wrong really with filling your time that way, if those things are what calls to you. But don't feel bad for being more of a sage than almost anyone.