Facial hair growth is indeed determined by hormones on the onset of puberty, but, if you don't have much to begin with, that's basically what you'll have for the rest of your life. Meaning, if you don't have a distinct set of burns by the time you need to shave, you won't have it.
Personally, I didn't really like having a mustache and goatee when I was young and often shaved it, until I realized it served a purpose other than giving me a distinct rugged look..