Asking for feedback

I have worked for 3 1/2 years at my company and never had an appraisal. Ive had virtually no feedback, just that I'm doing good. This is all well and good but id like feedback to know how I can improve. Is it a good idea to ask the manager or will it be received badly? Is there a certain way to ask?