Can I tell my friends I go to harvard if it's HES?

If I'm going through a degree program through the Harvard extension school and they ask me "where do you go to school?", would it be deceiving to say "i go to harvard"? Has anyone from the HES had to go through that situation? If so, how did you respond to the question?