Can I get Ehefähigkeitszeugnis in Germany as a foreigner?

Hi, I've been here in Germany for 5 years. So I've already extended my resident permit 5 times. Every time I've put myself as single.

Now if I wanna get married and need Ehefähigkeitszeugnis, can I get it from the Rathaus? Can they give foreigners that?

Thank you!