I’m not asking for legal advice but just wondering if what my lawyer told me is true

For context I live in the state of Georgia so I spoke with the a lawyer today about terminating my sons biological fathers rights. Bio dad has signed paternity acknowledgement and he is on the birth certificate however he hasn’t shown any willingness to support my son at all and hasn’t seen him in years. The lawyer told me that because a judge never legitimized him we don’t have to terminate rights we can just proceed with adoption and I just wanted a second opinion to be sure