Pulling an abscessed tooth without draining abscess?

I have an abscessed tooth. About 2 weeks ago the dentist put me on penicillin, which failed to completely solve the infection, but it got a little bit better and more importantly the horrific pain stopped, so last Wednesday he put me on clindamyacin. It's slightly less swollen but still not going down. He told me to come in as soon as the swelling went down but if it still wasn't going down they would just have to pull it regardless.

Now, obviously I am not a dentist but wouldn't pulling it if it is still infected (or swollen with pus) be dangerous? Should I insist it be drained or will I be fine?