Lot swap with builders?

We are looking to build a house on a lot that’s owned by a builder on a neighborhood. We love the house/floor plans of the builder but not amazed by the lot and see there’s other lots that we would prefer. Is it crazy to throw out the idea to the builder or is this something that doesn’t happen?