What are thoughts on giving defenses a point for 4th down stops?

Defenses are a big hit or miss and this could become a value for defenses. But would this cause too much of a point swing that it shouldn’t?