Should Catholics view physical illness and/or personal misfortune as a chastisement?

I feel like the Bible presents several different views on this: there are many Old Testament examples of chastisements from God in the form of physical illness or misfortune, but on the other hand we have the example of Job who was a righteous man and suffered terribly despite that. We also have John 9:3, where (when asked if a man was born blind in punishment for his own or his parents sins) Jesus said “It was not that this man sinned, or his parents, but that the works of God might be made manifest in him.” I’ve encountered modern Catholic commentators who appear to suggest that something like a chronic illness can be allowed by God as a temporal punishment for an individual. As a hyper-logical person, I struggle to accept this view because it seems to me that a lot of bad things routinely happen to good, faithful Catholics.

Should we as Catholics view illness and misfortune as potential chastisements that should prompt us to examine our consciences? Or should we figure that John 9:3 always applies?