Does velaryon fell off because they probably maybe secretly supported daemon blackfyre?

I was talking with my friend suddenly I realised during blackfyre rebelion, there was no mention of velaryons but also as velaryons were irrelevant in main storyline maybe they supported daemon blackfyre in the blackfyre rebelion as his grandmother is a velaryon and they felt replaced by martells ?