Perlite or Vermiculite for garden beds? Oregon zone 8B

I put lots of bagged soils, manure, compost over the past 2 years, its about 8 inch height right now

At the base of the beds is clay muddy soil and lots of rocks underneath that

Should I add perlite or vermiculite and mix into it?

So hard to find vermiculite here, I don’t know if it has anything to with our weather here in Portland Oregon.

Maybe it’s too wet here and we need perlite instead?