Help: Perlite in substrate

Hey guys..

so I finished my pedes enclosure like two weeks ago and the substrate consists of: dirt from the forest, flake soil, specific millipede soil, white rotten wood, leaves and some organic dirt from the garden Center… however I just read somewhere that the substrate shouldn’t have perlite as this could possibly kill them. Is this true? Because I’m pretty sure the substrate had little perlite stones:/ do I have to renew the whole substrate? Because I’m willing as long as my babies are safe