Feeling concerned about the risk of getting bird fancier's lung

So it hasn't been long since I welcomed two new budgies into my home .Just the other day I came across a post about how birds can cause severe lung issues like bird fancier"s lung ,since mine aren't fully accustomed yet they still spend a lot of time inside their cage.I sleep and spend most of my time with them in the same space ,I do clean their cages (bare handed as I use a paper towel with warm water to clean up any droppings ) yes I wash my hands right after ,I make sure there's no feathers and try to keep their area clean .I just worry that it'll be a risk for me .Are the chances high with any pet bird or is it more common with people who are allergic or have asthma to develop lung issues .