Frigidaire Refrigerator - No Water Question

Hi - I have a Frigidaire (ffhs2611pfea). It has a ice maker and water in the door. The water stopped coming out this morning. I watched several videos and narrowed it down to the water valve or maybe the switch behind the panel that activates when you push in the water paddle. Before I took things apart I unlugged it for an hour to see if maybe if was frozen, Still no water. Then on a whim I removed the water filter and then tried the water. Water came shooting out of where the filter should be. So, clogged filter? Replace it and move on? Am I on the right track to NOT order the other parts until I try this?