[Question] Daedric Crafting options?

As a sneaky character, I went up the light armor side of blacksmithing, thinking I could wrap it around to pickup daedric from the top to make myself dragon scale armor, lydia daedric, and daedric weapons.

I've now found you can't wrap around the tree without going up from the bottom of both sides.

So... do you have to either be heavy blacksmith, or do quests to use the atronach forge? Or can I just run down there and use ebony weapons/armor and the proper recipes in the forge to make daedric stuff?