Making Patterns vs Samples

I really just want to get a feel on how other people think about these different work flows, I'm a little newer to music production and this has been the biggest thing I've thought about ever since starting I've only been doing it for about 5 years and I feel like the best way for me personally is to mold my music as in not crafting it through a midi pattern but instead molding samples from FL and splice and having little to no built patterns from me. However it feels like I'm making music wrong because 90% of the time I see people producing they are making it from damn near scratch I can clearly see that this method of making music gives flexibility, requires a lot of skill, determination and time but any time I try to make music with purely patterns or mostly patterns I find it much less enjoyable but I don't like the simplicity of a person being able to hear someone's song just by scrolling through samples on FL or splice it just frustrates me that it feels like I'm taking the easy route to music besides learning how to make patterns, but then I try to do it and lose interest in making music. I just want to see if anyone else feels like making music off of samples is shunned upon or am I just being biased from what I've seen