Am I being too passive?

So at my gym Ive been training for about a year. Generally I play a fairly defensive game, and even experienced blue belts with 10-15kgs on me have a difficult time tapping me out, if they can at all. I can usually see what people are trying to do and let them burn energy trying to complete a submission they dont quite have. While I feel this is a good tactic (or at least not the worst) against bigger higher belts, this passivity carries over to newer white belts as well. I find myself doing the same thing, just letting them burn their energy, often from the top but sometimes from the bottom as well.

My question is, at this stage, is this a bad habit to get into? I feel that white belt is the time to become comfortable with pressure, and to learn defense, but am I neglecting other important parts of my game? I feel the only way I can counter this is by being "aggressive", which to me just feels like moving more quickly, and using more strength (i.e. spazzing).