I think you are doing it right, the transition from big company to smaller operation has maintained the original flavour of the brand. The new team members such as Franky or Windsor add a really good vibe too. It almost has a smaller brand feel (like Polar or $lave). I think your apparel line has a really good potential to grow.
Stay focused on Zero, skateboarding and your family, and don't lose too much energy and time on side projects.
Dwindle wood was never an issue for me, had a lot of enjoi boards and a couple of almost and it was never bad.