you don't know what you are missing not riding 56s
There is definitely a place for 56 mm wheels and above, as per quite a few of my usual boards, but I still prefer smaller wheels for a lot of things, small tech stuff that bigger wheels just don't do so well on.
I guess it is down to what you skate or even how you skate, as people with big wheels can still get tech, but I find 56 and up almost impossible to skate curbs and small things, whereas 50 mm wheels work oh so well on those smaller things, lots of slides, wheels not getting in the way the way bigger wheels do, etc.
The real question is tho... Are you wheels really the size you say they are?
I know my wheels isent 54mm anymore, after a couple of months. More like 51-52mm. Wheels shred atleast 1mm per month, if you skate streets or rougher parks
I think more than a few people have measuring calipers on here - I got a bulk deal when I went looking so I passed quite a few round to people I skate with, so there are definitely more people who are very aware of their wheel sizes more in my circle of skate friends.
I prefer 56 mm wheels for my "Go fast" boards, more for transition but also anywhere I am not really thinking about doing much else too. That said, I do have boards with 57, 58, 59 and 60+ but I don't skate them much.
I have 52 - 54 mm wheels on my main setups, often starting at 54 but usually worn down at least to 53 or under, usually Conical Full that have been rounded off.
Then around 50 mm or so, give or take a mm, on my small tech / curb setups or boards that are pretty much done, but they might still be good for small stuff.