Hey MCL
I have a similar set up, just bought in January to toddle around the West of Scotland with the wife and two four year olds.
They love it, but the conditions have to be pretty good... We got caught out on Loch Lomond recently when the wind got up: the boat and the engine loved it but the kids weren't too happy!
Best to stick to perfect weather with the wee ones on board and keep pushing yourself in worse conditions to learn about handling etc. The Clyde at Dumbarton recently was a surprise for me: wind Vs tide = 3ft chop which was pretty unpleasant.
Every trip means more confidence and therefore safer adventures. Keep at it!