I think removing one leaf may be a good idea for ride quality, just keep an eye on the Swing Spring as it settles, as mine is already a bit lower than when I'd finished and Towed found a great photo comparison of my Sammio build with the new spring fitted and then after 12 months and the height difference was quite visible!
Love the veined drum brakes btw!