2000 sportsman 500 ebs

Rebuilt drive clutch due to creeping and hard shifting into gears. Fired up machine and a lot of improvement. At first secondary was rarely spinning in idle but I could visually see belt was ridding closer to outer sheave. Secondary had 2 shims/washers behind it, I removed 1, now secondary has zero spin but belt is still visually closer to outer sheave. Can I remove the last shim/washer to better center the belt or do I have to have at least 1 shim/washer behind the secondary?