Sounds like you don't have enough timing now.

 

I checked timing with the vacuum advance off and it was at 8*, then when I put the vacuum advance back on the timing was still at 8*...Does that sound right?

 

Yes that's normal, when the advance is hooked up to ported vacuum (no vacuum at idle). Just for fun, you should try hooking your advance up to the full manifold fitting on the carb and see if it makes a difference, one way or the other.