Totally with you there. I've got a Zeiss V6 which tracks perfectly. Thought about getting a NF or tactical style scope but the reticle would be more of a pain than a boon for me. I have a nice rangefinder (sig) but no chronograph. I use a calculator and BC+ drop values to estimate velocities. I have the Strelok app and a few others.
Im a little worried that shooting my 06 too much won't be helpful if I move up later; I imagine a lot of the wind intuition will remain, and the numbers can be adjusted for drop for the new load, but the time might have been better spent using the final cartridge and learning how it behaves in wind specifically.
I agree recoil can be an issue. However, I'm specifically going for threaded, and won't shoot without either a brake or silencer, which significantly reduce the recoil. A magnum will kick less than my current 06 with the muzzle devices, so I am not concerned with that.