I changed cam shafts once with out taking the flywheel off. I still think it was one of the luckiest days I ever had in either wrenching and/or Love. I'm still batting O in Love so I guess I'm a good wrench.
Look for a used cam shaft. The lifters you have are reusable if the bottom faces are not pitted.