D35 axles have their bearing rollers ride directly on the axle shaft, and the axle functions as the "inner race" for the bearing.
The outer race for the bearing is a LIGHT press fit into the bore of the axle housing. A block of wood and a few taps are all that it should take. Anything more than that, and something is wrong. Either the bearing is the wrong size, or something is inhibiting the bearing from seating in the bore of the axle tube.
There is a change in bore diameter in the axle tube that acts as a stop to prevent the bearing from being driven too deep.
The seal for the axle shaft is a slightly tighter fit into the axle tube. It is coated with a colored sealant on it's outer surface, and thus needs to be driven into the bore of the axle tube with a block of wood and a dead blow mallet until it is FLUSH with the end of the tube. If the seal won't seat flush with the end of the tube, you have not got the bearing seated into the axle tube sufficiently.
By the way, check the surface on the axle shaft where the bearing rollers ride. If the shaft is scored, heat damaged, or exhibits spalling, the shaft must be replaced, or the axle will trash the new bearing in short order.