This isn’t quite the comparison you make it out to be.
Bone has great compressive strength, but two thirds the tensile strength and one third the shear strength.
Bending strength is one of the most common forces exerted on objects. This involves both compressive and tensile strengths. Because they differ you tend towards the lower value as it is unlikely you’ll find yourself in a strictly compressive situation. You just cut the strength down by a third, and bending forces (torque or moment) are exponential in magnitude so that strength goes away quickly as you make the bones longer.
Shear strength comes in on forces not along the axis. So, if you aren’t bending the bone but pressing against it your strength is one third.
As you can see you get away from that great compressive strength quickly.
Also, concrete. Modern concrete has great compressive strength but poor tensile and shear strength rather like bone. But, we add steel reinforcement to handle the tensile and shear forces. So, if we were to reinforce bone rather like concrete you would be correct in that animals would be able to grow a great deal larger.
