This simplifies the build and should speed it up a bit because the
standard library doesn't need to be cross compiled on the 32bit builder.