You could probably use the TARGETARCH arg to conditionally install it. Something like this might work: RUN [ "$TARGETARCH" != "arm64" ] || apt-get install -y gcc-aarch64-linux-gnu binutils-aarch64-linux-gnu