M1 agents often crash with segfaults during compilation

[paulbrauner-da]

The errors look like this:

ERROR: /Users/vsts/agent/_work/1/s/sdk/daml-assistant/daml-helper/BUILD.bazel:123:16: HaskellLinkBinary daml-assistant/daml-helper/test-deployment failed: (Exit 1): ghc_wrapper failed: error executing command 
  (cd /private/var/tmp/_bazel_vsts/cd6b383638c28c5d683465b14b6fc513/sandbox/processwrapper-sandbox/5/execroot/com_github_digital_asset_daml && \
  exec env - \
    CC_WRAPPER_CC_PATH=external/local_config_cc/cc_wrapper.sh \
    CC_WRAPPER_CPU=darwin_arm64 \
    CC_WRAPPER_PLATFORM=darwin \
    LANG=C.UTF-8 \
    MUST_EXTRACT_ABI=false \
    PATH=/nix/store/j84snzhwac2vn7mr5zx635ssjzxpdp1h-posix-toolchain/bin \
    RULES_HASKELL_DOCDIR_PATH=/nix/store/4q7mz5ijbz4iww7kjwr55nz2f6wydfpz-ghc-native-bignum-9.0.2-doc/share/doc/ghc-native-bignum/html/libraries/base-4.15.1.0 \
    RULES_HASKELL_GHC_PATH=external/rules_haskell_ghc_nixpkgs/bin/ghc \
    RULES_HASKELL_GHC_PKG_PATH=external/rules_haskell_ghc_nixpkgs/bin/ghc-pkg \
    RULES_HASKELL_LIBDIR_PATH=/nix/store/lwx7h4jpf4qgry7vygqf48mpvyflclxp-ghc-native-bignum-9.0.2/lib/ghc-9.0.2 \
  bazel-out/host/bin/external/rules_haskell/haskell/ghc_wrapper bazel-out/darwin_arm64-opt/bin/daml-assistant/daml-helper/compile_flags_test-deployment__HaskellLinkBinary bazel-out/darwin_arm64-opt/bin/daml-assistant/daml-helper/extra_args_test-deployment__HaskellLinkBinary)
# Configuration: 260697b05a953898f874496667781501d5e3172909775dfe8781c23f8772be82
# Execution platform: @rules_nixpkgs_core//platforms:host

This may be due to stack size, see NixOS/nixpkgs#149692 (comment).

Another thing we may try to fix it is to run the native m1 azure agent instead of the intel one on top of rosetta.