Troubleshooting slow uploads to S3 for jobs using an m1 macOS resource class

Problem:

Users may see slower upload speeds when transferring files to S3 on AWS in a job using an m1 macOS image. This is due to an issue with the virtualization framework used on the macOS machines.

Solutions:

  • Disable TSO (TCP segmentation offload)

    • To disable TSO, please add the following run step in your job before any steps interacting with S3:
      - run: sudo sysctl net.inet.tcp.tso=0

Outcome:

After disabling TSO, users will see transfer speeds similar to those of other executors.

Was this article helpful?
3 out of 3 found this helpful

Comments

0 comments

Article is closed for comments.