Problem:
Users may see slower upload speeds when transferring files to S3 on AWS in a job using an m1 macOS image. This is due to an issue with the virtualization framework used on the macOS machines.
Solutions:
-
Disable TSO (TCP segmentation offload)
- To disable TSO, please add the following run step in your job before any steps interacting with S3:
- run: sudo sysctl net.inet.tcp.tso=0
- To disable TSO, please add the following run step in your job before any steps interacting with S3:
Outcome:
After disabling TSO, users will see transfer speeds similar to those of other executors.
Comments
Article is closed for comments.