I believe the problem was not the bandwith usage (which would be saved by a CDN) but the way CocoaPods is using git that generates a lot of CPU expensive operations.

Things that GitHub suggested help with that: faster check for updates, breaking up big directories so diffs are computed faster.