创建AWS账户
创建组
进入控制台:https://console.aws.amazon.com/

创建组

设置组名

设置策略:s3-readonly和审核


创建用户

设置用户名,访问权限

将用户添加到组

之后一路next,直到获得访问密钥

安装CLI
https://docs.aws.amazon.com/cli/latest/userguide/install-cliv2-windows.html
https://awscli.amazonaws.com/AWSCLIV2.msi
配置CLI
将前面的访问ID和私有访问密钥

aws s3命令下载数据集
| |

加速
https://blog.csdn.net/xuanwu_yan/article/details/79160034
修改配置文件vim ~/.aws/config,末尾加入
[default]
output = json
s3 =
max_concurrent_requests =500
max_queue_size = 10001
multipart_threshold = 500MB