This page looks best with JavaScript enabled

AWS s3 下载

 ·  ☕ 1 min read

创建AWS账户

创建组

进入控制台:https://console.aws.amazon.com/

1.jpg

创建组

2.jpg

设置组名

3.jpg

设置策略:s3-readonly和审核

4.jpg

5.jpg

创建用户

6.jpg

设置用户名,访问权限

7.jpg

将用户添加到组

8.jpg

之后一路next,直到获得访问密钥

9.jpg

安装CLI

https://docs.aws.amazon.com/cli/latest/userguide/install-cliv2-windows.html
https://awscli.amazonaws.com/AWSCLIV2.msi

配置CLI

将前面的访问ID和私有访问密钥

10.jpg

aws s3命令下载数据集

1
aws s3 cp "s3://ml-inat-competition-datasets/2021/train.tar.gz" ./ --recursive

11.jpg

加速

https://blog.csdn.net/xuanwu_yan/article/details/79160034

修改配置文件vim ~/.aws/config,末尾加入

[default]
output = json 
s3 = 
  max_concurrent_requests =500 
  max_queue_size = 10001 
  multipart_threshold = 500MB
Share on

MiaoMiaoYang
WRITTEN BY
MiaoMiaoYang