Skip to content

Commit bb0542c

Browse files
authored
change underscores to hyphen (#790)
- edit bucket names, underscore to hyphen - fix some wording
2 parents aec35cf + 70071c2 commit bb0542c

File tree

4 files changed

+45
-45
lines changed

4 files changed

+45
-45
lines changed

docs/Storage/Long_Term_Storage/Configuring_s3cmd.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ s3cmd --configure
2222

2323
Enter the following details when prompted in the terminal:
2424

25-
`Access Key`: Your NeSI user ID
25+
`Access Key`: Your username
2626

2727
`Secret Key`: This is the code from the 1-time link in your Freezer allocation email. Please let us know if you need to <a href="mailto:[email protected]?subject=Reset%20Freezer%20Secret%20Key">reset this key</a>.
2828

@@ -31,7 +31,7 @@ Please copy and paste the sections in <span style="color:blue">blue</span>.
3131
<pre><code>Enter new values or accept defaults in brackets with Enter.
3232
Refer to user manual for detailed description of all options.
3333
Access key and Secret key are your identifiers for AWS S3. Leave them empty for using the env variables.
34-
Access Key: <span style="color:green"><b>User ID</b></span>
34+
Access Key: <span style="color:green"><b>Your username</b></span>
3535
Secret Key: <span style="color:green"><b>Your Freezer Secret Key</b></span>
3636
Default Region: <span style="color:blue"><b>akl-1</b></span>
3737
Use "s3.amazonaws.com" for S3 Endpoint and not modify it to the target Amazon S3.

docs/Storage/Long_Term_Storage/Freezer_Guide.md

Lines changed: 31 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ Please note that your bucket has the same name as your Freezer allocation. If yo
3030
List all objects in a bucket.
3131

3232
```sh
33-
s3cmd ls -r -l -H s3://<freezer_bucket>/
33+
s3cmd ls -r -l -H s3://<freezer-bucket>/
3434
```
3535

3636
This can also be used to list all the objects in path.
@@ -49,8 +49,8 @@ s3cmd la
4949
### Storage usage by specific bucket
5050

5151
```sh
52-
s3cmd du -H s3://<freezer_bucket>
53-
7G 1781 objects s3://<freezer_bucket>/
52+
s3cmd du -H s3://<freezer-bucket>
53+
7G 1781 objects s3://<freezer-bucket>/
5454
```
5555

5656
`s3cmd du -H` without specifying a bucket is only available for project owners.
@@ -66,33 +66,33 @@ To transfer files/folders to S3 gateway to be archived. `cd` into where the file
6666

6767
!!! warning
6868

69-
If you have files larger than 10TB you may need to change chunk size, please see the [Large files and Chunk Size](Other_Useful_Commands.md) section for details
69+
If you have files larger than 10TB you may need to change chunk size, please see the [Large files and chunk size](Other_Useful_Commands.md#large-files-and-chunk-size) section for details
7070

7171
```sh
72-
s3cmd put --verbose your_file s3://<freezer_bucket>/your_directory/your_file
72+
s3cmd put --verbose your_file s3://<freezer-bucket>/your_directory/your_file
7373
```
7474

7575
``` out
7676
INFO: Cache file not found or empty, creating/populating it.
7777
INFO: Compiling list of local files...
7878
INFO: Running stat() and reading/calculating MD5 values on 1 files, this may take some time...
7979
INFO: Summary: 1 local files to upload
80-
upload: 'your_file' -> 's3://<freezer_bucket>/your_directory/your_file' [1 of 1]
80+
upload: 'your_file' -> 's3://<freezer-bucket>/your_directory/your_file' [1 of 1]
8181
172202 of 172202 100% in 0s 920.89 KB/s done
8282
```
8383

8484
or folders
8585

8686
```sh
87-
s3cmd put --recursive --verbose yourfolder s3://<freezer_bucket>/your_directory/your_folder/
87+
s3cmd put --recursive --verbose yourfolder s3://<freezer-bucket>/your_directory/your_folder/
8888
```
8989

9090
``` out
9191
INFO: Cache file not found or empty, creating/populating it.
9292
INFO: Compiling list of local files...
9393
INFO: Running stat() and reading/calculating MD5 values on 1 files, this may take some time...
9494
INFO: Summary: 1 local files to upload
95-
upload: 'yourfolder/your_file' -> 's3://<freezer_bucket>/your_directory/your_folder/yourfolder/yourfile' [1 of 1]
95+
upload: 'yourfolder/your_file' -> 's3://<freezer-bucket>/your_directory/your_folder/yourfolder/yourfile' [1 of 1]
9696
172202 of 172202 100% in 0s 1691.71 KB/s done
9797
```
9898

@@ -105,7 +105,7 @@ Partially uploaded files will be deleted automatically.
105105
Synchronize a directory tree to S3 (checks files freshness using size and md5 checksum, unless overridden by options). If you wish to have additional informative output, please use the `--verbose` flag as well.
106106

107107
```sh
108-
s3cmd sync yourfolder s3://<freezer_bucket>/your_directory/your_folder/
108+
s3cmd sync yourfolder s3://<freezer-bucket>/your_directory/your_folder/
109109
```
110110

111111
### Preview or dry-run
@@ -120,54 +120,54 @@ Only shows what should be uploaded or downloaded but doesn't actually do it. May
120120
List contained objects/files/folders:
121121

122122
```sh
123-
s3cmd ls -l -H s3://<freezer_bucket>/your_directory/your_folder/
123+
s3cmd ls -l -H s3://<freezer-bucket>/your_directory/your_folder/
124124
```
125125

126126
``` out
127-
DIR s3://<freezer_bucket>/your_directory/your_folder/MY_TEST/
128-
2025-06-16 23:13 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer_bucket>/your_directory/your_folder/10G_test.file
129-
2025-06-16 23:30 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer_bucket>/your_directory/your_folder/10G_copy.file
130-
2025-06-17 01:26 0 d41d8cd98f00b204e9800998ecf8427e STANDARD s3://<freezer_bucket>/your_directory/your_folder/1test.txt
127+
DIR s3://<freezer-bucket>/your_directory/your_folder/MY_TEST/
128+
2025-06-16 23:13 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer-bucket>/your_directory/your_folder/10G_test.file
129+
2025-06-16 23:30 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer-bucket>/your_directory/your_folder/10G_copy.file
130+
2025-06-17 01:26 0 d41d8cd98f00b204e9800998ecf8427e STANDARD s3://<freezer-bucket>/your_directory/your_folder/1test.txt
131131
```
132132

133133
or all objects recursive -r or --recursive
134134

135135
```sh
136-
s3cmd ls -r -l -H s3://<freezer_bucket>/your_directory/your_folder/
136+
s3cmd ls -r -l -H s3://<freezer-bucket>/your_directory/your_folder/
137137
```
138138

139139
``` out
140-
2025-06-16 23:13 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer_bucket>/your_directory/your_folder/10G_test.file
141-
2025-06-16 23:30 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer_bucket>/your_directory/your_folder/10G_copy.file
142-
2025-06-17 01:31 14 95b28899a460dd8971705dfcd0f5f0d4 STANDARD s3://<freezer_bucket>/your_directory/your_folder/MY_TEST/annotations/3/4/test3.txt
143-
2025-06-17 01:31 14 e76c3a8939fb031bab02a89f6fab520b STANDARD s3://<freezer_bucket>/your_directory/your_folder/MY_TEST/annotations/3/test2.txt
144-
2025-06-17 01:31 14 be2520c884c1be55bab187374a982b12 STANDARD s3://<freezer_bucket>/your_directory/your_folder/MY_TEST/raw_data/test1.txt
145-
2025-06-17 01:26 0 d41d8cd98f00b204e9800998ecf8427e STANDARD s3://<freezer_bucket>/your_directory/your_folder/test/test.txt
140+
2025-06-16 23:13 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer-bucket>/your_directory/your_folder/10G_test.file
141+
2025-06-16 23:30 10G 8add0bf4f023e3dbd36a329d1eae5bbd-684 STANDARD s3://<freezer-bucket>/your_directory/your_folder/10G_copy.file
142+
2025-06-17 01:31 14 95b28899a460dd8971705dfcd0f5f0d4 STANDARD s3://<freezer-bucket>/your_directory/your_folder/MY_TEST/annotations/3/4/test3.txt
143+
2025-06-17 01:31 14 e76c3a8939fb031bab02a89f6fab520b STANDARD s3://<freezer-bucket>/your_directory/your_folder/MY_TEST/annotations/3/test2.txt
144+
2025-06-17 01:31 14 be2520c884c1be55bab187374a982b12 STANDARD s3://<freezer-bucket>/your_directory/your_folder/MY_TEST/raw_data/test1.txt
145+
2025-06-17 01:26 0 d41d8cd98f00b204e9800998ecf8427e STANDARD s3://<freezer-bucket>/your_directory/your_folder/test/test.txt
146146
```
147147

148148
### Restore from tape
149149

150150
It is necessary to restore data from the tape (Glacier) prior to retrieving it. To restore file from Glacier storage:
151151

152152
```sh
153-
s3cmd restore --recursive --verbose s3://<freezer_bucket>/your_directory/data_folder/
153+
s3cmd restore --recursive --verbose s3://<freezer-bucket>/your_directory/data_folder/
154154
```
155155

156156
``` out
157-
INFO: Retrieving list of remote files for s3://<freezer_bucket>/your_directory/your_folder/ ...
157+
INFO: Retrieving list of remote files for s3://<freezer-bucket>/your_directory/your_folder/ ...
158158
INFO: Summary: Restoring 6 remote files for 1 days at Standard priority
159-
restore: 's3://n<freezer_bucket>/your_directory/your_folder/10G.file'
160-
restore: 's3://<freezer_bucket>/your_directory/your_folder/10G_copy.file'
161-
restore: 's3://<freezer_bucket>/your_directory/your_folder/MY_TEST/annotations/3/4/test3.txt'
162-
restore: 's3://<freezer_bucket>/your_directory/your_folder/MY_TEST/annotations/3/test2.txt'
163-
restore: 's3://<freezer_bucket>/your_directory/your_folder/MY_TEST/raw_data/test1.txt'
164-
restore: 's3://<freezer_bucket>/your_directory/your_folder/test.txt'
159+
restore: 's3://n<freezer-bucket>/your_directory/your_folder/10G.file'
160+
restore: 's3://<freezer-bucket>/your_directory/your_folder/10G_copy.file'
161+
restore: 's3://<freezer-bucket>/your_directory/your_folder/MY_TEST/annotations/3/4/test3.txt'
162+
restore: 's3://<freezer-bucket>/your_directory/your_folder/MY_TEST/annotations/3/test2.txt'
163+
restore: 's3://<freezer-bucket>/your_directory/your_folder/MY_TEST/raw_data/test1.txt'
164+
restore: 's3://<freezer-bucket>/your_directory/your_folder/test.txt'
165165
```
166166

167167
By default files will remain in the S3 bucket for 1 day. If longer is required, this can be modified at the time of file restoration:
168168

169169
```sh
170-
s3cmd restore --recursive s3://<freezer_bucket>/your_directory/data_folder/ --restore-days=1
170+
s3cmd restore --recursive s3://<freezer-bucket>/your_directory/data_folder/ --restore-days=1
171171
```
172172

173173
### Get objects after restore
@@ -178,7 +178,7 @@ s3cmd restore --recursive s3://<freezer_bucket>/your_directory/data_folder/ --re
178178
Example to get or download the directory `data_folder` and all contained objects/files/folders:
179179

180180
```sh
181-
s3cmd get --recursive s3://<freezer_bucket>/your_directory/data_folder/
181+
s3cmd get --recursive s3://<freezer-bucket>/your_directory/data_folder/
182182
```
183183

184184
This will place the all files and subdirectories in the above `data_folder` into your current directory.

docs/Storage/Long_Term_Storage/Other_Useful_Commands.md

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -36,39 +36,39 @@ This can be set by using the flag `--multipart-chunk-size-mb=5120` to the comman
3636
Example:
3737

3838
```sh
39-
s3cmd put --multipart-chunk-size-mb=1000 yourfile s3://<freezer_bucket>/your_directory/your_file/ --verbose
39+
s3cmd put --multipart-chunk-size-mb=1000 yourfile s3://<freezer-bucket>/your_directory/your_file/ --verbose
4040
```
4141

4242
``` out
43-
upload: 'your_file' -> 's3://<freezer_bucket>/your_directory/your_file/' [part 1 of 23, 1000MB] [1 of 1]
43+
upload: 'your_file' -> 's3://<freezer-bucket>/your_directory/your_file/' [part 1 of 23, 1000MB] [1 of 1]
4444
1048576000 of 1048576000 100% in 25s 39.62 MB/s done
4545
4646
....
4747
48-
upload: 'your_file' -> 's3://<freezer_bucket>/your_directory/your_file/' [part 23 of 23, 169MB] [1 of 1]
48+
upload: 'your_file' -> 's3://<freezer-bucket>/your_directory/your_file/' [part 23 of 23, 169MB] [1 of 1]
4949
177209344 of 177209344 100% in 4s 35.90 MB/s done
5050
```
5151

5252
## Moving files
5353
To move files within a bucket:
5454

5555
``` sh
56-
s3cmd mv s3://<freezer_bucket>/your_directory/your_file.txt s3://<freezer_bucket>/other_directory/your_file.txt
56+
s3cmd mv s3://<freezer-bucket>/your_directory/your_file.txt s3://<freezer-bucket>/other_directory/your_file.txt
5757
```
5858
``` out
5959
60-
move: 's3://<freezer_bucket>/your_directory/your_file.txt' -> 's3://<freezer_bucket>/other_directory/your_file.txt' [1 of 1]
60+
move: 's3://<freezer-bucket>/your_directory/your_file.txt' -> 's3://<freezer-bucket>/other_directory/your_file.txt' [1 of 1]
6161
```
6262

6363
## Copying files
6464
To make a copy of a file within a bucket to another location:
6565

6666
``` sh
67-
s3cmd cp s3://<freezer_bucket>/your_directory/your_file.txt s3://<freezer_bucket>/your_directory/your_file_copy.txt
67+
s3cmd cp s3://<freezer-bucket>/your_directory/your_file.txt s3://<freezer-bucket>/your_directory/your_file_copy.txt
6868
```
6969

7070
``` out
71-
remote copy: 's3://<freezer_bucket>/your_directory/your_file.txt' -> 's3://<freezer_bucket>/your_directory/your_file_copy.txt' [1 of 1]
71+
remote copy: 's3://<freezer-bucket>/your_directory/your_file.txt' -> 's3://<freezer-bucket>/your_directory/your_file_copy.txt' [1 of 1]
7272
```
7373

7474
## Deleting data
@@ -80,13 +80,13 @@ remote copy: 's3://<freezer_bucket>/your_directory/your_file.txt' -> 's3://<free
8080
Data can be deleted from both the bucket (cache) and from tape (thought this is a flag to overwrite, rather than actual deletion)
8181

8282
```sh
83-
s3cmd rm s3://<freezer_bucket>/your_directory/data_folder/
83+
s3cmd rm s3://<freezer-bucket>/your_directory/data_folder/
8484
```
8585

8686
This command can also be used recursively.
8787

8888
```sh
89-
s3cmd rm --recursive s3://<freezer_bucket>/your_directory/data_folder/
89+
s3cmd rm --recursive s3://<freezer-bucket>/your_directory/data_folder/
9090
```
9191

9292
## s3cmd reference

docs/Storage/Long_Term_Storage/Troubleshooting.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -18,12 +18,12 @@ tmux new -s freezer_transfer
1818
cd /nesi/nobackup/<project_id>/myproject
1919

2020
# put data 'your_folder' into Freezer bucket
21-
s3cmd put --recursive --verbose your_folder s3://<freezer_bucket>/your_directory/your_folder
21+
s3cmd put --recursive --verbose your_folder s3://<freezer-bucket>/your_directory/your_folder
2222
```
23-
To detatch from the current `tmux` session by:
23+
To detach from the current `tmux` session by:
2424
<kbd>ctrl</kbd> + <kbd>b</kbd>, then <kbd>d</kbd>
2525

26-
Detatching the `tmux` session, allows you to close your primary terminal and logoff while the upload continues. 
26+
Detaching the `tmux` session, allows you to close your primary terminal and logoff while the upload continues. 
2727

2828
To reattach to the session:
2929

0 commit comments

Comments
 (0)