How can I download data with CLI?

Sound Demixing Challenge 2023
#1

Hello,
I tried to download the data with CLI, and I found the name of the completion in the list, but the list was empty. Is there any way that I could download the dataset with CLI? Would you please provide a code snippet for it?

Cheers,
Hadi

#2

Hi,

I started the download on my Windows Chrome browser, then copied the actual s3 download link from the downloading file, canceled it, and used curl/wget with that URL in the terminal.

If you copy the link address from the resources page here, it does not resolve to the actual file URL, so I let the browser resolve the final URL and used that.

Also, don’t forget to put the URL inside double quotes, otherwise, it throws command not found errors for parts of the URL.

#3

Thanks, it worked perfectly :slight_smile:

1 Like
#4

Hi,

I tried the way as @subatomicseer said, but it didn’t work.
I got 403 Forbidden error after running the following command.
How can I solve it?

$ wget “https://sdx-2023-data-bucket.s3.amazonaws.com/music-demixing/sony/bleeding/v1.0-rc1/sdxdb23_bleeding_v1.0_rc1.zips”

output:
–2023-04-03 23:46:59-- https://sdx-2023-data-bucket.s3.amazonaws.com/music-demixing/sony/bleeding/v1.0-rc1/sdxdb23_bleeding_v1.0_rc1.zips
Resolving sdx-2023-data-bucket.s3.amazonaws.com (sdx-2023-data-bucket.s3.amazonaws.com)… 52.219.47.173
Connecting to sdx-2023-data-bucket.s3.amazonaws.com (sdx-2023-data-bucket.s3.amazonaws.com)|52.219.47.173|:443… connected.
HTTP request sent, awaiting response… 403 Forbidden
2023-04-03 23:47:00 ERROR 403: Forbidden.

#5

You should use the complete URL, including everything after a “?” mark in the URL.

When you start downloading on Chrome, it will append some authentication information and tokens to the end of the url.

#6

Thank you for your reply.

The problem has been solved.
I also tried the complete URL before you mentioned, but the authentication had expired.

1 Like