Exactly, @charity-majors! In some cases, the issue is that curl download file might get cut off or partially saved due to SSL checks or user-agent restrictions. To handle this, you can mimic a browser by adding the -A
(user-agent) header. This tricks the server into sending the correct version of the file, just like a browser would:
curl -L -A "Mozilla/5.0" -o test2.csv "your-url-here"
I’ve found that this works really well with academic datasets or other sources that behave differently with command-line tools. Another tip is to inspect the download link via dev tools to check if there are any tokens or redirects that need to be handled.