Cfrtjryk

I am trying to do this:

function download() {

  wget 

    -r 

    -c 

    -A .zip,.html,.jsp,.php,.cgi 

    --reject-regex "(.*)?(.*)" 

    --secure-protocol=TLSv1_2 

    "$1"

}

The problems I'm facing are:

1. I only want the .zip files.


2. The .zip files are linked to on the "HTML" pages, which can be found under URLs such as /foo, /foo.html, /foo.jsp, /foo.php, /foo.cgi, and a few others I am not aware of I'm sure.

So I am trying to say: "Visit every HTML link, but download every .zip file." Wondering how to do this properly with wget. I am also skipping visiting the URL parameter links because currently it downloads them all, but if there is a better way to handle this (such as just collecting the links from them and not downloading them, that would be good to know).

The above doesn't work because it misses links without an extension like /foo. Plus, I don't want to save the php and other files, just the zip ones. Right now I am just leaving off the -A and downloading everything, then removing it in an custom run script after wget finishes which doesn't seem right. Basically just wondering how to do this correctly with wget.