Different page from a browser and wget











up vote
0
down vote

favorite












I have a very curious case that has dumbfounded me.



Here is the address that I try to access, or rather certbot is trying to access:



http://promobuilder.co.uk/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU



And when he does he gets a page like this:



<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Frameset//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-frameset.dtd">

<html>
<head>
<title>Promo Builder</title>
<meta name="keywords" content="ECD Promo Builder for the electrical wholesale industry" />
<meta name="description" content="ECD Promo Builder for the electrical wholesale industry" />
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
</head>
<frameset rows="100%">
<frame src="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU" title="Promo Builder" frameborder="0" noresize="noresize"/>
<noframes>
<body>
<h1>Promo Builder</h1>
<p><a href="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU">http://promobuilder.co.uk/</a></p>
</body>
</noframes>
</frameset>
</html>


However, this is not what he should see and when I try accessing the same site via browser I get a text file that I have put there (obviously not what certbot expects but its different to what it sees anyway):



In a browser you will see this text...


It's easy to replicate - when I run wget from any server I get the same frameset but when I open via browser, even through proxy I get the In a browser...



There are no frames anywhere on the site... where do they come from?



As you will notice there is a different domain in the iframe src: mymediahub.co.uk - this is a domain of the same company so it makes me think perhaps this has something to do with DNS settings? But I had no idea DNSes could do such things... can anoying please shed a light?



CLARIFICATIONS:



I get the file even via the incognito mode so no cookies involved.



And even if my browser is showing something that it should not I am confident that the server itself does not have/point at/redirect to any frames... where can this framed page be coming from?










share|improve this question









New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 2




    different User-Agent
    – Ipor Sircer
    9 hours ago










  • Can't confirm you get the text file in a browser. If you have a login cookie set, the server could spot that even when you go through a proxy.
    – Ulrich Schwarz
    9 hours ago










  • @IporSircer what does this mean and how does it help me?
    – RandomWhiteTrash
    8 hours ago















up vote
0
down vote

favorite












I have a very curious case that has dumbfounded me.



Here is the address that I try to access, or rather certbot is trying to access:



http://promobuilder.co.uk/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU



And when he does he gets a page like this:



<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Frameset//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-frameset.dtd">

<html>
<head>
<title>Promo Builder</title>
<meta name="keywords" content="ECD Promo Builder for the electrical wholesale industry" />
<meta name="description" content="ECD Promo Builder for the electrical wholesale industry" />
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
</head>
<frameset rows="100%">
<frame src="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU" title="Promo Builder" frameborder="0" noresize="noresize"/>
<noframes>
<body>
<h1>Promo Builder</h1>
<p><a href="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU">http://promobuilder.co.uk/</a></p>
</body>
</noframes>
</frameset>
</html>


However, this is not what he should see and when I try accessing the same site via browser I get a text file that I have put there (obviously not what certbot expects but its different to what it sees anyway):



In a browser you will see this text...


It's easy to replicate - when I run wget from any server I get the same frameset but when I open via browser, even through proxy I get the In a browser...



There are no frames anywhere on the site... where do they come from?



As you will notice there is a different domain in the iframe src: mymediahub.co.uk - this is a domain of the same company so it makes me think perhaps this has something to do with DNS settings? But I had no idea DNSes could do such things... can anoying please shed a light?



CLARIFICATIONS:



I get the file even via the incognito mode so no cookies involved.



And even if my browser is showing something that it should not I am confident that the server itself does not have/point at/redirect to any frames... where can this framed page be coming from?










share|improve this question









New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 2




    different User-Agent
    – Ipor Sircer
    9 hours ago










  • Can't confirm you get the text file in a browser. If you have a login cookie set, the server could spot that even when you go through a proxy.
    – Ulrich Schwarz
    9 hours ago










  • @IporSircer what does this mean and how does it help me?
    – RandomWhiteTrash
    8 hours ago













up vote
0
down vote

favorite









up vote
0
down vote

favorite











I have a very curious case that has dumbfounded me.



Here is the address that I try to access, or rather certbot is trying to access:



http://promobuilder.co.uk/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU



And when he does he gets a page like this:



<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Frameset//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-frameset.dtd">

<html>
<head>
<title>Promo Builder</title>
<meta name="keywords" content="ECD Promo Builder for the electrical wholesale industry" />
<meta name="description" content="ECD Promo Builder for the electrical wholesale industry" />
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
</head>
<frameset rows="100%">
<frame src="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU" title="Promo Builder" frameborder="0" noresize="noresize"/>
<noframes>
<body>
<h1>Promo Builder</h1>
<p><a href="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU">http://promobuilder.co.uk/</a></p>
</body>
</noframes>
</frameset>
</html>


However, this is not what he should see and when I try accessing the same site via browser I get a text file that I have put there (obviously not what certbot expects but its different to what it sees anyway):



In a browser you will see this text...


It's easy to replicate - when I run wget from any server I get the same frameset but when I open via browser, even through proxy I get the In a browser...



There are no frames anywhere on the site... where do they come from?



As you will notice there is a different domain in the iframe src: mymediahub.co.uk - this is a domain of the same company so it makes me think perhaps this has something to do with DNS settings? But I had no idea DNSes could do such things... can anoying please shed a light?



CLARIFICATIONS:



I get the file even via the incognito mode so no cookies involved.



And even if my browser is showing something that it should not I am confident that the server itself does not have/point at/redirect to any frames... where can this framed page be coming from?










share|improve this question









New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











I have a very curious case that has dumbfounded me.



Here is the address that I try to access, or rather certbot is trying to access:



http://promobuilder.co.uk/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU



And when he does he gets a page like this:



<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Frameset//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-frameset.dtd">

<html>
<head>
<title>Promo Builder</title>
<meta name="keywords" content="ECD Promo Builder for the electrical wholesale industry" />
<meta name="description" content="ECD Promo Builder for the electrical wholesale industry" />
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
</head>
<frameset rows="100%">
<frame src="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU" title="Promo Builder" frameborder="0" noresize="noresize"/>
<noframes>
<body>
<h1>Promo Builder</h1>
<p><a href="https://mymediahub.co.uk/site/login/ecd/.well-known/acme-challenge/ZdkjhzbZ27ffIUOSRucMCy-zPOwikmAkj_DwNVC5LdU">http://promobuilder.co.uk/</a></p>
</body>
</noframes>
</frameset>
</html>


However, this is not what he should see and when I try accessing the same site via browser I get a text file that I have put there (obviously not what certbot expects but its different to what it sees anyway):



In a browser you will see this text...


It's easy to replicate - when I run wget from any server I get the same frameset but when I open via browser, even through proxy I get the In a browser...



There are no frames anywhere on the site... where do they come from?



As you will notice there is a different domain in the iframe src: mymediahub.co.uk - this is a domain of the same company so it makes me think perhaps this has something to do with DNS settings? But I had no idea DNSes could do such things... can anoying please shed a light?



CLARIFICATIONS:



I get the file even via the incognito mode so no cookies involved.



And even if my browser is showing something that it should not I am confident that the server itself does not have/point at/redirect to any frames... where can this framed page be coming from?







linux dns wget http certbot






share|improve this question









New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question









New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question








edited 8 hours ago





















New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 9 hours ago









RandomWhiteTrash

1012




1012




New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








  • 2




    different User-Agent
    – Ipor Sircer
    9 hours ago










  • Can't confirm you get the text file in a browser. If you have a login cookie set, the server could spot that even when you go through a proxy.
    – Ulrich Schwarz
    9 hours ago










  • @IporSircer what does this mean and how does it help me?
    – RandomWhiteTrash
    8 hours ago














  • 2




    different User-Agent
    – Ipor Sircer
    9 hours ago










  • Can't confirm you get the text file in a browser. If you have a login cookie set, the server could spot that even when you go through a proxy.
    – Ulrich Schwarz
    9 hours ago










  • @IporSircer what does this mean and how does it help me?
    – RandomWhiteTrash
    8 hours ago








2




2




different User-Agent
– Ipor Sircer
9 hours ago




different User-Agent
– Ipor Sircer
9 hours ago












Can't confirm you get the text file in a browser. If you have a login cookie set, the server could spot that even when you go through a proxy.
– Ulrich Schwarz
9 hours ago




Can't confirm you get the text file in a browser. If you have a login cookie set, the server could spot that even when you go through a proxy.
– Ulrich Schwarz
9 hours ago












@IporSircer what does this mean and how does it help me?
– RandomWhiteTrash
8 hours ago




@IporSircer what does this mean and how does it help me?
– RandomWhiteTrash
8 hours ago










1 Answer
1






active

oldest

votes

















up vote
0
down vote













I found the reason...



DNS had different IPv4 and IPv6 servers pointed too and my browser was using IPv4 while all the servers I checked used IPv6, certbot included.



Maybe it will help someone else...






share|improve this answer








New contributor




RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.


















    Your Answer








    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "106"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });






    RandomWhiteTrash is a new contributor. Be nice, and check out our Code of Conduct.










     

    draft saved


    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f481626%2fdifferent-page-from-a-browser-and-wget%23new-answer', 'question_page');
    }
    );

    Post as a guest
































    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes








    up vote
    0
    down vote













    I found the reason...



    DNS had different IPv4 and IPv6 servers pointed too and my browser was using IPv4 while all the servers I checked used IPv6, certbot included.



    Maybe it will help someone else...






    share|improve this answer








    New contributor




    RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.






















      up vote
      0
      down vote













      I found the reason...



      DNS had different IPv4 and IPv6 servers pointed too and my browser was using IPv4 while all the servers I checked used IPv6, certbot included.



      Maybe it will help someone else...






      share|improve this answer








      New contributor




      RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















        up vote
        0
        down vote










        up vote
        0
        down vote









        I found the reason...



        DNS had different IPv4 and IPv6 servers pointed too and my browser was using IPv4 while all the servers I checked used IPv6, certbot included.



        Maybe it will help someone else...






        share|improve this answer








        New contributor




        RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
        Check out our Code of Conduct.









        I found the reason...



        DNS had different IPv4 and IPv6 servers pointed too and my browser was using IPv4 while all the servers I checked used IPv6, certbot included.



        Maybe it will help someone else...







        share|improve this answer








        New contributor




        RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
        Check out our Code of Conduct.









        share|improve this answer



        share|improve this answer






        New contributor




        RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
        Check out our Code of Conduct.









        answered 8 hours ago









        RandomWhiteTrash

        1012




        1012




        New contributor




        RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
        Check out our Code of Conduct.





        New contributor





        RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
        Check out our Code of Conduct.






        RandomWhiteTrash is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
        Check out our Code of Conduct.






















            RandomWhiteTrash is a new contributor. Be nice, and check out our Code of Conduct.










             

            draft saved


            draft discarded


















            RandomWhiteTrash is a new contributor. Be nice, and check out our Code of Conduct.













            RandomWhiteTrash is a new contributor. Be nice, and check out our Code of Conduct.












            RandomWhiteTrash is a new contributor. Be nice, and check out our Code of Conduct.















             


            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f481626%2fdifferent-page-from-a-browser-and-wget%23new-answer', 'question_page');
            }
            );

            Post as a guest




















































































            Popular posts from this blog

            Morgemoulin

            Scott Moir

            Souastre