So, what I want is to download lemmy posts (including comments) as raw html through a script. The problem I have is, that curl by default does not include the css of the page. Is there a way I can download the posts webpages as they are being displayed?

  • apparia@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 days ago

    If this is what you are seeing that makes it “not work”:

    It seems to be implemented in a script that runs when the saved page loads and hides the content, even though that content is actually there. You can tell wget to ignore scripts (which aren’t very useful in a download anyway, as they mostly pertain to interactivity) with --reject js. I tried this and was able to view the downloaded post properly.

    I’ve no idea why the script does that, one could probably look at the lemmy-ui source code to figure it out.