cultural reviewer and dabbler in stylistic premonitions

  • 233 Posts
  • 524 Comments
Joined 5 years ago
cake
Cake day: January 17th, 2022

help-circle

  • In the spirit of open-source OP asked if people want to contribute their time. You wouldn’t flame any other foss project this hard for simply being unfinished.

    asking strangers to review your LLM outputs without informing them that some (or in this case, most) of it has never been reviewed by any human before, is not at all in the “spirit of open-source”. This website continues to be very misleading: it says “Learn math and science by doing. Bite-sized, hands-on lessons. Drag, predict, and solve your way to real understanding. Free for everyone.” and has a “Start learning” button. The disclaimer which OP added on the About page absolutely needs to be moved to the front page, where everybody will see it before they see a pitch implying that this is ready to go.

    @kiarash@lemmy.world when i undeleted your post before, after you added the “less than a third” disclosure on the About page, I told you in a PM that that was insufficient and I see now you have still not fixed it so I am sorry but I am going to delete this post again. Send me a PM if/when you make the disclosure of what this actually is far more prominent. I suggest showing your agent my comments and asking it if this is reasonable and if your disclosures are sufficiently prominent.



  • Hi, i’m an admin on the lemmy.ml instance where you also posted this.

    You asked in your other post in !privacy@lemmy.ml (which I was going to delete for being privacy snake-oil, but someone else beat me to it):

    what would you want from a tool like this to trust it?

    For one thing, I would want the ability to download the whole thing (models included) in a single step, to be able to actually be sure I’m using this offline (without taking my computer offline).

    Using this kind of “nothing is uploaded, we promise” application on a website leaves the user relying on the website to keep its promise: even if the javascript has been reviewed and doesn’t usually upload a file, a user can’t ever be sure (without going offline after loading the page, which is very inconvenient and also a fragile guarantee at best given webworkers and various other browser technology) that the server isn’t sending some different javascript this time which will actually exfiltrate their secrets.

    I also don’t want an AppImage, because then I would need to trust you much more - an AppImage can do far more damage than a malicious webpage! And also I see your AppImage is only 170MB, so it obviously doesn’t include all of the models… so it itself also needs internet access.

    If what the site says is true, I should be able to host the whole thing with a local static webserver and access it using a browser which I deny internet access to (eg configure it to use a nonexistent proxy and let connections to 127.0.0.1 bypass the proxy, or, better, run it in a different network namespace where it cannot reach the internet at all). If you have some way to predownload all of the models for people to use this in an offline browser like this, you should make that clearer and easier to find.

    But, beyond that, I think you’ve also got a long way to go before you can credibly suggest this as a security and privacy tool. I’ve only had a quick glance at what you’ve built so far, and the breadth of features is certainly amazing.

    However your first (and so far only) tool which I actually looked somewhat closely at - “Secret Note Link”, source code here - is misleading users by offering them an “expiry” feature which is trivially circumventable. This is obvious to any technically savvy user who thinks for a moment about the impossibility of enforcing an expiry policy in this context (where the data is stored in the URL and not on a server), but i think the overwhelming majority people seeing this feature will not infer its pointlessness and will assume incorrectly that it actually works. This incorrect assumption is reinforced by the fact that this privacy-cosplay expiration feature is for some inexplicable reason enabled by default, with a one day expiration.

    It’s also weird to be hyping the AES aspect of your “secret link” when the default setting is to use no passphrase (which, looking at the source code, I see means that you still encrypt but with a random key which you include in the url fragment alongside the ciphertext). Without a passphrase, maintaining the secrecy of the link is all that can keep the payload secret. Encryption provides no benefit whatsoever in that case; you may as well just gzip and base64 the plaintext and put that in the fragment instead instead of using AES… or, just send the plaintext instead of sending a “secret” link at all (although given the way mobile phones work having a way to send base64-encoded text is maybe actually useful 🤡). The pointlessness of the encryption here is obvious to some people, but not to most of your target audience.

    screenshot of 'Secret Note Link' as it looked at the time this comment was written

    screenshot of website, including text "Turn a password or private message into an encrypted link that only opens in the browser, with an optional password and expiry." and "AES-256-GCM in your browser. The whole note lives inside the link, nothing is stored anywhere. Anyone who has the full link (and password) can read it, so share it only with the right person. Expiry is checked when the link is opened." and "expires after" control set to 1 day.

    I think you should remove the expiry and no-passphrase key-concatenated-with-ciphertext features altogether, and ask your agent to review all of the other tools in light of this feedback to look for and remediate similar cases of snake oil.

    I was going to remove your post from !privacy@lemmy.ml but leave the one in !opensource@lemmy.ml, but someone else removed both while I was writing this. I was going to say about the latter: I removed your post in !privacy@lemmy.ml but I’m leaving this one for now on the assumption that many of the tools that you have created are probably actually useful. fyi you should know that you’re probably going to receive a lot of negative feedback posting this here (see the discussion in the post currently pinned at the top of this (/c/opensource) community).

    I think you probably have good intentions so I am unbanning you from lemmy.ml (but not undeleting your posts to communities on this instance), and I’m posting this comment here in another community on another instance instead.

    HTH.


  • I agree. I’ll make the modifications later. Thank you.

    Thanks, glad to hear it.

    How much later, though? If it’s not soon, I think I will delete this post for now (i’m an admin on the home instance of this community). You can still edit it while the post is deleted but only you and mods and admins will be able to see it; send me a message after your edits are made and I’ll undelete it.

    To be clear what I am asking for is an early/prominent/clear disclosure, both on the website and in the body of this lemmy post, of the percentage of the lessons which you estimate have not yet been carefully read by you (or presumably anyone else).

    Thank you, and I hope this isn’t too discouraging!


  • Are you sure? […] I think the server itself may actually be GitHub somehow?

    Yes, as i said:

    When you use it on the web, there is a server serving it (the static files) to you.

    And that server is github pages - one of microsoft’s free static web hosting services.

    This is might seem inconsistent with what OP said:

    It’s a static site with no servers or accounts, so it costs almost nothing to run

    … but it isn’t really imo. You always need some kind of server to put something on the web for the world (using a normal web browser without installing something else) to be able to access it; what they mean by “no servers” here is that (1) there is no logic on the server, the server just serves a static web page, and (2) you can easily get the static files yourself and serve them yourself (or browse them from your filesystem without even serving them).




  • That’s why community contribution will be really important here.

    requiring a github account to contribute is a major friction point; i highly recommend that you build something to allow people to give you feedback without requiring them to make an account with microsoft or anything else.

    also, the website says:

    AI tools helped us build this many lessons quickly. What turns a good lesson into a great one is human insight: the moment a step confused you, a clearer example, a mistake only a careful reader spots. OpenAha is open source, and every suggestion is read.

    but you go much further in this lemmy comment and acknowledge:

    I’ve already read through at least 30% of all the pages myself.

    I think you really need to clearly disclose early - not only in this lemmy post but also on the website itself - that most (or any at all, if/when you’ve read most) of the lessons have not yet been read by any human at all.

    Asking teachers to try this with their students without disclosing this crucial fact is not really OK.



  • Regarding my background, my full name is publicly visible on github. You can search that up to see some of my background, education and activities. I have talked to some teachers about this and used their feedbacks, but there’s still a long way to go. I can’t foresee the future, but I’m serious about exploring this projects potential.

    I'm going to interpolate that answer into answers to my questions, let me know if i've gotten anything wrong:

    Are you an educator?

    No.

    And/or do you have connections with educators who plan to use this with students?

    None with plans to use it.

    Is this a solo project so far?

    Yes.

    What is the likelihood that you’ll get bored and abandon this project in a week or a month from now?

    High.

    I’m sorry to be so negative here; from what i can tell what you’ve built seems quite impressive for a solo project in such a short time. Maybe I’m wrong and this is the next Khan Academy, but I am sadly not optimistic about this evolving into something which is useful for many people.

    … but speaking of Khan Academy, why not try to build things with them instead of starting a new thing from scratch? (i don’t actually know much about them besides that they’ve been around a long time and have a good reputation from what i can tell)


  • I tried your first example, the planar graphs one. It made some sense until the “How many lines fit?” challenge which asks “What is the largest number of edges a planar graph with 10 vertices can have?” - the earlier steps do not remotely explain how to figure out the answer to this question, nor does the hint given when an incorrect answer is entered.

    And it’s the same with the next challenge after it: “A football is stitched from pentagons and hexagons, with three patches meeting at every corner. Engineers design geodesic domes and virus shells the same way, some with hundreds of hexagons. However many hexagons there are, how many pentagons must such a closed ball have?” - there is nothing earlier to prepare someone to answer this question (except for the fact that this challenge is titled “Always twelve” and the answer is in fact 12 😂).

    I’m curious about your background and plans for this project. Are you an educator? And/or do you have connections with educators who plan to use this with students? Is this a solo project so far? What is the likelihood that you’ll get bored and abandon this project in a week or a month from now? It is difficult for me to imagine many strangers on the internet volunteering their time to help you develop this when your website doesn’t preemptively provide answers to these and other questions.

    tbh I am very tempted to remove this post from !opensource@lemmy.ml 🤔







  • please don’t put your citation as the title

    sorry i forgot the rules in this comm; i edited the post to put just the article title as the post title and quote the first two paragraphs in the post body

    what attracts you to that article and what, according to you, is worth other’s attention?

    the interestingness seems self-evident in this case, but what caused me to post it specifically now was being reminded of it by a comment which mentioned it recently (which i can’t find now) which pointed out that as LLMs become more efficient, it’s unlikely that will lead to a reduction in overall power consumption as the increase in use of them will outpace the efficiency improvements.

    While failing to find that comment I just found another one citing Jevon’s paradox in the context of cost and demand for software development.









  • It actually was their slogan back then

    which period “back then” are you referring to? 1976 maybe? the Apple I was affordable (at just $666.66 😄) compared to other kits at the time, but the Apple II (1977) cost more than twice what a TRS-80 did and afaik since then Apple has always positioned itself as a premium brand.

    i don’t recall them ever having a price-related marketing slogan or campaign, but maybe i’m forgetting something?