• 0 Posts
  • 18 Comments
Joined 1 year ago
cake
Cake day: June 11th, 2023

help-circle

  • IDe@lemmy.onetoGo - Weiqi - Baduk@lemmy.mlHow do you use AI to train?
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    11 months ago

    One thing AI has taught me is that it’s not really about the specific move (unless it’s life and death), but about direction. Almost always playing roughly in the correct direction results in +/- 2 point changes at best, whereas wrong direction, even if it’s locally good can easily cost you 5-10 points. It really helped me stop fussing over the “correct sequence”/joseki/fuseki and focus on mistakes that were actually costing me the games.

    For training my intuition I find replaying/memorizing pro games is still far more effective, since the moves follow human reasoning and shapes. AI seems to work best as a review tool for finding/exploring mistakes.









  • The problem with the line of thinking that this is some sort of deception or a trap, is that none of what is happening here is working towards anything. You simply can’t do surprise troop movements in the age of GEOINT, nor are intelligence agencies so single-minded you could “distract” them with a fake coup, nor does this have any effect on the current Ukrainian offensive. The supposed trap is missing the “trap” part.









  • Most of the data used in training GPT4 has been gathered through open initiatives like Wikipedia and CommonCrawl. Both are freely accessible by anyone. As for building datasets and models, there are many non-profits like LAION and EleutherAI involved that release their models for free for others to iterate on.

    While actually running the larger models at a reasonable scale will always require expensive computational resources, you really only need to do the expensive base model training once. So the cost is not nearly as expensive as one might first think.

    Any headstart OpenAI may have gotten is quickly diminishing, and it’s not like they actually have any super secret sauce behind the scenes. The situation is nowhere as bleak as you make it sound.

    Fighting against the use of publicly accessible data is ultimately as self-sabotaging as fighting against encryption.