• 1 Post
  • 14 Comments
Joined 2 years ago
cake
Cake day: July 10th, 2023

help-circle









  • More than fair, how much effort do we put in to make sure the ants have a comfortable life? Or even further, the tardigrades? I am on the optimistic side, hoping that a superintelligence holds a benevolent nostalgia/amusement for sentient life if it does indeed come to that.

    There’s a chance that asi doesn’t happen and we stall indefinitely on a simple token prediction system, in which case the disruption could be limited to what we’ve seen already?



  • I do this on my ultra, token speed is not great, depending on the model of course, a lot of source code sets are optimized for Nvidia and don’t even use native Mac gpu without modifying the code, defaulting to cpu. I’ve had to modify about half of what I run

    Ymmv but I find it’s actually cheaper to just use a hosted service

    If you want some specific numbers lmk