• Finadil@lemmy.world
    link
    fedilink
    arrow-up
    6
    ·
    17 days ago

    Looking at the source they thankfully already use a temp of zero, but max tokens is 320. That doesn’t seem like much for code especially since most symbols are a whole token.