• gaylord_fartmaster@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    If we had that, LLMs could just improve themselves directly, bypassing any need for prompt engineering in the first place.

    Yep, exactly, and it’s been studied and put in to practice effectively already.

    Prompt tuning is not the only way to fine tune the output of an LLM, and since the goal for most is going to be to make them usable by anyone, that’s going to be the least desirable route.

    • Blóðbók@slrpnk.net
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      1 year ago

      I know LLMs are used to grade LLMs. That isn’t solving the problem, it’s just better than nothing because there are no alternatives. There aren’t enough humans willing to endlessly sit and grade LLM responses.