• RustyEarthfire@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    2 months ago
    1. The bar exam is just one part of a larger set of qualifications
    2. The bar exam is just a (closed-book) proxy for the actual skills and knowledge being tested. While a reasonable proxy for humans, it is a poor proxy for computers
    • UraniumBlazer@lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      2 months ago

      Ok. What test would an LLM need to pass to convince you that it capable of being a lawyer?

      • RustyEarthfire@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 months ago

        The short answer is being admitted by the bar; we already trust them to certify humans.

        If for some reason I were arbiter, I would say a convincing record of doing actual legal work, vetted by existing lawyers. The legal profession already has a well-defined model of how non-lawyers can contribute to the work, so there is no need for a quantum leap up to being a lawyer.