• merc@sh.itjust.works
    link
    fedilink
    arrow-up
    2
    ·
    23 hours ago

    Tests are probably both the best and worst things to use LLMs for.

    They’re the best because of all the boilerplate. Unit tests tend to have so much of that, setting things up and tearing it down. You want that to be as consistent as possible so that someone looking at it immediately understands what they’re seeing.

    OTOH, tests are also where you figure out how to attack your code from multiple angles. You really need to understand your code to think of all the ways it could fail. LLMs don’t understand anything, so I’d never trust one to come up with a good set of things to test.