LITIG’s AI benchmarking working group led by CMS chief innovation and knowledge officer John Craske has launched a draft AI Glossary of Terms, which is the first step in its bid to improve AI literacy, understanding, standardisation of terms and adoption across the legal industry. LITIG is the Legal IT Innovators Group – an independent, not-for-profit organisation to support senior legal technology, operations and innovation professionals.
In an update yesterday (18 February) to the LITIG AI Benchmarking LinkedIn group, Craske, who formed the working AI group in June 2024, said that the working group had met a couple of times to turn output from initial brainstorming sessions into action.
“As well as striving to improve AI literacy and adoption across the industry, the working group’s first objective was to ensure we are all using the same language and meaning when we’re talking about artificial intelligence. As our first output, I’m pleased to be able to share the first draft of a Glossary of Terms,” he said.
The terms range from Accuracy to Weights. While many of the terms of relevant to AI generally, entries such as ‘hallucination’ and ‘prompt engineering’ are specific to GenAI. You can see the list in full here: DRAFT – Glossary of Terms – LITIG AI Benchmarking
Craske said: “We welcome your thoughts and feedback on the Glossary and these definitions, especially when considering how you and those around you talk about and adopt AI. We will collate all the feedback and review it over the next month or so to inform the next version.” Jo Owen, formerly CIO of Cripps, was in October last year brought in as project manager and you can send any feedback to Jo on [email protected]
One of the working group’s next steps is to create an online space for this glossary and other working group updates and collateral.
The working group are now turning their attention to defining principles for transparency of AI tools. That will include a high-level transparency charter and a more detailed template statement or ‘model card’ (see here for background for how model cards are used in another context: Google Model Cards), which will set out the information expected from tool vendors.
If you haven’t yet joined the LITIG benchmarking LinkedIn group you can join here: https://www.linkedin.com/groups/13127037/