We, the Law Librarian Benchmarking Group, started with what seemed like an easy enough task: Create simple tools that law librarians can use to benchmark the latest AI research tools so they can choose the best ones for their work.  But with AI changing faster than even the most enthusiastic afficiandos can keep pace with, we've found ourselves diverging from our original mission to focus more on benchmarking in general.  

In this session we'll:

  • Discuss past and present benchmarking best practices
  • Analyze various attempts to benchmark legal research tools - what worked, and what missed the mark?
  • Explore future ideas about benchmarking and how it applies to legal research

 

[Debbie will be live, the others remote]

Speaker