Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Evaluating a Legal Argument Program: The BankXX Experiments

Evaluating a Legal Argument Program: The BankXX Experiments In this article we evaluate the BankXX program from several perspectives. BankXX is a case-based legal argument program that retrieves cases and other legal knowledge pertinent to a legal argument through a combination of heuristic search and knowledge-based indexing. The program is described in detail in a companion article in Artificial Intelligence and Law 4: 1--71, 1996. Three perspectives are used to evaluate BankXX:(1) classical information retrieval measures of precision and recall applied against a hand-coded baseline; (2) knowledge-representation and case-based reasoning, where the baseline is provided by the functionality of a well-known case-based argument program, HYPO (Ashley, 1990); and (3) search, in which the performance of BankXX run with various parameter settings, for instance, resource limits, is compared. In this article we report on an extensive series of experiments performed to evaluate the program. We also describe two additional experiments concerning(1) the program's search behavior; and (2) the use of a modified form of precision and recall based on case similarity. Finally we offer some general conclusions that might be drawn from these particular experiments. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Artificial Intelligence and Law Springer Journals

Evaluating a Legal Argument Program: The BankXX Experiments

Download PDF
74 pages

Loading next page...
 
/lp/springer-journals/evaluating-a-legal-argument-program-the-bankxx-experiments-BHQYE7IXqX
Publisher
Springer Journals
Copyright
Copyright © 1997 by Kluwer Academic Publishers
Subject
Computer Science; Artificial Intelligence (incl. Robotics); International IT and Media Law, Intellectual Property Law; Philosophy of Law; Legal Aspects of Computing; Information Storage and Retrieval
ISSN
0924-8463
eISSN
1572-8382
DOI
10.1023/A:1008215000938
Publisher site
See Article on Publisher Site

Abstract

In this article we evaluate the BankXX program from several perspectives. BankXX is a case-based legal argument program that retrieves cases and other legal knowledge pertinent to a legal argument through a combination of heuristic search and knowledge-based indexing. The program is described in detail in a companion article in Artificial Intelligence and Law 4: 1--71, 1996. Three perspectives are used to evaluate BankXX:(1) classical information retrieval measures of precision and recall applied against a hand-coded baseline; (2) knowledge-representation and case-based reasoning, where the baseline is provided by the functionality of a well-known case-based argument program, HYPO (Ashley, 1990); and (3) search, in which the performance of BankXX run with various parameter settings, for instance, resource limits, is compared. In this article we report on an extensive series of experiments performed to evaluate the program. We also describe two additional experiments concerning(1) the program's search behavior; and (2) the use of a modified form of precision and recall based on case similarity. Finally we offer some general conclusions that might be drawn from these particular experiments.

Journal

Artificial Intelligence and Law – Springer Journals

Published: Sep 19, 2004

References

  • Modeling Legal Argument: Reasoning with Cases and Hypotheticals
    Ashley, K. D.
  • Lattice Theory
    Birkhoff, G.
  • An Evaluation of Retrieval Effectiveness for a Full-Text Document-Retrieval System
    Blair, D. C.; Maron, M. E.
  • Building Explanations from Rules and Structured Cases
    Branting, L. K.
  • Gilbert Law Summaries: Contracts
    Eisenberg, M. A.
  • An Artificial Intelligence Approach to Legal Reasoning
    Gardner, A. v.
  • Proceedings of The Thirteenth Annual Conference of the Cognitive Science Society
    Gentner, D.; Forbus, K. D.
  • The New Rhetoric: A Treatise on Argumentation
    Perelman, C.; Olbrechts-Tyteca, L.
  • Proceedings of The Second International Conference on AI and Law
    Rissland, E. L.
  • Proceedings of The First International Conference on Artificial Intelligence and Law
    Rissland, E. L.; Ashley, K. D.
  • Proceedings of the Eleventh National Conference on Artificial Intelligence
    Rissland, E. L.; Daniels, J. J.; Rubinstein, Z. B.; Skalak, D. B.
  • BankXX: Supporting Legal Arguments through Heurisitic Retrieval
    Rissland, E. L.; Skalak, D. B.; Friedman, M. T.
  • Proceedings of the Fourth National Conference on Artificial Intelligence
    Rissland, E. L.; Valcarce, E. M.; Ashley, K. D.
  • Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer
    Salton, G.
  • Introduction to Modern Information Retrieval
    Salton, G.; McGill, M. J.
  • Arguments and Cases: An Inevitable Intertwining
    Skalak, D. B.; Rissland, E. L.
  • Information Retrieval
    van Rijsbergen, C. J.
  • Proceedings of The Third Case-Based Reasoning Workshop, May 1991
    Veloso, M. M.; Carbonell, J. G.