Access the full text.
Sign up today, get DeepDyve free for 14 days.
T. Saracevic, A. Spink, Mei-Mei Wu (1997)
Users and Intermediaries in Information Retrieval: What Are They Talking About?
B. Fein, Brian Merrell, F. Nelson (2009)
Backstop LLP and Cleary Gottlied Steen & Hamilton LLP at TREC Legal Track 2009
(2005)
The science of analytical reasoning. In: Illuminating the path: the research and development agenda for visual analytics. National Visualization and Analytics Center, Richland, WA
Robert Bauer, Dan Brassil, Christopher Hogan, G. Taranto, J. Brown (2009)
Impedance matching of humans ⇔ machines in high-Q information retrieval systems2009 IEEE International Conference on Systems, Man and Cybernetics
D. Russell, M. Stefik, P. Pirolli, S. Card (1993)
The cost structure of sensemakingProceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Gary Klein, Jennifer Phillips, Erica Rall, Deborah Peluso (2007)
A Data–Frame Theory of Sensemaking
John Wang, C. Coles, Rob Elliot, Sofia Andrianakou (2009)
ZL Technologies at TREC 2009 Legal Interactive: Comparing Exclusionary and Investigative Approaches for Electronic Discovery Using the TREC Enron Corpus
N. Stokes (2005)
Book Review: TREC: Experiment and Evaluation in Information Retrieval, edited by Ellen M. Voorhees and Donna K. Harman
D Kuropka (2004)
Modelle zur Repräsentation natürlichsprachlicher Dokumente. Ontologie-basiertes Information-Filtering und -Retrieval mit relationalen Datenbanken. Advances in information systems and management science, Bd. 10
V. Rangan, M. Jiang (2009)
Clearwell Systems at TREC 2009 Legal Interactive
Robert Bauer, Teresa Jade, Bruce Hedin, Christopher Hogan (2008)
Automated Legal Sensemaking: The Centrality of Relevance and Intentionality
Gary Klein, B. Moon, R. Hoffman (2006)
Making Sense of Sensemaking 2: A Macrocognitive ModelIEEE Intelligent Systems, 21
Jianqiang Wang, Ying Sun, Paul Thompson (2009)
TREC 2009 at the University of Buffalo: Interactive Legal E-Discovery With Enron Emails
G. Marchionini (2007)
Toward human‐computer information retrievalBulletin of The American Society for Information Science and Technology, 32
Tal Sterenzy (2009)
EQUIVIO at TREC 2009 Legal Interactive
Thomas Willging, J. Shapard, D. Stienstra, D. Miletich (1998)
Discovery and Disclosure Practice , Problems , and Proposals for Change : A Case-based National Survey of Counsel in Closed Federal Civil Cases
J. González, Jaime Gómez (2007)
TREC: Experiment and evaluation in information retrievalJ. Assoc. Inf. Sci. Technol., 58
Christopher Hogan, Dan Brassil, Shana Rugani, Jennifer Reinhart, M. Gerber, Teresa Jade (2008)
H5 at TREC 2008 Legal Interactive: User Modeling, Assessment & Measurement
H. Roitblat, A. Kershaw, P. Oot (2010)
Document categorization in legal electronic discovery: computer classification vs. manual reviewJ. Assoc. Inf. Sci. Technol., 61
(2005)
Using sense-making methodology in legal and law enforcement investigations. Presented at a non-divisional workshop held at the meeting of the International Communication
B. Dervin (1983)
AN OVERVIEW OF SENSE-MAKING RESEARCH: CONCEPTS, METHODS AND RESULTS TO DATE
D. Lewis (1998)
Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval
Paul Thompson, Howard Turtle, Bokyung Yang, James Flood (1994)
TREC-3 Ad Hoc Retrieval and Routing Experiments using the WIN System
Jack Glazier, R. Powell (1992)
Qualitative Research in Information Management
T. Tech, A. Kershaw (2006)
TALKING TECH Automated Document Review Proves Its Reliability
T. Shaffer (2005)
Legal interviewing and counseling in a nutshell
(1980)
Anomolous states of knowledge as a basis for information retrieval
A Kershaw (2005)
Automated document review proves its reliabilityDigit Discov Evid, 5
Dominik Kuropka (2004)
Modelle zur Repräsentation natürlichsprachlicher Dokumente: Ontologie-basiertes Information-Filtering-und-Retrieval mit relationalen Datenbanken
(2004)
Manual for complex litigation, fourth
Rosalie Steier (1985)
An evaluation of retrieval effectiveness for a full-text document-retrieval systemCommun. ACM, 28
Louis Rosenfeld, Peter Morville (1998)
Information Architecture for the World Wide Web
Jürgen Koenemann, N. Belkin (1996)
A case for interaction: a study of interactive information retrieval behavior and effectivenessProceedings of the SIGCHI Conference on Human Factors in Computing Systems
L. Takayama (2008)
Tracing the Microstructure of Sensemaking
G. Cormack, Mona Mojdeh (2009)
Machine Learning for Information Retrieval: TREC 2009 Web, Relevance Feedback and Legal Tracks
Douglas Oard, Björn Hedin, Stephen Tomlinson, Jason Baron (2008)
Overview of the TREC 2008 Legal Track
B. Dervin (1992)
From the mind’s eye of the user: The sense-making qualitative-quantitative methodology.
Retrieval of relevant unstructured information from the ever-increasing textual communications of individuals and businesses has become a major barrier to effective litigation/defense, mergers/acquisitions, and regulatory compliance. Such e-discovery requires simultaneously high precision with high recall (high-P/R) and is therefore a prototype for many legal reasoning tasks. The requisite exhaustive information retrieval (IR) system must employ very different techniques than those applicable in the hyper-precise, consumer search task where insignificant recall is the accepted norm. We apply Russell, et al.’s cognitive task analysis of sensemaking by intelligence analysts to develop a semi-autonomous system that achieves high IR accuracy of F1 ≥ 0.8 compared to F1 < 0.4 typical of computer-assisted human-assessment (CAHA) or alternative approaches such as Roitblat, et al.’s. By understanding the ‘Learning Loop Complexes’ of lawyers engaged in successful small-scale document review, we have used socio-technical design principles to create roles, processes, and technologies for scalable human-assisted computer-assessment (HACA). Results from the NIST-TREC Legal Track’s interactive task from both 2008 and 2009 validate the efficacy of this sensemaking approach to the high-P/R IR task.
Artificial Intelligence and Law – Springer Journals
Published: Oct 6, 2010
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.