Analytics Workflows for Smaller Cases and QC
Washington DC User Group Analytics Workflows for Smaller Cases and QC Workflows
© kCura LLC. All rights reserved.
The D.C. Steering Committee •
Kristin Thompson – Williams & Connolly
•
Margaret Havinga - Williams & Connolly
•
Richard Addison - Finnegan
•
Kate Bauer - Steptoe & Johnson
© kCura LLC. All rights reserved.
How does a user group work? •
You, the community, drive the user group’s topics and conversation
•
kCura is here to moderate the conversation
•
The more you put into the meetings the more you get out
•
Surveys will go out at the end of each meeting. Please fill them out!!
© kCura LLC. All rights reserved.
Who are you?
© kCura LLC. All rights reserved.
Analytics for smaller cases
© kCura LLC. All rights reserved.
Relativity Analytics features Structured
Conceptual
•
Email threading
•
Concept searching
•
Textual Near Duplicate ID
•
Categorization
•
Language identification
•
Clustering
•
Keyword expansion
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
•
Email threading
•
Foreign language identification
Narrowing the review set
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
Narrowing the review set
•
Near duplicate identification
•
Quality control
•
Cluster visualization
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
Narrowing the review set
•
Keyword expansion
•
Quality control
•
Concept search
•
Investigation
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
Narrowing the review set
•
Clustering
•
Quality control
•
Categorization
•
Investigation
•
Organizing large sets of data
© kCura LLC. All rights reserved.
Common Objection: “Analytics is best only for the largest cases.” • Messaging with analytics in e-discovery has focused on large case wins.
• There are a number of uses for most cases. For example: – Batching • Reviewing conceptually related documents increases review speed • Reviewing email threads together reduces inconsistencies – Production prep – Analytics can help to avoid mistakenly producing privileged docs – Keyword sampling – Find potentially relevant documents that keywords miss – Threading – Only review inclusives and reduce the volume of email
© kCura LLC. All rights reserved.
Email Threading
© kCura LLC. All rights reserved.
2/24/99 11:25 a.m.
4/29/99 6:45 p.m.
4/30/99 9:03 p.m.
?
Barry Pearce
Bob Crane & Jeff Harbert
Maria Nartey
Richard Sage & Mark Elliott
© kCura LLC. All rights reserved.
4/30/99 7:00 p.m.
4/30/99 7:22 p.m.
4/30/99 10:24 p.m.
5/1/99 12:57 a.m.
Email Threading What is it? • Identifies and arranges emails that were part of a single thread or conversation. What is it used for? • Allows you to: – Easily see the order of each email in a thread. – See which emails are inclusive (i.e. have unique content). – Identify email duplicate spares (i.e. emails with the same content). How will it help me? • Sort and organize emails by thread for more intuitive review. • Saves time if only reviewing the non-duplicative inclusive emails. ◊
© kCura LLC. All rights reserved.
Near Duplicate
© kCura LLC. All rights reserved.
Can you spot the difference? Version A
© kCura LLC. All rights reserved.
Version B
Textual Near Duplicate Identification What is it? • Identifies documents with highly similar text and places them into relational groups. What is it used for? • Allows you to: – Use near dupe groups in searching or filtering. – Conflict check coding decisions amongst near dupes prior to production. How will it help me? • Saves time by identifying very similar documents prior to the start of review. You can also use the near dupe groups for review and QC. ◊
© kCura LLC. All rights reserved.
Best Practices and Considerations •
Run instead of or in place of email threading
•
Use with Compare function
•
Not meant to eliminate items but as prioritization and grouping
•
Include Numbers?
•
Use for QC, comparison of datasets
© kCura LLC. All rights reserved.
Conceptual Analytics
© kCura LLC. All rights reserved.
What is Conceptual Analytics? Relativity Analytics indexes use a mathematical approach to indexing documents.
Terminology is understood based on language usage in your documents. – No outside word lists • Dictionaries, thesauri, ontologies, etc. – Language-agnostic – Term co-occurrence, not term location ◊
© kCura LLC. All rights reserved.
Analytics Index: Best Practices and Considerations •
Minimum text (>0 KB)
•
Maximum text (
© kCura LLC. All rights reserved.
The D.C. Steering Committee •
Kristin Thompson – Williams & Connolly
•
Margaret Havinga - Williams & Connolly
•
Richard Addison - Finnegan
•
Kate Bauer - Steptoe & Johnson
© kCura LLC. All rights reserved.
How does a user group work? •
You, the community, drive the user group’s topics and conversation
•
kCura is here to moderate the conversation
•
The more you put into the meetings the more you get out
•
Surveys will go out at the end of each meeting. Please fill them out!!
© kCura LLC. All rights reserved.
Who are you?
© kCura LLC. All rights reserved.
Analytics for smaller cases
© kCura LLC. All rights reserved.
Relativity Analytics features Structured
Conceptual
•
Email threading
•
Concept searching
•
Textual Near Duplicate ID
•
Categorization
•
Language identification
•
Clustering
•
Keyword expansion
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
•
Email threading
•
Foreign language identification
Narrowing the review set
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
Narrowing the review set
•
Near duplicate identification
•
Quality control
•
Cluster visualization
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
Narrowing the review set
•
Keyword expansion
•
Quality control
•
Concept search
•
Investigation
© kCura LLC. All rights reserved.
Features by use case Use Case
Feature
•
Narrowing the review set
•
Clustering
•
Quality control
•
Categorization
•
Investigation
•
Organizing large sets of data
© kCura LLC. All rights reserved.
Common Objection: “Analytics is best only for the largest cases.” • Messaging with analytics in e-discovery has focused on large case wins.
• There are a number of uses for most cases. For example: – Batching • Reviewing conceptually related documents increases review speed • Reviewing email threads together reduces inconsistencies – Production prep – Analytics can help to avoid mistakenly producing privileged docs – Keyword sampling – Find potentially relevant documents that keywords miss – Threading – Only review inclusives and reduce the volume of email
© kCura LLC. All rights reserved.
Email Threading
© kCura LLC. All rights reserved.
2/24/99 11:25 a.m.
4/29/99 6:45 p.m.
4/30/99 9:03 p.m.
?
Barry Pearce
Bob Crane & Jeff Harbert
Maria Nartey
Richard Sage & Mark Elliott
© kCura LLC. All rights reserved.
4/30/99 7:00 p.m.
4/30/99 7:22 p.m.
4/30/99 10:24 p.m.
5/1/99 12:57 a.m.
Email Threading What is it? • Identifies and arranges emails that were part of a single thread or conversation. What is it used for? • Allows you to: – Easily see the order of each email in a thread. – See which emails are inclusive (i.e. have unique content). – Identify email duplicate spares (i.e. emails with the same content). How will it help me? • Sort and organize emails by thread for more intuitive review. • Saves time if only reviewing the non-duplicative inclusive emails. ◊
© kCura LLC. All rights reserved.
Near Duplicate
© kCura LLC. All rights reserved.
Can you spot the difference? Version A
© kCura LLC. All rights reserved.
Version B
Textual Near Duplicate Identification What is it? • Identifies documents with highly similar text and places them into relational groups. What is it used for? • Allows you to: – Use near dupe groups in searching or filtering. – Conflict check coding decisions amongst near dupes prior to production. How will it help me? • Saves time by identifying very similar documents prior to the start of review. You can also use the near dupe groups for review and QC. ◊
© kCura LLC. All rights reserved.
Best Practices and Considerations •
Run instead of or in place of email threading
•
Use with Compare function
•
Not meant to eliminate items but as prioritization and grouping
•
Include Numbers?
•
Use for QC, comparison of datasets
© kCura LLC. All rights reserved.
Conceptual Analytics
© kCura LLC. All rights reserved.
What is Conceptual Analytics? Relativity Analytics indexes use a mathematical approach to indexing documents.
Terminology is understood based on language usage in your documents. – No outside word lists • Dictionaries, thesauri, ontologies, etc. – Language-agnostic – Term co-occurrence, not term location ◊
© kCura LLC. All rights reserved.
Analytics Index: Best Practices and Considerations •
Minimum text (>0 KB)
•
Maximum text (
