Overview
Legal issues are seldom difficult due to a lack of data. On the contrary, the challenge in such cases lies in sifting through a large amount of data, which can be contained in numerous documents, emails, communications, and records, in a limited time frame.
A litigation matter, an internal investigation, a regulatory inquiry, and a due diligence exercise all carry a considerable number of documents. Proper review of all such documents takes time, coordination, decision-making and proper quality control.
Where the legal team is already juggling several such matters, this can prove to be difficult. Legal experts find themselves spending a lot of time in repetitively reviewing documents rather than dealing with legal strategy and preparation.
This gives rise to an interesting question: how can legal teams handle document-intensive matters properly without compromising on accuracy, consistency and quality?
Here comes the concept of managed review. Managed review is the use of legal expertise, proper review protocol, project management, quality control and proper technological tools to handle document-intensive matters.
Managed review gives legal firms and companies involved in complicated legal matters an orderly process to deal with huge amounts of data and enables internal legal teams to work on the tasks for which they are best suited.
What Is Managed Review?
Managed review is a process-based service in which a dedicated legal services provider manages some or all of the document review processes within the context of a legal matter.
More than just adding more reviewers to the effort, managed review involves establishing the parameters of the review, setting up coding processes, training reviewers, monitoring the process, quality checking, and generally overseeing the entire process.
Depending on the needs of the matter, managed document review services can include such items as:
- Development of review protocols and workflows.
- Identification of relevant documents and information.
- First- and second-level document review.
- Coding of documents for relevance and responsiveness.
- Identification of potentially privileged or confidential information.
- Personal or sensitive information review.
- Issue coding and prioritisation of documents.
- Quality Control and Quality Assurance.
- Project tracking.
The exact scope depends on the matter, number of documents, and requirements as well as the degree of support required. The key point is that managed review involves managing the process, not just adding more people.
Properly managed, the process has structure and oversight built in.
Why Should Legal Teams Use Managed Review?
Document review becomes an operational problem when there is a larger amount of data or tight deadlines.
Imagine a law firm that has several litigation cases running at once. In each case, there are various document collections, review needs, deadlines, and confidentiality issues.
Increasing the number of lawyers working on the task may seem like an easy way out. Still, it will also mean more coordination, training, supervision, and expenses. The value of managed review lies in its structured workflow and specialised review management.
It could help legal teams:
- Process a high volume of documents without immediate expansion of permanent teams.
- Use the same review criteria for the entire project.
- Discover which documents need legal attention.
- Control the course of review and open issues.
- Control the quality of the process.
- Reduce the operational burden on internal lawyers.
The goal is not to process more documents faster. It is to develop a process that would help legal teams handle volume without compromising the quality of their review outcomes.
How Does the Managed Review Process Take Place?
A successful managed review process starts even before the very first document review takes place. The scope, review criteria, responsibilities of the team, and quality control measures must be determined before proceeding with the process.
The following points will describe the workings of the managed review process:
1. Understanding the Legal Issue and Determining the Scope of the Matter
Every managed review starts by having an understanding of the issue or matter for which the documents are being reviewed.
The team understands what the legal issues and the purpose of the review are, what custodians are involved, from what sources documents need to be collected, the expected number of documents, what deadlines are involved, and what information is supposed to be found through the review process.
For instance, in a litigation review, the communications related to certain allegations have to be identified, whereas in an investigation, information regarding certain events or decisions needs to be obtained.
2. Determine the Review Process
A review process is an approach to assessing and classifying documents. It gives a reviewer a unified set of instructions by which the documents can be reviewed on the same criteria.
Depending on the issue at hand, a review process may include:
- Relevance and responsiveness.
- Issues of privilege.
- Confidentiality and sensitivity issues.
- Important legal and factual questions.
- Documents with priority that need to be escalated.
- Email attachments and related documents.
- Coding and escalation procedures.
The clear instruction process makes decision-making clearer and less confusing. Furthermore, this process should be checked against any newly received information.
3. Training and Calibration of the Review Team
Even with a well-developed protocol, there will likely be inconsistencies if reviewers interpret the instructions in different ways.
Training is helpful for understanding what the matter entails, how the review process works, what coding the reviewers need to perform, and what documents must be escalated for further examination.
Calibration means examining sample documents, discussing complex decisions, and sorting out interpretation differences before starting the review process.
This step is especially critical when several reviewers work on one matter. Effective training and calibration of the reviewers help minimize any avoidable mistakes in the process.
4. Perform the Document Review
Now that the team is calibrated and trained, the substantive document review begins.
The exact review process depends on the matter, but it may include several tiers of the document review process.
First-tier review Documents are reviewed by reviewers in accordance with the criteria defined.
Secondary-level review Certain documents are subjected to additional review by more experienced individuals or lawyers. This is required in the case of complicated matters, potentially privileged documents, or when interpretation is needed.
Privilege review Documents and communications are analysed to determine any privilege or other possible protections available according to the instructions of the legal team.
Issue review Documents are classified according to specific legal or factual issues to assist the legal team in identifying evidence in the case.
Redaction review When necessary, documents are reviewed for information that must be withheld or redacted according to the instructions and legal standards. These levels of review aim at creating accurate information for the decision-making process in legal matters and not at increasing the number of reviewed documents.
5. Perform Quality Control and Quality Assurance
Quality control is a crucial aspect of managed review. A large review will consist of multiple decision points. If not monitored on a continuous basis, inconsistency in coding or misunderstanding the protocol may affect the overall quality of the review.
Some possible steps that can be taken for quality assurance may include:
- Sampling the reviewed documents.
- Coding consistency check.
- Individual reviewer’s performance review.
- Additional review of riskier documents.
- Repeated mistakes or interpretation issues.
- Feedback and further training.
- Escalation and decision logging.
The process of performing quality checks should continue throughout the course of the engagement, rather than being performed only at the start and/or the end. This way, the team will be able to detect any issues early, solve them and increase consistency.
6. Track Progress and Handle Deadlines
Document review at high volume involves project management. Legal teams must be aware of the volume of work done, the pending volume of work, the quality of decisions made in the process, and the issues that may arise that could impact the schedule.
Reporting for managed review can be made up of:
- The number of documents received and reviewed.
- Completion status of the reviews.
- Performance and quality metrics.
- Pending documents and open questions.
- Issues that need the attention of legal teams.
- Progress relative to agreed schedules.
Legal teams are provided with useful information to make good decisions regarding their resources, priorities, and deadlines without the need to manage every operational task.
7. Escalation of Complex Issues and Finalizing of the Review
It may not always be possible to review all documents using standard coding instructions. Some of them may involve issues related to privileges, confidentiality, relevance or interpretation of significant facts. Such documents need to be escalated as per the pre-existing review procedure.
The designated legal team can assist in addressing these queries, clearing doubts, or deciding whether further review is needed.
At the end of the engagement, the legal team should verify that the required review criteria have been met and all unresolved queries have been either sorted out or documented.
The final output would depend upon the reason behind the engagement. It could consist of coded documents, an issue-related document set, prioritized documents or documents that can be used for the next phase of legal proceedings.
Why Does Your Firm Need Managed Review Services?
Managed review can be helpful in offering operational efficiencies if a legal firm has to deal with large numbers of documents.
1. Ability to Scale the Review Process
There are times when the number of documents becomes unexpectedly large. In such a case, managed review will make sure that a legal firm has enough review capacity as per the needs of the project. It will be very useful, especially when there are multiple projects to deal with at once.
2. Lightening the Workload of the Attorneys
There is a need for time for the attorneys for legal analyses and case preparation, negotiations, and strategy. With the help of managed review, it is possible to reduce the workload of the attorneys in document assessment processes.
3. Higher Level of Consistency
Consistent criteria application for a large number of documents can be guaranteed through consistent protocol, proper training, calibration, and regular quality assurance. It minimises the possibility of making inconsistent decisions due to misunderstanding of the requirements or varying interpretation of the criteria.
4. More Effective Cost Management
A high number of review projects requires a lot of money to be spent on recruitment, training, supervision, and expansion of the team. Such a review may benefit from a managed review approach because it implies an established workflow, flexible resources, and project management.
The cost is defined by the number of documents, their complexity, staff, technology, and deadlines. However, the factor that should be taken into account is the effectiveness of the entire process.
5. Better Deadlines Handling
Legal professionals often face the necessity to meet certain deadlines that cannot be changed regardless of the workload of the team. In such a situation, the workflow of managed review may be useful for handling the process of the review better.
6. Access to Expertise for Specialized Reviews
Legal issues have various methods of review. For example, a regulatory investigation, a business conflict, a labour issue, and a due diligence review could all have varying coding requirements, confidentiality concerns, and escalation needs. Managed review services give access to reviewers and review processes that are suited to the unique demands of the particular engagement.
7. Reduction in Administrative Responsibilities
The administration of a temporary review team involves coordination, training, performance management, quality assurance, reporting, and problem-solving. Outsourcing those administrative tasks to a managed review vendor can enable the internal legal department to control the process without handling all aspects of the review process.
When to Outsource Document Review Services to a Law Firm?
There are many occasions where a law firm should consider using document review outsourcing services:
1. There is an increase in the number of documents.
The document review process includes a larger volume of documents that can be processed by the existing team in the stipulated timeframe.
2. The deadline is nearing.
Additional document review services are required for completing the process without affecting any other legal activities.
3. The attorneys are taking too much time reviewing documents on the first level.
High-profile professionals have to spend their time evaluating rather than analyzing the documents and providing legal strategies to the clients.
4. Many documents need review at once.
The pressure of different cases and documents is impacting the resources.
5. Structured quality control is required for the review process.
The document review is complex and involves many aspects and codings.
6. The team will need either temporary or specialized staffing.
Review staffing requirements are not constant and vary from one project to another, making any permanent increase in size of the internal team inappropriate.
Not every situation requires outsourcing assistance. Small-scale reviews, highly sensitive matters, or projects which require deep knowledge about the organization itself are easier to manage without outsourcing.
In some situations, the hybrid approach may serve perfectly well: the internal legal team will take charge of strategy and major decisions, while the managed review team will take care of the rest.
How Can Technology Help in Managed Review?
Technology can assist legal teams in organizing, searching, prioritizing, and analyzing large volumes of documents. Depending on the project and the particular review tool, managed review processes may utilize any of the following technologies:
- Advanced search and filtering.
- Document classification and metadata analysis.
- Technology Assisted Review (TAR).
- Continuous Active Learning (CAL).
- Analytics and clustering.
- Automated quality controls.
- Report and review dashboards.
This list can help reduce unnecessary work, detect patterns, and prioritize the documents that may require further consideration.
However, technology is supposed to be used according to an appropriate review protocol. The classifications and search results made using technology should be validated especially when those influence critical legal decision-making, privileges, and identification of relevant documents. The best strategy is to use technology together with skilled legal experts who are able to understand the context, resolve ambiguities, and make legal decisions.
JurisIQ also provides the means to organize the work of lawyers and analyze legal documents within a connected workspace. Legal workspace and document capabilities of JurisIQ may be relevant for legal teams trying to decrease fragmented workflow processes and information access.
Attributes of a Defensible Managed Review Process
A defensible managed review process should be characterized by clear guidelines, consistency, proper supervision, and adequate documentation of major decision points. This varies based on the particular matter at hand, the jurisdiction, as well as court orders and regulations that might apply.
Documentation includes:
- The scope and purpose of the review.
- The guidelines and criteria of the review.
- Training and calibration documentation.
- Quality assurance procedures and findings.
- Escalation procedures and decision log.
- The tools and techniques used in the process.
- Any material change in the review process.
- Quality assurance and validation documentation.
Such documentation ensures that the lawyers know about the review process and can explain the rationale behind major decisions when needed.
The goal is not just to do the review. The goal is to do it in a manner that can be documented and explained.
Managed Review at JurisIQ
The approach to managed review at JurisIQ is designed to enable legal departments to manage document-driven cases more effectively.
The process involves blending legal skills, workflow, quality management, the right technology, and project management to assist in meeting review requirements where the internal team lacks capacity.
Legal Skills Legal review activities must be consistent with the objectives of the case at hand.
Customized Workflow Workflows for review processes are customized based on the size of the case, the type of documents involved, timelines, and other requirements of the matter at hand.
Quality-Driven Execution Processes such as training, calibration, quality assurance, and escalation are used to keep consistency throughout the review process.
Scalable Review Teams The review team can be scaled to meet the size of the matter.
Technology-Assisted Review The right review technology can help manage the review process and ensure efficient workflow.
Confidentiality and Security Legal and business matters that need confidentiality have to be dealt with accordingly.
Goals-Based Results The goal is to assist legal departments in managing volume, quality, time management, and concentrating on legal thinking.
Legal departments interested in connecting document management with their broader legal process can get more insight into JurisIQ’s connected legal workspace through its AI legal research and case/matter management abilities.
The Question Isn’t Whether Your Team Can Perform the Document Review. The Question Is How You Should Manage the Document Review.
Document review is an important part of litigation, investigations, due diligence, and many other kinds of legal projects. However, as document volume increases, the task of conducting the review itself becomes a separate operation challenge.
The best method for managing the task depends on the type of the case/project, resources, time constraints, and level of supervision necessary.
Managed document review can offer you a system for conducting document review in bulk while still allowing your internal legal team to concentrate on strategic work.
The Right Methodology Includes: People + Process + Technology + Quality Control
And this is how a simple document review outsourcing becomes a managed document review.
Want help conducting a high-volume document review project? Contact JurisIQ to discuss your managed review needs.
Frequently Asked Questions
What differentiates managed review from document review outsourcing?
Whereas document review outsourcing usually refers to the outsourcing of document review tasks, managed review goes further to provide process organization, training, supervision, quality control, and reporting to manage the review process.
When should a law firm resort to managed document review services?
In cases where there is an excessive document volume, tight deadlines, many simultaneous cases, or limited internal capabilities among others, a law firm should consider managed document review services.
Does managed review help in litigation and investigations?
Yes. Managed review is helpful for litigation, internal investigations, regulatory inquiries, due diligence, and all such cases where there is a need to have an organized analysis of a large number of documents.
What steps can legal departments take to initiate managed review?
Legal departments usually start with understanding the case or matter, determining the volume of documents, source of documents, deadline, and the requirements for review.
Does managed review replace lawyers?
No. Managed review facilitates the legal department with coordination for document review. Lawyers are supposed to take care of legal aspects and decision-making.