Source of article 2's Company - Magnus Insights.

In thinking about my prior post on confirmation bias, I thought about one aspect of being hired as a professional trial consultant. It happens that I recently saw an announcement of a bar association seminar on do it yourself (DIY) mock trials. I know that mock trials are often expensive when conducted by a qualified trial consultant (what constitutes the distinction of “qualified” has been the topic of other posts). I get it, sometimes a case does not warrant the cost of a professional. But just as other DIY projects, DIY mock juries often suffer from the lack of expertise of the person conducting it. Melissa and I have written before about some of the dangers of DIY mock trials but, what struck me in writing on confirmation bias is the realization that it is highly likely this is a dangerous problem with DIY mock trials (despite the books and seminars purporting to teach lawyers to DIY). Suppose the mock jury verdict seems outrageous. Suppose the mock jurors award significantly more than one expected. What if it was much less? The next question should be “why”? What was done to cause the unexpected result? Were biases involved that skewed the results? Should one then rely on results that are unexpected? Is it fair to the end client to be presented with potentially faulty information, or was the information correct? I know of a trial consultant who believed the results of a particular mock trial were unrealistic, thus, she changed the results in her report to the client so as not to report an “outlier” result. The result did not confirm her expectations to the point she falsified the results rather than add a disclaimer! On a case Magnus handled, a plaintiff’s attorney was astonished that the mock jurors awarded considerably more damages than he anticipated. An insurance adjuster was once so upset at being wrong upon hearing mock jury verdicts that he literally lost his appetite. Both of these individuals reacted to contrary information in a positive fashion; they had us there to tell them what seemed to be driving the unexpected results. The plaintiff’s attorney got a larger settlement than he ever expected. The insurance adjuster got the case settled rather than risk a huge loss. But, in a DIY mock jury, there is no devil’s advocate watching the outcome (not to mention ensuring that as much bias is eliminated from the process as possible). It seems entirely possible that a failure to understand confirmation bias could lead to disastrous results for the ultimate client. Whether that is that malpractice for the DIY attorney remains to be seen. But, clearly the risk of not knowing one’s limitations and abilities in terms of conducting DIY research is dangerous.