See “Evidence Management” for an overview of this series and for links to other articles.
“You [are not] responsible for my mistakes and wrong conclusions,” [said Pip.]
“Not a particle of evidence, Pip,” said Mr. Jaggers, shaking his head and gathering up his skirts. “Take nothing on its looks; take every thing on evidence. There’s no better rule.”1
I’ve discussed the immaturity of the source summaries of Ancestry.com and FamilySearch.org. Today, I will examine the embryonic nature of their evidence management and their total lack of evidence summaries (the green boxes in the diagram, below).
Evidence can be managed when
separated from sources and conclusions
Current genealogy programs lack separate treatment of evidence. Source summaries and records of individuals are left struggling to fill the gap. Some aspects are picked up by each, as shown in the diagram below. Contrast this with the evidence management diagram (above).
Current genealogy programs suffer because
evidence is not managed separately
One may well ask if it matters that users follow established research processes and proven techniques for evidence analysis. Consider the following:
- User retention goes up when success goes up. Conversely, research errors are demotivating at best and—when publicly and embarrassingly discovered—can be humiliating.
- Genealogy practitioners have invested tens of thousands of hours distilling successes and failures into a research process that repeatably yields positive results.
- Subscribers whose retention is most at risk are the very users least likely to follow successful research practices without guidance.
- Software that reflects and enables successful research practices will lead to greater research success and greater subscriber retention.
Think back to the example in “Evidence Management Explained” where the month and day for the conclusion came from one source and the year came from several other sources. Compare the two diagrams above, while you think about these questions:
- When evidence and conclusion are one and the same, what do you do when making a conclusion that is different from the evidence in any one source?
- Do you enter a primary conclusion that is not linked to any source?
- Do you link the primary conclusion to a source that states something different from the conclusion?
- When evidence and sources are one and the same, what do you do when the source contains both primary and secondary information?
- When evidence and conclusion are one and the same, what do you do with contradictory evidence?
- Do you enter an erroneous, alternate conclusion?
- Do you leave the contradictory evidence unconnected to the conclusion?
- Do you enter source notes explaining the contradictory evidence?
- What if the source also contains supportive evidence?
Further, when evidence is not managed separately from sources and conclusions:
- Reports can not be generated about the evidences.
- Evidence lists can’t be generated.
- Evidence can’t be flagged as primary/secondary, direct/indirect, or supporting/contradicting.
- Lists can’t be sorted by characteristic.
- Lists can’t be grouped by geography or by time period.
- Lists can’t be printed showing evidence that requires additional work or special handling.
- Should you discover you misidentified a person, it takes a lot of manual work to move evidence from one individual to another.
Evidence. There’s no better rule.