Skip to content

Bloodstain Pattern Analysis Black Box Study

This CSAFE webinar was held on October 14, 2021.

Presenters:

Austin Hicklin
Noblis Forensic Science Group, Director

Paul Kish
Forensic Consultant, Paul Erwin Kish Forensic Consultant and Associates

Kevin Winer
Director, Kansas City Police Crime Laboratory

Presentation Description:

This study was conducted to assess the accuracy and reproducibility of BPA conclusions. Although the analysis of bloodstain pattern evidence left at crime scenes relies on the expert opinions of bloodstain pattern analysts, the accuracy and reproducibility of these conclusions have never been rigorously evaluated at a large scale. We investigated conclusions made by 75 practicing bloodstain pattern analysts on 192 bloodstain patterns selected to be broadly representative of operational casework, resulting in 33,005 responses to prompts and 1,760 short text responses. Our results show that conclusions were often erroneous and often contradicted other analysts. On samples with known causes, 11.2% of responses were erroneous. The results show limited reproducibility of conclusions: 7.8% of responses contradicted other analysts. The disagreements with respect to the meaning and usage of BPA terminology and classifications suggest a need for improved standards. Both semantic differences and contradictory interpretations contributed to errors and disagreements, which could have serious implications if they occurred in casework. Paul Kish, Kevin Winer, and Noblis conducted the study under a grant from the U.S. National Institute of Justice (NIJ).

Additional resources can be found by emailing bloodstain@noblis.org.

Related Resources

Statistical Interpretation and Reporting of Fingerprint Evidence: FRStat Introduction and Overview

Statistical Interpretation and Reporting of Fingerprint Evidence: FRStat Introduction and Overview

The FRStat is a tool designed to help quantify the strength of fingerprint evidence. Following lengthy development and validation with assistance from CSAFE and NIST, in 2017 the FRStat was…
Forensic Science in Legal Education

Forensic Science in Legal Education

In criminal cases, forensic science reports and expert testimony play an increasingly important role in adjudication. More states now follow a federal reliability standard, following Daubert v. Merrell Dow Pharmaceuticals…
Hierarchical Bayesian non-response models for error rates in forensic black-box studies

Hierarchical Bayesian non-response models for error rates in forensic black-box studies

Forensic science plays a critical role in the United States criminal legal system. Historically, however, most feature-based fields of forensic science, including firearms examination and latent print analysis, have not…
Towards a likelihood ratio approach for bloodstain pattern analysis

Towards a likelihood ratio approach for bloodstain pattern analysis

In this work, we explore the application of likelihood ratio as a forensic evidence assessment tool to evaluate the causal mechanism of a bloodstain pattern. It is assumed that there…