Friday, February 27, 2009

high reliablity in literature search work

This issue has been of interest to me for a while.

Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C.
An evidence-based practice guideline for the peer review of electronic search strategies.
J Clin Epidemiol. 2009 Feb 18. [Epub ahead of print]

The notion of the reliability of the evidence identification process has been of keen interest ever since the Hopkins IRB incident where a good intentioned researcher missed important information that was a part of the failure spiral that resulted in the death of a healthy research volunteer.

This article discussed the use of peer review and checklists (used to improve reliability in other facets of medical work) as a potential improvement mechanism for the evidence retrieval process. I hope by the time I get through the article, others have too - and we can chat about it here.

I hope Sampson and colleagues provide us all with backgound that will lend support to some failure analysis work in this area. I've been talking that up and pitching it for years --- perhaps a door will open now for the study this gap requires to fully understand it.


Amanda said...

I read the article soon after seeing Margaret Sampson present at UNYOC in the fall. I'm thinking of using it as a template to mark student assignments as well. Opening ourselves up to the peer review process in this way is a great idea and would allow us to further develop the science of searching.

Lorri Zipperer said...

Thanks Amanda. Please let us know how that plays out. I am taking the article to an IRB meeting this am. I am interested in the impact of this information in the acute care arena. If others have done something like what Amada suggests, or have used this study to drive improvements in the IRB process, please let us know.