If you do newspaper research online as part of your genealogy and family history pursuits, then you have certainly been puzzled by some of the search results (or lack thereof) that you have received.
Creation of newspaper images and the application of the OCR process does not always result in what you might expect in the index which is used to match against your search criteria.
There is a simple explanation for this, and it all has to do with quality:
- Quality of the original material – was the newspaper old and brittle when scanned? Was it yellowed? Ripped or torn? Creased? Did it have dirt on it or lots of ink spots?
- Was the scan performed that creates the digital image and the index, from the original paper or from a microfilm of the paper, or worse a copy of the microfilm? Every additional copy or scan degrades the resulting image and when the OCR process is applied, the index suffers.
- Quality of the OCR software.- some are more accurate than others.
- Quality of the writing in the original newspaper. Did the author get your ancestor’s name spelled correctly?
- Quality of the typesetter – did the typesetter get every word from the author set up correctly?
Thus what you are searching probably won’t be a perfect digital database that represents what was originally written by the author and newspaper publisher.
What can we do about it? There are lots of things to try and this article deals with changing the letters in your search criteria. For example – if the surname you are searching for is “Wilson” and the letter “n” is often converted to the letter “m” in the index from the OCR process, why not search for “Wilsom”?
I guarantee that changing your search letters will lead to an improvement of at least 5 to 10% in search results. I heard from one reader that changing letters and letter pairs got them a 20% improvement!
So what letter pairs are often confused and exchanged in the index?
- rn and m (ar n and em)
- h and b
- h and n
- Capital D and O
- i, l, 1, /, !, and I are all often interchanged
- 0 and O
- c and e and o
- r and n
- [, ] and l (el)
- nl and m (en el and em)
- R and B
- n and ri (en and ar eye)
- v and y
- S and 8
- S and 5
- Z and 2
- G and 6
- G and O
- B and 8
- K and |<
- Y and V
My suggestion? Change your search criteria and exchange the letter string you are entering in the search box to include these alternative letter and letter pairs and see what happens. In other words – deliberately misspell the name or word. You will be pleasantly surprised!
For other ways to improve your search results and to learn much more about becoming an expert newspaper researcher, check out the Newspapers! Page. And by the way, on that page you will find links to over 15,000 free online historic newspapers from all over the world.