Named entity extraction from financial documents with OpenCV, Pytesseract, Spacy (OCR + NER)

Most chronophagous task, took around more than 10 good hours per day and some weeks
Learning -- Collecting good data in Real Life is not a cakewalk

Eyeballing Scanned results of very common and easy input point you can get in Real Time, input can be anything in range of crazy to very crazy

You are observing NER Prediction on scanned results of above business card
Finding organisation and name is still bit difficult , clearly I have to increase business card data from 3000+ cards to maybe 10000+, in parallel I need to update my approach a bot more to bit more maybe

Develop customized Named Entity Recognizer to extract entities from scanned documents images like:

1. Invoice
2. Business Card [my focus] || Extract Entities like: Name, Phone, Email, Organisation and Website link
3. Shipping Bill etc

1. Compute Vision modules were used to:

   1. scan document
   2. identify location of text
   3. extract text from image

2. Natural Language Processing used to

   1. extract entitles from text
   2. text cleaning
   3. parsing entities form text

1. Location of Entity
2. Text of Corresponding Entity

1. I am using Spacy NER model, which is a BERT architecture i.e. I have to provide more data to this model to see performance improvement
2. I can also improve Data Preparation Framework
3. I am using PyTesseract(google) to extract text, it have some limitations like:
4. Image resolution must be atlest 200 dpi or width & height must be atlest 300 pixels
5. Text must not be Rotated or Skewed
6. Text must not be having some effets applied on it
7. Text must not be blured
8. Text must not be cursive handwriting

• Skew Detection and Correction of Document images using Hough Transform
• Skew Detection and Correction of Devanagari Script Using Hough Transform

• Understanding this