Auto image rotation

Using Tesseract OCR to autorotate scanned text to right rotation.

Problem

From time to time, everyone has a bunch images of text that they don't want to rotate one by one to their right orientation.

Solution

I decided to write a small script that auto detects the orientation of pages based on OCR recognition and dictionary matching. First I used open source tesseract as OCR for parsing text from images. Second, I wrote down a list of most probably occurring words in a text (there are only 5-6 in example below, feel free to write your own). Finally the images rotate and parse every rotation through OCR and test with dictionary. As the OCR accuracy isn't 100% I used some small deviation on comparing words. See code below.

Just copy these 3 files listed below into your ~/bin directory and run tesseract_rotate_all


Dependencies

You need to install perl re::engine::TRE - TRE regular expression engine

download here


recognize_good_rotation

perl script to evaluate the tesseracted text if it contains any of the word in our dictionary
       


#use lib "/root/perl5/lib";
# @author Miroslav Bodis 2014

use strict; 
use warnings;

my $file = shift;
 my $rotati
my $debug_mode = shift;

my $find = 0;

if (!defined $debug_mode){
 $debug_mode = 0; 
 # $debug_mode = 1; # TODO use for more details 
}

if ($debug_mode == 1){ 
 print "file:" . $file."\n";
 print $rotation . "\n";
 print "debug mode: " . $debug_mode."\n";
}

my @recognize_words = ('then', 'change', 'when', 'over', 'suddenly', 'another');

open(my $fh, "<", $file) or die "cannot open file";

while(<$fh>)  {
 chomp;
 
 my $line = $_;
 {
  use re::engine::TRE max_cost => 1;

  foreach (@recognize_words) {

   if ($line =~ /$_/i) {
    
    $find += 1;

    if ($debug_mode == 1){ 
     print "match word: " . $_ . "\n";
    }    
   }
  }
 }
}

close $fh;

if ($find > 2){
 exit 0;
}

exit 1;



tesseract_rotate

shell script to auto rotate one image
       

#! /bin/sh

# @author Miroslav Bodis 2014


if [ -z "$1" ]
then
 echo "
 @author Miroslav Bodis 2014
 
 #   script to autorotate image of printed text
 # - inpnut image try all 4 rotations (0, 90, 270, 180)
 # - tesseract current rotation
 # - use your dictionary to find word in tesseracted text (with some tollerance - used TRE max_cost => 1)
 #   - see log for results
 #   - TODO: copy script to your bin folder e.g.: \"~/bin/recognize_good_rotation.pl\"
 # \$1 -> \"input_image\"" 
 exit
fi;


# required 1 arguments
if [ -z "$1" ]
then
 echo "required 1 arguments \"image_name\""
 exit
fi;


help_rotated_img="rotation_help.jpg"
help_ocr_out="output_ocr"
help_ocr_out_txt="$help_ocr_out.txt"
find=1


# 0 - rotation
echo "image $1 try rotation 0"
tesseract -l slk $1 $help_ocr_out 
perl ~/bin/recognize_good_rotation.pl $help_ocr_out_txt 'rotation 0'
find=$?


# 90 - rotation clockwise
if [ $find -eq 1 ] 
then

 echo "image $1 try rotation 90"
 convert $1 -rotate 90 -quality 100 $help_rotated_img
 tesseract -l slk $help_rotated_img $help_ocr_out
 perl ~/bin/recognize_good_rotation.pl $help_ocr_out_txt 'rotation 90'
 
 find=$?
fi;


# 270 - rotation clockwise
if [ $find -eq 1 ] 
then
 
 echo "image $1 try rotation 270"
 convert $1 -rotate 270 -quality 100 $help_rotated_img 
 tesseract -l slk $help_rotated_img $help_ocr_out 
 perl ~/bin/recognize_good_rotation.pl $help_ocr_out_txt 'rotation 270' 

 find=$?
fi;

# 180 - rotation clockwise
if [ $find -eq 1 ] 
then
 
 echo "image $1 try rotation 180"
 convert $1 -rotate 180 -quality 100 $help_rotated_img
 tesseract -l slk $help_rotated_img $help_ocr_out
 perl ~/bin/recognize_good_rotation.pl $help_ocr_out_txt 'rotaiton 180'

 find=$? 
fi;


if [ $find -eq 1 ] 
then
 echo ">>>>>>>>>>>>>>>>> image $1 NOT ROTATED, please update dictionary ! <<<<<<<<<<<<<<<<"
else 
 echo "image $1 ROTATED"
 # if rotated replace new right rotation with old one
 cp $help_rotated_img $1
fi;

rm $help_rotated_img
rm $help_ocr_out_txt

tesseract_rotate_all

loop to do it on the whole folder
       

#! /bin/sh

# @author Miroslav Bodis 2014
# move to current folder with pictures and run "tesseract_rotate_all"

FILES=./*

for f in $FILES
do 
 echo "--- --- --- --- START FILE $f" 
 tesseract_rotate $f
done

echo "finished"

Comments

Post a Comment

Popular posts from this blog

Counting dice and train wagons using computer vision

Image
Computer vision exercises with preprocessing Before the next project I decided to do some computer vision exercises. Each example is based on a simple logic image preprocessing. No data structure or learning is required. Dice I got this idea while browsing the net. I was curious about how hard can it be to write such a script. I'll describe the algorithm in steps. movement detection : Comparing few frames with thresholds gives us the information, whether something is moving in the frame. Adding some small time frame after the movement stops gives us more precise information. remove background : Thresholding gray frame removes the background and gives us binary image with objects cropping the objects : Using contours to detect object and then separate them by cropping. detecting dots : Inverting the image we get objects that can be again simply detected using contours. filtering dots : If dice is visible also from the side therefore dots from that side can be recogn
Read more

Play table

Image
Using proximity sensors for playing midi tones combined with LED visualization Description The aim of this project was to create a table sized device with multiple proximity sensors that can play midi tones. Each sensor had a few LEDs to show hand distance above the table. This table could be used by one or more persons at once. Hardware setup First I created a prototype from a cardboard to test sensors and some logic behind. Than I ordered a customized plottered sticker with a design which was painted with bare conductive paint. Afterwards I drilled some holes and connected the touchboard with 7 arduino Nanos. Each arduino was connected to 13 LEDs diodes. At the end I added two potentiometers. One for controlling volume and one for changing notes setup. Programming Programming consists of two parts. Master(touchboard) program that reads values from proximity sensors and sends messages to slaves(arduinos). Second program for slaves that reads messages from m
Read more

Skate tricks recognition using gyroscope

Image
In this article we're going to describe how to recognize a skateboard trick using a gyroscope. This sensor is already present in most of the smartphones but in case you are not familiar with it, here is a description . Before we begin, small disclaimer. This project was originally as a part of hackathon that was used with Slido and the purpose was to confirm that it's possible to recognize a trick using a gyroscope. For the sake of simplicity of this project we're not considering skater's stance on a board and we're only trying to recognize 2 simple tricks. So, let's begin by splitting the problem into several smaller ones. We need to record the trick, store it, describe it, understand it, and then of course recognize it. Recording the trick Let's start with the trick recording. To have a precise data we need to have a device with a gyroscope that is attached directly to a skateboard. We need to place it on the bottom of the board, otherwise it might interfe
Read more