robotframework-doctestlibrary

---

Project will be moved to GitHub soon as a public package. So some links in this readme already refer to the future GitHub Locations. Sorry for the inconvenience.

Robot Framework DocTest library. Simple Automated Visual Document Testing.

Powered by

• Open CV
• scikit-image
• ImageMagick
• Ghostscript
• PyWand
• Tesseract OCR
• pdfminer
• parsimonious
• The knowledge of stackoverflow.com

See keyword documentation for

• Visual Document Tests
• Print Job Tests
• Pdf Tests (very basic)

Installation instructions

Only Python 3.X or newer is supported.

1. Clone the robotframework-doctestlibrary git clone https://github.com/manykarim/robotframework-doctestlibrary.git
2. Install robotframework-doctestlibrary via pip or setup.py
   • pip install --upgrade robotframework-doctestlibrary
   • python setup.py install
3. Install Tesseract, Ghoscript, GhostPCL, ImageMagick binaries
   • Linux
     • apt-get install imagemagick
     • apt-get install tesseract-ocr
     • apt-get install ghostscript
     • apt-get install libdmtx0b
   • Windows
     • https://github.com/UB-Mannheim/tesseract/wiki
     • https://www.ghostscript.com/download/gsdnld.html
     • https://www.ghostscript.com/download/gpcldnld.html
     • https://imagemagick.org/script/download.php

Some special instructions for Windows

Add tesseract, ghostscript and imagemagick to system path in windows

• C:\Program Files\ImageMagick-7.0.10-Q16-HDRI
• C:\Program Files\Tesseract-OCR
• C:\Program Files\gs\gs9.53.1\bin
• C:\Program Files\gs\ghostpcl-9.53.1-win64

(The folder names and versions on your system might be different)

That means: When you open the CMD shell you can run the commands

• magick.exe
• tesseract.exe
• gswin64.exe
• pcl6.exe

successfully from any folder/location

Rename executable for GhostPCL to pcl6.exe

The executable for GhostPCL gpcl6win64.exe needs to be renamed to pcl6.exe

Otherwise it will not be possible to render .pcl files successfully for visual comparison.

Docker

You can also use the docker images or create your own Docker Image docker build -t robotframework-doctest . Afterwards you can e.g. start the container and run the povided examples like this:

• Windows
  • docker run -t -v "%cd%":/opt/test -w /opt/test robotframework-doctest robot atest/Compare.robot
• Linux
  • docker run -t -v $PWD:/opt/test -w /opt/test robotframework-doctest robot atest/Compare.robot

Examples

Check the /atest/Compare.robot test suite for some examples

Testing with Robot Framework

*** Settings ***
Library    DocTest.VisualTest

*** Test Cases ***
Compare two Images and highlight differences
    Compare Images    Reference.jpg    Candidate.jpg

Use masks/placeholders to exclude parts from visual comparison

*** Settings ***
Library    DocTest.VisualTest

*** Test Cases ***
Compare two Images and ignore parts by using masks
    Compare Images    Reference.jpg    Candidate.jpg    placeholder_file=masks.json

Compare two PDF Docments and ignore parts by using masks
    Compare Images    Reference.jpg    Candidate.jpg    placeholder_file=masks.json

Different Mask Types to ignore parts from comparison

Areas, Coordinates, Text Patterns

[
    {
    "page": "all",
    "name": "Date Pattern",
    "type": "pattern",
    "pattern": ".*[0-9]{2}-[a-zA-Z]{3}-[0-9]{4}.*"
    },
    {
    "page": "1",
    "name": "Top Border",
    "type": "area",
    "location": "top",
    "percent":  5
    },
    {
    "page": "1",
    "name": "Left Border",
    "type": "area",
    "location": "left",
    "percent":  5
    },
    {
    "page": 1,
    "name": "Top Rectangle",
    "type": "coordinates",
    "x": 0,
    "y": 0,
    "height": 10,
    "width": 210,
    "unit": "mm"
    }
]

Accept visual different by checking move distance or text content

*** Settings ***
Library    DocTest.VisualTest

*** Test Cases ***
Accept if parts are moved up to 20 pixels by pure visual check
    Compare Images    Reference.jpg    Candidate.jpg    move_tolerance=20

Accept if parts are moved up to 20 pixels by reading PDF Data
    Compare Images    Reference.pdf    Candidate.pdf    move_tolerance=20    get_pdf_content=${true}

Accept differences if text content is the same via OCR
    Compare Images    Reference.jpg    Candidate.jpg    check_text_content=${true}

Accept differences if text content is the same from PDF Data
    Compare Images    Reference.pdf    Candidate.pdf    check_text_content=${true}    get_pdf_content=${true}

Options for taking additional screenshots, screenshot format and render resolution

*** Settings ***
Library    DocTest.VisualTest   take_screenshots=${true}    screenshot_format=png

*** Settings ***
Library    DocTest.VisualTest   show_diff=${true}    DPI=300

Check content of PDF files

*** Settings ***
Library    DocTest.PdfTest

*** Test Cases ***
Check if list of strings exists in PDF File
    @{strings}=    Create List    First String    Second String
    Check Text Content    ${strings}    Candidate.pdf

Development

See CONTRIBUTING.md for development instructions.

Core team

In order of appearance.

• Many Kasiriha

Contributors

This project is community driven and becomes a reality only through the work of all the people who contribute.