org.openimaj.image.processing.restoration.inpainting

Class AbstractFMMInpainter<IMAGE extends Image<?,IMAGE> & SinglebandImageProcessor.Processable<Float,FImage,IMAGE>>

java.lang.Object

org.openimaj.image.processing.restoration.inpainting.AbstractImageMaskInpainter<IMAGE>

org.openimaj.image.processing.restoration.inpainting.AbstractFMMInpainter<IMAGE>

Type Parameters:

IMAGE - The type of image that this processor can process

All Implemented Interfaces:

Inpainter<IMAGE>, ImageProcessor<IMAGE>, Processor<IMAGE>

Direct Known Subclasses:

TeleaInpainting

@Reference(type=Article,author="Telea, Alexandru",title="An Image Inpainting Technique Based on the Fast Marching Method.",year="2004",journal="J. Graphics, GPU, & Game Tools",pages={"23","34"},url="http://dblp.uni-trier.de/db/journals/jgtools/jgtools9.html#Telea04",number="1",volume="9",customData={"biburl","http://www.bibsonomy.org/bibtex/2b0bf54e265d011a8e1fe256e6fcf556b/dblp","ee","http://dx.doi.org/10.1080/10867651.2004.10487596","keywords","dblp"}) @Reference(type=Inproceedings,author="J. A. Sethian",title="A Fast Marching Level Set Method for Monotonically Advancing Fronts",year="1995",booktitle="Proc. Nat. Acad. Sci",pages={"1591","","1595"})
public abstract class AbstractFMMInpainter<IMAGE extends Image<?,IMAGE> & SinglebandImageProcessor.Processable<Float,FImage,IMAGE>>
extends AbstractImageMaskInpainter<IMAGE>

Abstract base class for inpainting algorithms based on the Fast Marching Method (FMM) for selecting the order of pixels to paint.

FMM is used for computing the evolution of boundary moving in a direction normal to itself. Formally, FMM approximates the solution to the Eikonal function using an upwind scheme.

The core algorithm implemented by the performInpainting(Image) method follows these steps:

• Extract the pixel with the smallest distance value (t) in the BAND pixels.
• Update its flag value as KNOWN.
• March the boundary inwards by adding new points.
• If they are either UNKNOWN or BAND, compute its t value using the Eikonal function for all the 4 quadrants.
• If flag is UNKNOWN:
• Change it to BAND.
• Inpaint the pixel.
• Select the min value and assign it as the t value of the pixel.
• Insert this new value in the heap.

The inpaint(int, int, Image) method must be implemented by subclasses to actually perform the inpainting operation

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk)

Field Summary

Fields

Modifier and Type	Field and Description
protected static byte	BAND Flag for pixels on the boundary
protected byte[][]	flag The working flag image
protected PriorityQueue<FValuePixel>	heap The working heap of pixels to process next
protected static byte	KNOWN Flag for pixels with a known value
protected FImage	timeMap The space-time map (T)
protected static byte	UNKNOWN Flag for pixels with an unknown value

Fields inherited from class org.openimaj.image.processing.restoration.inpainting.AbstractImageMaskInpainter

mask

Constructor Summary

Constructors

Constructor and Description
AbstractFMMInpainter()

Method Summary

Modifier and Type	Method and Description
protected void	initMask() Perform any initialisation once the mask has been set.
protected abstract void	inpaint(int x, int y, IMAGE image) Inpaint the specified pixel of the given image.
void	performInpainting(IMAGE image) Perform the inpainting of the given image
protected float	solveEikonalStep(int x1, int y1, int x2, int y2) Solve a step of the Eikonal equation.

Methods inherited from class org.openimaj.image.processing.restoration.inpainting.AbstractImageMaskInpainter

processImage, setMask, setMask, setMask

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

KNOWN

protected static byte KNOWN

Flag for pixels with a known value

BAND

protected static byte BAND

Flag for pixels on the boundary

UNKNOWN

protected static byte UNKNOWN

Flag for pixels with an unknown value

flag

protected byte[][] flag

The working flag image

timeMap

protected FImage timeMap

The space-time map (T)

heap

protected PriorityQueue<FValuePixel> heap

The working heap of pixels to process next

Constructor Detail

AbstractFMMInpainter

public AbstractFMMInpainter()

Method Detail

initMask

protected void initMask()

Description copied from class: AbstractImageMaskInpainter

Perform any initialisation once the mask has been set. Does nothing by default; subclasses should override as required.

Overrides:

initMask in class AbstractImageMaskInpainter<IMAGE extends Image<?,IMAGE> & SinglebandImageProcessor.Processable<Float,FImage,IMAGE>>

solveEikonalStep

protected float solveEikonalStep(int x1,
                                 int y1,
                                 int x2,
                                 int y2)

Solve a step of the Eikonal equation.

Parameters:

x1 - x-position of first pixel (diagonally adjacent to the second)

y1 - y-position of first pixel (diagonally adjacent to the second)

x2 - x-position of second pixel (diagonally adjacent to the first)

y2 - y-position of second pixel (diagonally adjacent to the first)

Returns:

the time/distance value of the pixel at (x2, y1)

performInpainting

public void performInpainting(IMAGE image)

Description copied from class: AbstractImageMaskInpainter

Perform the inpainting of the given image

Specified by:

performInpainting in class AbstractImageMaskInpainter<IMAGE extends Image<?,IMAGE> & SinglebandImageProcessor.Processable<Float,FImage,IMAGE>>

Parameters:

image - the image to inpaint

inpaint

protected abstract void inpaint(int x,
                                int y,
                                IMAGE image)

Inpaint the specified pixel of the given image.

Parameters:

x - the x-ordinate of the pixel to paint

y - the y-ordinate of the pixel to paint

image - the image