org.openimaj.image.processing.face.alignment

Class MeshWarpAligner

java.lang.Object

org.openimaj.image.processing.face.alignment.MeshWarpAligner

All Implemented Interfaces:

FaceAligner<KEDetectedFace>, ReadableBinary, ReadWriteableBinary, WriteableBinary

public class MeshWarpAligner
extends Object
implements FaceAligner<KEDetectedFace>

A MeshWarpAligner aligns facial images using a piecewise mesh warping such that all detected facial keypoints are moved to their canonical coordinates. The warping is accomplished by defining a mesh of triangles and quadrilaterals over the facial keypoints and using bi-linear interpolation to get corrected pixel values.

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk)

See Also:

PiecewiseMeshWarp

Constructor Summary

Constructors

Constructor and Description
MeshWarpAligner() Default constructor
MeshWarpAligner(String[][] meshDefinition) Construct with the given mesh definition

Method Summary

Modifier and Type	Method and Description
FImage	align(KEDetectedFace descriptor) For the provided face detection, return an aligned version of the face.
byte[]	binaryHeader() Header for binary input.
protected List<Pair<Shape>>	createMesh(FacialKeypoint[] det)
protected FacialKeypoint[]	getActualPoints(FacialKeypoint[] keys, Jama.Matrix tf0)
FImage	getMask() Return a mask image for aligned faces.
protected FImage	getWarpedImage(FacialKeypoint[] kpts, FImage patch, Jama.Matrix tf0)
void	readBinary(DataInput in) Read internal state from in.
void	writeBinary(DataOutput out) Write the content of this as binary to out.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MeshWarpAligner

public MeshWarpAligner()

Default constructor

MeshWarpAligner

public MeshWarpAligner(String[][] meshDefinition)

Construct with the given mesh definition

Parameters:

meshDefinition - The mesh definition

Method Detail

getActualPoints

protected FacialKeypoint[] getActualPoints(FacialKeypoint[] keys,
                                           Jama.Matrix tf0)

createMesh

protected List<Pair<Shape>> createMesh(FacialKeypoint[] det)

align

public FImage align(KEDetectedFace descriptor)

Description copied from interface: FaceAligner

For the provided face detection, return an aligned version of the face.

Specified by:

align in interface FaceAligner<KEDetectedFace>

Parameters:

descriptor - the face to align

Returns:

aligned face

getWarpedImage

protected FImage getWarpedImage(FacialKeypoint[] kpts,
                                FImage patch,
                                Jama.Matrix tf0)

getMask

public FImage getMask()

Description copied from interface: FaceAligner

Return a mask image for aligned faces. 0 pixels mark background pixels that should be ignored in further processing of aligned faces produced by this aligner.

Specified by:

getMask in interface FaceAligner<KEDetectedFace>

Returns:

a mask image, or null if masking isn't required

readBinary

public void readBinary(DataInput in)
                throws IOException

Description copied from interface: ReadableBinary

Read internal state from in.

Specified by:

readBinary in interface ReadableBinary

Parameters:

in - source to read from.

Throws:

IOException - an error reading input

binaryHeader

public byte[] binaryHeader()

Description copied from interface: ReadableBinary

Header for binary input. Will be automatically read by IOUtils when using readBinary().

Specified by:

binaryHeader in interface ReadableBinary

Specified by:

binaryHeader in interface WriteableBinary

Returns:

header

writeBinary

public void writeBinary(DataOutput out)
                 throws IOException

Description copied from interface: WriteableBinary

Write the content of this as binary to out.

Specified by:

writeBinary in interface WriteableBinary

Parameters:

out - sink to write to

Throws:

IOException - an error writing to out