org.openimaj.image.processing.face.alignment

Class AffineAligner

java.lang.Object

org.openimaj.image.processing.face.alignment.AffineAligner

All Implemented Interfaces:

FaceAligner<KEDetectedFace>, ReadableBinary, ReadWriteableBinary, WriteableBinary

public class AffineAligner
extends Object
implements FaceAligner<KEDetectedFace>

The AffineAligner attempts to find an affine transform that will warp the face to the canonical frame by aligning facial keypoints.

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk)

Field Summary

Fields

Modifier and Type	Field and Description
protected static float[][]	Pmu Normalised positions of facial parts

Constructor Summary

Constructors

Constructor and Description
AffineAligner() Default Constructor with the default mask (80x80) and default border percentage (0.225).
AffineAligner(FImage mask) Construct with a mask (in the canonical frame) to apply after aligning and default border percentage (0.225).
AffineAligner(FImage mask, float facePatchBorderPercentage) Construct with a mask (in the canonical frame) to apply after aligning and default border percentage (0.225).
AffineAligner(int facePatchWidth, int facePatchHeight, float facePatchBorderPercentage) Construct with no mask and the given size and border.

Method Summary

Modifier and Type	Method and Description
FImage	align(KEDetectedFace descriptor) For the provided face detection, return an aligned version of the face.
byte[]	binaryHeader() Header for binary input.
protected static Jama.Matrix	estimateAffineTransform(FacialKeypoint[] pts)
static Jama.Matrix	estimateAffineTransform(KEDetectedFace face) Estimate the affine transform required to warp a set of facial keypoints to their canonical coordinates.
FImage	getMask() Return a mask image for aligned faces.
void	readBinary(DataInput in) Read internal state from in.
void	writeBinary(DataOutput out) Write the content of this as binary to out.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

Pmu

protected static final float[][] Pmu

Normalised positions of facial parts

Constructor Detail

AffineAligner

public AffineAligner()

Default Constructor with the default mask (80x80) and default border percentage (0.225).

AffineAligner

public AffineAligner(FImage mask)

Construct with a mask (in the canonical frame) to apply after aligning and default border percentage (0.225).

Parameters:

mask -

AffineAligner

public AffineAligner(FImage mask,
                     float facePatchBorderPercentage)

Construct with a mask (in the canonical frame) to apply after aligning and default border percentage (0.225).

Parameters:

mask - the mask

facePatchBorderPercentage - the proportional size (against the detection patch) of the border for the crop. Higher values result in a more zoomed-in face.

AffineAligner

public AffineAligner(int facePatchWidth,
                     int facePatchHeight,
                     float facePatchBorderPercentage)

Construct with no mask and the given size and border.

Parameters:

facePatchWidth - the width of the desired aligned faces

facePatchHeight - the height of the desired aligned faces

facePatchBorderPercentage - the proportional size (against the detection patch) of the border for the crop. Higher values result in a more zoomed-in face.

Method Detail

align

public FImage align(KEDetectedFace descriptor)

Description copied from interface: FaceAligner

For the provided face detection, return an aligned version of the face.

Specified by:

align in interface FaceAligner<KEDetectedFace>

Parameters:

descriptor - the face to align

Returns:

aligned face

estimateAffineTransform

public static Jama.Matrix estimateAffineTransform(KEDetectedFace face)

Estimate the affine transform required to warp a set of facial keypoints to their canonical coordinates.

Affine transform is from a flat, vertically oriented (canonical) face to located face space. You'll need to invert this if you want to use it to extract the face from the image.

Parameters:

face - the face

Returns:

the affine transform matrix

estimateAffineTransform

protected static Jama.Matrix estimateAffineTransform(FacialKeypoint[] pts)

getMask

public FImage getMask()

Description copied from interface: FaceAligner

Return a mask image for aligned faces. 0 pixels mark background pixels that should be ignored in further processing of aligned faces produced by this aligner.

Specified by:

getMask in interface FaceAligner<KEDetectedFace>

Returns:

a mask image, or null if masking isn't required

readBinary

public void readBinary(DataInput in)
                throws IOException

Description copied from interface: ReadableBinary

Read internal state from in.

Specified by:

readBinary in interface ReadableBinary

Parameters:

in - source to read from.

Throws:

IOException - an error reading input

binaryHeader

public byte[] binaryHeader()

Description copied from interface: ReadableBinary

Header for binary input. Will be automatically read by IOUtils when using readBinary().

Specified by:

binaryHeader in interface ReadableBinary

Specified by:

binaryHeader in interface WriteableBinary

Returns:

header

writeBinary

public void writeBinary(DataOutput out)
                 throws IOException

Description copied from interface: WriteableBinary

Write the content of this as binary to out.

Specified by:

writeBinary in interface WriteableBinary

Parameters:

out - sink to write to

Throws:

IOException - an error writing to out