org.openimaj.stream.functions

Class ImageSiteURLExtractor

java.lang.Object

org.openimaj.stream.functions.SiteSpecificURLExtractor

org.openimaj.stream.functions.ImageSiteURLExtractor

All Implemented Interfaces:

MultiFunction<URL,URL>

public class ImageSiteURLExtractor
extends SiteSpecificURLExtractor

This class implements a function that will given an input URL outputs a list of URLs to the possible images related to the input URL. This works by using a set of SiteSpecificConsumers for common image hosting sites to determine if the input URL is likely to lead to an image of images.

Currently, the following consumers are included:

• InstagramConsumer
• TwitterPhotoConsumer
• TmblrPhotoConsumer
• TwitPicConsumer
• ImgurConsumer
• FacebookConsumer
• YfrogConsumer
• OwlyImageConsumer
• TwipleConsumer
• CommonHTMLConsumers.FOTOLOG
• CommonHTMLConsumers.PHOTONUI
• CommonHTMLConsumers.PICS_LOCKERZ

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk)

Field Summary

Fields inherited from class org.openimaj.stream.functions.SiteSpecificURLExtractor

siteSpecific

Constructor Summary

Constructors

Constructor and Description
ImageSiteURLExtractor() Default constructor; includes tumblr support.
ImageSiteURLExtractor(boolean tumblr) Construct with or without Tumblr support
ImageSiteURLExtractor(boolean tumblr, boolean fallback) Construct with or without Tumblr support

Method Summary

Modifier and Type	Method and Description
protected List<URL>	processURLs(URL url) First, try all the SiteSpecificConsumer instances loaded into SiteSpecificURLExtractor.siteSpecific.

Methods inherited from class org.openimaj.stream.functions.SiteSpecificURLExtractor

apply

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ImageSiteURLExtractor

public ImageSiteURLExtractor(boolean tumblr,
                             boolean fallback)

Construct with or without Tumblr support

Parameters:

tumblr - true if tumblr is required.

fallback - true if should try to download directly

ImageSiteURLExtractor

public ImageSiteURLExtractor(boolean tumblr)

Construct with or without Tumblr support

Parameters:

tumblr - true if tumblr is required.

ImageSiteURLExtractor

public ImageSiteURLExtractor()

Default constructor; includes tumblr support.

Method Detail

processURLs

protected List<URL> processURLs(URL url)

First, try all the SiteSpecificConsumer instances loaded into SiteSpecificURLExtractor.siteSpecific. If any consumer takes control of a link the consumer's output is used if this fails use HttpUtils.readURLAsByteArrayInputStream(URL, org.apache.http.client.RedirectStrategy) with a StatusConsumerRedirectStrategy which specifically disallows redirects to be dealt with automatically and forces this function to be called for each redirect.

Overrides:

processURLs in class SiteSpecificURLExtractor

Parameters:

url -

Returns:

a list of images or null