org.openimaj.web.scraping

Interface SiteSpecificConsumer

All Known Implementing Classes:

FacebookConsumer, HTMLScrapingSiteSpecificConsumer, ImgurConsumer, InstagramConsumer, OwlyImageConsumer, SimpleHTMLScrapingConsumer, TmblrPhotoConsumer, TwipleConsumer, TwitPicConsumer, TwitterPhotoConsumer, YfrogConsumer

public interface SiteSpecificConsumer

Site specific consumers answer whether they can handle a URL and when asked handle the URL, returning another URL from which the data can be downloaded. This interface doesn't specify exactly what the data is, but specific implementations will usually only apply to a single data modality.

Typical uses are for the downloading of images on a URL to an image hosting site.

Author:

Sina Samangooei (ss@ecs.soton.ac.uk), Jonathon Hare (jsh2@ecs.soton.ac.uk)

Method Summary

Modifier and Type	Method and Description
boolean	canConsume(URL url) Determine whether the given URL can be handled by this consumer.
List<URL>	consume(URL url) Get the data urls at the given URL.

Method Detail

canConsume

boolean canConsume(URL url)

Determine whether the given URL can be handled by this consumer.

Parameters:

url - the url to test

Returns:

true if the URL can be handled by this consumer; false otherwise.

consume

List<URL> consume(URL url)

Get the data urls at the given URL.

Parameters:

url - the url to test

Returns:

A list of URLs to data items at the given URL