org.openimaj.web.scraping

Class SimpleHTMLScrapingConsumer

java.lang.Object

org.openimaj.web.scraping.HTMLScrapingSiteSpecificConsumer

org.openimaj.web.scraping.SimpleHTMLScrapingConsumer

All Implemented Interfaces:

SiteSpecificConsumer

public class SimpleHTMLScrapingConsumer
extends HTMLScrapingSiteSpecificConsumer

Simple scraper that just uses the given css selector to find all relevant data in the page

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Constructor Summary

Constructors

Constructor and Description
SimpleHTMLScrapingConsumer(String linkContains, String select)

Method Summary

Modifier and Type	Method and Description
boolean	canConsume(URL url) Determine whether the given URL can be handled by this consumer.
String	cssSelect()

Methods inherited from class org.openimaj.web.scraping.HTMLScrapingSiteSpecificConsumer

consume

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleHTMLScrapingConsumer

public SimpleHTMLScrapingConsumer(String linkContains,
                                  String select)

Parameters:

linkContains - the link should contain this

select - the css selector for the img

Method Detail

canConsume

public boolean canConsume(URL url)

Description copied from interface: SiteSpecificConsumer

Determine whether the given URL can be handled by this consumer.

Parameters:

url - the url to test

Returns:

true if the URL can be handled by this consumer; false otherwise.

cssSelect

public String cssSelect()

Specified by:

cssSelect in class HTMLScrapingSiteSpecificConsumer

Returns:

the css selection from which to find the img to scrape