public class ProcessRobotsTask
extends java.lang.Object
implements java.lang.Runnable
Constructor and Description |
---|
ProcessRobotsTask(java.lang.String protocolAndDomain,
BaseScoreGenerator scorer,
java.util.Queue<GroupedUrlDatum> urls,
BaseFetcher fetcher,
BaseRobotsParser parser,
cascading.tuple.TupleEntryCollector collector,
com.scaleunlimited.cascading.LoggingFlowProcess flowProcess) |
Modifier and Type | Method and Description |
---|---|
static void |
emptyQueue(java.util.Queue<GroupedUrlDatum> urls,
java.lang.String groupingKey,
cascading.tuple.TupleEntryCollector collector,
cascading.flow.FlowProcess process)
Clear out the queue by outputting all entries with
|
void |
run() |
public ProcessRobotsTask(java.lang.String protocolAndDomain, BaseScoreGenerator scorer, java.util.Queue<GroupedUrlDatum> urls, BaseFetcher fetcher, BaseRobotsParser parser, cascading.tuple.TupleEntryCollector collector, com.scaleunlimited.cascading.LoggingFlowProcess flowProcess)
public static void emptyQueue(java.util.Queue<GroupedUrlDatum> urls, java.lang.String groupingKey, cascading.tuple.TupleEntryCollector collector, cascading.flow.FlowProcess process)
urls
- Queue of URLs to empty outgroupingKey
- grouping key to use for all entries.collector
- tuple output collectorpublic void run()
run
in interface java.lang.Runnable
Copyright © 2012 Bixo Labs