Package | Description |
---|---|
bixo.datum | |
bixo.operations |
Modifier and Type | Class and Description |
---|---|
class |
ScoredUrlDatum |
Modifier and Type | Method and Description |
---|---|
int |
GroupedUrlDatum.compareTo(GroupedUrlDatum o) |
Modifier and Type | Method and Description |
---|---|
double |
BaseScoreGenerator.generateScore(java.lang.String domain,
java.lang.String pld,
GroupedUrlDatum url) |
Modifier and Type | Method and Description |
---|---|
static void |
ProcessRobotsTask.emptyQueue(java.util.Queue<GroupedUrlDatum> urls,
java.lang.String groupingKey,
cascading.tuple.TupleEntryCollector collector,
cascading.flow.FlowProcess process)
Clear out the queue by outputting all entries with
|
Constructor and Description |
---|
ProcessRobotsTask(java.lang.String protocolAndDomain,
BaseScoreGenerator scorer,
java.util.Queue<GroupedUrlDatum> urls,
BaseFetcher fetcher,
BaseRobotsParser parser,
cascading.tuple.TupleEntryCollector collector,
com.scaleunlimited.cascading.LoggingFlowProcess flowProcess) |
Copyright © 2012 Bixo Labs