Package | Description |
---|---|
bixo.config | |
bixo.datum | |
bixo.fetcher |
Modifier and Type | Method and Description |
---|---|
java.util.List<ScoredUrlDatum> |
BaseFetchJobPolicy.FetchSetInfo.getUrls() |
Modifier and Type | Method and Description |
---|---|
protected int |
DefaultFetchJobPolicy.getMaxUrlsPerServer(ScoredUrlDatum scoredDatum)
Return max URLs per fetch job for the server indicated by the URL in
|
protected int |
DefaultFetchJobPolicy.getMaxUrlsPerSet(ScoredUrlDatum scoredDatum)
Return max URLs per fetch set for the server indicated by the URL in
|
BaseFetchJobPolicy.FetchSetInfo |
DefaultFetchJobPolicy.nextFetchSet(ScoredUrlDatum scoredDatum) |
abstract BaseFetchJobPolicy.FetchSetInfo |
BaseFetchJobPolicy.nextFetchSet(ScoredUrlDatum scoredDatum) |
Constructor and Description |
---|
BaseFetchJobPolicy.FetchSetInfo(java.util.List<ScoredUrlDatum> urls,
long sortKey,
long fetchDelay,
boolean skipping) |
Modifier and Type | Method and Description |
---|---|
java.util.List<ScoredUrlDatum> |
FetchSetDatum.getUrls() |
Modifier and Type | Method and Description |
---|---|
void |
FetchSetDatum.setUrls(java.util.List<ScoredUrlDatum> urls) |
Constructor and Description |
---|
ContentDatum(ScoredUrlDatum scoredDatum)
Create place-holder FetchedDatum from the data used to attempt the fetch.
|
FetchedDatum(ScoredUrlDatum scoredDatum)
Create place-holder FetchedDatum from the data used to attempt the fetch.
|
Constructor and Description |
---|
FetchSetDatum(java.util.List<ScoredUrlDatum> urls,
long fetchTime,
long fetchDelay,
int groupingKey,
java.lang.String groupingRef) |
Modifier and Type | Method and Description |
---|---|
FetchedDatum |
SimpleHttpFetcher.get(ScoredUrlDatum scoredUrl) |
FetchedDatum |
LoggingFetcher.get(ScoredUrlDatum datum) |
abstract FetchedDatum |
BaseFetcher.get(ScoredUrlDatum scoredUrl) |
Constructor and Description |
---|
FetchTask(IFetchMgr fetchMgr,
BaseFetcher httpFetcher,
java.util.List<ScoredUrlDatum> items,
java.lang.String ref) |
Copyright © 2012 Bixo Labs