Package | Description |
---|---|
bixo.fetcher | |
bixo.operations | |
bixo.robots | |
bixo.utils |
Modifier and Type | Field and Description |
---|---|
protected UserAgent |
BaseFetcher._userAgent |
Modifier and Type | Method and Description |
---|---|
UserAgent |
BaseFetcher.getUserAgent() |
Constructor and Description |
---|
BaseFetcher(int maxThreads,
FetcherPolicy fetcherPolicy,
UserAgent userAgent) |
SimpleHttpFetcher(int maxThreads,
FetcherPolicy fetcherPolicy,
UserAgent userAgent) |
SimpleHttpFetcher(int maxThreads,
UserAgent userAgent) |
SimpleHttpFetcher(UserAgent userAgent) |
Modifier and Type | Method and Description |
---|---|
static BaseFetcher |
UrlLengthener.makeFetcher(int maxThreads,
UserAgent userAgent)
Return a SimpleHttpFetcher that's appropriate for lengthening URLs.
|
Constructor and Description |
---|
FilterAndScoreByUrlAndRobots(UserAgent userAgent,
int maxThreads,
BaseRobotsParser parser,
BaseScoreGenerator scorer) |
Modifier and Type | Method and Description |
---|---|
static BaseFetcher |
RobotUtils.createFetcher(UserAgent userAgent,
int maxThreads) |
Modifier and Type | Field and Description |
---|---|
static UserAgent |
ConfigUtils.BIXO_IT_AGENT |
static UserAgent |
ConfigUtils.BIXO_TEST_AGENT |
static UserAgent |
ConfigUtils.BIXO_TOOL_AGENT |
Copyright © 2012 Bixo Labs