public class SimpleRobotRules extends BaseRobotRules
Modifier and Type | Class and Description |
---|---|
protected class |
SimpleRobotRules.RobotRule
Single rule that maps from a path prefix to an allow flag.
|
static class |
SimpleRobotRules.RobotRulesMode |
Constructor and Description |
---|
SimpleRobotRules() |
SimpleRobotRules(SimpleRobotRules.RobotRulesMode mode) |
Modifier and Type | Method and Description |
---|---|
void |
addRule(java.lang.String prefix,
boolean allow) |
void |
clearRules() |
boolean |
isAllowAll()
Is our ruleset set up to allow all access?
|
boolean |
isAllowed(java.lang.String url) |
boolean |
isAllowNone()
Is our ruleset set up to disallow all access?
|
addSitemap, getCrawlDelay, getSitemaps, isDeferVisits, setCrawlDelay, setDeferVisits
public SimpleRobotRules()
public SimpleRobotRules(SimpleRobotRules.RobotRulesMode mode)
public void clearRules()
public void addRule(java.lang.String prefix, boolean allow)
public boolean isAllowed(java.lang.String url)
isAllowed
in class BaseRobotRules
public boolean isAllowAll()
isAllowAll
in class BaseRobotRules
public boolean isAllowNone()
isAllowNone
in class BaseRobotRules
Copyright © 2012 Bixo Labs