|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.nutch.protocol.httpclient.RobotRulesParser.RobotRuleSet
This class holds the rules which were parsed from a robots.txt file, and can test paths against those rules.
Method Summary | |
long |
getExpireTime()
Get expire time |
boolean |
isAllowed(String path)
Returns false if the robots.txt file
prohibits us from accessing the given path , or
true otherwise. |
void |
setExpireTime(long expireTime)
Change when the ruleset goes stale. |
String |
toString()
|
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait |
Method Detail |
public void setExpireTime(long expireTime)
public long getExpireTime()
public boolean isAllowed(String path)
false
if the robots.txt
file
prohibits us from accessing the given path
, or
true
otherwise.
public String toString()
|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |