Search Appliance SBE

 

Thunderstone Search Appliance Manual

Off-Site Pages

Syntax: select Yes or No button

Allow retrieval of individual off-site pages. By default the Search Appliance will not retrieve pages that are not on the same host as the base URL(s). Using this option, pages not on the same machine will be retrieved, but none of the pages that they reference will be walked.

All other discarding rules don't involve the site except for Stay Under still apply (Extensions, Exclude Prefix, Required Rex, etc).


Copyright © Thunderstone Software     Last updated: Dec 10 2020