Are there parts of your site you won’t want indexed? We’ve got you covered.
To exclude parts of your website by path, you can use Path Exclusions. You can exclude pages starting with, containing, or ending with the text you specify. For advanced users, we also support regular expression matches.
To add a path exclusion, click on a crawler-based engine, then select the Domains tab, then the domain to which you want to add path exclusions.
As you type your exclusion, we’ll show you a sample of the pages that will be removed from the index.
Once you’re happy with the exclusions, hit the Recrawl button to put them into effect.
On an individual page, you can exclude content (for example, your header or footer) by adding the
data-swiftype-index attribute set to
Here’s an example:
An example page with content exclusion
This content will be indexed, since it isn’t surrounded by an excluded tag.
By combining Path Exclusions and Content Exclusion, you can precisely control how your website is indexed by Swiftype.
As always, if you have trouble, please reach out.