Commit16a934b

authored

MAINT: Exclude devdocs from search engine results, except devdocs/devel/

1 parent451bdec commit16a934bCopy full SHA for 16a934b

File tree

+16

-1

lines changed

+16

-1

lines changed

Lines changed: 16 additions & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -6,7 +6,6 @@ User-agent: *`
`6`	`6`
`7`	`7`	`# do not search root directory by default.`
`8`	`8`	`Disallow:/api/`
`9`		`-Disallow:/devdocs/`
`10`	`9`	`Disallow:/devel/`
`11`	`10`	`Disallow:/examples/`
`12`	`11`	`Disallow:/faq/`
`@@ -39,6 +38,22 @@ Disallow: /py-modindex.html`
`39`	`38`	`Disallow:/search.html`
`40`	`39`	`Disallow:/searchindex.js`
`41`	`40`	`Disallow:/win32_*.tar.gz`
	`41`	`+# exclude all of /devdocs except /devdocs/devel`
	`42`	`+Disallow:/devdocs/api/`
	`43`	`+Disallow:/devdocs/faq/`
	`44`	`+Disallow:/devdocs/gallery/`
	`45`	`+Disallow:/devdocs/plot_types/`
	`46`	`+Disallow:/devdocs/resources/`
	`47`	`+Disallow:/devdocs/thirdpartypackages/`
	`48`	`+Disallow:/devdocs/tutorials/`
	`49`	`+Disallow:/devdocs/users/`
	`50`	`+Disallow:/devdocs/citing.html`
	`51`	`+Disallow:/devdocs/contents.html`
	`52`	`+Disallow:/devdocs/index.html`
	`53`	`+Disallow:/devdocs/objects.inv`
	`54`	`+Disallow:/devdocs/py-modindex.html`
	`55`	`+Disallow:/devdocs/search.html`
	`56`	`+Disallow:/devdocs/searchindex.js`
`42`	`57`
`43`	`58`	`# tell robots this is sitemap`
`44`	`59`	`Sitemap:https://matplotlib.org/_sitemap/sitemap.xml`

Comments

(0)