forked from LibreSchool/libreschool.org
added robots.txt and favicon
This commit is contained in:
parent
875c5f0af5
commit
14c54c1383
BIN
static/favicon.ico
Normal file
BIN
static/favicon.ico
Normal file
Binary file not shown.
After Width: | Height: | Size: 1.1 KiB |
63
static/robots.txt
Normal file
63
static/robots.txt
Normal file
@ -0,0 +1,63 @@
|
||||
User-agent: *
|
||||
Disallow: /images/
|
||||
Disallow: /js/
|
||||
Disallow: /css/
|
||||
|
||||
User-agent: MJ12bot
|
||||
Disallow: /
|
||||
|
||||
User-agent: AhrefsBot
|
||||
Disallow: /
|
||||
|
||||
User-agent: BLEXBot
|
||||
Disallow: /
|
||||
|
||||
# Block SISTRIX
|
||||
User-agent: SISTRIX Crawler
|
||||
Disallow: /
|
||||
User-agent: sistrix
|
||||
Disallow: /
|
||||
User-agent: 007ac9
|
||||
Disallow: /
|
||||
User-agent: 007ac9 Crawler
|
||||
Disallow: /
|
||||
|
||||
# Block Uptime robot
|
||||
User-agent: UptimeRobot/2.0
|
||||
Disallow: /
|
||||
|
||||
# Block Ezooms Robot
|
||||
User-agent: Ezooms Robot
|
||||
Disallow: /
|
||||
|
||||
# Block Perl LWP
|
||||
User-agent: Perl LWP
|
||||
Disallow: /
|
||||
|
||||
# Block netEstate NE Crawler (+http://www.website-datenbank.de/)
|
||||
User-agent: netEstate NE Crawler (+http://www.website-datenbank.de/)
|
||||
Disallow: /
|
||||
|
||||
# Block WiseGuys Robot
|
||||
User-agent: WiseGuys Robot
|
||||
Disallow: /
|
||||
|
||||
# Block Turnitin Robot
|
||||
User-agent: Turnitin Robot
|
||||
Disallow: /
|
||||
|
||||
# Block Heritrix
|
||||
User-agent: Heritrix
|
||||
Disallow: /
|
||||
|
||||
# Block pricepi
|
||||
User-agent: pimonster
|
||||
Disallow: /
|
||||
|
||||
User-agent: SurdotlyBot
|
||||
Disallow: /
|
||||
|
||||
User-agent: ZoominfoBot
|
||||
Disallow: /
|
||||
|
||||
Sitemap: https://libreschool.org/sitemap.xml
|
Loading…
x
Reference in New Issue
Block a user