Skip to content

a2n/web-robots

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Web Robots.txt Checker

  • A web robots.txt checker.

Usage

import (
	"github.com/a2n/web-robots"
	"fmt"
)

func main() {
	r := robots.NewRobots()
	fmt.Println(r.IsAllowURLString("Safari", "https://www.google.com/search/a"))
	fmt.Println(r.IsAllowURLString("Chrome", "https://www.yahoo.com/p/a"))
}

#License Web-robots is released under the CC0 1.0 Universal.

About

A web robots.txt checker.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages