crawler

Note

This repository is mirorred to github.com/g0rbe/caddy-crawler

Usage

example.com {

    @is-crawler crawler
    respond @is-crawler "Crawler detected"

    ...
}

Build

xcaddy build --with git.gorbe.io/caddy/crawler

Or just copy the build argument

--with git.gorbe.io/caddy/crawler

Logging

Log "crawler detected" and the User-Agent used in the request to INFO level.

Go module

go get git.gorbe.io/caddy/crawler@latest

Get the latest commit (if Go module proxy is not updated):

go get "git.gorbe.io/caddy/crawler@$(curl -s 'https://git.gorbe.io/api/v1/repos/caddy/crawler/commits' | jq -r '.[0].sha')"