Process json web logs and remove logs from detected crawlers/bots/scrapers
Processes json web log input from stdin (one json log object per line), removing any user agents determined to be crawlers/bot/scrapers. The project uses the crawler-user-agents project as the user agent database.
