crawler-cleaner
Process json web logs and remove logs from detected crawlers/bots/scrapers
Installation
To install this package, run one of the following:
Usage Tracking
0.1
1 / 8 versions selected
Downloads (Last 6 months): 0
Description
Processes json web log input from stdin (one json log object per line), removing any user agents determined to be crawlers/bot/scrapers. The project uses the crawler-user-agents project as the user agent database.
About
Summary
Process json web logs and remove logs from detected crawlers/bots/scrapers
Last Updated
Nov 8, 2024 at 19:57
Total Downloads
6
Supported Platforms
linux-64
macOS-64