• License: BSD-3-Clause
• Home: https://github.com/scrapy/w3lib/
• Development: https://github.com/scrapy/w3lib
• 253086 total downloads
• Last upload: 5 months and 21 days ago

Description

This is a Python library of web-related functions, such as remove comments, or tags from HTML snippets, extract base url from HTML snippets, translate entites on HTML strings, convert raw HTTP headers to dicts and vice-versa, construct HTTP auth header, converting HTML pages to unicode, sanitize urls (like browsers do), extract arguments from urls.