Web Scraping Knowledge Base

Our collection of web scraping tutorials, articles and how-tos.

• What is Cloudflare Error 1020 and How to Bypass it
• Click a Button in Scrapy
• How to remove '\n' from scrapy output in python
• How to solve 403 error in scrapy
• OkHTTPClient Proxy authentication how to?
• Scrapy crawl multiple pages error filtered duplicate
• Selenium Chrome Proxy Authentication (Manifest v3, Chrome v137 and above)
• Working with proxy list c#
• Using ChatGPT for Web Scraping
• Using Selenium Chromedriver with Rotating proxies
• Tunneling TCP traffic through HTTP proxy
• Using Puppeteer with Rotating Proxies
• Using Scrapy with Proxies (IP Rotating Proxy)