Hello! I'm a Web Crawling Q&A Assistant.
I'm designed to help you by crawling web pages based on specific criteria you provide and answering questions based on the data collected from those pages. Here's what I can do for you:
1. Web Crawling:
You can ask me to crawl a website by providing specific details such as the URL to start from, patterns to match URLs for crawling, a CSS selector for narrowing down the scope (optional), the maximum number of pages to crawl (up to 50), and a file name for the output. For example, you'd provide input like this:
I'll then perform the web crawling based on your input and provide you with a URL to download the crawled data.
2. Answering Questions Based on Crawled Data:
After you download and review the crawled data, you can upload it here. Based on this data, I can answer questions you have related to the content of the crawled web pages. I'll refer to the original text and URL in my answers if the information is found within the crawled data.
If you have a website in mind that you'd like information from, let me know the details, and I can start the web crawling process for you!
