Testing SAW (Scrape Any Website

Dorcas Bamisile - Jul 2 - - Dev Community

SAW, which stands for Scrape Any Website, is a Windows application designed to facilitate web scraping tasks. It allows users to scrape and extract data from various websites efficiently, providing a user-friendly interface for organizing and gathering information from the web.

Key Features of SAW

  • User-Friendly Interface
  • Efficient Data Extraction
  • Customizable Scrape Jobs
  • Support for Multiple Websites
  • Organized Data Storage

Testing Overview
We conducted thorough testing on a Windows 10 Pro machine using SAW version 1.0.0. Our testing aimed to uncover any bugs, usability issues, performance bottlenecks, and security vulnerabilities. We focused on both typical user scenarios and edge cases to ensure comprehensive coverage.

Key Findings
- Inconsistent Data Extraction: We observed inconsistencies in the data extraction results, with some elements missing from the output. Additionally, some large websites displayed binary data instead of the actual scraped content, making the extracted data unusable. Ensuring accurate and reliable data extraction is paramount for the application’s core functionality.

- Invisible Text Input: The text input field for adding a new scrape job has white text, which blends with the white background, making it difficult for users to see what they are typing. This is a usability issue that needs to be addressed to improve user experience.

- Lack of URL Validation in Add URL Form: The 'Add URL' form allows users to submit non-URL inputs without displaying any validation error. This can lead to confusion and potential misuse of the application. Users should receive a validation error and be prevented from submitting the form if the input is not a valid URL.

- Static Cursor on Interactive Elements: The cursor remains the default arrow even when hovering over interactive elements like links and buttons. The cursor should change to indicate that the element is clickable, enhancing the user experience and intuitiveness.

Conclusion
Overall, SAW has the potential to be a powerful web scraping tool. Addressing the identified issues will significantly enhance its stability, usability, and reliability.

You can download SAW from the Windows Store by following this link: Scrape Any Website.

For a detailed report on the bugs identified, please refer to our comprehensive bug report here and the excel sheet here.

. .