Independent Web Vulnerability Scanner Comparison – Acunetix WVS, IBM Rational AppScan & HP WebInspect
I saw a relevant paper published today by an individual that claims the comparison was ordered by a penetration testing company (a company which remains unnamed).
The vendors were not contacted during or after the evaluation.
Testing Procedure
The author tested 13 web applications (some of them containing a lot of vulnerabilities), 3 demo applications provided by the vendors:
And some tests were done to verify JavaScript execution capabilities.
In total, 16 applications were tested.
An attempt was made to try and cover all the major platforms, so applications in PHP, ASP, ASP.NET and Java were used.
Note for Application Tests:
The report only included “important/critical/major” vulnerabilities like SQL injection, Local/Remote File Inclusion, XSS – Vulnerabilities like “Unencrypted Login Form”, “Directory listing found”, “Email address found” were not included to avoid clutter.
SQL injection vulnerabilities can be discovered through error messages or blind SQL injection. Some scanners are showing 2 alerts: one for the vulnerability found through error message and another for the blind technique. In these cases only one vulnerability has been counted.
The scanners were rated as follows:
You can download the full PDF report here:
And the associated JavaScript files used for testing here:
The original file location is:
http://drop.io/anantasecfiles/
Author’s blog – http://anantasec.blogspot.com/
Posted in: 
Recent in Countermeasures:
- Noted Chinese Hacker Wicked Rose Heading Antivirus Company Anvisoft
- HoneyDrive – Honeypots In A Box
- Microsoft Patches Critical Security Vulnerabilities In Windows, Office, IE, Exchange & SQL Server
Related Posts:
- Acunetix Web Vulnerability Scanner (WVS) 6.5 Released
- Acunetix WVS (Web Vulnerability Scanner) 7 Review – Engine & Scanning Improvements
- Acunetix Web Vulnerability Scanner 6 Review
Most Read in Countermeasures:
- AJAX: Is your application secure enough? - 117,838 views
- Password Hasher Firefox Extension - 115,942 views
- NDR or Backscatter Spam – How Non Delivery Reports Become a Nuisance - 57,465 views
That’s brutal at best…
This simply proves what I’ve always felt: Acunetix +Acusensor is the best choice out there
A bit slower, but extremely valuable!!
Nice report though!!
Thanks
I think it’s stupid to use the WebInspect demo page. Why wouldn’t WI win for that one!?!
With Navin,
Yep nice report.
The amount of missed and false negatives is worrying and it’s a good thing for Acunetix that they appear to do so well. The other should definitely wake up and get improving.