The author of WAVSEP (Shay Chen) e-mailed quite some time back about this project, but I have to say I honestly didn’t have time to look at it back then. It popped back up on my radar again when it was mentioned by the author of – Arachni v0.3 – his tool did extremely well in the WAVSEP tests.
The benchmark tests the SQL Injection and Reflected XSS vulnerability detection accuracy of12 commercial web application scanners and 48 free & open source web application scanners, and discusses the capabilities of many others (including information about a potential Trojan horse in one of them).
In addition to the benchmark, the author has published a detailed feature comparison between all the scanners (which generally include every open source or free to use web application vulnerability scanner commonly available)
The research compares the following aspects of these tools:
- Number & Type of Vulnerability Detection Features
- SQL Injection Detection Accuracy
- Reflected Cross Site Scripting Detection Accuracy
- General & Special Scanning Features
And what the author believes to me most important is that during his research he has developed a toolkit that can be used by any individual or organization to test the accuracy of web application scanners in a very detailed and accurate manner.
I for one applaud his efforts and I think this is a great project, of course there’s no completely objective ranking for these kind of things – but this study does give you a good idea of where different apps stand especially in terms of SQL Injection and XSS detection.
A lot of the tools we’ve written about here at Darknet come out tops (unsurprisingly).
The benchmark and reports (about 13 in total) can be found here:
The framework for assessing vulnerability scanners was implemented in JEE and can be downloaded here:
Or you can read more here.