Test suites
Test suites are sets of test cases. They are generally based on a software codebase or a specific weakness type category.
Standalone applications #
| ID | Name | Author | Language | Test cases | Created at | ||
|---|---|---|---|---|---|---|---|
 |
3 | GNU Grep 2.14 | Charles Oliveira | C | 380 | 27 Oct 2015 | |
 |
5 | PostgreSQL 9.2.4 | Charles Oliveira | C | 637 | 27 Oct 2015 | |
 |
8 | Wireshark 1.10.2 | Charles Oliveira | C | 637 | 27 Oct 2015 | |
 |
7 | Apache Subversion 1.8.3 | Charles Oliveira | C | 638 | 27 Oct 2015 | |
 |
11 | Apache Jena 2.11.0 | Charles Oliveira | Java | 476 | 27 Oct 2015 | |
 |
14 | Apache Lucene 4.5.0 | Charles Oliveira | Java | 480 | 27 Oct 2015 | |
 |
17 | FFmpeg 1.2.2 | Charles Oliveira | C | 637 | 27 Oct 2015 | |
| 9 | CoffeeMUD 5.8 | Charles Oliveira | Java | 478 | 27 Oct 2015 | ||
 |
4 | OpenSSL 1.0.1e | Charles Oliveira | C | 636 | 27 Oct 2015 | |
 |
15 | Apache POI 3.9 | Charles Oliveira | Java | 479 | 27 Oct 2015 | |
 |
18 | Gimp 2.8.8 | Charles Oliveira | C | 637 | 27 Oct 2015 | |
| 6 | Tree 1.7.0 | Charles Oliveira | C | 380 | 27 Oct 2015 | ||
| 16 | JTree | Charles Oliveira | Java | 160 | 27 Oct 2015 | ||
 |
10 | Elasticsearch 1.0.0 | Charles Oliveira | Java | 478 | 27 Oct 2015 | |
 |
12 | Apache JMeter 2.8 | Charles Oliveira | Java | 160 | 27 Oct 2015 | |
 |
21 | Open Fire 3.6.0 | SAMATE Team Staff | Java | 12 | 18 Sep 2017 | |
 |
19 | IARPA STONESOUP phase 3 - Asterisk 10.2.0 | SAMATE Team Staff | C | 20 | 18 Sep 2017 | |
 |
22 | IARPA STONESOUP phase 3 - Wireshark 1.8.0 | SAMATE Team Staff | C | 127 | 18 Sep 2017 |
Mobile applications #
| ID | Name | Author | Language | Test cases | Created at | ||
|---|---|---|---|---|---|---|---|
| 2 | Card Board Sample 1.0 | Charles Oliveira | Java | 1 | 15 Apr 2015 | ||
 |
23 | VLC 2.1.3 deprecated | SAMATE Team Staff | Java | 16 | 19 Sep 2017 |
Stand-alone Suites #
| ID | Name | Author | Language | Test cases | Created at | ||
|---|---|---|---|---|---|---|---|
 |
113 | IARPA STONESOUP Phase 3 - Virtual Machine 3.0 | IARPA | C | 7,770 | 01 May 2015 | |
| 110 | Juliet C# 1.3 | NSA Center for Assured Software | C# | 28,942 | 01 Aug 2020 | ||
| 112 | Juliet C/C++ 1.3 | NSA Center for Assured Software | C++ | 64,099 | 01 Oct 2017 | ||
| 111 | Juliet Java 1.3 | NSA Center for Assured Software | Java | 28,881 | 01 Oct 2017 |
Web applications #
| ID | Name | Author | Language | Test cases | Created at | ||
|---|---|---|---|---|---|---|---|
 |
1 | WordPress 2.0 | Charles Oliveira | PHP | 23 | 31 Mar 2015 | |
 |
13 | Apache Lenya 2.0.4 | Charles Oliveira | Java | 477 | 27 Oct 2015 | |
 |
20 | JSP Wiki 2.5.124-beta | SAMATE Team Staff | Java | 3 | 18 Sep 2017 |
SARD Suites #
| ID | Name | Author | Language | Test cases | Created at | ||
|---|---|---|---|---|---|---|---|
| 100 | C Test Suite for Source Code Analyzer v2 - Vulnerable | Aurelien Delaitre | C | 102 | 15 Mar 2015 | ||
| 101 | C Test Suite for Source Code Analyzer - Secure v2 | Aurelien Delaitre | C | 102 | 15 Mar 2015 | ||
| 105 | C# Vulnerability Test Suite | Bertrand C. Stivalet | C# | 32,003 | 12 Sep 2016 | ||
| 103 | PHP Vulnerability Test Suite | Bertrand C. Stivalet | PHP | 42,212 | 27 Oct 2015 | ||
| 104 | ITC-Benchmarks | Charles Oliveira | C | 100 | 12 Sep 2016 | ||
 |
102 | IARPA STONESOUP Phase 3 - Test Cases | Charles Oliveira | C | 7,770 | 27 Oct 2015 | |
| 27 | MS | Eric D. | C | 25 | 17 Oct 2006 | ||
| 88 | Testing Exploitable Buffer Overflows From Open Source Code | Eric Rosenberg | C | 28 | 08 Jun 2014 | ||
| 89 | A Taxonomy of Buffer Overflows | Eric Rosenberg | C | 1,164 | 08 Jun 2014 | ||
| 114 | PHP test suite - XSS, SQLi 1.0.0 | Felix Schuckert, Hanno Langweg, Basel Katt | PHP | 248,592 | 12 May 2022 | ||
| 115 | PHP test suite - data flow 1.0.0 | Felix Schuckert, Hanno Langweg, Basel Katt | PHP | 20 | 02 Aug 2022 | ||
| 35 | ABM 1.0.1 | Jeff Meister | C | 112 | 22 Jun 2006 | ||
| 57 | C++ Test Suite for Source Code Analyzer - weakness | Michael Koo | C++ | 41 | 05 Dec 2007 | ||
| 81 | Basic CWE Effectiveness, CWE-121: Stack-based Buffer Overflow, for C | Michael Koo | C | 5 | 07 Feb 2013 | ||
| 59 | C++ Test Suite for Source Code Analyzer - weakness suppresion | Michael Koo | C++ | 14 | 05 Dec 2007 | ||
| 64 | Java Test Suite for Source Code Analyzer - false positive | Michael Koo | Java | 27 | 03 Feb 2010 | ||
| 65 | Java Test Suite for Source Code Analyzer - weakness suppresion | Michael Koo | Java | 10 | 03 Feb 2010 | ||
| 47 | C Test Suite for Source Code Analyzer - weakness suppresion deprecated | Michael Koo | C | 21 | 04 Feb 2007 | ||
| 63 | Java Test Suite for Source Code Analyzer - weakness | Michael Koo | Java | 27 | 03 Feb 2010 | ||
| 45 | C Test Suite for Source Code Analyzer - weakness deprecated | Michael Koo | C | 77 | 23 Jan 2007 | ||
| 46 | C Test Suite for Source Code Analyzer - false positive deprecated | Michael Koo | C | 73 | 04 Feb 2007 | ||
| 58 | C++ Test Suite for Source Code Analyzer - false positive | Michael Koo | C++ | 39 | 05 Dec 2007 | ||
| 108 | Juliet C/C++ 1.3 with extra support deprecated | Paul E. Black | C++ | 64,099 | 02 Nov 2017 | ||
| 109 | Juliet Java 1.3 with extra support | Paul E. Black | Java | 28,881 | 02 Nov 2017 | ||
| 116 | Juliet C/C++ 1.3.1 with extra support | Paul E. Black, Yann Prono | C++ | 64,099 | 11 Aug 2022 | ||
| 36 | Test suite (2006/07/11 18:32:50) | Redge Bartholomew | C | 5 | 10 Jul 2006 | ||
| 31 | Web Applications in PHP | Romain Gaucher | PHP | 15 | 23 Oct 2006 | ||
 |
95 | Apache-tomcat 5.5.13 | SAMATE Team Staff | Java | 37 | 31 Jul 2014 | |
 |
98 | Openfire 3.6.0 | SAMATE Team Staff | Java | 12 | 31 Jul 2014 | |
 |
107 | VLC for Android test suite deprecated | SAMATE Team Staff | Java | 16 | 18 Sep 2017 | |
| 37 | CANDIDATE Source Code Analysis Tool Functional Specification Test Suite | SAMATE Team Staff | C | 34 | 08 Aug 2006 | ||
 |
92 | Dovecot 1.2.0 | SAMATE Team Staff | C | 9 | 31 Jul 2014 | |
| 106 | Klocwork test suite | SAMATE Team Staff | C | 41 | 18 Sep 2017 | ||
 |
94 | Wireshark 1.8.0 | SAMATE Team Staff | C | 127 | 31 Jul 2014 | |
 |
91 | Chrome 5.0.375.54 | SAMATE Team Staff | C | 10 | 31 Jul 2014 | |
 |
93 | Wireshark 1.2.0 | SAMATE Team Staff | C | 44 | 31 Jul 2014 | |
 |
96 | Jetty 6.1.16 | SAMATE Team Staff | Java | 6 | 31 Jul 2014 | |
 |
99 | Wordpress 2.0 | SAMATE Team Staff | PHP | 22 | 31 Jul 2014 | |
 |
90 | Asterisk 10.2.0 | SAMATE Team Staff | C | 20 | 31 Jul 2014 | |
 |
97 | Jspwiki 2.5.124 | SAMATE Team Staff | Java | 3 | 31 Jul 2014 | |
| 62 | Defence R&D Canada | SAMATE Team Staff | C | 26 | 01 Oct 2008 |
Archives #
| ID | Name | Author | Language | Test cases | Created at | ||
|---|---|---|---|---|---|---|---|
 |
33 | IARPA STONESOUP Phase 1 - Null Pointer Dereference for C 1.0 | IARPA | C | 115 | 01 Nov 2012 | |
 |
34 | IARPA STONESOUP Phase 1 - Memory Corruption for C 1.0 | IARPA | C | 212 | 01 Nov 2012 | |
 |
32 | IARPA STONESOUP Phase 1 - Injection for Java 1.0 | IARPA | Java | 36 | 01 Nov 2012 | |
 |
30 | IARPA STONESOUP Phase 1 - Numeric Handling for Java 1.0 | IARPA | Java | 59 | 01 Nov 2012 | |
 |
29 | IARPA STONESOUP Phase 1 - Tainted Data for Java 1.0 | IARPA | Java | 35 | 01 Nov 2012 | |
| 24 | Juliet Java 1.0 | NSA Center for Assured Software | Java | 14,184 | 01 Dec 2010 | ||
| 28 | Juliet Java 1.1.1 | NSA Center for Assured Software | Java | 23,957 | 01 Sep 2012 | ||
| 84 | Juliet C/C++ 1.2 deprecated | NSA Center for Assured Software | C++ | 61,387 | 01 May 2013 | ||
| 25 | Juliet C/C++ 1.0 | NSA Center for Assured Software | C++ | 45,309 | 01 Dec 2010 | ||
| 85 | Juliet Java 1.2 deprecated | NSA Center for Assured Software | Java | 25,477 | 01 May 2013 | ||
| 26 | Juliet C/C++ 1.1 | NSA Center for Assured Software | C++ | 57,099 | 01 Jul 2012 | ||
| 69 | Juliet Java 1.0 with extra support deprecated | SAMATE Team Staff | Java | 14,184 | 07 Apr 2011 | ||
| 87 | Juliet Java 1.2 with extra support deprecated | SAMATE Team Staff | Java | 25,477 | 14 May 2013 | ||
| 86 | Juliet C/C++ 1.2 with extra support deprecated | SAMATE Team Staff | C++ | 61,387 | 14 May 2013 | ||
| 68 | Juliet C/C++ 1.0 with extra support deprecated | SAMATE Team Staff | C++ | 45,309 | 07 Apr 2011 |