Merge branch 'connorgilbert/docs-sast-eval-guide' into 'master'

Docs: Add guide to selecting a test project for SAST

See merge request https://gitlab.com/gitlab-org/gitlab/-/merge_requests/169494



Merged-by: Russell Dickenson <rdickenson@gitlab.com>
Approved-by: Thiago Figueiró <tfigueiro@gitlab.com>
Approved-by: Dinesh Bolkensteyn <dbolkensteyn@gitlab.com>
Approved-by: Russell Dickenson <rdickenson@gitlab.com>
Reviewed-by: Connor Gilbert <cgilbert@gitlab.com>
Co-authored-by: Connor Gilbert <cgilbert@gitlab.com>

doc/user/application_security/sast/evaluation_guide.md

+---
+stage: Secure
+group: Static Analysis
+info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://handbook.gitlab.com/handbook/product/ux/technical-writing/#assignments
+---
+
+# Evaluate GitLab SAST
+
+DETAILS:
+**Tier:** Ultimate
+**Offering:** GitLab.com, Self-managed, GitLab Dedicated
+
+You might choose to evaluate GitLab SAST before using it in your organization.
+Consider the following guidance as you plan and conduct your evaluation.
+
+## Choose a test codebase
+
+When choosing a codebase to test SAST, you should:
+
+- Test in a repository where you can safely modify the CI/CD configuration without getting in the way of normal development activities.
+  SAST scans run in your CI/CD pipeline, so you'll need to make a small edit to the CI/CD configuration to [enable SAST](index.md#configuration).
+  - You can make a fork or copy of an existing repository for testing. This way, you can set up your testing environment without any chance of interrupting normal development.
+- Use a codebase that matches your organization's typical technology stack.
+- Use a language that [Advanced SAST supports](gitlab_advanced_sast.md#supported-languages).
+  Advanced SAST produces more accurate results than other [analyzers](analyzers.md).
+
+Your test project must have GitLab Ultimate. Only Ultimate includes [features](index.md#features) like:
+
+- Proprietary cross-file, cross-function scanning with GitLab Advanced SAST.
+- The merge request widget, pipeline security report, and default-branch vulnerability report that makes scan results visible and actionable.
+
+### Benchmarks and example projects
+
+If you choose to use a benchmark or an intentionally vulnerable application for testing, remember that these applications:
+
+- Focus on specific vulnerability types.
+  The benchmark's focus may be different from the vulnerability types your organization prioritizes for discovery and remediation.
+- Use specific technologies in specific ways that may differ from how your organization builds software.
+- Report results in ways that may implicitly emphasize certain criteria over others.
+  For example, you may prioritize precision (fewer false-positive results) while the benchmark only scores based on recall (fewer false-negative results).
+
+[Epic 15296](https://gitlab.com/groups/gitlab-org/-/epics/15296) tracks work to recommend specific projects for testing.
+
+### AI-generated test code
+
+You should not use AI tools to create vulnerable code for testing SAST.
+AI models often return code that is not truly exploitable.
+
+For example:
+
+- AI tools often write small functions that take a parameter and use it in a sensitive context (called a "sink"), without actually receiving any user input.
+  This can be a safe design if the function is only called with program-controlled values, like constants.
+  The code is not vulnerable unless user input is allowed to flow to these sinks without first being sanitized or validated.
+- AI tools may comment out part of the vulnerability to prevent you from accidentally running the code.
+
+Reporting vulnerabilities in these unrealistic examples would cause false-positive results in real-world code.
+GitLab SAST is not designed to report vulnerabilities in these cases.
+
+## Conduct the test
+
+After you choose a codebase to test with, you're ready to conduct the test. You can follow these steps:
+
+1. [Enable SAST](index.md#configuration) by creating a merge request (MR) that adds SAST to the CI/CD configuration.
+   - Be sure to set the CI/CD variable to [enable Advanced SAST](gitlab_advanced_sast.md#enable-advanced-sast-scanning) for more accurate results.
+1. Merge the MR to the repository's default branch.
+1. Open the [Vulnerability Report](../vulnerability_report/index.md) to see the vulnerabilities found on the default branch.
+   - If you're using Advanced SAST, you can use the [Tool filter](../vulnerability_report/index.md#tool-filter) to show results only from that scanner.
+1. Review vulnerability results.
+   - Check the [code flow view](../vulnerabilities/index.md#vulnerability-code-flow) for Advanced SAST vulnerabilities that involve tainted user input, like SQL injection or path traversal.
+   - If you have GitLab Duo Enterprise, [explain](../vulnerabilities/index.md#explaining-a-vulnerability) or [resolve](../vulnerabilities/index.md#resolve-a-vulnerability) a vulnerability.
+1. To see how scanning works as new code is developed, create a new merge request that changes application code and adds a new vulnerability or weakness.

doc/user/application_security/sast/gitlab_advanced_sast.md

@@ -84,7 +84,7 @@ On GitLab self-managed, you must also use a GitLab version that supports Advance
   - The latest template includes Advanced SAST in GitLab 17.2 or later. Note that you [should not mix latest and stable templates](../index.md#template-editions) in a single project.
 - At a minimum, GitLab Advanced SAST requires version 17.1 or later.
-### Enabling Advanced SAST scanning
+### Enable Advanced SAST scanning
 Advanced SAST is included in the standard GitLab SAST CI/CD template, but isn't yet enabled by default.
 To enable it, set the CI/CD variable `GITLAB_ADVANCED_SAST_ENABLED` to `true`.

doc/user/application_security/sast/rules.md

@@ -16,6 +16,15 @@ It automatically chooses which analyzers to run based on which programming langu
 Each analyzer processes the code, then uses rules to find possible weaknesses in source code.
 The analyzer's rules determine what types of weaknesses it reports.
+## Scope of rules
+
+GitLab SAST focuses on security weaknesses and vulnerabilities. It does not aim to find general bugs or assess overall code quality or maintainability.
+
+GitLab manages the detection ruleset with a focus on identifying actionable security weaknesses and vulnerabilities.
+The ruleset is designed to provide broad coverage against the most impactful vulnerabilities while minimizing false positives (reported vulnerabilities where no vulnerability exists).
+
+GitLab SAST is designed to be used in its default configuration, but you can [configure detection rules](#configure-rules-in-your-projects) if needed.
+
 ## Source of rules
 ### Advanced SAST