From 1f98d9361351540ef9684903bb19d0c99815a6e4 Mon Sep 17 00:00:00 2001 From: NikkyXO Date: Sun, 16 Apr 2023 13:43:49 +0100 Subject: [PATCH] submitter_guide: add sections on issues and incidents submitter_guide: add sections on issues and incidents --- doc/submitter_guide.md | 88 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 88 insertions(+) diff --git a/doc/submitter_guide.md b/doc/submitter_guide.md index 95d1077a..d0c4934b 100644 --- a/doc/submitter_guide.md +++ b/doc/submitter_guide.md @@ -312,6 +312,94 @@ Date/Time Format][datetime_format]. Example: `"2020-08-14T23:41:54+00:00"` +#### Issues +The following properties are used to describe issues found in reports + +##### `build_valid` +The status to assign to incident builds + +Example: `"build_valid": false` + +##### `test_status` +The Status to assign to incident tests, it can be one of the following + +* `ERROR` - the test is faulty, the status of the tested code is unknown. +* `FAIL` - the test has failed, the tested code is faulty. +* `PASS` - the test has passed, the tested code is correct. +* `DONE` - the test has finished successfully, the status of the tested code + is unknown. +* `SKIP` - the test wasn't executed, the status of the tested code is unknown. + +Example: `"test_status": "ERROR"` + +##### `culprit` +The layers of the execution stack responsible for the issue +It can contain one or more of the following properties, which are all boolean + +* `code` - the built or tested code, value is boolean +* `tool` - the static analyzer, the build toolchain, the test, etc +* `harness` - the system controlling the execution of the build. + +Example: `"code": True` + +#### Incidents +The following properties are used to describe an issue occurrence or absence of it +======= + +##### `culprit` +The layers of the execution stack responsible for the issue +It can be one of the following properties + +* `Code` - the built or tested code, value is boolean +* `Tool` - the static analyzer, the build toolchain, the test, etc +* `Harness` - the system controlling the execution of the build. + +#### Incidents + +##### `present` +True if the issue occurred in the linked objects, False if it was absent + +Example: `"present": True` + +##### `comment` +A human-readable comment regarding the incident + +Example: `"comment": ""` + +##### `origin` +The name of the CI system which submitted the incident + +Example: `"origin_id": "submitter:956769"` + +##### `issue_id` +The id of the occurring or absent issue + +Example: `"issue_id": "submitter:124853810"` + +##### `issue_version` +The modification version number of the occurring or absent issue + +Example: `"issue_version": 0` + +##### `build_id` +The ID of the build object exhibiting or missing the issue + +Example: `"build_id": "submitter:956769"` + +##### `test_id` +The ID of the test object exhibiting or missing the issue + +Example: `"test_id": "submitter:114353810"` + + + + +======= +##### `comment` +A human-readable comment regarding the incident + + + ### Extra data If you have some data you'd like to provide developers with, but the schema doesn't accommodate it, put it as arbitrary JSON under the `misc` field, which