Skip to content

Commit

Permalink
submitter_guide: add sections on issues and incidents
Browse files Browse the repository at this point in the history
submitter_guide: add sections on issues and incidents
  • Loading branch information
NikkyXO committed Apr 16, 2023
1 parent 835498f commit 1f98d93
Showing 1 changed file with 88 additions and 0 deletions.
88 changes: 88 additions & 0 deletions doc/submitter_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -312,6 +312,94 @@ Date/Time Format][datetime_format].

Example: `"2020-08-14T23:41:54+00:00"`

#### Issues
The following properties are used to describe issues found in reports

##### `build_valid`
The status to assign to incident builds

Example: `"build_valid": false`

##### `test_status`
The Status to assign to incident tests, it can be one of the following

* `ERROR` - the test is faulty, the status of the tested code is unknown.
* `FAIL` - the test has failed, the tested code is faulty.
* `PASS` - the test has passed, the tested code is correct.
* `DONE` - the test has finished successfully, the status of the tested code
is unknown.
* `SKIP` - the test wasn't executed, the status of the tested code is unknown.

Example: `"test_status": "ERROR"`

##### `culprit`
The layers of the execution stack responsible for the issue
It can contain one or more of the following properties, which are all boolean

* `code` - the built or tested code, value is boolean
* `tool` - the static analyzer, the build toolchain, the test, etc
* `harness` - the system controlling the execution of the build.

Example: `"code": True`

#### Incidents
The following properties are used to describe an issue occurrence or absence of it
=======

##### `culprit`
The layers of the execution stack responsible for the issue
It can be one of the following properties

* `Code` - the built or tested code, value is boolean
* `Tool` - the static analyzer, the build toolchain, the test, etc
* `Harness` - the system controlling the execution of the build.

#### Incidents

##### `present`
True if the issue occurred in the linked objects, False if it was absent

Example: `"present": True`

##### `comment`
A human-readable comment regarding the incident

Example: `"comment": "<An human readable comment in string>"`

##### `origin`
The name of the CI system which submitted the incident

Example: `"origin_id": "submitter:956769"`

##### `issue_id`
The id of the occurring or absent issue

Example: `"issue_id": "submitter:124853810"`

##### `issue_version`
The modification version number of the occurring or absent issue

Example: `"issue_version": 0`

##### `build_id`
The ID of the build object exhibiting or missing the issue

Example: `"build_id": "submitter:956769"`

##### `test_id`
The ID of the test object exhibiting or missing the issue

Example: `"test_id": "submitter:114353810"`




=======
##### `comment`
A human-readable comment regarding the incident



### Extra data
If you have some data you'd like to provide developers with, but the schema
doesn't accommodate it, put it as arbitrary JSON under the `misc` field, which
Expand Down

0 comments on commit 1f98d93

Please sign in to comment.