[Tests] Adding Color Loop set tests for Github CI #25964

mkardous-silabs · 2023-04-04T13:57:00Z

Description

Tests for Color Loop Set take too long to run on the Github CI. Adding a copy / paste of the certification tests but with shorter delays.

Tests

CI to validate that the test passes

github-actions · 2023-04-04T14:38:07Z

PR #25964: Size comparison from d81d4e3 to 206a70f

Full report (1 build for cc32xx)

platform	target	config	section	`d81d4e3`	`206a70f`
cc32xx	lock	CC3235SF_LAUNCHXL		0	0
			(read only)	644409	644409
			(read/write)	203848	203848
			.ARM.attributes	44	44
			.ARM.exidx	8	8
			.bss	197248	197248
			.comment	194	194
			.data	1480	1480
			.debug_abbrev	933099	933099
			.debug_aranges	87608	87608
			.debug_frame	301328	301328
			.debug_info	20302987	20302987
			.debug_line	`2679748`	`2679748`
			.debug_loc	2824679	2824679
			.debug_ranges	286200	286200
			.debug_str	`3039406`	`3039406`
			.ramVecs	780	780
			.resetVecs	64	64
			.rodata	105953	105953
			.shstrtab	232	232
			.stab	204	204
			.stabstr	441	441
			.stack	2048	2048
			.strtab	377422	377422
			.symtab	256768	256768
			.text	536336	536336

github-actions · 2023-04-04T18:32:50Z

PR #25964: Size comparison from d81d4e3 to 45df76c

Full report (1 build for cc32xx)

platform	target	config	section	`d81d4e3`	`45df76c`
cc32xx	lock	CC3235SF_LAUNCHXL		0	0
			(read only)	644409	644409
			(read/write)	203848	203848
			.ARM.attributes	44	44
			.ARM.exidx	8	8
			.bss	197248	197248
			.comment	194	194
			.data	1480	1480
			.debug_abbrev	933099	933099
			.debug_aranges	87608	87608
			.debug_frame	301328	301328
			.debug_info	20302987	20302987
			.debug_line	`2679748`	`2679748`
			.debug_loc	2824679	2824679
			.debug_ranges	286200	286200
			.debug_str	`3039406`	`3039406`
			.ramVecs	780	780
			.resetVecs	64	64
			.rodata	105953	105953
			.shstrtab	232	232
			.stab	204	204
			.stabstr	441	441
			.stack	2048	2048
			.strtab	377422	377422
			.symtab	256768	256768
			.text	536336	536336

github-actions · 2023-04-04T18:59:44Z

PR #25964: Size comparison from d81d4e3 to d6e2a07

Full report (4 builds for cc32xx, mbed, qpg)

platform	target	config	section	`d81d4e3`	`d6e2a07`
cc32xx	lock	CC3235SF_LAUNCHXL		0	0
			(read only)	644409	644409
			(read/write)	203848	203848
			.ARM.attributes	44	44
			.ARM.exidx	8	8
			.bss	197248	197248
			.comment	194	194
			.data	1480	1480
			.debug_abbrev	933099	933099
			.debug_aranges	87608	87608
			.debug_frame	301328	301328
			.debug_info	20302987	20302987
			.debug_line	`2679748`	`2679748`
			.debug_loc	2824679	2824679
			.debug_ranges	286200	286200
			.debug_str	`3039406`	`3039406`
			.ramVecs	780	780
			.resetVecs	64	64
			.rodata	105953	105953
			.shstrtab	232	232
			.stab	204	204
			.stabstr	441	441
			.stack	2048	2048
			.strtab	377422	377422
			.symtab	256768	256768
			.text	536336	536336
mbed	lock-app	CY8CPROTO_062_4343W+release	(read only)	6224	6224
			(read/write)	2466152	2466152
			.bss	215964	215964
			.data	5880	5880
			.text	1428796	1428796
qpg	lighting-app	qpg6105+debug	(read/write)	`1153680`	`1153680`
			.bss	97404	97404
			.data	852	852
			.text	600776	600776
	lock-app	qpg6105+debug	(read/write)	1122216	1122216
			.bss	92540	92540
			.data	856	856
			.text	569316	569316

bzbarsky-apple · 2023-04-04T20:18:26Z

@mkardous-silabs TestColorControl_9_1 is failing on both Linux and Mac:

ERROR   19:09:08.883 - TEST OUT  : CHIP:TOO:  ***** Test Step 15 : Read ColorLoopStoredEnhancedHue attribute from DUT
...
ERROR   19:09:08.888 - TEST OUT  : CHIP:TOO:  ***** Test Failure: colorLoopStoredEnhancedHue value mismatch: expected 16384 but got 0

mkardous-silabs · 2023-04-04T20:20:28Z

@bzbarsky-apple

@mkardous-silabs TestColorControl_9_1 is failing on both Linux and Mac:

ERROR   19:09:08.883 - TEST OUT  : CHIP:TOO:  ***** Test Step 15 : Read ColorLoopStoredEnhancedHue attribute from DUT
...
ERROR   19:09:08.888 - TEST OUT  : CHIP:TOO:  ***** Test Failure: colorLoopStoredEnhancedHue value mismatch: expected 16384 but got 0

I'll check... I ran the test with an efr32 and it passed several times without any failures...

github-actions · 2023-04-13T21:05:38Z

PR #25964: Size comparison from e1f306f to 7aef248

Full report (1 build for cc32xx)

platform	target	config	section	`e1f306f`	`7aef248`
cc32xx	lock	CC3235SF_LAUNCHXL		0	0
			(read only)	643081	643081
			(read/write)	203848	203848
			.ARM.attributes	44	44
			.ARM.exidx	8	8
			.bss	197248	197248
			.comment	194	194
			.data	1480	1480
			.debug_abbrev	933224	933224
			.debug_aranges	87760	87760
			.debug_frame	302028	302028
			.debug_info	20326062	20326062
			.debug_line	`2687403`	`2687403`
			.debug_loc	2838361	2838361
			.debug_ranges	288040	288040
			.debug_str	3042379	3042379
			.ramVecs	780	780
			.resetVecs	64	64
			.rodata	104393	104393
			.shstrtab	232	232
			.stab	204	204
			.stabstr	441	441
			.stack	2048	2048
			.strtab	377626	377626
			.symtab	256832	256832
			.text	536568	536568

github-actions · 2023-04-13T22:07:41Z

PR #25964: Size comparison from e1f306f to 8cadd68

Decreases (1 build for cc32xx)

platform	target	config	section	`e1f306f`	`8cadd68`	change	% change
cc32xx	lock	CC3235SF_LAUNCHXL	.debug_info	20326062	20326060	-2	-0.0

Full report (1 build for cc32xx)

platform	target	config	section	`e1f306f`	`8cadd68`	change	% change
cc32xx	lock	CC3235SF_LAUNCHXL		0	0	0	0.0
			(read only)	643081	643081	0	0.0
			(read/write)	203848	203848	0	0.0
			.ARM.attributes	44	44	0	0.0
			.ARM.exidx	8	8	0	0.0
			.bss	197248	197248	0	0.0
			.comment	194	194	0	0.0
			.data	1480	1480	0	0.0
			.debug_abbrev	933224	933224	0	0.0
			.debug_aranges	87760	87760	0	0.0
			.debug_frame	302028	302028	0	0.0
			.debug_info	20326062	20326060	-2	-0.0
			.debug_line	`2687403`	`2687403`	0	0.0
			.debug_loc	2838361	2838361	0	0.0
			.debug_ranges	288040	288040	0	0.0
			.debug_str	3042379	3042379	0	0.0
			.ramVecs	780	780	0	0.0
			.resetVecs	64	64	0	0.0
			.rodata	104393	104393	0	0.0
			.shstrtab	232	232	0	0.0
			.stab	204	204	0	0.0
			.stabstr	441	441	0	0.0
			.stack	2048	2048	0	0.0
			.strtab	377626	377626	0	0.0
			.symtab	256832	256832	0	0.0
			.text	536568	536568	0	0.0

github-actions · 2023-04-14T01:59:34Z

PR #25964: Size comparison from 62974a0 to a69936e

Increases (1 build for cc32xx)

platform	target	config	section	`62974a0`	`a69936e`	change	% change
cc32xx	lock	CC3235SF_LAUNCHXL	.debug_info	20326060	20326062	2	0.0

Full report (3 builds for cc32xx, qpg)

platform	target	config	section	`62974a0`	`a69936e`	change
cc32xx	lock	CC3235SF_LAUNCHXL		0	0	0
			(read only)	643081	643081	0
			(read/write)	203848	203848	0
			.ARM.attributes	44	44	0
			.ARM.exidx	8	8	0
			.bss	197248	197248	0
			.comment	194	194	0
			.data	1480	1480	0
			.debug_abbrev	933224	933224	0
			.debug_aranges	87760	87760	0
			.debug_frame	302028	302028	0
			.debug_info	20326060	20326062	2
			.debug_line	`2687403`	`2687403`	0
			.debug_loc	2838361	2838361	0
			.debug_ranges	288040	288040	0
			.debug_str	3042379	3042379	0
			.ramVecs	780	780	0
			.resetVecs	64	64	0
			.rodata	104393	104393	0
			.shstrtab	232	232	0
			.stab	204	204	0
			.stabstr	441	441	0
			.stack	2048	2048	0
			.strtab	377626	377626	0
			.symtab	256832	256832	0
			.text	536568	536568	0
qpg	lighting-app	qpg6105+debug	(read/write)	1166632	1166632	0
			.bss	99308	99308	0
			.data	856	856	0
			.text	613732	613732	0
	lock-app	qpg6105+debug	(read/write)	1136704	1136704	0
			.bss	94452	94452	0
			.data	860	860	0
			.text	583800	583800	0

github-actions · 2023-04-14T02:19:09Z

PR #25964: Size comparison from 62974a0 to a9c6d4b

Increases (1 build for cc32xx)

platform	target	config	section	`62974a0`	`a9c6d4b`	change	% change
cc32xx	lock	CC3235SF_LAUNCHXL	.debug_info	20326060	20326061	1	0.0

Full report (1 build for cc32xx)

platform	target	config	section	`62974a0`	`a9c6d4b`	change
cc32xx	lock	CC3235SF_LAUNCHXL		0	0	0
			(read only)	643081	643081	0
			(read/write)	203848	203848	0
			.ARM.attributes	44	44	0
			.ARM.exidx	8	8	0
			.bss	197248	197248	0
			.comment	194	194	0
			.data	1480	1480	0
			.debug_abbrev	933224	933224	0
			.debug_aranges	87760	87760	0
			.debug_frame	302028	302028	0
			.debug_info	20326060	20326061	1
			.debug_line	`2687403`	`2687403`	0
			.debug_loc	2838361	2838361	0
			.debug_ranges	288040	288040	0
			.debug_str	3042379	3042379	0
			.ramVecs	780	780	0
			.resetVecs	64	64	0
			.rodata	104393	104393	0
			.shstrtab	232	232	0
			.stab	204	204	0
			.stabstr	441	441	0
			.stack	2048	2048	0
			.strtab	377626	377626	0
			.symtab	256832	256832	0
			.text	536568	536568	0

github-actions · 2023-04-14T12:20:44Z

PR #25964: Size comparison from 62974a0 to 06d8e92

Increases (1 build for cc32xx)

platform	target	config	section	`62974a0`	`06d8e92`	change	% change
cc32xx	lock	CC3235SF_LAUNCHXL	.debug_info	20326060	20326061	1	0.0

Full report (2 builds for cc32xx, mbed)

platform	target	config	section	`62974a0`	`06d8e92`	change
cc32xx	lock	CC3235SF_LAUNCHXL		0	0	0
			(read only)	643081	643081	0
			(read/write)	203848	203848	0
			.ARM.attributes	44	44	0
			.ARM.exidx	8	8	0
			.bss	197248	197248	0
			.comment	194	194	0
			.data	1480	1480	0
			.debug_abbrev	933224	933224	0
			.debug_aranges	87760	87760	0
			.debug_frame	302028	302028	0
			.debug_info	20326060	20326061	1
			.debug_line	`2687403`	`2687403`	0
			.debug_loc	2838361	2838361	0
			.debug_ranges	288040	288040	0
			.debug_str	3042379	3042379	0
			.ramVecs	780	780	0
			.resetVecs	64	64	0
			.rodata	104393	104393	0
			.shstrtab	232	232	0
			.stab	204	204	0
			.stabstr	441	441	0
			.stack	2048	2048	0
			.strtab	377626	377626	0
			.symtab	256832	256832	0
			.text	536568	536568	0
mbed	lock-app	CY8CPROTO_062_4343W+release	(read only)	6224	6224	0
			(read/write)	2466272	2466272	0
			.bss	215960	215960	0
			.data	5888	5888	0
			.text	1428916	1428916	0

github-actions bot added app tests labels Apr 4, 2023

mkardous-silabs added 11 commits April 13, 2023 13:09

Add yaml tests for CC color loop

33e9437

Add new tests to CI

36d8746

Generated files

8c8bfea

PR review comments

005297f

Generated files

1f3766f

apply restyle manually

0ab5f3a

Fix tests

56584fd

generated files

5c404fe

restyle generation

0fcc7d0

increase delay for an operation

640e603

generated files

7aef248

mkardous-silabs force-pushed the test/add_cc_ci branch from d6e2a07 to 7aef248 Compare April 13, 2023 20:52

increase delay

53eea0d

mkardous-silabs force-pushed the test/add_cc_ci branch from 8cadd68 to a69936e Compare April 14, 2023 01:35

mkardous-silabs added 2 commits April 13, 2023 22:03

fix comment

a4212d9

fix generation

a9c6d4b

mkardous-silabs force-pushed the test/add_cc_ci branch from a69936e to a9c6d4b Compare April 14, 2023 02:03

fix generation

06d8e92

jmartinez-silabs merged commit 27158dd into project-chip:master Apr 14, 2023

mkardous-silabs deleted the test/add_cc_ci branch April 14, 2023 16:16

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Tests] Adding Color Loop set tests for Github CI #25964

[Tests] Adding Color Loop set tests for Github CI #25964

mkardous-silabs commented Apr 4, 2023

github-actions bot commented Apr 4, 2023

github-actions bot commented Apr 4, 2023

github-actions bot commented Apr 4, 2023

bzbarsky-apple commented Apr 4, 2023

mkardous-silabs commented Apr 4, 2023 •

edited

Loading

github-actions bot commented Apr 13, 2023

github-actions bot commented Apr 13, 2023

github-actions bot commented Apr 14, 2023

github-actions bot commented Apr 14, 2023

github-actions bot commented Apr 14, 2023

[Tests] Adding Color Loop set tests for Github CI #25964

[Tests] Adding Color Loop set tests for Github CI #25964

Conversation

mkardous-silabs commented Apr 4, 2023

Description

Tests

github-actions bot commented Apr 4, 2023

github-actions bot commented Apr 4, 2023

github-actions bot commented Apr 4, 2023

bzbarsky-apple commented Apr 4, 2023

mkardous-silabs commented Apr 4, 2023 • edited Loading

github-actions bot commented Apr 13, 2023

github-actions bot commented Apr 13, 2023

github-actions bot commented Apr 14, 2023

github-actions bot commented Apr 14, 2023

github-actions bot commented Apr 14, 2023

mkardous-silabs commented Apr 4, 2023 •

edited

Loading