QA cycle report for 2.8 M1 RC2:

No high milestone defects.  
Three new defects are found in this cycle, BSP HW - parselog issue (BUG id:13396), BSP HW - audio issue (BUG id:13397), qemux86 oe-selftest failure on AB (BUG id: 13399). 
ptests, failing in this release which were passing in previous release - acl (BUG id: 13395).
Three timeout issues observed in ptests are - acl (BUG id: 13391), bluez5 (BUG id: 13366)  and mdadm (BUG id: 13368).

More comments on these ptests timeout issues:

acl, bluez5 and mdadm are not blocking issues. 
The bluez5 issue is gcc9 related - there is a fix in master, mdadm was exposed by wider testing in master.
The acl issue is a regression caused by the perl upgrade with a fix in master.

Summary of ptest in this build:
qemuarm64-ptest:
Total : 435597
Pass : 433344
Fail :  65
Skip : 2188
Timeout issues in bluez5 and mdadm

qemux86-64-ptest
Total : 45346
Pass : 43235
Fail :  56
Skip : 2055
Timeout issues in acl, bluez5 and mdadm

Summary of ltp test run in this build:
qemuarm64-ltp
Total : 1886
Pass : 1759
Fail :  127

qemux86-64-ltp
Total : 1879
Pass : 1825
Fail :  54

==============================================================================================================
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Test Series         | ID                                                            | Passed      | Failed   | Skipped  
--------------------------------------------------------------------------------------------------------------
a-full              | oeselftest_debian-9_qemux86_20190610221957                    | 1 (100%)    | 0 (0%)   | 0 (0%)   
beaglebone          | manual_bsp-hw_20190613144741                                  | 22 (48%)    | 0 (0%)   | 24 (52%) 
beaglebone          | manual_compliance-test_20190614105634                         | 2 (50%)     | 0 (0%)   | 2 (50%)  
beaglebone          | runtime_core-image-sato-sdk_beaglebone-yocto_20190611071807   | 47 (78%)    | 1 (2%)   | 12 (20%) 
beaglebone          | sdk_core-image-sato_i686_beaglebone-yocto_20190610223616      | 11 (92%)    | 0 (0%)   | 1 (8%)   
bitbake             | manual_oe-core_20190613193542                                 | 6 (100%)    | 0 (0%)   | 0 (0%)   
coffeelake          | manual_bsp-hw_20190613172206                                  | 27 (59%)    | 6 (13%)  | 13 (28%) 
coffeelake          | runtime_core-image-lsb-sdk_genericx86-64_20190613073735       | 46 (77%)    | 1 (2%)   | 13 (22%) 
coffeelake          | runtime_core-image-sato-sdk_genericx86-64_20190613070008      | 47 (78%)    | 1 (2%)   | 12 (20%) 
core-image-lsb-sdk  | runtime_core-image-lsb-sdk_genericx86_20190613065304          | 47 (78%)    | 0 (0%)   | 13 (22%) 
core-image-sato-sdk | runtime_core-image-sato-sdk_genericx86_20190613063906         | 48 (80%)    | 0 (0%)   | 12 (20%) 
edgerouter          | manual_bsp-hw_20190613143752                                  | 11 (24%)    | 0 (0%)   | 35 (76%) 
edgerouter          | manual_compliance-test_20190614110359                         | 0 (0%)      | 0 (0%)   | 4 (100%) 
edgerouter          | runtime_core-image-sato-sdk_edgerouter_20190613003116         | 46 (77%)    | 2 (3%)   | 12 (20%) 
edgerouter          | sdk_core-image-sato_i686_edgerouter_20190610223431            | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86-64       | sdk_core-image-sato_i686_genericx86-64_20190610230311         | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86          | sdk_core-image-sato_i686_genericx86_20190610225500            | 11 (92%)    | 0 (0%)   | 1 (8%)   
meta-mingw          | sdk_core-image-minimal_x86_64-mingw32_qemux86_20190610225453  | 13 (100%)   | 0 (0%)   | 0 (0%)   
mpc8315e-rdb        | sdk_core-image-sato_i686_mpc8315e-rdb_20190610224750          | 11 (92%)    | 0 (0%)   | 1 (8%)   
mpc8315e            | manual_bsp-hw_20190613142654                                  | 15 (33%)    | 0 (0%)   | 31 (67%) 
mpc8315e            | manual_compliance-test_20190614110140                         | 0 (0%)      | 0 (0%)   | 4 (100%) 
mpc8315e            | runtime_core-image-sato-sdk_mpc8315e-rdb_20190613020557       | 47 (78%)    | 1 (2%)   | 12 (20%) 
multilib            | runtime_core-image-minimal_qemumips64_20190610224530          | 1 (2%)      | 0 (0%)   | 56 (98%) 
multilib            | runtime_core-image-sato_qemux86-64_20190610223131             | 36 (58%)    | 0 (0%)   | 26 (42%) 
multilib            | runtime_core-image-sato_qemux86-64_20190610223452             | 15 (24%)    | 0 (0%)   | 47 (76%) 
multilib            | runtime_lib32-core-image-minimal_qemux86-64_20190610222424    | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib            | runtime_lib32-core-image-minimal_qemux86-64_20190610222541    | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib            | sdk_core-image-minimal_x86_64_qemumips64_20190610224530       | 10 (83%)    | 0 (0%)   | 2 (17%)  
musl-qemux86-64     | runtime_core-image-full-cmdline_qemux86-64_20190610223131     | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86-64     | runtime_core-image-minimal_qemux86-64_20190610223131          | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86-64     | runtime_core-image-sato-sdk_qemux86-64_20190610223131         | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86        | runtime_core-image-full-cmdline_qemux86_20190610223146        | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86        | runtime_core-image-minimal_qemux86_20190610223146             | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86        | runtime_core-image-sato-sdk_qemux86_20190610223146            | 46 (78%)    | 0 (0%)   | 13 (22%) 
no-x11              | runtime_core-image-full-cmdline_qemux86-64_20190610222827     | 12 (20%)    | 0 (0%)   | 48 (80%) 
no-x11              | runtime_core-image-weston_qemux86-64_20190610222827           | 32 (53%)    | 0 (0%)   | 28 (47%) 
nuc6                | runtime_core-image-lsb-sdk_genericx86-64_20190614034800       | 47 (78%)    | 0 (0%)   | 13 (22%) 
nuc6                | runtime_core-image-sato-sdk_genericx86-64_20190613060156      | 48 (80%)    | 0 (0%)   | 12 (20%) 
nuc7                | manual_bsp-hw_20190614103923                                  | 28 (61%)    | 6 (13%)  | 12 (26%) 
nuc7                | runtime_core-image-lsb-sdk_genericx86-64_20190614014543       | 47 (78%)    | 0 (0%)   | 13 (22%) 
nuc7                | runtime_core-image-sato-sdk_genericx86-64_20190613060736      | 48 (80%)    | 0 (0%)   | 12 (20%) 
oe-selftest-centos  | oeselftest_centos-7_qemux86-64_20190610222633                 | 349 (99%)   | 0 (0%)   | 4 (1%)   
oe-selftest-debian  | oeselftest_debian-8_qemux86-64_20190610222835                 | 348 (99%)   | 0 (0%)   | 5 (1%)   
oe-selftest-fedora  | oeselftest_fedora-28_qemux86-64_20190610222606                | 349 (99%)   | 0 (0%)   | 4 (1%)   
oe-selftest-ubuntu  | oeselftest_ubuntu-18.04_qemux86-64_20190610222608             | 349 (99%)   | 0 (0%)   | 4 (1%)   
pkgman-deb-non-deb  | runtime_core-image-minimal_qemux86_20190610224904             | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-deb-non-deb  | runtime_core-image-sato-sdk_qemux86_20190610224904            | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-deb-non-deb  | runtime_core-image-sato_qemux86_20190610224904                | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-non-rpm      | runtime_core-image-minimal_qemux86_20190610223021             | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm      | runtime_core-image-minimal_qemux86_20190610224955             | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm      | runtime_core-image-sato-sdk_qemux86_20190610223021            | 30 (50%)    | 0 (0%)   | 30 (50%) 
pkgman-non-rpm      | runtime_core-image-sato-sdk_qemux86_20190610224955            | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-non-rpm      | runtime_core-image-sato_qemux86_20190610223021                | 14 (23%)    | 0 (0%)   | 46 (77%) 
pkgman-non-rpm      | runtime_core-image-sato_qemux86_20190610224955                | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-rpm-non-rpm  | runtime_core-image-minimal_qemux86_20190610222902             | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-rpm-non-rpm  | runtime_core-image-sato-sdk_qemux86_20190610222902            | 48 (80%)    | 0 (0%)   | 12 (20%) 
pkgman-rpm-non-rpm  | runtime_core-image-sato_qemux86_20190610222902                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2          | runtime_core-image-sato_qemux86-64_20190610223420             | 37 (62%)    | 0 (0%)   | 23 (38%) 
qa-extras2          | runtime_core-image-sato_qemux86-64_20190610223731             | 36 (60%)    | 0 (0%)   | 24 (40%) 
qa-extras2          | runtime_core-image-sato_qemux86-64_20190610224039             | 37 (60%)    | 0 (0%)   | 25 (40%) 
qa-extras2          | runtime_core-image-sato_qemux86-64_20190610224437             | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2          | runtime_core-image-sato_qemux86-64_20190610224739             | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2          | runtime_core-image-sato_qemux86-64_20190610225149             | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2          | runtime_core-image-sato_qemux86-64_20190610225628             | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm-lsb         | runtime_core-image-lsb-sdk_qemuarm_20190610223454             | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuarm-lsb         | runtime_core-image-lsb_qemuarm_20190610223454                 | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64-armhost   | runtime_core-image-minimal_qemuarm64_20190610224004           | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64-armhost   | runtime_core-image-sato-sdk_qemuarm64_20190610224004          | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64-armhost   | runtime_core-image-sato_qemuarm64_20190610224004              | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64-armhost   | sdk_core-image-sato_aarch64_qemuarm64_20190610224004          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64-armhost   | sdkext_core-image-minimal_aarch64_qemuarm64_20190610224004    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64-armhost   | sdkext_core-image-sato_aarch64_qemuarm64_20190610224004       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64-ltp       | runtime_core-image-sato_qemuarm64_20190610223115              | 1759 (93%)  | 127 (7%) | 0 (0%)   
qemuarm64-ptest     | runtime_core-image-sato-sdk-ptest_qemuarm64_20190610223711    | 43344 (95%) | 65 (0%)  | 2188 (5%)
qemuarm64           | manual_bsp-qemu_20190613173901                                | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuarm64           | oeselftest_debian-8_qemuarm64_20190610235229                  | 16 (100%)   | 0 (0%)   | 0 (0%)   
qemuarm64           | runtime_core-image-minimal_qemuarm64_20190610224636           | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64           | runtime_core-image-sato-sdk_qemuarm64_20190610224636          | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64           | runtime_core-image-sato_qemuarm64_20190610224636              | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64           | sdk_core-image-sato_i686_qemuarm64_20190610224636             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64           | sdk_core-image-sato_x86_64_qemuarm64_20190610234400           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64           | sdkext_core-image-minimal_x86_64_qemuarm64_20190610234400     | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64           | sdkext_core-image-sato_x86_64_qemuarm64_20190610234400        | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm             | manual_bsp-qemu_20190613173713                                | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuarm             | oeselftest_centos-7_qemuarm_20190610234127                    | 16 (100%)   | 0 (0%)   | 0 (0%)   
qemuarm             | runtime_core-image-minimal_qemuarm_20190610223723             | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuarm             | runtime_core-image-sato-sdk_qemuarm_20190610223723            | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm             | runtime_core-image-sato_qemuarm_20190610223723                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm             | sdk_core-image-sato_i686_qemuarm_20190610223723               | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm             | sdk_core-image-sato_x86_64_qemuarm_20190610233136             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm             | sdkext_core-image-minimal_x86_64_qemuarm_20190610233136       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm             | sdkext_core-image-sato_x86_64_qemuarm_20190610233136          | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips-lsb        | runtime_core-image-lsb-sdk_qemumips_20190610223921            | 44 (77%)    | 0 (0%)   | 13 (23%) 
qemumips-lsb        | runtime_core-image-lsb_qemumips_20190610223921                | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64          | manual_bsp-qemu_20190613173512                                | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemumips64          | oeselftest_fedora-28_qemumips64_20190611000600                | 16 (100%)   | 0 (0%)   | 0 (0%)   
qemumips64          | runtime_core-image-minimal_qemumips64_20190610224115          | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips64          | runtime_core-image-sato-sdk_qemumips64_20190610224115         | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips64          | runtime_core-image-sato_qemumips64_20190610224115             | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64          | sdk_core-image-sato_i686_qemumips64_20190610224115            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64          | sdk_core-image-sato_x86_64_qemumips64_20190610235634          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64          | sdkext_core-image-minimal_x86_64_qemumips64_20190610235634    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64          | sdkext_core-image-sato_x86_64_qemumips64_20190610235634       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips            | manual_bsp-qemu_20190613173359                                | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemumips            | oeselftest_fedora-30_qemumips_20190611003433                  | 16 (100%)   | 0 (0%)   | 0 (0%)   
qemumips            | runtime_core-image-minimal_qemumips_20190610223526            | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips            | runtime_core-image-sato-sdk_qemumips_20190610223526           | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips            | runtime_core-image-sato_qemumips_20190610223526               | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips            | sdk_core-image-sato_i686_qemumips_20190610223526              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips            | sdk_core-image-sato_x86_64_qemumips_20190611002608            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips            | sdkext_core-image-minimal_x86_64_qemumips_20190611002608      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips            | sdkext_core-image-sato_x86_64_qemumips_20190611002608         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc-lsb         | runtime_core-image-lsb-sdk_qemuppc_20190610223353             | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuppc-lsb         | runtime_core-image-lsb_qemuppc_20190610223353                 | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc             | manual_bsp-qemu_20190613173618                                | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuppc             | oeselftest_ubuntu-16.04_qemuppc_20190610235739                | 16 (100%)   | 0 (0%)   | 0 (0%)   
qemuppc             | runtime_core-image-minimal_qemuppc_20190610224604             | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuppc             | runtime_core-image-sato-sdk_qemuppc_20190610224604            | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuppc             | runtime_core-image-sato_qemuppc_20190610224604                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc             | sdk_core-image-sato_i686_qemuppc_20190610224604               | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc             | sdk_core-image-sato_x86_64_qemuppc_20190610234901             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc             | sdkext_core-image-minimal_x86_64_qemuppc_20190610234901       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc             | sdkext_core-image-sato_x86_64_qemuppc_20190610234901          | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64-lsb      | runtime_core-image-lsb-sdk_qemux86-64_20190610223234          | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-64-lsb      | runtime_core-image-lsb_qemux86-64_20190610223234              | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64-ltp      | runtime_core-image-sato_qemux86-64_20190610223342             | 1825 (97%)  | 54 (3%)  | 0 (0%)   
qemux86-64-ptest    | runtime_core-image-sato-sdk-ptest_qemux86-64_20190610223110   | 43235 (95%) | 56 (0%)  | 2055 (5%)
qemux86-64-x32      | runtime_core-image-minimal_qemux86-64_20190610222918          | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64-x32      | runtime_core-image-sato_qemux86-64_20190610222950             | 36 (59%)    | 0 (0%)   | 25 (41%) 
qemux86-64          | manual_bsp-qemu_20190613173137                                | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemux86-64          | oeselftest_centos-7_qemux86-64_20190610230042                 | 16 (100%)   | 0 (0%)   | 0 (0%)   
qemux86-64          | runtime_core-image-minimal_qemux86-64_20190610223814          | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64          | runtime_core-image-sato-sdk_qemux86-64_20190610223814         | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86-64          | runtime_core-image-sato_qemux86-64_20190610223814             | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64          | sdk_core-image-sato_i686_qemux86-64_20190610223814            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64          | sdk_core-image-sato_x86_64_qemux86-64_20190610225000          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64          | sdkext_core-image-minimal_x86_64_qemux86-64_20190610225000    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64          | sdkext_core-image-sato_x86_64_qemux86-64_20190610225000       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-lsb         | runtime_core-image-lsb-sdk_qemux86_20190610224037             | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-lsb         | runtime_core-image-lsb_qemux86_20190610224037                 | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86             | manual_bsp-qemu_20190613160529                                | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemux86             | manual_bsp-qemu_20190613160802                                | 4 (50%)     | 0 (0%)   | 4 (50%)  
qemux86             | oeselftest_opensusetumbleweed-20190606_qemux86_20190610225929 | 15 (94%)    | 1 (6%)   | 0 (0%)   
qemux86             | runtime_core-image-minimal_qemux86_20190610223759             | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86             | runtime_core-image-sato-sdk_qemux86_20190610223759            | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86             | runtime_core-image-sato_qemux86_20190610223759                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86             | sdk_core-image-sato_i686_qemux86_20190610223759               | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86             | sdk_core-image-sato_x86_64_qemux86_20190610224856             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86             | sdkext_core-image-minimal_x86_64_qemux86_20190610224856       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86             | sdkext_core-image-sato_x86_64_qemux86_20190610224856          | 15 (71%)    | 0 (0%)   | 6 (29%)  
--------------------------------------------------------------------------------------------------------------

==============================================================================================================
PTest Result Summary
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Recipe                       | Passed      | Failed   | Skipped   | Time(s)   
--------------------------------------------------------------------------------------------------------------
acl                          | 186         | 10       | 0         | 302 T
apr                          | 88          | 0        | 0         | 57
apr-util                     | 38          | 0        | 0         | 8
attr                         | 216         | 0        | 0         | 0
bash                         | 158         | 4        | 0         | 164
bluez5                       | 0           | 2        | 0         | 301 T
busybox                      | 1056        | 8        | 152       | 84
bzip2                        | 12          | 0        | 0         | 0
dbus-test                    | 20          | 1        | 2         | 301 T
diffstat                     | 878         | 0        | 0         | 3
diffutils                    | 42          | 0        | 0         | 6
e2fsprogs                    | 708         | 0        | 16        | 109
elfutils                     | 394         | 3        | 9         | 33
ethtool                      | 4           | 0        | 0         | 0
flex                         | 228         | 0        | 0         | 2
gawk                         | 826         | 14       | 20        | 27
gdbm                         | 48          | 0        | 0         | 1
gdk-pixbuf                   | 40          | 0        | 0         | 36
gettext                      | 776         | 4        | 44        | 35
glib-2.0                     | 428         | 2        | 0         | 372
gstreamer1.0                 | 204         | 6        | 0         | 109
gzip                         | 44          | 0        | 0         | 3
json-glib                    | 28          | 0        | 0         | 0
kbd                          | 14          | 0        | 0         | 1
libconvert-asn1-perl         | 44          | 0        | 0         | 2
liberror-perl                | 30          | 0        | 0         | 1
libevent                     | 2           | 0        | 0         | 128
libpcre                      | 6           | 0        | 0         | 1
libtest-needs-perl           | 2           | 0        | 2         | 4
libtimedate-perl             | 10          | 0        | 0         | 0
liburi-perl                  | 80          | 0        | 2         | 23
libusb1                      | 8           | 0        | 0         | 6
libxml-namespacesupport-perl | 2           | 0        | 0         | 0
libxml-parser-perl           | 30          | 0        | 0         | 2
libxml-perl                  | 12          | 0        | 0         | 0
libxml-sax-base-perl         | 36          | 0        | 2         | 1
libxml-sax-perl              | 28          | 0        | 0         | 2
libxml-simple-perl           | 20          | 0        | 8         | 14
libxml2                      | 268         | 0        | 0         | 16
lttng-tools                  | 9386        | 2        | 824       | 590
lzo                          | 10          | 0        | 0         | 2
m4                           | 306         | 0        | 34        | 6
mdadm                        | 0           | 0        | 0         | 301 T
nettle                       | 194         | 0        | 4         | 8
openssh                      | 134         | 0        | 6         | 1000
openssl                      | 292         | 2        | 16        | 99
opkg                         | 0           | 0        | 0         | 9
pango                        | 24          | 0        | 0         | 1
parted                       | 86          | 2        | 40        | 5
perl                         | 4842        | 36       | 474       | 1120
python                       | 630         | 3        | 119       | 394
python3                      | 60661       | 5        | 2018      | 1193
quilt                        | 114         | 0        | 0         | 34
sed                          | 172         | 0        | 0         | 4
slang                        | 194         | 0        | 0         | 21
strace                       | 915         | 12       | 335       | 348
tcl                          | 298         | 0        | 0         | 210
util-linux                   | 1000        | 4        | 98        | 99
valgrind                     | 299         | 1        | 18        | 631
zlib                         | 2           | 0        | 0         | 0
--------------------------------------------------------------------------------------------------------------


==============================================================================================================
Failed test cases (sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190611071807
    parselogs.ParseLogsTest.test_parselogs
testseries | result_id : coffeelake | manual_bsp-hw_20190613172206
    bsps-hw.bsps-hw.audio_-_play_(wav)_with_HDMI
    bsps-hw.bsps-hw.audio_-_play_(ogg)_with_HDMI
    bsps-hw.bsps-hw.Test_Seek_bar_and_volume_control
    bsps-hw.bsps-hw.media_player_-_play_video_(ogv)
    bsps-hw.bsps-hw.video_-_libva_check_(ogg_video_play)
    bsps-hw.bsps-hw.media_player_-_stop/play_button_(ogv)
testseries | result_id : coffeelake | runtime_core-image-lsb-sdk_genericx86-64_20190613073735
    parselogs.ParseLogsTest.test_parselogs
testseries | result_id : coffeelake | runtime_core-image-sato-sdk_genericx86-64_20190613070008
    parselogs.ParseLogsTest.test_parselogs
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190613003116
    parselogs.ParseLogsTest.test_parselogs
    xorg.XorgTest.test_xorg_running
testseries | result_id : mpc8315e | runtime_core-image-sato-sdk_mpc8315e-rdb_20190613020557
    xorg.XorgTest.test_xorg_running
testseries | result_id : nuc7 | manual_bsp-hw_20190614103923
    bsps-hw.bsps-hw.audio_-_play_(wav)_with_HDMI
    bsps-hw.bsps-hw.audio_-_play_(ogg)_with_HDMI
    bsps-hw.bsps-hw.Test_Seek_bar_and_volume_control
    bsps-hw.bsps-hw.media_player_-_play_video_(ogv)
    bsps-hw.bsps-hw.video_-_libva_check_(ogg_video_play)
    bsps-hw.bsps-hw.media_player_-_stop/play_button_(ogv)
testseries | result_id : qemuarm64-ltp | runtime_core-image-sato_qemuarm64_20190610223115
    ltpresult.syscalls.mknod07
    ltpresult.containers.netns_breakns_ns_exec_ipv4_ioctl
    ltpresult.syscalls.umount2_03
    ltpresult.controllers.cgroup
    ltpresult.commands.df01_vfat_sh
    ltpresult.commands.df01_ext4_sh
    ltpresult.syscalls.fallocate04
    ltpresult.syscalls.mount01
    ltpresult.syscalls.mount02
    ltpresult.commands.df01_exfat_sh
    ltpposixresult.THR.pthread_cond_broadcast
    ltpposixresult.TPS.sched_get_priority_max
    ltpresult.syscalls.mmap16
    ltpresult.syscalls.ftruncate04
    ltpresult.containers.netns_comm_ns_exec_ipv6_netlink
    ltpresult.syscalls.statx05
    ltpresult.containers.netns_breakns_ns_exec_ipv6_ioctl
    ltpresult.syscalls.renameat01
    ltpresult.syscalls.acct01
    ltpresult.syscalls.fsetxattr01
    ltpresult.syscalls.fallocate05
    ltpresult.commands.file01_sh
    ltpresult.containers.netns_comm_ip_ipv4_ioctl
    ltpresult.containers.netns_netlink
    ltpresult.syscalls.chown04
    ltpresult.syscalls.fgetxattr01
    ltpresult.containers.netns_comm_ip_ipv6_netlink
    ltpresult.containers.netns_breakns_ip_ipv6_ioctl
    ltpresult.containers.netns_comm_ns_exec_ipv6_ioctl
    ltpresult.containers.userns06
    ltpresult.commands.mv01_sh
    ltpresult.containers.netns_comm_ip_ipv6_ioctl
    ltpresult.containers.netns_breakns_ip_ipv4_ioctl
    ltpresult.controllers.cpuset_inherit
    ltpresult.syscalls.setxattr01
    ltpresult.syscalls.getxattr04
    ltpresult.syscalls.readahead02
    ltpposixresult.MEM.mmap
    ltpresult.syscalls.chown04_16
    ltpresult.containers.netns_breakns_ns_exec_ipv4_netlink
    ltpposixresult.TPS.sched_getscheduler
    ltpresult.syscalls.umount03
    ltpresult.mm.mtest01
    ltpresult.syscalls.open12
    ltpresult.containers.netns_sysfs
    ltpresult.commands.mkfs01_btrfs_sh
    ltpresult.commands.df01_ntfs_sh
    ltpresult.commands.mkfs01_msdos_sh
    ltpresult.commands.mkfs01_vfat_sh
    ltpresult.syscalls.inotify03
    ltpresult.syscalls.ftruncate04_64
    ltpresult.syscalls.lchown03_16
    ltpresult.syscalls.mknodat02
    ltpposixresult.TPS.sched_get_priority_min
    ltpresult.commands.df01_xfs_sh
    ltpresult.commands.mkfs01_ext3_sh
    ltpresult.commands.unshare01_sh
    ltpresult.syscalls.ioctl04
    ltpresult.commands.mkfs01_ext2_sh
    ltpresult.fs_bind.BindMounts
    ltpresult.syscalls.msgstress03
    ltpresult.commands.ar_sh
    ltpposixresult.TMR.timer_getoverrun
    ltpposixresult.AIO.aio_write
    ltpposixresult.SEM.sem_init
    ltpposixresult.THR.pthread_rwlock_unlock
    ltpresult.syscalls.ioctl06
    ltpposixresult.AIO.aio_read
    ltpresult.syscalls.statx04
    ltpresult.containers.netns_comm_ip_ipv4_netlink
    ltpresult.syscalls.fanotify10
    ltpposixresult.AIO.aio_error
    ltpposixresult.TPS.sched_setparam
    ltpposixresult.THR.pthread_barrier_destroy
    ltpresult.containers.netns_comm_ns_exec_ipv4_netlink
    ltpposixresult.AIO.aio_return
    ltpresult.commands.df01_ext3_sh
    ltpresult.syscalls.fremovexattr02
    ltpresult.syscalls.fremovexattr01
    ltpposixresult.MEM.shm_open
    ltpresult.commands.df01_ext2_sh
    ltpresult.commands.mkfs01_xfs_sh
    ltpresult.syscalls.mount04
    ltpposixresult.TPS.sched_setscheduler
    ltpresult.syscalls.rename11
    ltpresult.commands.mkswap01_sh
    ltpresult.syscalls.umount02
    ltpresult.controllers.memcg_test_3
    ltpresult.syscalls.preadv03
    ltpresult.commands.mkfs01_ext4_sh
    ltpresult.syscalls.umount2_01
    ltpresult.syscalls.preadv03_64
    ltpresult.syscalls.quotactl01
    ltpresult.syscalls.umount01
    ltpresult.syscalls.fchown04_16
    ltpresult.syscalls.lchown03
    ltpresult.containers.netns_breakns_ip_ipv4_netlink
    ltpresult.commands.mkfs01_minix_sh
    ltpresult.mm.mtest01w
    ltpresult.syscalls.lremovexattr01
    ltpresult.syscalls.linkat02
    ltpresult.syscalls.mount06
    ltpresult.commands.mkfs01_ntfs_sh
    ltpresult.syscalls.utime06
    ltpresult.syscalls.pwritev03
    ltpresult.fs.fs_fill
    ltpresult.syscalls.fchown04
    ltpposixresult.AIO.aio_suspend
    ltpresult.syscalls.kill11
    ltpresult.containers.netns_breakns_ip_ipv6_netlink
    ltpresult.syscalls.umount2_02
    ltpresult.syscalls.ioctl05
    ltpposixresult.TPS.sched_getparam
    ltpposixresult.MEM.shm_unlink
    ltpresult.syscalls.abort01
    ltpposixresult.THR.pthread_rwlock_rdlock
    ltpresult.commands.mkfs01_sh
    ltpresult.syscalls.getrusage03
    ltpresult.containers.netns_breakns_ns_exec_ipv6_netlink
    ltpresult.syscalls.pwritev03_64
    ltpresult.syscalls.mount03
    ltpresult.syscalls.fsync01
    ltpposixresult.TMR.clock_getcpuclockid
    ltpresult.net.ipv6_lib.getaddrinfo_01
    ltpresult.containers.netns_comm_ns_exec_ipv4_ioctl
    ltpresult.syscalls.msync04
    ltpresult.syscalls.statx06
testseries | result_id : qemuarm64-ptest | runtime_core-image-sato-sdk-ptest_qemuarm64_20190610223711
    ptestresult.perl.cpan/Win32/t/GetOSName
    ptestresult.perl.cpan/Win32/t/GetOSVersion
    ptestresult.strace.trace_fstatfs.gen.test
    ptestresult.perl.ext/VMS-DCLsym/t/vms_dclsym
    ptestresult.perl.cpan/Win32/t/CreateFile
    ptestresult.python.test_pipe_cloexec__test.test_subprocess.POSIXProcessTestCase_
    ptestresult.strace.trace_statfs.gen.test
    ptestresult.util-linux.mount:_btrfs__fstab___mount/fstab-btrfs_
    ptestresult.busybox.wget-retrieves-google-index
    ptestresult.perl.cpan/Win32/t/Names
    ptestresult.strace.trace_personality_32.gen.test
    ptestresult.gettext.autopoint-2
    ptestresult.perl.cpan/Win32/t/GetCurrentThreadId
    ptestresult.glib-2.0.glib/resources.test__Child_process_killed_by_signal_6_
    ptestresult.strace.sched.gen.test
    ptestresult.gawk.backbigs1
    ptestresult.gawk.mbstr2
    ptestresult.perl.cpan/Win32/t/GuidGen
    ptestresult.elfutils.run-backtrace-dwarf.sh
    ptestresult.perl.cpan/Win32/t/ExpandEnvironmentStrings
    ptestresult.gettext.autopoint-3
    ptestresult.python.test_struct_by_value__ctypes.test.test_win32.Structures_
    ptestresult.strace.trace_personality_regex_64.gen.test
    ptestresult.strace.trace_question.gen.test
    ptestresult.util-linux.misc:_ul__misc/ul_
    ptestresult.perl.cpan/Win32/t/CodePage
    ptestresult.lttng-tools.ust/blocking/test_blocking_49_-_No_event_lost_with_UST_blocking_mode:_found_0_expect_5000000
    ptestresult.gawk.mbprintf1
    ptestresult.acl.mount_ext3.img
    ptestresult.perl.cpan/Win32/t/GetFileVersion
    ptestresult.dbus-test.test/test-names
    ptestresult.gstreamer1.0.gst/gstelement
    ptestresult.perl.cpan/Win32/t/GetFolderPath
    ptestresult.openssl.test/recipes/90-test_shlibload.t,_test_returned_9__wstat_2304,_0x900_
    ptestresult.gstreamer1.0.pipelines/parse-launch
    ptestresult.bash.run-trap
    ptestresult.gawk.mbprintf4
    ptestresult.gawk.backsmalls1
    ptestresult.perl.ext/VMS-Stdio/t/vms_stdio
    ptestresult.gstreamer1.0.gst/gsturi
    ptestresult.strace.trace_personality_64.gen.test
    ptestresult.elfutils.run-reloc-bpf.sh
    ptestresult.strace.clock.gen.test
    ptestresult.python3.test_start_tls_server_1__test.test_asyncio.test_sslproto.SelectorStartTLSTests_
    ptestresult.strace.kexec_file_load.gen.test
    ptestresult.busybox.wget-supports--P
    ptestresult.perl.cpan/Win32/t/GetLongPathName
    ptestresult.perl.cpan/Win32/t/Unicode
    ptestresult.gawk.mbfw1
    ptestresult.perl.t/op/stat
    ptestresult.strace.trace_statfs_like.gen.test
    ptestresult.perl.cpan/Win32/t/GetShortPathName
    ptestresult.strace.trace_personality_regex_32.gen.test
    ptestresult.strace.regex.gen.test
    ptestresult.perl.ext/VMS-Filespec/t/filespec
    ptestresult.bluez5.test-avctp
    ptestresult.gawk.mbstr1
    ptestresult.busybox.wget-handles-empty-path
    ptestresult.parted.t6001-psep.sh
    ptestresult.bash.run-read
    ptestresult.python3.test_struct_by_value__ctypes.test.test_win32.Structures_
    ptestresult.python3.test_doctest_main_issue4197__test.test_zipimport_support.ZipSupportTests__..._Expected_line_File_"/var/volatile/tmp/tmpzr1mlxv7/script.py",_line_2,_in___main__.Test
    ptestresult.elfutils.run-disasm-bpf.sh
    ptestresult.busybox.wget--O-overrides--P
    ptestresult.perl.cpan/Win32/t/GetFullPathName
testseries | result_id : qemux86-64-ltp | runtime_core-image-sato_qemux86-64_20190610223342
    ltpresult.containers.netns_breakns_ns_exec_ipv4_ioctl
    ltpresult.controllers.cgroup
    ltpresult.commands.df01_ext4_sh
    ltpposixresult.TPS.sched_get_priority_max
    ltpresult.containers.netns_comm_ns_exec_ipv6_netlink
    ltpresult.containers.netns_breakns_ns_exec_ipv6_ioctl
    ltpresult.commands.file01_sh
    ltpresult.containers.netns_comm_ip_ipv4_ioctl
    ltpresult.containers.netns_netlink
    ltpresult.containers.netns_comm_ip_ipv6_netlink
    ltpresult.containers.netns_breakns_ip_ipv6_ioctl
    ltpresult.containers.netns_comm_ns_exec_ipv6_ioctl
    ltpresult.commands.mv01_sh
    ltpresult.containers.netns_comm_ip_ipv6_ioctl
    ltpresult.containers.netns_breakns_ip_ipv4_ioctl
    ltpresult.controllers.cpuset_inherit
    ltpposixresult.MEM.mmap
    ltpresult.containers.netns_breakns_ns_exec_ipv4_netlink
    ltpposixresult.TPS.sched_getscheduler
    ltpresult.containers.netns_sysfs
    ltpposixresult.TPS.sched_get_priority_min
    ltpresult.commands.unshare01_sh
    ltpresult.fs_bind.BindMounts
    ltpresult.syscalls.msgstress03
    ltpresult.controllers.memcg_usage_in_bytes
    ltpposixresult.AIO.aio_write
    ltpposixresult.SEM.sem_init
    ltpposixresult.THR.pthread_rwlock_unlock
    ltpposixresult.AIO.aio_read
    ltpresult.containers.netns_comm_ip_ipv4_netlink
    ltpposixresult.AIO.aio_error
    ltpposixresult.TPS.sched_setparam
    ltpposixresult.THR.pthread_barrier_destroy
    ltpresult.containers.netns_comm_ns_exec_ipv4_netlink
    ltpresult.cve.cve-2017-5754
    ltpposixresult.AIO.aio_return
    ltpposixresult.MEM.shm_open
    ltpresult.commands.df01_ext2_sh
    ltpposixresult.TPS.sched_setscheduler
    ltpresult.commands.ar_sh
    ltpresult.controllers.memcg_max_usage_in_bytes
    ltpresult.syscalls.quotactl01
    ltpresult.containers.netns_breakns_ip_ipv4_netlink
    ltpposixresult.AIO.aio_suspend
    ltpresult.syscalls.kill11
    ltpresult.containers.netns_breakns_ip_ipv6_netlink
    ltpposixresult.TPS.sched_getparam
    ltpposixresult.MEM.shm_unlink
    ltpresult.syscalls.abort01
    ltpposixresult.THR.pthread_rwlock_rdlock
    ltpresult.containers.netns_breakns_ns_exec_ipv6_netlink
    ltpposixresult.TMR.clock_getcpuclockid
    ltpresult.net.ipv6_lib.getaddrinfo_01
    ltpresult.containers.netns_comm_ns_exec_ipv4_ioctl
testseries | result_id : qemux86-64-ptest | runtime_core-image-sato-sdk-ptest_qemux86-64_20190610223110
    ptestresult.perl.cpan/Win32/t/GetOSName
    ptestresult.acl.$_su
    ptestresult.perl.cpan/Win32/t/GetOSVersion
    ptestresult.perl.ext/VMS-DCLsym/t/vms_dclsym
    ptestresult.acl.$_su_daemon
    ptestresult.python.test_pipe_cloexec__test.test_subprocess.POSIXProcessTestCase_
    ptestresult.util-linux.mount:_btrfs__fstab___mount/fstab-btrfs_
    ptestresult.busybox.wget-retrieves-google-index
    ptestresult.perl.cpan/Win32/t/Names
    ptestresult.valgrind.drd/tests/pth_detached3
    ptestresult.gettext.autopoint-2
    ptestresult.perl.cpan/Win32/t/GetCurrentThreadId
    ptestresult.glib-2.0.glib/resources.test__Child_process_killed_by_signal_6_
    ptestresult.acl.$_echo_daemon3_>>_f
    ptestresult.gawk.backbigs1
    ptestresult.gawk.mbstr2
    ptestresult.perl.cpan/Win32/t/GuidGen
    ptestresult.acl.$_su_bin
    ptestresult.perl.cpan/Win32/t/ExpandEnvironmentStrings
    ptestresult.acl.$_echo_daemon4_>>_f
    ptestresult.gettext.autopoint-3
    ptestresult.util-linux.misc:_ul__misc/ul_
    ptestresult.perl.cpan/Win32/t/CodePage
    ptestresult.lttng-tools.ust/blocking/test_blocking_49_-_No_event_lost_with_UST_blocking_mode:_found_0_expect_5000000
    ptestresult.acl.$_echo_daemon_>>_f
    ptestresult.gawk.mbprintf1
    ptestresult.acl.$_cat_f
    ptestresult.perl.cpan/Win32/t/GetFileVersion
    ptestresult.perl.cpan/Win32/t/GetFolderPath
    ptestresult.openssl.test/recipes/90-test_shlibload.t,_test_returned_9__wstat_2304,_0x900_
    ptestresult.perl.cpan/Win32/t/CreateFile
    ptestresult.gstreamer1.0.pipelines/parse-launch
    ptestresult.bash.run-trap
    ptestresult.gawk.mbprintf4
    ptestresult.perl.ext/VMS-Stdio/t/vms_stdio
    ptestresult.python3.test_doctest_main_issue4197__test.test_zipimport_support.ZipSupportTests__..._Expected_line_File_"/var/volatile/tmp/tmp2afkk4t0/script.py",_line_2,_in___main__.Test
    ptestresult.gstreamer1.0.gst/gsturi
    ptestresult.gstreamer1.0.gst/gstsystemclock
    ptestresult.python3.test_start_tls_server_1__test.test_asyncio.test_sslproto.SelectorStartTLSTests_
    ptestresult.busybox.wget-supports--P
    ptestresult.perl.cpan/Win32/t/GetLongPathName
    ptestresult.gawk.backsmalls1
    ptestresult.perl.cpan/Win32/t/Unicode
    ptestresult.gawk.mbfw1
    ptestresult.perl.t/op/stat
    ptestresult.perl.cpan/Win32/t/GetShortPathName
    ptestresult.perl.ext/VMS-Filespec/t/filespec
    ptestresult.bluez5.test-avctp
    ptestresult.gawk.mbstr1
    ptestresult.busybox.wget-handles-empty-path
    ptestresult.parted.t6001-psep.sh
    ptestresult.bash.run-read
    ptestresult.busybox.wget--O-overrides--P
    ptestresult.perl.cpan/Win32/t/GetFullPathName
    ptestresult.acl.$_sg_bin
    ptestresult.acl.$_getfacl_g
testseries | result_id : qemux86 | oeselftest_opensusetumbleweed-20190606_qemux86_20190610225929
    runqemu.RunqemuTests.test_boot_machine_slirp
--------------------------------------------------------------------------------------------------------------