2023-12-09T00:44:56.270 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-09T00:44:56.270 INFO:teuthology.results:subset: '111/120000'
2023-12-09T00:44:56.270 INFO:teuthology.results:seed: '5893'
2023-12-09T00:53:32.154 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-09T00:53:32.158 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-12-09T12:54:26.382 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-12-09T12:54:27.029 INFO:scrape:Found 9 jobs
2023-12-09T12:54:33.495 INFO:scrape:Found 4 distinct failure reasons
2023-12-09T12:54:33.495 INFO:scrape:Dead: b'2023-12-09T12:54:26.341 INFO:journalctl@ceph.mon.b.smithi143.stdout:Dec 09 12:54:25 smithi143 ceph-e4564d6c-962f-11ee-95a3-87774f69a715-mon-b[110820]: cluster 2023-12-09T12:54:24.214591+0000 mgr.y (mgr.14589) 23793 : cluster [DBG] pgmap v23470: 105 pgs: 105 active+clean; 4.0 MiB data, 6.3 GiB used, 709 GiB / 715 GiB avail'
2023-12-09T12:54:33.495 INFO:scrape:3 jobs: ['7484546', '7484542', '7484545']
2023-12-09T12:54:33.495 INFO:scrape:suites intersection: []
2023-12-09T12:54:33.495 INFO:scrape:suites union: ['0-roles', '0-start', '1-start', '1-tasks', '2-first-half-tasks/rbd_api', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', 'mon_election/classic', 'mon_election/connectivity', 'mon_election/connectivity}', 'rados_api', 'rados_loadgenbig', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'rbd_import_export', 'readwrite', 'snaps-few-objects}', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'upgrade:pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'upgrade:pacific-x/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8', 'workload/{ec-rados-default']
2023-12-09T12:54:33.496 INFO:scrape:
2023-12-09T12:54:33.496 INFO:scrape:Dead: b'2023-12-09T12:54:27.449 INFO:journalctl@ceph.mon.a.smithi078.stdout:Dec 09 12:54:27 smithi078 ceph-79b87714-962f-11ee-95a3-87774f69a715-mon-a[111947]: audit 2023-12-09T12:54:26.122669+0000 mon.c (mon.2) 12615 : audit [DBG] from=\'client.? 172.21.15.78:0/826628239\' entity=\'client.admin\' cmd=[{"prefix": "mon versions"}]: dispatch'
2023-12-09T12:54:33.496 INFO:scrape:3 jobs: ['7484541', '7484544', '7484543']
2023-12-09T12:54:33.496 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}']
2023-12-09T12:54:33.496 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '2-first-half-tasks/rbd-import-export', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools', 'upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun', 'upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0']
2023-12-09T12:54:33.496 INFO:scrape:
2023-12-09T12:54:33.496 INFO:scrape:Dead: b'2023-12-09T12:54:30.512 INFO:journalctl@ceph.mgr.x.smithi195.stdout:Dec 09 12:54:30 smithi195 bash[29390]: ::ffff:172.21.15.195 - - [09/Dec/2023:12:54:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4"'
2023-12-09T12:54:33.496 INFO:scrape:1 jobs: ['7484547']
2023-12-09T12:54:33.496 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/readwrite', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x/stress-split/{0-distro/ubuntu_20.04']
2023-12-09T12:54:33.496 INFO:scrape:
2023-12-09T12:54:33.497 INFO:scrape:Dead: b'2023-12-09T12:54:29.190 DEBUG:teuthology.exit:Finished running handlers'
2023-12-09T12:54:33.497 INFO:scrape:2 jobs: ['7484540', '7484539']
2023-12-09T12:54:33.497 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}']
2023-12-09T12:54:33.497 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/readwrite', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8', 'upgrade:pacific-x/stress-split/{0-distro/ubuntu_20.04']
2023-12-09T12:54:33.497 INFO:scrape:
2023-12-09T12:54:33.498 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/
failed:  0
dead:    0
running: 9
waiting: 0
queued:  0
passed:  0


Running
=================================================================
[7484539] upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484539/

[7484540] upgrade:pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484540/

[7484541] upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484541/

[7484542] upgrade:pacific-x/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484542/

[7484543] upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484543/

[7484544] upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484544/

[7484545] upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484545/

[7484546] upgrade:pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484546/

[7484547] upgrade:pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic}
info:   https://pulpito.ceph.com/yuriw-2023-12-08_19:37:29-upgrade:pacific-x-main-distro-default-smithi/7484547/