2023-07-03T17:35:37.972 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-03T17:35:37.974 INFO:teuthology.results:subset: '111/120000'
2023-07-03T17:35:37.974 INFO:teuthology.results:seed: '6532'
2023-07-03T17:49:21.648 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-03T17:49:21.651 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-07-04T05:50:20.436 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-07-04T05:50:21.593 INFO:scrape:Found 19 jobs
2023-07-04T05:50:23.940 INFO:scrape:Found 6 distinct failure reasons
2023-07-04T05:50:23.940 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f424ac457fa02811c2a787afcb876dab43bd0065 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2023-07-04T05:50:23.941 INFO:scrape:2 jobs: ['7324859', '7324847']
2023-07-04T05:50:23.941 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}']
2023-07-04T05:50:23.941 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-zstd}', 'random-objectstore$/{bluestore-stupid}', 'tasks/e2e}']
2023-07-04T05:50:23.942 INFO:scrape:
2023-07-04T05:50:23.942 INFO:scrape:Timeout 3h running clone.client.0/qa/standalone/mon-stretch/mon-stretch-fail-recovery.sh
2023-07-04T05:50:23.942 INFO:scrape:1 jobs: ['7324852']
2023-07-04T05:50:23.942 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'workloads/mon-stretch}']
2023-07-04T05:50:23.943 INFO:scrape:
2023-07-04T05:50:23.943 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/cephtool/test.sh
2023-07-04T05:50:23.943 INFO:scrape:4 jobs: ['7324842', '7324858', '7324846', '7324850']
2023-07-04T05:50:23.944 INFO:scrape:suites intersection: ['rados', 'rados/singleton-bluestore/{all/cephtool']
2023-07-04T05:50:23.944 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/none', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}']
2023-07-04T05:50:23.944 INFO:scrape:
2023-07-04T05:50:23.944 INFO:scrape:Dead: b'2023-07-04T05:49:24.116 DEBUG:teuthology.exit:Finished running handlers'
2023-07-04T05:50:23.945 INFO:scrape:3 jobs: ['7324851', '7324845', '7324843']
2023-07-04T05:50:23.945 INFO:scrape:suites intersection: []
2023-07-04T05:50:23.945 INFO:scrape:suites union: ['agent/off', 'mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_20.04}}', 'task/test_set_mon_crush_locations}']
2023-07-04T05:50:23.946 INFO:scrape:
2023-07-04T05:50:23.946 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi150 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f424ac457fa02811c2a787afcb876dab43bd0065 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'
2023-07-04T05:50:23.946 INFO:scrape:2 jobs: ['7324853', '7324857']
2023-07-04T05:50:23.946 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'test_envlibrados_for_rocksdb}']
2023-07-04T05:50:23.947 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}']
2023-07-04T05:50:23.947 INFO:scrape:
2023-07-04T05:50:23.947 INFO:scrape:Dead: b'2023-07-04T05:50:21.012 INFO:journalctl@ceph.mon.a.smithi003.stdout:Jul 04 05:50:20 smithi003 ceph-b9e74d4a-19cc-11ee-9b2e-001a4aab830c-mon-a[108602]: 2023-07-04T05:50:20.730+0000 7fc42ab30700 -1 mon.a@0(electing) e27037 get_health_metrics reporting 6 slow ops, oldest is mon_command({"prefix": "mon set_location", "name": "a", "args": ["datacenter=a"]} v 0)'
2023-07-04T05:50:23.948 INFO:scrape:1 jobs: ['7324854']
2023-07-04T05:50:23.948 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_set_mon_crush_locations}']
2023-07-04T05:50:23.948 INFO:scrape: