2024-01-23T06:47:56.383 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-23T06:47:56.383 INFO:teuthology.results:subset: '111/120000' 2024-01-23T06:47:56.383 INFO:teuthology.results:seed: '994' 2024-01-23T06:55:38.477 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-23T06:55:38.480 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-23T18:56:34.208 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2024-01-23T18:56:35.457 INFO:scrape:Found 16 jobs 2024-01-23T18:56:38.506 INFO:scrape:Found 6 distinct failure reasons 2024-01-23T18:56:38.507 INFO:scrape:Dead: b'2024-01-23T18:55:57.300 DEBUG:teuthology.exit:Finished running handlers' 2024-01-23T18:56:38.507 INFO:scrape:1 jobs: ['7527432'] 2024-01-23T18:56:38.507 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-23T18:56:38.507 INFO:scrape: 2024-01-23T18:56:38.507 INFO:scrape:Dead: b'2024-01-23T07:12:16.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored' 2024-01-23T18:56:38.507 INFO:scrape:1 jobs: ['7527441'] 2024-01-23T18:56:38.508 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-23T18:56:38.508 INFO:scrape: 2024-01-23T18:56:38.508 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-01-23T18:56:38.508 INFO:scrape:1 jobs: ['7527431'] 2024-01-23T18:56:38.508 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-01-23T18:56:38.508 INFO:scrape: 2024-01-23T18:56:38.508 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-01-23T18:56:38.508 INFO:scrape:5 jobs: ['7527433', '7527445', '7527443', '7527436', '7527437'] 2024-01-23T18:56:38.509 INFO:scrape:suites intersection: [] 2024-01-23T18:56:38.509 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-01-23T18:56:38.509 INFO:scrape: 2024-01-23T18:56:38.509 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2024-01-23T18:56:38.509 INFO:scrape:2 jobs: ['7527434', '7527446'] 2024-01-23T18:56:38.509 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output'] 2024-01-23T18:56:38.509 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-23T18:56:38.509 INFO:scrape: 2024-01-23T18:56:38.509 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi133 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d1563036928048a487b8d17bdf66baca01c75bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py' 2024-01-23T18:56:38.509 INFO:scrape:1 jobs: ['7527435'] 2024-01-23T18:56:38.510 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_timeout}'] 2024-01-23T18:56:38.510 INFO:scrape: