2024-02-03T09:00:56.354 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-03T09:00:56.355 INFO:teuthology.results:subset: '9000/10000' 2024-02-03T09:00:56.355 INFO:teuthology.results:seed: '1837' 2024-02-03T09:10:11.993 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-03T09:10:11.996 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-02-03T12:11:26.066 INFO:teuthology.results:Tests finished! gathering results... 2024-02-03T12:11:26.651 INFO:scrape:Found 9 jobs 2024-02-03T12:11:28.574 INFO:scrape:Found 1 distinct failure reasons 2024-02-03T12:11:28.574 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd_python.sh) on smithi053 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' 2024-02-03T12:11:28.574 INFO:scrape:2 jobs: ['7543512', '7543507'] 2024-02-03T12:11:28.574 INFO:scrape:suites intersection: ['0-start', '1-tasks', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2024-02-03T12:11:28.575 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'upgrade:reef-x/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'upgrade:reef-x/parallel/{0-random-distro$/{ubuntu_20.04}', 'workload/{ec-rados-default'] 2024-02-03T12:11:28.575 INFO:scrape: 2024-02-03T12:11:28.576 INFO:teuthology.results:Sending results to ksirivad@redhat.com: Test Run: ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 7 Fail ================================================================= [7543507] upgrade:reef-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 01:56:02 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543507/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543507/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8cf6e6ae9d394997a74c450a1d34b164 Command failed (workunit test rbd/test_librbd_python.sh) on smithi192 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' [7543512] upgrade:reef-x/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 01:48:07 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543512/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543512/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0091fcc60772444aa100e3133a304154 Command failed (workunit test rbd/test_librbd_python.sh) on smithi053 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' Pass ================================================================= [7543508] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:42:28 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543508/ [7543509] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:29:34 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543509/ [7543510] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:26:25 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543510/ [7543511] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:38:46 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543511/ [7543513] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:54:50 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543513/ [7543514] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:47:10 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543514/ [7543515] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:40:39 info: https://pulpito.ceph.com/ksirivad-2024-02-02_14:48:48-upgrade:reef-x-wip-ksirivad-osdmap-encode-bug-distro-default-smithi/7543515/