2023-04-01T01:25:00.947 INFO:root:teuthology version: 0.0.1.dev91+g5338cb9 2023-04-01T01:25:00.948 INFO:teuthology.results:subset: '111/12000' 2023-04-01T01:25:00.948 INFO:teuthology.results:seed: '9857' 2023-04-01T01:38:51.923 INFO:root:teuthology version: 0.0.1.dev91+g5338cb9 2023-04-01T01:38:51.926 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-04-01T04:25:05.343 INFO:teuthology.results:Tests finished! gathering results... 2023-04-01T04:25:06.187 INFO:scrape:Found 10 jobs 2023-04-01T04:25:07.172 INFO:scrape:Found 1 distinct failure reasons 2023-04-01T04:25:07.172 INFO:scrape:Failure: Command failed (workunit test cls/test_cls_rbd.sh) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=octopus TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' 2023-04-01T04:25:07.173 INFO:scrape:2 jobs: ['7228880', '7228876'] 2023-04-01T04:25:07.173 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}'] 2023-04-01T04:25:07.174 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools', 'upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools_crun'] 2023-04-01T04:25:07.174 INFO:scrape: 2023-04-01T04:25:07.175 INFO:teuthology.results:Sending results to yweinste@radhat.com: Test Run: yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 8 Fail ================================================================= [7228876] upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 01:27:11 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228876/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228876/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3dbfe2a945834dbcb0b88bf86a34c9ef Command failed (workunit test cls/test_cls_rbd.sh) on smithi042 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=octopus TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' [7228880] upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:19:59 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228880/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5319caeef84e421aa2106f49edc8d027 Command failed (workunit test cls/test_cls_rbd.sh) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=octopus TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' Pass ================================================================= [7228872] upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:03:46 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228872/ [7228874] upgrade:quincy-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:45:49 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228874/ [7228878] upgrade:quincy-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:25:54 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228878/ [7228882] upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:49:25 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228882/ [7228884] upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:26:12 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228884/ [7228886] upgrade:quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_20.04} time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228886/ [7228888] upgrade:quincy-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:36:28 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228888/ [7228890] upgrade:quincy-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:11:31 info: http://pulpito.ceph.com/yuriw-2023-03-31_20:19:01-upgrade:quincy-x-reef-distro-default-smithi/7228890/