2023-03-21T15:57:37.558 INFO:root:teuthology version: 0.0.1.dev59+g7f7f7c3 2023-03-21T15:57:37.559 INFO:teuthology.results:seed: '4754' 2023-03-21T16:15:54.950 INFO:root:teuthology version: 0.0.1.dev59+g7f7f7c3 2023-03-21T16:15:54.958 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-03-21T19:38:10.356 INFO:teuthology.results:Tests finished! gathering results... 2023-03-21T19:38:11.357 INFO:scrape:Found 14 jobs 2023-03-21T19:38:11.535 INFO:scrape:Found 2 distinct failure reasons 2023-03-21T19:38:11.536 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd_python.sh 2023-03-21T19:38:11.536 INFO:scrape:1 jobs: ['7214155'] 2023-03-21T19:38:11.536 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_python_api_tests_old_format}'] 2023-03-21T19:38:11.536 INFO:scrape: 2023-03-21T19:38:11.537 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_lock_fence.sh 2023-03-21T19:38:11.537 INFO:scrape:1 jobs: ['7214151'] 2023-03-21T19:38:11.537 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_lock_and_fence}'] 2023-03-21T19:38:11.538 INFO:scrape: 2023-03-21T19:38:11.539 INFO:teuthology.results:Sending results to yingxincheng@gmail.com: Test Run: yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 12 Fail ================================================================= [7214151] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 03:14:29 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214151/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214151/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eef9e0dca0064db68363ac58ad5b19ee Command failed (workunit test rbd/test_lock_fence.sh) on smithi115 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3523011415b7e29afd0423a639e576dda9e64ba4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_lock_fence.sh' [7214155] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 03:13:48 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214155/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214155/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07cd58543c4448618fa5c243e72d6b7a Command failed (workunit test rbd/test_librbd_python.sh) on smithi149 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3523011415b7e29afd0423a639e576dda9e64ba4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' Pass ================================================================= [7214143] crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/rados_api_tests} time: 01:05:37 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214143/ [7214144] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_api_tests_old_format} time: 00:28:03 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214144/ [7214145] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:35 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214145/ [7214146] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:29:08 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214146/ [7214147] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_cls_tests} time: 00:20:18 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214147/ [7214148] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench} time: 00:30:37 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214148/ [7214149] crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/rados_python} time: 00:28:10 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214149/ [7214150] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:23:58 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214150/ [7214152] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:24:18 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214152/ [7214153] crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/readwrite} time: 00:18:07 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214153/ [7214154] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} time: 00:24:03 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214154/ [7214156] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:35 info: http://pulpito.ceph.com/yingxin-2023-03-20_05:27:41-crimson-rados-wip-chunmei-multicore-os-crimson-only-distro-default-smithi/7214156/