2023-06-17T12:44:43.215 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-17T12:44:43.215 INFO:teuthology.results:seed: '3308' 2023-06-17T13:57:21.462 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-17T13:57:21.501 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-17T14:42:24.865 INFO:teuthology.results:Tests finished! gathering results... 2023-06-17T14:42:29.736 INFO:scrape:Found 40 jobs 2023-06-17T14:42:53.736 INFO:scrape:Found 2 distinct failure reasons 2023-06-17T14:42:53.737 INFO:scrape:Failure: Command failed (workunit test rbd/diff_continuous.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' 2023-06-17T14:42:53.739 INFO:scrape:39 jobs 2023-06-17T14:42:53.745 INFO:scrape:suites intersection: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/thrash/{bluestore-bitmap', 'thrashosds-health', 'workloads/krbd_diff_continuous}'] 2023-06-17T14:42:53.745 INFO:scrape:suites union: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/thrash/{bluestore-bitmap', 'ms_mode$/{legacy-rxbounce}', 'ms_mode$/{legacy}', 'thrashers/backoff', 'thrashers/mon-thrasher', 'thrashers/pggrow', 'thrashers/upmap', 'thrashosds-health', 'workloads/krbd_diff_continuous}'] 2023-06-17T14:42:53.745 INFO:scrape: 2023-06-17T14:42:53.746 INFO:scrape:Failure: {'smithi016.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to update apt cache: unknown reason'}} 2023-06-17T14:42:53.746 INFO:scrape:1 jobs: ['7306489'] 2023-06-17T14:42:53.746 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/thrash/{bluestore-bitmap', 'ms_mode$/{legacy}', 'thrashers/backoff', 'thrashosds-health', 'workloads/krbd_diff_continuous}'] 2023-06-17T14:42:53.747 INFO:scrape: 2023-06-17T14:42:53.774 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi ================================================================= info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/ failed: 39 dead: 1 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7306490] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:30:57 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306490/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306490/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aebc999a408a489fb7bd84324210e491 Command failed (workunit test rbd/diff_continuous.sh) on smithi160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306491] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:09 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306491/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306491/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69f2d30e25984981848f11905603a6ed Command failed (workunit test rbd/diff_continuous.sh) on smithi120 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306492] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:30:35 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306492/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306492/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc91961370a8438da26282feff5b141f Command failed (workunit test rbd/diff_continuous.sh) on smithi172 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306493] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:32:51 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306493/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30d1bb9309a24333b185c8c06618d79a Command failed (workunit test rbd/diff_continuous.sh) on smithi118 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306494] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:06 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306494/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306494/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ba28f669ac64d96b64c8e8df32ce46e Command failed (workunit test rbd/diff_continuous.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306495] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:29:58 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306495/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306495/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ee8b3423af64824b1e380087a4ef924 Command failed (workunit test rbd/diff_continuous.sh) on smithi192 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306496] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:27:56 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306496/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306496/ sentry: https://sentry.ceph.com/organizations/ceph/?query=973d2d2b18a24465a3fa99b0036a526d Command failed (workunit test rbd/diff_continuous.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306497] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:52 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306497/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306497/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a813be3daf6d4d50bbe00108dd5d231b Command failed (workunit test rbd/diff_continuous.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306498] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:28:44 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306498/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306498/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81e02de7458e4514b6b367003f260ba7 Command failed (workunit test rbd/diff_continuous.sh) on smithi169 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306499] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:38:52 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306499/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306499/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0acf0dd877294c3296e568bccb265e1c Command failed (workunit test rbd/diff_continuous.sh) on smithi167 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306500] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:32:09 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306500/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306500/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24f450dcae0d4fe4b30f7e534c069cfd Command failed (workunit test rbd/diff_continuous.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306501] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:32:26 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306501/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306501/ sentry: https://sentry.ceph.com/organizations/ceph/?query=be0e4c225b4646e7a86af2e5d265a753 Command failed (workunit test rbd/diff_continuous.sh) on smithi105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306502] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:45 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306502/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a99bf6ba20142a8aff81a274af07380 Command failed (workunit test rbd/diff_continuous.sh) on smithi156 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306503] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:07 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306503/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306503/ sentry: https://sentry.ceph.com/organizations/ceph/?query=43b4b1b1485f4dfa98ce7b473b97a4f7 Command failed (workunit test rbd/diff_continuous.sh) on smithi130 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306504] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:31:54 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306504/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306504/ sentry: https://sentry.ceph.com/organizations/ceph/?query=09e64f71aef04320a8c58fbde864bb05 Command failed (workunit test rbd/diff_continuous.sh) on smithi191 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306505] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:31:48 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306505/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d46104b2eefd4ce69bf9a0ca3740f9b6 Command failed (workunit test rbd/diff_continuous.sh) on smithi155 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306506] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:29:01 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306506/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306506/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1954dadde584e3ab14e9cc3567f0ec4 Command failed (workunit test rbd/diff_continuous.sh) on smithi196 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306507] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:31:45 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306507/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306507/ sentry: https://sentry.ceph.com/organizations/ceph/?query=548856d2f90a4e8995b38351fc8916bd Command failed (workunit test rbd/diff_continuous.sh) on smithi151 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306508] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:28:45 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306508/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306508/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c983e0fc0134edd97ea9b5dc2087c6b Command failed (workunit test rbd/diff_continuous.sh) on smithi193 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306509] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:30:46 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306509/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306509/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a820bcc8e3ea4be39dcb5e081ce38c22 Command failed (workunit test rbd/diff_continuous.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306510] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:31:18 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306510/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f605c6d83ced4058a96f9f5d6d8a7b48 Command failed (workunit test rbd/diff_continuous.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306511] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:32:42 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306511/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306511/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ac88663ff614833acc650847331f556 Command failed (workunit test rbd/diff_continuous.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306512] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:29:47 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306512/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306512/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7904fc69a078409f8ae093f30ad2f9eb Command failed (workunit test rbd/diff_continuous.sh) on smithi190 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306513] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:37:55 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306513/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306513/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c27721f977b749a0a3939d5ad6d5da8c Command failed (workunit test rbd/diff_continuous.sh) on smithi138 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306514] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:39:28 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306514/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9aeea2d1a01940869da3cb166d1182d9 Command failed (workunit test rbd/diff_continuous.sh) on smithi202 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306515] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:31:55 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306515/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306515/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9b377d76739b4c95a2ce0f2615c04b25 Command failed (workunit test rbd/diff_continuous.sh) on smithi142 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306516] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:28:29 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306516/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306516/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b3e80cbf8e304defa13a04d4b4d4c789 Command failed (workunit test rbd/diff_continuous.sh) on smithi162 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306517] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:34:29 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306517/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306517/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e228e7da686546fcb512df638643360a Command failed (workunit test rbd/diff_continuous.sh) on smithi181 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306518] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:01 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306518/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306518/ sentry: https://sentry.ceph.com/organizations/ceph/?query=478b06841db347069132de1aa6813bb0 Command failed (workunit test rbd/diff_continuous.sh) on smithi182 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306519] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:34:53 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306519/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db1e56b32c074252bea612ce2d2b765a Command failed (workunit test rbd/diff_continuous.sh) on smithi161 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306520] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:33:20 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306520/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306520/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0fe5af9c6bd2479ab08d4fc1fa746f2b Command failed (workunit test rbd/diff_continuous.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306521] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:31:43 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306521/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306521/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ec08958b026411eb522a6459b6fe593 Command failed (workunit test rbd/diff_continuous.sh) on smithi150 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306522] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:32:54 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306522/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306522/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1bc7ac09f3a1404394ab9818f59a50f5 Command failed (workunit test rbd/diff_continuous.sh) on smithi157 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306523] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:35:23 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306523/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306523/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1eb46c42c78f43c1a4ff5c09e803f2e3 Command failed (workunit test rbd/diff_continuous.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306524] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:38:21 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306524/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306524/ sentry: https://sentry.ceph.com/organizations/ceph/?query=626ae6fc4f884a6fa68fde06efffad17 Command failed (workunit test rbd/diff_continuous.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306525] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:30:54 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306525/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f93976ad466437dba17af39950d263f Command failed (workunit test rbd/diff_continuous.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306526] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:34:39 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306526/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306526/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e79dc04eb434619a3ead98b050ff92e Command failed (workunit test rbd/diff_continuous.sh) on smithi181 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306527] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:28:54 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306527/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306527/ sentry: https://sentry.ceph.com/organizations/ceph/?query=647c7b7f3f214882adae3ae1830e5a87 Command failed (workunit test rbd/diff_continuous.sh) on smithi157 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' [7306528] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:28:51 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306528/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306528/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91ee34d566784cff8ba94dc825fceddf Command failed (workunit test rbd/diff_continuous.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88f2ae72a89331e6cbd9296793cfcd3dc8e53855 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' Dead ================================================================= [7306489] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:19:16 info: http://pulpito.ceph.com/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306489/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-17_12:44:20-krbd-main-testing-default-smithi/7306489/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eb40c7b5022f4c5b8b72c2e8bb18d66c {'smithi016.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to update apt cache: unknown reason'}}