2023-11-02T08:21:00.295 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-02T08:21:00.296 INFO:teuthology.results:seed: '9473' 2023-11-02T09:09:06.647 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-02T09:09:06.668 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-02T09:32:08.667 INFO:teuthology.results:Tests finished! gathering results... 2023-11-02T09:32:18.413 INFO:scrape:Found 122 jobs 2023-11-02T09:32:27.829 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444036/teuthology.log 2023-11-02T09:32:29.681 INFO:scrape:Found 5 distinct failure reasons 2023-11-02T09:32:29.682 INFO:scrape:Failure: Command failed on smithi160 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' 2023-11-02T09:32:29.683 INFO:scrape:115 jobs 2023-11-02T09:32:29.685 INFO:scrape:suites intersection: [] 2023-11-02T09:32:29.686 INFO:scrape:suites union: ['0-roles', '0-start', '1-start', '1-tasks', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '2-first-half-tasks/rbd-import-export', '2-first-half-tasks/rbd_api', '2-first-half-tasks/readwrite', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'rados_api', 'rados_loadgenbig', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'rbd_import_export', 'readwrite', 'snaps-few-objects}', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'upgrade:reef-x/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'upgrade:reef-x/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0}', 'upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools', 'upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun', 'upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0', 'upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8', 'upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04', 'workload/{ec-rados-default'] 2023-11-02T09:32:29.686 INFO:scrape: 2023-11-02T09:32:29.687 INFO:scrape:Failure: ['Failed to connect to the host via ssh: ssh: connect to host smithi038.front.sepia.ceph.com port 22: No route to host'] 2023-11-02T09:32:29.687 INFO:scrape:3 jobs: ['7444093', '7444067', '7444048'] 2023-11-02T09:32:29.688 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}'] 2023-11-02T09:32:29.688 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/rbd-import-export', '2-first-half-tasks/rbd_api', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0', 'upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8'] 2023-11-02T09:32:29.689 INFO:scrape: 2023-11-02T09:32:29.689 INFO:scrape:Failure: ['Not copying any file from skel directory into it.', "useradd: user 'baum' already exists", "useradd: user 'lechernin' already exists", 'useradd: warning: the home directory already exists.'] 2023-11-02T09:32:29.690 INFO:scrape:2 jobs: ['7443991', '7443992'] 2023-11-02T09:32:29.690 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}'] 2023-11-02T09:32:29.691 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0', 'upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8'] 2023-11-02T09:32:29.691 INFO:scrape: 2023-11-02T09:32:29.691 INFO:scrape:Failure: Stale jobs detected, aborting. 2023-11-02T09:32:29.692 INFO:scrape:1 jobs: ['7444052'] 2023-11-02T09:32:29.692 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0'] 2023-11-02T09:32:29.693 INFO:scrape: 2023-11-02T09:32:29.693 INFO:scrape:Dead: None 2023-11-02T09:32:29.694 INFO:scrape:1 jobs: ['7444036'] 2023-11-02T09:32:29.694 INFO:scrape: 2023-11-02T09:32:29.708 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/ failed: 118 dead: 4 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7443978] upgrade:reef-x/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443978/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443978/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0402c7d10c1843f1a3635dc1533a720c Command failed on smithi077 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443979] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443979/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443979/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c08732d7fbb493597829a4b9cfe0381 Command failed on smithi064 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443980] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443980/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443980/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab40a7dfd8ee4bb9a6b7ab863c745107 Command failed on smithi118 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443981] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:18:05 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443981/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443981/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4bec8ea94a2c474d9c9ad981f05236b2 Command failed on smithi156 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443982] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443982/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443982/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85cb042d82bc42378f62f7772de211f0 Command failed on smithi055 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443983] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:08:13 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443983/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443983/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a827d3e8afbb4a2fa3ac5a10ce71462e Command failed on smithi088 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443984] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443984/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443984/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e1a6d944c5e4d41847f0e0482e4d9c8 Command failed on smithi061 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443985] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443985/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443985/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0182aa99816240b2abb96626c2601909 Command failed on smithi123 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443986] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443986/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443986/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca7c0b6d400f49af902c52f5d01d3e04 Command failed on smithi160 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443987] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443987/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443987/ sentry: https://sentry.ceph.com/organizations/ceph/?query=20f5e4b2c57b47c59b6d12299f943b56 Command failed on smithi089 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443988] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443988/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443988/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d86dcb1eda1247329a2c4fe732ea75dc Command failed on smithi145 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443989] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443989/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443989/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b799654c86fa47fd812b06d2519ed921 Command failed on smithi031 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443990] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443990/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443990/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e3ae89328664937ba184730d7dd7f39 Command failed on smithi019 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443991] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443991/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443991/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa80fa630c4143faa2ab37000b8c54f1 ['Not copying any file from skel directory into it.', "useradd: user 'baum' already exists", "useradd: user 'lechernin' already exists", 'useradd: warning: the home directory already exists.'] [7443993] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:08:17 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443993/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443993/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ac625c5b9074fd4b326ff40e5dcc2ab Command failed on smithi008 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443994] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443994/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443994/ sentry: https://sentry.ceph.com/organizations/ceph/?query=18e3cad1d56b44a69478049c79db7169 Command failed on smithi005 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443995] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443995/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443995/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0377d0f485d4489801d539b21712a2d Command failed on smithi153 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443996] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443996/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443996/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d08651edb36495fbc78934e8b8b3ef6 Command failed on smithi050 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443997] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:17:38 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443997/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443997/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a75c9368af0a4c5da7d31496278b7dff Command failed on smithi096 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443998] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:17 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443998/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443998/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7060691f8e9a4893894c540a3a21eb97 Command failed on smithi097 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7443999] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443999/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443999/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61bc31e7dc6d4a009ba50c07ad9b5ea0 Command failed on smithi137 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444000] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444000/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444000/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2928b8687ca645a0a4fa2103cdef942d Command failed on smithi042 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444001] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444001/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444001/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e87c9e7426d04aab8537fdd05918f3e8 Command failed on smithi027 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444002] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:33 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444002/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444002/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ff505c348404602b55937668e5b07be Command failed on smithi079 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444003] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444003/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444003/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf00c2a7d96845b09f7b264cb2203f48 Command failed on smithi110 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444004] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444004/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444004/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1141be3f9e4040a3951850222218230b Command failed on smithi049 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444005] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444005/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444005/ sentry: https://sentry.ceph.com/organizations/ceph/?query=45513f40d6e945d89429b73719ed0ff5 Command failed on smithi087 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444006] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:15 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444006/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444006/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4aeb10784e124771a57950f4a3e1d3de Command failed on smithi060 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444007] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444007/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444007/ sentry: https://sentry.ceph.com/organizations/ceph/?query=788682acb9d145ca84e8fd03ddd306de Command failed on smithi073 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444008] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444008/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444008/ sentry: https://sentry.ceph.com/organizations/ceph/?query=036ea9ba29e34c90bea4e07f5476d37f Command failed on smithi119 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444009] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444009/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444009/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bab82190b0304e0cb55561b599e32880 Command failed on smithi007 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444010] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444010/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444010/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c2719f20df684b75b9f18bc1006dc36a Command failed on smithi143 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444011] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:07 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444011/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444011/ sentry: https://sentry.ceph.com/organizations/ceph/?query=008f0cb40a5244f58d19381db6ea9ce3 Command failed on smithi084 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444012] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444012/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444012/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0462359a80df4f579aa9d2ca75efaf4a Command failed on smithi105 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444013] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444013/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444013/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d4abe669cc134250b40f87d3d5289a26 Command failed on smithi167 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444014] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444014/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444014/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cfae549956d249bc9a342e4c89b5c784 Command failed on smithi083 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444015] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444015/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444015/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03f4c845a7b04fe78814bf73698af4eb Command failed on smithi150 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444016] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444016/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444016/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a235cce152b49a5ab2189e532d70ef6 Command failed on smithi003 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444017] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444017/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444017/ sentry: https://sentry.ceph.com/organizations/ceph/?query=491f1126438e41a381d909956699ebe2 Command failed on smithi144 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444018] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:08:38 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444018/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444018/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3eee8ce9b69e4a329ce5ab4733fcfd78 Command failed on smithi081 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444019] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444019/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444019/ sentry: https://sentry.ceph.com/organizations/ceph/?query=15c2e0429ae74deb98657247669e88a8 Command failed on smithi088 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444020] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:13:33 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444020/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444020/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad8043574b6543d8a3cab86a938691b8 Command failed on smithi037 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444021] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444021/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444021/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2cc4057a55f544afbe4198adb7117d5a Command failed on smithi045 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444022] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:18:20 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444022/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444022/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da09010c6d3a4b309e0ea1f84db6b6ec Command failed on smithi057 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444023] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444023/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444023/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82cffdf1dcb64cceacf11a47fad4bd1d Command failed on smithi194 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444024] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444024/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444024/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f54a202f295847ec8a86c2984079773a Command failed on smithi023 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444025] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444025/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444025/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7efab64cc2794fa788a0c96adb0f80cb Command failed on smithi002 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444026] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444026/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444026/ sentry: https://sentry.ceph.com/organizations/ceph/?query=27882f65840440319aeccf21a6d2e863 Command failed on smithi033 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444027] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444027/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444027/ sentry: https://sentry.ceph.com/organizations/ceph/?query=acc4050f62db4e8da1f043d275ea873c Command failed on smithi067 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444028] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444028/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444028/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b659e2c73ba41e9aa020ef019e46d33 Command failed on smithi064 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444029] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444029/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444029/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e89722c5a37e460fac102f4d1d4198f4 Command failed on smithi006 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444030] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444030/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444030/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c2cbd5923554d72a47d6e39d0099951 Command failed on smithi046 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444031] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444031/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444031/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a070ce0b5194defab902a6637acdd28 Command failed on smithi077 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444032] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444032/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444032/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea60d830f5dd482688e9531975127730 Command failed on smithi111 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444033] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444033/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444033/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0c18b19a65b4db6b8764443e9caebab Command failed on smithi118 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444034] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444034/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444034/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38bad5ee3d57482e922432a71f0869f6 Command failed on smithi061 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444035] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444035/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444035/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85c84d1102364d049058555583f77e87 Command failed on smithi123 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444037] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444037/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444037/ sentry: https://sentry.ceph.com/organizations/ceph/?query=053ce742d1bb4edea97fe93bd3b28f2f Command failed on smithi132 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444038] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444038/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444038/ sentry: https://sentry.ceph.com/organizations/ceph/?query=152a6f997eeb4e5da8d2df37761e9d14 Command failed on smithi031 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444039] upgrade:reef-x/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444039/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444039/ sentry: https://sentry.ceph.com/organizations/ceph/?query=45f784775d9d4c48a22a304ed7927cdc Command failed on smithi097 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444040] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:12:00 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444040/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444040/ sentry: https://sentry.ceph.com/organizations/ceph/?query=324d6a0ef87148de8346a173325c9805 Command failed on smithi156 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444041] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444041/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444041/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f9b730b7359472db77677633ad0d403 Command failed on smithi055 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444042] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:21:35 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444042/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444042/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cfba3c7ce32d4b338a0c8834a22aab45 Command failed on smithi129 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444043] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444043/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444043/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05e6f6f0e0314b3cb11456e36cd2ddeb Command failed on smithi008 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444044] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444044/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444044/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80be287e59b74c6eb3ddedda087cc672 Command failed on smithi094 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444045] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:00 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444045/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444045/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d9cb9585c0444e5b56d00cd3cd13649 Command failed on smithi089 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444046] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444046/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444046/ sentry: https://sentry.ceph.com/organizations/ceph/?query=355eb5c2ea4f44db8cef86bc6f9c8b70 Command failed on smithi160 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444047] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444047/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444047/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b709efd9ed1a407db03e15906228aabf Command failed on smithi153 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444049] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444049/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444049/ sentry: https://sentry.ceph.com/organizations/ceph/?query=246c899527704fe9bc8b6939ea1f1ba0 Command failed on smithi110 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444050] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444050/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444050/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93720f1fd4274e6a827de84389d8516e Command failed on smithi137 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444051] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444051/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444051/ sentry: https://sentry.ceph.com/organizations/ceph/?query=996aa7f68b7e404f94b12a4993147f17 Command failed on smithi019 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444052] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444052/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444052/ sentry: https://sentry.ceph.com/organizations/ceph/?query=edede2469f614238a0d6f85f9c1741ff Stale jobs detected, aborting. [7444053] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444053/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84cc19a5d5a8431cbed06d892325a7e0 Command failed on smithi005 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444054] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444054/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444054/ sentry: https://sentry.ceph.com/organizations/ceph/?query=945897dcc7054effba00c3c7e5700664 Command failed on smithi119 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444055] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444055/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444055/ sentry: https://sentry.ceph.com/organizations/ceph/?query=124a43ef5e834e52891e4a6abc147857 Command failed on smithi122 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444056] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:14:37 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444056/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444056/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c8bb509c1874e0dbac8ded9ac120dbd Command failed on smithi042 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444057] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:05 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444057/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444057/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f3852a6f2d94f51920fb5f9ca102dca Command failed on smithi096 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444058] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444058/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444058/ sentry: https://sentry.ceph.com/organizations/ceph/?query=caffc47eef454792aa4156bcc2ccc225 Command failed on smithi050 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444059] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444059/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444059/ sentry: https://sentry.ceph.com/organizations/ceph/?query=277ba6df74f5491d8e533bd33f48cda3 Command failed on smithi087 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444060] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444060/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444060/ sentry: https://sentry.ceph.com/organizations/ceph/?query=af874d1af4814b56b42545d5e471f9aa Command failed on smithi027 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444061] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444061/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444061/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6e495261f364a3bb8df99649737ca23 Command failed on smithi079 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444062] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444062/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444062/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4534a453cf63492da04da11731740762 Command failed on smithi073 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444063] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444063/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444063/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2802b6de0f9a4d44956b44f9fbaa8b19 Command failed on smithi071 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444064] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444064/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444064/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b3da4f1c0684e30b76dbc3d3e254a16 Command failed on smithi043 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444065] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444065/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444065/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a5408216484427d851881ae64b9cc00 Command failed on smithi143 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444066] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444066/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444066/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ea238892f704ff2a6dabaebb3e8691d Command failed on smithi069 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444068] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:18:20 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444068/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6677f6b6b6f40eabc02c40b7bd9e44e Command failed on smithi012 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444069] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444069/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444069/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9107fc396ebc4f68ae08a274f2d06f20 Command failed on smithi049 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444070] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444070/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=35a489fc3143409fa47be49114647ccf Command failed on smithi081 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444071] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444071/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444071/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2fbce1a101154b9d9abc018906bd0ddf Command failed on smithi167 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444072] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:19:17 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444072/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ea74ad1d3f24c6f8fcc8b7b7497aaa4 Command failed on smithi007 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444073] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444073/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444073/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2cf309a18fcb4bb98082fd200734a4ff Command failed on smithi083 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444074] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444074/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444074/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83a1b99af1db46a5868dfed35ed73f38 Command failed on smithi150 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444075] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444075/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444075/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7acf344137c94161a6958be80a6095cd Command failed on smithi064 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444076] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444076/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444076/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3212ffafa2ee4658a44f89172502e893 Command failed on smithi194 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444077] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:18:03 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444077/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444077/ sentry: https://sentry.ceph.com/organizations/ceph/?query=561619a22e464f6dad4e1b560cf5fc30 Command failed on smithi088 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444078] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:57 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444078/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444078/ sentry: https://sentry.ceph.com/organizations/ceph/?query=306c1384df234c1eba8c58cbd09f0cfb Command failed on smithi084 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444079] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444079/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444079/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c31a2e4206f4fdd9794a3c4ebcf901c Command failed on smithi105 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444080] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444080/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da0e27e48b00486090bce09ed53dfb25 Command failed on smithi118 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444081] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444081/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444081/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2110ec7ae3cc459bb3617576fde71cfe Command failed on smithi003 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444082] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444082/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444082/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab5c04c32f3545878b725cf692954f93 Command failed on smithi017 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444083] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444083/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444083/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8edae4463d04fe4a9e9d4e12c7f6320 Command failed on smithi144 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444084] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444084/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444084/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01b9e5679c824e208bb9290ea297fcc9 Command failed on smithi037 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444085] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444085/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444085/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05ee6ca1d33a4c2c96467b027974f7fe Command failed on smithi002 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444086] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444086/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444086/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b34a9d48b4984df3b3a4992cfcf6a34b Command failed on smithi045 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444087] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444087/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444087/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3792d5d372ba49d68796a359f41ceac3 Command failed on smithi023 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444088] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444088/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c2e2490a18d84fb380b15110a39ece75 Command failed on smithi094 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444089] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444089/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444089/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b552c0624eac40b0a14bc36ba58d6826 Command failed on smithi131 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444090] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444090/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444090/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f5ce3aa02774b6fafb184910cbf41f1 Command failed on smithi006 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444091] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444091/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444091/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ad8925427a34e7e8a907d8c5ef9bca6 Command failed on smithi046 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444092] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:47 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444092/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444092/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5293b63e80bd4355b3918eedc1494265 Command failed on smithi061 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444093] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444093/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444093/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7c57d5e8f364a439cc5ee6464422a52 ['Failed to connect to the host via ssh: ssh: connect to host smithi038.front.sepia.ceph.com port 22: No route to host'] [7444094] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444094/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444094/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3bfd2c88eb548da8831f3427cb951ac Command failed on smithi033 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444095] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444095/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444095/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd48203fb7f5414795fa193f0864030a Command failed on smithi110 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444096] upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444096/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444096/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a2bda2176dbb4ed1a420811a58b9aa80 Command failed on smithi123 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444097] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444097/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444097/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0718bd649a7c45dcb47b09485e90e6ff Command failed on smithi067 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444098] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444098/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444098/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23255273eac745dd8313206193d796ad Command failed on smithi097 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' [7444099] upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} ----------------------------------------------------------------- time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444099/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444099/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ca5541232d642af8aaf90cfa2dcbc4e Command failed on smithi077 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm' Dead ================================================================= [7443992] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443992/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7443992/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b9093ec98ab4488f8c3d081f862b8a5c ['Not copying any file from skel directory into it.', "useradd: user 'bcs- ceph' already exists", "useradd: user 'poonc3' already exists", 'useradd: warning: the home directory already exists.'] [7444036] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444036/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444036/ Error reimaging machines: list index out of range [7444048] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444048/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444048/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6a0f7c0ab0e4f5d8b4578d95faf0573 ['Failed to connect to the host via ssh: ssh: connect to host smithi038.front.sepia.ceph.com port 22: No route to host'] [7444067] upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444067/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2023-11-02_02:25:02-upgrade:reef-x-main-distro-default-smithi/7444067/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90ac3ee0105540ca98e1ff654f5ecd06 ['Failed to connect to the host via ssh: ssh: connect to host smithi038.front.sepia.ceph.com port 22: No route to host']