2022-02-02T05:36:47.848 INFO:root:teuthology version: 1.1.0-0f634dc1 2022-02-02T05:36:47.850 INFO:teuthology.results:subset: '111/120000' 2022-02-02T05:36:47.850 INFO:teuthology.results:seed: '9204' 2022-02-02T08:24:04.089 INFO:root:teuthology version: 1.1.0-0f634dc1 2022-02-02T08:24:04.120 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-02-02T12:58:25.878 INFO:teuthology.results:Tests finished! gathering results... 2022-02-02T12:58:36.717 INFO:scrape:Found 99 jobs 2022-02-02T12:58:37.047 WARNING:scrape:Not-understood crash indication 2022-02-02T07:07:18.944 INFO:tasks.rgw.c2.client.0.smithi204.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.048 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:37.067 WARNING:scrape:Not-understood crash indication 2022-02-02T07:07:18.944 INFO:tasks.rgw.c2.client.0.smithi204.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.068 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:37.085 WARNING:scrape:Not-understood crash indication 2022-02-02T07:07:18.944 INFO:tasks.rgw.c2.client.0.smithi204.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.087 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:37.105 WARNING:scrape:Not-understood crash indication 2022-02-02T07:07:18.944 INFO:tasks.rgw.c2.client.0.smithi204.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.106 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:37.250 WARNING:scrape:Not-understood crash indication 2022-02-02T08:13:02.346 INFO:tasks.rgw.c2.client.0.smithi133.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.251 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:37.270 WARNING:scrape:Not-understood crash indication 2022-02-02T08:13:02.346 INFO:tasks.rgw.c2.client.0.smithi133.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.271 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:37.839 WARNING:scrape:Not-understood crash indication 2022-02-02T06:14:41.182 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.840 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:37.858 WARNING:scrape:Not-understood crash indication 2022-02-02T06:14:41.182 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:37.859 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:38.564 WARNING:scrape:Not-understood crash indication 2022-02-02T06:42:22.949 INFO:tasks.rgw.c2.client.0.smithi140.stderr:daemon-helper: command crashed with signal 11 2022-02-02T12:58:38.565 WARNING:scrape:Not-understood crash indication 2022-02-02T12:58:41.976 INFO:scrape:Found 5 distinct failure reasons 2022-02-02T12:58:41.977 INFO:scrape:Failure: Command failed on smithi122 with status 1: 'sudo yum install -y kernel' 2022-02-02T12:58:41.977 INFO:scrape:24 jobs: ['6654325', '6654282', '6654326', '6654284', '6654348', '6654273', '6654309', '6654323', '6654275', '6654324', '6654331', '6654271', '6654299', '6654269', '6654349', '6654318', '6654330', '6654286', '6654358', '6654281', '6654293', '6654343', '6654287', '6654334'] 2022-02-02T12:58:41.978 INFO:scrape:suites intersection: [] 2022-02-02T12:58:41.979 INFO:scrape:suites union: ['0-roles', '0-start', '1-ceph-install/octopus', '1-start', '1-tasks', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-first-half-tasks/rbd-import-export', '2-first-half-tasks/rbd_api', '2-first-half-tasks/readwrite', '2-partial-upgrade/firsthalf', '3-stress-tasks/{radosbench', '3-thrash/default', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rados_api', 'rados_loadgenbig', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'rbd_import_export', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'test_rbd_api', 'test_rbd_api}}', 'test_rbd_python}}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade-sequence', 'upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0', 'upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack', 'upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0', 'upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0', 'upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.2_container_tools_3.0}', 'upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0', 'upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0', 'workload/{ec-rados-default'] 2022-02-02T12:58:41.980 INFO:scrape: 2022-02-02T12:58:41.980 INFO:scrape:Failure: rgw multisite test failures 2022-02-02T12:58:41.980 INFO:scrape:3 jobs: ['6654319', '6654344', '6654270'] 2022-02-02T12:58:41.981 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters'] 2022-02-02T12:58:41.981 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters', 'upgrade/primary}', 'upgrade/secondary}'] 2022-02-02T12:58:41.982 INFO:scrape: 2022-02-02T12:58:41.982 INFO:scrape:Failure: Failure object was: {'smithi133.front.sepia.ceph.com': {'cache_updated': False, 'stdout': "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 92 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nErr:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2\n Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out\nErr:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2\n Unable to connect to archive.ubuntu.com:http:\nErr:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nIgn:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19\nErr:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\n", 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-data_4.2-3ubuntu6.19_all.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-gui_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': None, 'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'autoclean': False, 'install_recommends': None, 'name': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': None, 'update_cache': None, 'default_release': None, 'only_upgrade': False, 'deb': None, 'cache_valid_time': 0}}, 'cache_update_time': 1643782768, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" --force-yes install \'qemu-system-x86\' \'git-core\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-data_4.2-3ubuntu6.19_all.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-gui_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'stdout_lines': ['Reading package lists...', 'Building dependency tree...', 'Reading state information...', 'git is already the newest version (1:2.25.1-1ubuntu3.2).', 'The following packages were automatically installed and are no longer required:', ' libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic', ' linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic', ' linux-modules-extra-5.4.0-66-generic', "Use 'sudo apt autoremove' to remove them.", 'The following additional packages will be installed:', ' librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data', ' qemu-system-gui qemu-utils', 'Suggested packages:', ' samba vde2 debootstrap', 'The following NEW packages will be installed:', ' librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86', ' qemu-utils', 'The following packages will be upgraded:', ' qemu-system-data qemu-system-gui', '2 upgraded, 6 newly installed, 0 to remove and 92 not upgraded.', 'Need to get 14.3 MB of archives.', 'After this operation, 62.7 MB of additional disk space will be used.', 'Err:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2', ' Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out', 'Err:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2', ' Unable to connect to archive.ubuntu.com:http:', 'Err:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Ign:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19', 'Err:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:'], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-data_4.2-3ubuntu6.19_all.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-gui_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?'], '_ansible_no_log': False, 'changed': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'cache_update_time') 2022-02-02T12:58:41.983 INFO:scrape:1 jobs: ['6654298'] 2022-02-02T12:58:41.984 INFO:scrape:suites: ['1-ceph-install/octopus', '1.1-pg-log-overrides/normal_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-02-02T12:58:41.984 INFO:scrape: 2022-02-02T12:58:41.985 INFO:scrape:Dead: b'2022-02-02T12:43:55.600 DEBUG:teuthology.exit:Finished running handlers' 2022-02-02T12:58:41.985 INFO:scrape:1 jobs: ['6654295'] 2022-02-02T12:58:41.985 INFO:scrape:suites: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters', 'upgrade/secondary}'] 2022-02-02T12:58:41.986 INFO:scrape: 2022-02-02T12:58:41.986 INFO:scrape:Failure: timeout expired in wait_until_healthy 2022-02-02T12:58:41.987 INFO:scrape:1 jobs: ['6654267'] 2022-02-02T12:58:41.987 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8'] 2022-02-02T12:58:41.988 INFO:scrape: 2022-02-02T12:58:41.994 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/ failed: 28 dead: 2 running: 0 waiting: 0 queued: 0 passed: 69 Fail ================================================================= [6654267] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 02:26:11 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654267/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654267/ sentry: https://sentry.ceph.com/organizations/ceph/?query=348582590c7444ef8130b2b6e9968c6f timeout expired in wait_until_healthy [6654269] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654269/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99ae9614bda34610b9ce36deb60e40a6 Command failed on smithi102 with status 1: 'sudo yum install -y kernel' [6654270] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:07:43 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654270/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9dba0cf21d84497ba2d0479bd0c4dd3d rgw multisite test failures [6654271] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.2_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654271/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654271/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61f6595f2df54e58948684ef5dfd2158 Command failed on smithi159 with status 1: 'sudo yum install -y kernel' [6654273] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:50:10 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654273/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654273/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f84b5df9e5a74c84be3e384977b2e8ed Command failed on smithi173 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6654275] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654275/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aba4fe2d8f074cefb5076237298344e7 Command failed on smithi037 with status 1: 'sudo yum install -y kernel' [6654281] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654281/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654281/ sentry: https://sentry.ceph.com/organizations/ceph/?query=619d8aa88b084327a7ecaf260276af1b Command failed on smithi017 with status 1: 'sudo yum install -y kernel' [6654282] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654282/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6fd9060c96264668a19f07a74bd925d7 Command failed on smithi163 with status 1: 'sudo yum install -y kernel' [6654284] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:45:47 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654284/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f60bb744645473a8ba2e57333482fc3 Command failed on smithi143 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6654286] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654286/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654286/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38a27c40ec8b4d89a704c97a48f12823 Command failed on smithi061 with status 1: 'sudo yum install -y kernel' [6654287] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654287/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654287/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7fbab3bce4d4411ab518687978c0b37f Command failed on smithi152 with status 1: 'sudo yum install -y kernel' [6654293] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654293/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654293/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51ff09b2cd1d42d38970576ba42e6678 Command failed on smithi107 with status 1: 'sudo yum install -y kernel' [6654299] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654299/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654299/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c845e2fe3ef04ae3b3f954f633181b4e Command failed on smithi107 with status 1: 'sudo yum install -y kernel' [6654309] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:46:51 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654309/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654309/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0df4074e2fff4335a59d571259ce36b5 Command failed on smithi201 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6654318] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654318/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654318/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41685aafd04e4d25b923bb3d7fbb9847 Command failed on smithi017 with status 1: 'sudo yum install -y kernel' [6654319] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:06:55 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654319/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654319/ sentry: https://sentry.ceph.com/organizations/ceph/?query=94f2de50ded74d0c80bdba3cdd2bba6d rgw multisite test failures [6654323] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:40:20 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654323/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654323/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0f5c94be2e749708590c44a6b4fd875 Command failed on smithi087 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6654324] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654324/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654324/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f66ba23bfc4e4e2989b8758abaf106e3 Command failed on smithi150 with status 1: 'sudo yum install -y kernel' [6654325] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654325/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654325/ sentry: https://sentry.ceph.com/organizations/ceph/?query=87bd52552a0a462299a0841165a63574 Command failed on smithi122 with status 1: 'sudo yum install -y kernel' [6654326] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654326/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654326/ sentry: https://sentry.ceph.com/organizations/ceph/?query=66f19a2a27564122b4f1a211184d2b0c Command failed on smithi109 with status 1: 'sudo yum install -y kernel' [6654330] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654330/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654330/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b4cb53a998a94f2a8c1a61c60a8f34fa Command failed on smithi096 with status 1: 'sudo yum install -y kernel' [6654331] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654331/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0231d86cf3143c5836e5d165e98f31c Command failed on smithi122 with status 1: 'sudo yum install -y kernel' [6654334] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:46:22 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654334/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654334/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3dbbb102aacd4a09b6f8ee5674cbadab Command failed on smithi195 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6654343] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654343/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654343/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71aef746b9c34215811e3d8f2e00a570 Command failed on smithi139 with status 1: 'sudo yum install -y kernel' [6654344] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:07:57 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654344/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654344/ sentry: https://sentry.ceph.com/organizations/ceph/?query=66c4c7df2d5a40348fc91f8efc76eda6 rgw multisite test failures [6654348] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:40:14 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654348/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654348/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9526df2e6d14446499dfdfc428761241 Command failed on smithi160 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6654349] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654349/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654349/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a06d4bdff2364974a8fb4f734ade43f3 Command failed on smithi155 with status 1: 'sudo yum install -y kernel' [6654358] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:48:13 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654358/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654358/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85a6767f200b4975b0bbf5160840d078 Command failed on smithi169 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Dead ================================================================= [6654295] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654295/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654295/ hit max job timeout [6654298] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:05:23 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654298/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654298/ sentry: https://sentry.ceph.com/organizations/ceph/?query=100b50daf3e04cb79560213011655192 Failure object was: {'smithi133.front.sepia.ceph.com': {'cache_updated': False, 'stdout': "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux- headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux- modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu- system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 92 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nErr:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2\n Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out\nErr:2 http://archive.ubuntu.com/ubuntu focal- updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2\n Unable to connect to archive.ubuntu.com:http:\nErr:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system- common amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nIgn:5 http://archive.ubuntu.com/ubuntu focal- updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19\nErr:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:7 http://archive.ubuntu.com/ubuntu focal- updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\nErr:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19\n Unable to connect to archive.ubuntu.com:http:\n", 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2 _15.2.14-0ubuntu0.20.04.2_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out\nE: Failed to fetch http://a rchive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.14-0ubuntu0.20.04.2_ amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block- extra_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- common_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- data_4.2-3ubuntu6.19_all.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- gui_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu- system-x86_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu- utils_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Unable to fetch some archives, maybe run apt- get update or try with --fix-missing?\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': None, 'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid- dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default- jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'autoclean': False, 'install_recommends': None, 'name': ['mpich', 'qemu- system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open- iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': None, 'update_cache': None, 'default_release': None, 'only_upgrade': False, 'deb': None, 'cache_valid_time': 0}}, 'cache_update_time': 1643782768, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" --force-yes install \'qemu- system-x86\' \'git-core\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://ar chive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2_15.2.14-0ubuntu0.20.04.2 _amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/l ibrbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block- extra_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- common_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- data_4.2-3ubuntu6.19_all.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- gui_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu- system-x86_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu- utils_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Unable to fetch some archives, maybe run apt- get update or try with --fix-missing?\n', 'stdout_lines': ['Reading package lists...', 'Building dependency tree...', 'Reading state information...', 'git is already the newest version (1:2.25.1-1ubuntu3.2).', 'The following packages were automatically installed and are no longer required:', ' libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic', ' linux- image-5.4.0-66-generic linux-modules-5.4.0-66-generic', ' linux-modules- extra-5.4.0-66-generic', "Use 'sudo apt autoremove' to remove them.", 'The following additional packages will be installed:', ' librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data', ' qemu-system-gui qemu-utils', 'Suggested packages:', ' samba vde2 debootstrap', 'The following NEW packages will be installed:', ' librados2 librbd1 qemu- block-extra qemu-system-common qemu-system-x86', ' qemu-utils', 'The following packages will be upgraded:', ' qemu-system-data qemu-system- gui', '2 upgraded, 6 newly installed, 0 to remove and 92 not upgraded.', 'Need to get 14.3 MB of archives.', 'After this operation, 62.7 MB of additional disk space will be used.', 'Err:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2', ' Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out', 'Err:2 http://archive.ubuntu.com/ubuntu focal- updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2', ' Unable to connect to archive.ubuntu.com:http:', 'Err:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:4 http://archive.ubuntu.com/ubuntu focal- updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Ign:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19', 'Err:6 http://archive.ubuntu.com/ubuntu focal- updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:8 http://archive.ubuntu.com/ubuntu focal- updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:', 'Err:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19', ' Unable to connect to archive.ubuntu.com:http:'], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Failed to fetch http://archive.ubuntu. com/ubuntu/pool/main/c/ceph/librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph /librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block- extra_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- common_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- data_4.2-3ubuntu6.19_all.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system- gui_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu- system-x86_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu- utils_4.2-3ubuntu6.19_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?'], '_ansible_no_log': False, 'changed': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/py thon3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/ virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/py thon3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teu thology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/s ite-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/vi rtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a6 4a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/pyt hon3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuth worker/src/git.ceph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e16 63e0/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0f634dc1c0a6 4a93646e6d007882c69b3e1663e0/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git _teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/lib/python3 .6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_0f634dc1c0a64a93646e6d007882c69b3e1663e0/virtualenv/ lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'cache_update_time') Pass ================================================================= [6654266] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:18:19 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654266/ [6654268] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:25:03 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654268/ [6654272] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 04:09:50 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654272/ [6654274] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:18 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654274/ [6654276] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:21:50 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654276/ [6654277] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:09:26 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654277/ [6654278] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:58 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654278/ [6654279] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:35 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654279/ [6654280] upgrade/cephfs/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}} time: 00:11:52 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654280/ [6654283] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 01:42:08 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654283/ [6654285] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:57 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654285/ [6654288] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:38 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654288/ [6654289] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:10 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654289/ [6654290] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:24 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654290/ [6654291] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:45:46 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654291/ [6654292] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:57:18 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654292/ [6654294] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:18:20 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654294/ [6654296] upgrade/pacific-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:23:41 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654296/ [6654297] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 02:15:48 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654297/ [6654300] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:45 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654300/ [6654301] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:16:09 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654301/ [6654302] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:10:07 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654302/ [6654303] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:50 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654303/ [6654304] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:00 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654304/ [6654305] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:22:34 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654305/ [6654306] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:20:15 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654306/ [6654307] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:23:13 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654307/ [6654308] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 04:11:23 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654308/ [6654310] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:34 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654310/ [6654311] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:19:37 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654311/ [6654312] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:21:19 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654312/ [6654313] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:58 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654313/ [6654314] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:46 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654314/ [6654315] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:21 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654315/ [6654316] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:06:16 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654316/ [6654317] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:04:49 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654317/ [6654320] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:25:36 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654320/ [6654321] upgrade/pacific-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:23:56 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654321/ [6654322] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 04:07:26 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654322/ [6654327] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:20 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654327/ [6654328] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:41 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654328/ [6654329] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:35 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654329/ [6654332] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 02:12:15 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654332/ [6654333] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:01 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654333/ [6654335] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:19:33 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654335/ [6654336] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:15:44 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654336/ [6654337] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:09:07 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654337/ [6654338] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:30 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654338/ [6654339] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:21 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654339/ [6654340] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:17:57 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654340/ [6654341] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:03:36 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654341/ [6654342] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:54:38 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654342/ [6654345] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:16:19 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654345/ [6654346] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 01:44:49 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654346/ [6654347] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:36 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654347/ [6654350] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:12:47 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654350/ [6654351] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:14:46 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654351/ [6654352] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:43 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654352/ [6654353] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:21:11 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654353/ [6654354] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:55 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654354/ [6654355] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:03:07 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654355/ [6654356] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:00:18 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654356/ [6654357] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 04:41:38 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654357/ [6654359] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:02 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654359/ [6654360] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:56 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654360/ [6654361] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:14:35 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654361/ [6654362] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:23:24 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654362/ [6654363] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:45 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654363/ [6654364] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:14 info: http://pulpito.ceph.com/yuriw-2022-02-02_01:19:27-upgrade-wip-yuriw-master-2.1.22-distro-default-smithi/6654364/