2022-04-30T12:32:03.439 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166
2022-04-30T12:32:03.563 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2022-04-30T12:32:03.563 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2022-04-30T12:32:03.564 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-04-30T12:32:03.582 INFO:teuthology.lock.ops:Node 'smithi073.front.sepia.ceph.com' reimaging is complete
2022-04-30T12:32:03.583 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2022-04-30T12:32:03.583 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2022-04-30T12:32:03.583 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2022-04-30T12:32:03.601 INFO:teuthology.lock.ops:Node 'smithi187.front.sepia.ceph.com' reimaging is complete
2022-04-30T12:32:03.789 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.4
2022-04-30T12:32:03.807 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of rhel 8.4
2022-04-30T12:32:04.137 INFO:teuthology.orchestra.console:Power off smithi073
2022-04-30T12:32:04.219 INFO:teuthology.orchestra.console:Power off smithi187
2022-04-30T12:32:12.500 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-04-30T12:32:12.601 INFO:teuthology.orchestra.console:Power on smithi073
2022-04-30T12:32:16.695 INFO:teuthology.orchestra.console:Power off for smithi187 completed
2022-04-30T12:32:16.797 INFO:teuthology.orchestra.console:Power on smithi187
2022-04-30T12:32:20.962 INFO:teuthology.orchestra.console:Power on for smithi073 completed
2022-04-30T12:32:21.062 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2022-04-30T12:32:25.154 INFO:teuthology.orchestra.console:Power on for smithi187 completed
2022-04-30T12:32:25.255 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2022-04-30T12:36:52.931 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-30T12:36:53.147 INFO:teuthology.provision.fog.smithi073:Node is ready
2022-04-30T12:36:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2022-04-30T12:36:53.259 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2022-04-30T12:36:53.585 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2022-04-30T12:36:56.951 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-30T12:36:57.166 INFO:teuthology.provision.fog.smithi187:Node is ready
2022-04-30T12:36:57.222 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com
2022-04-30T12:36:57.278 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187
2022-04-30T12:36:57.591 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2022-04-30T12:36:57.768 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2022-04-30T12:36:57.851 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-30T12:36:57.871 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2022-04-30T12:36:57.871 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-30T12:36:57.887 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2022-04-30T12:36:57.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-04-30T12:36:58.134 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2022-04-30T12:36:58.189 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux"
2022-04-30T12:36:58.189 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)"
2022-04-30T12:36:58.189 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-30T12:36:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-30T12:36:58.191 INFO:teuthology.orchestra.run.smithi073.stdout:
2022-04-30T12:36:58.191 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-30T12:36:58.191 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-30T12:36:58.191 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-30T12:36:58.191 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-30T12:36:58.192 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-04-30T12:36:58.211 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2022-04-30T12:36:58.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2022-04-30T12:36:58.441 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2022-04-30T12:36:58.495 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux"
2022-04-30T12:36:58.495 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.4 (Ootpa)"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.4"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-30T12:36:58.496 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-30T12:36:58.497 INFO:teuthology.orchestra.run.smithi187.stdout:
2022-04-30T12:36:58.497 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-30T12:36:58.497 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-30T12:36:58.497 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-30T12:36:58.497 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-30T12:36:58.497 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2022-04-30T12:36:58.599 INFO:teuthology.dispatcher.supervisor:Running job 6815974
2022-04-30T12:36:58.599 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815974 --name yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi --description upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815974/orig.config.yaml
2022-04-30T12:36:58.602 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815974
2022-04-30T12:36:58.603 INFO:teuthology.dispatcher.supervisor:Job PID: 15281
2022-04-30T12:36:58.603 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-30T19:07:27.243 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-30T19:07:27.454 INFO:teuthology.kill:Killing Pids: {15281}
2022-04-30T19:07:29.113 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2022-04-30T19:07:29.113 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2022-04-30T19:07:29.114 INFO:teuthology.misc:Compressing logs...
2022-04-30T19:07:29.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-04-30T19:07:29.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2022-04-30T19:07:30.018 INFO:teuthology.misc:Compressing logs...
2022-04-30T19:07:30.575 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-04-30T19:07:30.896 INFO:teuthology.misc:Compressing logs...
2022-04-30T19:12:40.385 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-04-30T19:12:45.154 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-04-30T19:13:37.555 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-04-30T19:13:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-04-30T19:13:59.052 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-04-30T19:16:51.654 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-04-30T19:18:14.766 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-04-30T19:21:38.888 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-04-30T19:24:37.774 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-04-30T19:24:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/d67225ec-c884-11ec-8c39-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-04-30T19:28:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:tar: .: file changed as we read it
2022-04-30T19:31:20.799 INFO:teuthology.kill:No teuthology processes running
2022-04-30T19:31:22.215 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi187']
2022-04-30T19:31:23.520 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-04-30T19:31:23.521 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-04-30T19:31:23.521 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-04-30T19:31:23.521 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-04-30T19:31:23.521 INFO:teuthology.kill:2022-04-30 19:31:23,520.520 INFO:teuthology.nuke:targets:
2022-04-30T19:31:23.521 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCYpqD5wnh2j82yxLGKc+JoRUfDFyMQWmmMW+EIz89E/u8ABYWfNanyBxjf7z9i8CH1+ELZvJu/9qJJSY1ha6HRxgGB0o286Xc5iUg2634I3+6rHxpZz6kRb0tV/cUHM7Cf0uFgEvUTFaMzOd+TgJLGD+eayhiZ40/CUAiOWp6feSkVlUBR6qJBtFJA2zlffREUD0AKRCH1FKz1RtFQFqH9DtYwTxLGa9wRw3gD4SvMN97+2MBnso/yAo5Rept/ibhcUIHdWBzpmuaCpY6BE2Zscn0aV+ZI6b0qeGDcccppY0RWaztB1I8y1KxA0C7q0tTxHLbiTvOZh/KtwRXQRbeLcdN7GsI7lohrtTR7oB8NKAKU/F3/drDreFLiOGfX+pj2pCx+C1+phTNFlLJL8LDuXuJvipwvuyM+gfX0547C43dPgSAv4q+SPo7AnB9dBr8O2jdppkTMaogf7rnglphbxtxKjDJxPd0YXa3a/tG9a17BK1y/gJgeX5NJLZyjJbs=
2022-04-30T19:31:23.521 INFO:teuthology.kill:  smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHaOe+zEmNlwFBrJBNUjO0wbXugm9APpmGamayMupU8I7TLUYsyw5yb4hb5lxX4qGt6cuttmw7yNx1SKTSJFL4RnQpcsCyAp2+S4siYiydWd/IzUSpQoSHOkg6x0/C7TR4/kMfzbDNpG7iTFYHe2PMy90sR4AQdD3Roh8Ip/DwoNMgYceDuCtmynxuCAtJRgNPX+o5Vv7e/B9f9yTpw6nhkJS2HGpM93JnqjNXyRAreLiohszr8uwKOjw7ClYvI0PS1Y1hVbXpCn35R4x79eNXw8Q0W1AMPhxa1cpVe4tSfewjFnVO01ScDdWaKLoQRKtWIsRqfwRluMW0cDqUT3Q8oVIBxrFDmP+vyziFzI6/ENRG0jRQAhluxQireYb8ww/PpwVkb2Qxvj/nfutT5VliqsLGGa3t3gm7ev+tl6YNgtbuwTc2XORTaR5W+caf2gGPOuNfUYTi8hJI9kUO7HsxcEbPW92R7eCewjm/6DLYl059uX6jVzFa1ZVgT5+iQg8=
2022-04-30T19:31:23.548 INFO:teuthology.kill:2022-04-30 19:31:23,547.547 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-30T19:31:23.550 INFO:teuthology.kill:2022-04-30 19:31:23,550.550 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-30T19:31:23.624 INFO:teuthology.kill:2022-04-30 19:31:23,623.623 INFO:teuthology.orchestra.console:Power off smithi073
2022-04-30T19:31:23.636 INFO:teuthology.kill:2022-04-30 19:31:23,636.636 INFO:teuthology.orchestra.console:Power off smithi187
2022-04-30T19:31:31.996 INFO:teuthology.kill:2022-04-30 19:31:31,996.996 INFO:teuthology.orchestra.console:Power off for smithi187 completed
2022-04-30T19:31:32.157 INFO:teuthology.kill:2022-04-30 19:31:32,156.156 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com
2022-04-30T19:31:36.103 INFO:teuthology.kill:2022-04-30 19:31:36,103.103 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-04-30T19:31:36.247 INFO:teuthology.kill:2022-04-30 19:31:36,247.247 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2022-04-30T19:33:36.578 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-30T19:33:36.771 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-30_00:22:23-rados-pacific-16.2.8_RC1-distro-default-smithi/6814611
2022-04-30T19:33:36.837 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi187 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-30_00:22:23-rados-pacific-16.2.8_RC1-distro-default-smithi/6814611