2022-10-01T15:50:39.428 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-01T15:50:39.564 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2022-10-01T15:50:39.565 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2022-10-01T15:50:39.566 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2022-10-01T15:50:39.586 INFO:teuthology.lock.ops:Node 'smithi043.front.sepia.ceph.com' reimaging is complete
2022-10-01T15:50:39.587 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging
2022-10-01T15:50:39.587 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server
2022-10-01T15:50:39.587 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2022-10-01T15:50:39.610 INFO:teuthology.lock.ops:Node 'smithi179.front.sepia.ceph.com' reimaging is complete
2022-10-01T15:50:39.803 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.6
2022-10-01T15:50:39.842 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6
2022-10-01T15:50:40.156 INFO:teuthology.orchestra.console:Power off smithi043
2022-10-01T15:50:40.199 INFO:teuthology.orchestra.console:Power off smithi179
2022-10-01T15:50:48.540 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2022-10-01T15:50:48.572 INFO:teuthology.orchestra.console:Power off for smithi179 completed
2022-10-01T15:50:48.642 INFO:teuthology.orchestra.console:Power on smithi043
2022-10-01T15:50:48.673 INFO:teuthology.orchestra.console:Power on smithi179
2022-10-01T15:50:57.014 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2022-10-01T15:50:57.044 INFO:teuthology.orchestra.console:Power on for smithi179 completed
2022-10-01T15:50:57.116 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2022-10-01T15:50:57.146 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2022-10-01T15:53:13.414 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed.
2022-10-01T15:54:39.059 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-01T15:54:59.343 INFO:teuthology.provision.fog.smithi043:Node is ready
2022-10-01T15:54:59.363 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2022-10-01T15:54:59.421 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2022-10-01T15:54:59.783 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2022-10-01T15:55:00.768 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-01T15:55:26.347 INFO:teuthology.provision.fog.smithi179:Node is ready
2022-10-01T15:55:26.367 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2022-10-01T15:55:26.424 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2022-10-01T15:55:26.802 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2022-10-01T15:55:27.001 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2022-10-01T15:55:27.002 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-01T15:55:27.030 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2022-10-01T15:55:27.031 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-01T15:55:27.064 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2022-10-01T15:55:27.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2022-10-01T15:55:27.359 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2022-10-01T15:55:27.417 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2022-10-01T15:55:27.418 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)"
2022-10-01T15:55:27.418 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2022-10-01T15:55:27.418 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2022-10-01T15:55:27.419 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6"
2022-10-01T15:55:27.419 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2022-10-01T15:55:27.419 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-10-01T15:55:27.420 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2022-10-01T15:55:27.420 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-10-01T15:55:27.420 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2022-10-01T15:55:27.420 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-10-01T15:55:27.421 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-01T15:55:27.421 INFO:teuthology.orchestra.run.smithi043.stdout:
2022-10-01T15:55:27.421 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-01T15:55:27.421 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-10-01T15:55:27.422 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-10-01T15:55:27.422 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-10-01T15:55:27.424 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2022-10-01T15:55:27.449 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2022-10-01T15:55:27.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2022-10-01T15:55:27.700 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2022-10-01T15:55:27.757 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux"
2022-10-01T15:55:27.757 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)"
2022-10-01T15:55:27.758 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel"
2022-10-01T15:55:27.758 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora"
2022-10-01T15:55:27.759 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6"
2022-10-01T15:55:27.759 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2022-10-01T15:55:27.760 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-10-01T15:55:27.760 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2022-10-01T15:55:27.761 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-10-01T15:55:27.761 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/"
2022-10-01T15:55:27.761 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-10-01T15:55:27.762 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-10-01T15:55:27.762 INFO:teuthology.orchestra.run.smithi179.stdout:
2022-10-01T15:55:27.763 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-10-01T15:55:27.763 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-10-01T15:55:27.764 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-10-01T15:55:27.764 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-10-01T15:55:27.765 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2022-10-01T15:55:27.892 INFO:teuthology.dispatcher.supervisor:Running job 7050392
2022-10-01T15:55:27.892 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-09-30_20:17:13-rados-wip-yuri2-testing-2022-09-30-1047-distro-default-smithi/7050392 --name yuriw-2022-09-30_20:17:13-rados-wip-yuri2-testing-2022-09-30-1047-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2022-09-30_20:17:13-rados-wip-yuri2-testing-2022-09-30-1047-distro-default-smithi/7050392/orig.config.yaml
2022-10-01T15:55:27.897 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-09-30_20:17:13-rados-wip-yuri2-testing-2022-09-30-1047-distro-default-smithi/7050392
2022-10-01T15:55:27.898 INFO:teuthology.dispatcher.supervisor:Job PID: 28703
2022-10-01T15:55:27.898 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-10-02T03:55:51.055 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-10-02T03:55:51.269 INFO:teuthology.kill:Killing Pids: {28703}
2022-10-02T03:55:52.831 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2022-10-02T03:55:52.832 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2022-10-02T03:55:52.832 INFO:teuthology.misc:Compressing logs...
2022-10-02T03:55:52.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2022-10-02T03:55:53.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2022-10-02T03:55:53.425 INFO:teuthology.misc:Compressing logs...
2022-10-02T03:55:53.798 INFO:teuthology.misc:Compressing logs...
2022-10-02T03:55:54.057 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/425d58c0-41a3-11ed-8432-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-10-02T03:55:54.576 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/425d58c0-41a3-11ed-8432-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-10-02T03:56:22.492 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/425d58c0-41a3-11ed-8432-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-10-02T03:56:50.326 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/425d58c0-41a3-11ed-8432-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-10-02T03:57:17.965 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/425d58c0-41a3-11ed-8432-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-10-02T03:57:49.909 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/425d58c0-41a3-11ed-8432-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-10-02T03:57:57.567 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/425d58c0-41a3-11ed-8432-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-10-02T03:58:58.226 INFO:teuthology.kill:No teuthology processes running
2022-10-02T03:58:59.841 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi179']
2022-10-02T03:59:01.051 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-10-02T03:59:01.052 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-10-02T03:59:01.053 INFO:teuthology.kill:2022-10-02 03:59:01,051.051 INFO:teuthology.nuke:targets:
2022-10-02T03:59:01.053 INFO:teuthology.kill:  smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKwPPq/jzQh51iPqJFMDeTfwhMKMDrUxOB4z4CaKVfP6wKXF2U5fivL8zHSBlbQ12uA5GReLxDfSCg461ZkuDqj7RniBzSA460aqoOhoLqnZjh8potMEWUVfc3Ja3FcEi5p3bL3Jd86JL4T/m2dLMK1fPlX+w9fAYQlw4UUdm/6pJsIZru4+2Sqjab3v1ufES8lEf/BGWX8pG1kGMeDMUQcbameLuowkdnOOmTlmNpcHjiHEG63bBrDJAdD5asZkArhlU+jiE2y0JbGoKUsLN6170t85Y7PI08dVQQMccmKj0uPMEfntyJOOgffamiYfE7YE9sx1XPxXc1gmuFebMvNobS6Nd7mcmeyXwu7KLPuEOVT04ZvfA34nMdVZDBQ+Af8zkFRkZDgdsnNRjPk8qwbQ7I/pdJm9bf+5leMKjDKGy//wHCEIOT4VeQxst2El/4BWGCDycnXPUR0P9C4Jefx9+HCCxwTpNKNPrQBYlsYxSitUC2sjV8vVDRwOg0NzU=
2022-10-02T03:59:01.053 INFO:teuthology.kill:  smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqRt3jpR37jU2nyPEDujMdZlwBx0Xstg/VfSd5CMyePdvAnNEvXWo7B3a+GuuQjFET4uAcv18GZS/lq/LlL1es=
2022-10-02T03:59:01.054 INFO:teuthology.kill:2022-10-02 03:59:01,051.051 INFO:teuthology.nuke:Checking targets against current locks
2022-10-02T03:59:01.115 INFO:teuthology.kill:2022-10-02 03:59:01,114.114 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-02T03:59:01.149 INFO:teuthology.kill:2022-10-02 03:59:01,148.148 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-02T03:59:01.209 INFO:teuthology.kill:2022-10-02 03:59:01,209.209 INFO:teuthology.orchestra.console:Power off smithi043
2022-10-02T03:59:01.246 INFO:teuthology.kill:2022-10-02 03:59:01,246.246 INFO:teuthology.orchestra.console:Power off smithi179
2022-10-02T03:59:09.610 INFO:teuthology.kill:2022-10-02 03:59:09,609.609 INFO:teuthology.orchestra.console:Power off for smithi179 completed
2022-10-02T03:59:09.765 INFO:teuthology.kill:2022-10-02 03:59:09,764.764 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com
2022-10-02T03:59:13.690 INFO:teuthology.kill:2022-10-02 03:59:13,690.690 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2022-10-02T03:59:13.840 INFO:teuthology.kill:2022-10-02 03:59:13,839.839 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2022-10-02T04:01:14.103 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-10-02T04:01:14.230 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi043 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-01_14:23:03-upgrade:nautilus-x-pacific-distro-default-smithi/7050989
2022-10-02T04:01:14.231 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi179 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-01_14:23:03-upgrade:nautilus-x-pacific-distro-default-smithi/7050989