2022-06-24T04:39:11.738 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef
2022-06-24T04:39:11.954 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2022-06-24T04:39:11.955 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2022-06-24T04:39:11.956 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2022-06-24T04:39:11.988 INFO:teuthology.lock.ops:Node 'smithi105.front.sepia.ceph.com' reimaging is complete
2022-06-24T04:39:11.988 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2022-06-24T04:39:11.989 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2022-06-24T04:39:11.989 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2022-06-24T04:39:12.027 INFO:teuthology.lock.ops:Node 'smithi149.front.sepia.ceph.com' reimaging is complete
2022-06-24T04:39:12.207 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream
2022-06-24T04:39:12.278 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream
2022-06-24T04:39:12.614 INFO:teuthology.orchestra.console:Power off smithi105
2022-06-24T04:39:12.684 INFO:teuthology.orchestra.console:Power off smithi149
2022-06-24T04:39:21.064 INFO:teuthology.orchestra.console:Power off for smithi149 completed
2022-06-24T04:39:21.166 INFO:teuthology.orchestra.console:Power on smithi149
2022-06-24T04:39:25.111 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2022-06-24T04:39:25.218 INFO:teuthology.orchestra.console:Power on smithi105
2022-06-24T04:39:29.472 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2022-06-24T04:39:29.574 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2022-06-24T04:39:29.621 INFO:teuthology.orchestra.console:Power on for smithi149 completed
2022-06-24T04:39:29.723 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2022-06-24T04:44:07.967 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-06-24T04:44:08.242 INFO:teuthology.provision.fog.smithi105:Node is ready
2022-06-24T04:44:08.261 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2022-06-24T04:44:08.320 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2022-06-24T04:44:08.714 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2022-06-24T04:44:10.771 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-06-24T04:44:11.061 INFO:teuthology.provision.fog.smithi149:Node is ready
2022-06-24T04:44:11.079 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2022-06-24T04:44:11.137 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2022-06-24T04:44:11.499 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2022-06-24T04:44:11.759 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2022-06-24T04:44:11.760 INFO:teuthology.lock.ops:New key found. Updating...
2022-06-24T04:44:11.782 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2022-06-24T04:44:11.783 INFO:teuthology.lock.ops:New key found. Updating...
2022-06-24T04:44:11.805 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2022-06-24T04:44:11.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2022-06-24T04:44:12.007 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2022-06-24T04:44:12.067 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2022-06-24T04:44:12.067 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8"
2022-06-24T04:44:12.068 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2022-06-24T04:44:12.068 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2022-06-24T04:44:12.069 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8"
2022-06-24T04:44:12.069 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2022-06-24T04:44:12.070 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8"
2022-06-24T04:44:12.070 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2022-06-24T04:44:12.071 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-06-24T04:44:12.071 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2022-06-24T04:44:12.071 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-06-24T04:44:12.072 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-06-24T04:44:12.072 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-06-24T04:44:12.073 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2022-06-24T04:44:12.105 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2022-06-24T04:44:12.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2022-06-24T04:44:12.312 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2022-06-24T04:44:12.370 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2022-06-24T04:44:12.370 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8"
2022-06-24T04:44:12.370 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2022-06-24T04:44:12.371 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2022-06-24T04:44:12.372 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8"
2022-06-24T04:44:12.372 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8"
2022-06-24T04:44:12.372 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8"
2022-06-24T04:44:12.373 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2022-06-24T04:44:12.373 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-06-24T04:44:12.373 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2022-06-24T04:44:12.373 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-06-24T04:44:12.373 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-06-24T04:44:12.374 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-06-24T04:44:12.374 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2022-06-24T04:44:12.493 INFO:teuthology.dispatcher.supervisor:Running job 6895955
2022-06-24T04:44:12.493 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-06-24_01:35:59-orch:cephadm-wip-adk-testing-2022-06-23-1830-distro-default-smithi/6895955 --name adking-2022-06-24_01:35:59-orch:cephadm-wip-adk-testing-2022-06-23-1830-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2022-06-24_01:35:59-orch:cephadm-wip-adk-testing-2022-06-23-1830-distro-default-smithi/6895955/orig.config.yaml
2022-06-24T04:44:12.498 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-06-24_01:35:59-orch:cephadm-wip-adk-testing-2022-06-23-1830-distro-default-smithi/6895955
2022-06-24T04:44:12.498 INFO:teuthology.dispatcher.supervisor:Job PID: 6982
2022-06-24T04:44:12.499 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-06-24T16:45:14.635 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-06-24T16:45:14.822 INFO:teuthology.kill:Killing Pids: {6982}
2022-06-24T16:45:16.403 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-06-24T16:45:16.404 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-06-24T16:45:16.404 INFO:teuthology.misc:Compressing logs...
2022-06-24T16:45:16.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2022-06-24T16:45:16.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2022-06-24T16:45:16.645 INFO:teuthology.orchestra.run.smithi105.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-06-24T16:45:16.930 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-06-24T16:45:16.970 INFO:teuthology.orchestra.run.smithi105.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-06-24T16:45:16.971 INFO:teuthology.orchestra.run.smithi105.stderr:tar: Error is not recoverable: exiting now
2022-06-24T16:45:17.024 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-06-24T16:45:17.024 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now
2022-06-24T16:45:17.031 INFO:teuthology.misc:Compressing logs...
2022-06-24T16:45:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-06-24T16:45:17.476 INFO:teuthology.misc:Compressing logs...
2022-06-24T16:45:23.219 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-mgr.smithi105.jhmeiw.log: file size changed while zipping
2022-06-24T16:45:59.992 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-06-24T16:46:00.238 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-06-24T16:46:26.127 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-06-24T16:46:31.485 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-06-24T16:47:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-06-24T16:47:08.310 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-06-24T16:47:24.791 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-mon.smithi105.log: file size changed while zipping
2022-06-24T16:47:42.437 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-06-24T16:47:50.855 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-mon.smithi149.log: file size changed while zipping
2022-06-24T16:47:57.947 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/d1a17cd8-f378-11ec-842b-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-06-24T16:49:01.476 INFO:teuthology.kill:No teuthology processes running
2022-06-24T16:49:02.888 INFO:teuthology.kill:Nuking machines: ['smithi105', 'smithi149']
2022-06-24T16:49:04.048 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-06-24T16:49:04.049 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-06-24T16:49:04.049 INFO:teuthology.kill:2022-06-24 16:49:04,047.047 INFO:teuthology.nuke:targets:
2022-06-24T16:49:04.049 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbG7S/8KFpYU9k6Gaii9ofRAOzI6e3lLW8Un/rKaFxffm1gdr6npywVQ8n/mxwbMd8FknI5SE0GtzFVJttLNGb0s9rWEUMYSgApko1636kH92rk/Dt9JX2ZIn6qKSHhdC2eAp0GrR9poKzGjAUEngCbYnTfxld/KInHljXyKjwP5KRzadq40gGfDz6lhbyKPUTZiJfaj0xE/LTAjF8nJnMB3Cr6gagfvFEFA83vzZOzlzm22VPOZpp/AuqlV5XRRdvPAYt8p30nmWPoLFYIblyQWt2qauBl6CFanQnOo2cntSnskFfHW6Yr6gawKckseP6lAqjJqT+WfKlIM23ePjFcqFHtiLOLH8YuwdlYZDl7qzJuxlZk44zbBKtHeE+cupffs943BdLoih0RdE39zDkhczRxVRjBUXx2Fg1O5HTExqQe9EgE4jiep25dkaJ8jk5V/tMpOZExNHdOujmDqUqn2G9T/BJBBMrVCss/O4qQIgF60eoC52WmP8WpjEKkU8=
2022-06-24T16:49:04.049 INFO:teuthology.kill:  smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9sADg/gDfnlvh3BksSZe7HaZpzDnApamANnm+OCzmj6o277UgH7k1wx+qEBYffA9sWYos3IV7xmYh95U4C7Ta+bYKnilT4w8cKggESgui1iunv09tvIApI4A2PPLOG62u/o9k80EVmQpfAxoNuOKO+MPvQJnnLAGil8clLJWixKm/LHAcsouzZpXcF5SBP0lumGUKYO4DCGXyl6XJdzmTpVQEWBW7sl69+jFnoqNtE4r362YMDwTMf2aXR0rvAq8VLZ8K6pCFXxmEZbO+z7CwRxNIgAXoYsVYncS9RAhCJevfgzA+YA6rFrSmIKBtciMa5ZP9Q8rVsRJ+ewdi1HpgMGr11ca0lGNRzda+T3UaKpn+ThbR7enAuGz8AdkZJKw/5gziBdG5FiVYszeHPTeXCdLT35o3KzahrZKNIaNP7l6zVWf4mIuoPoEKKEBqZZOLsL2MqYZS37HG6+k6AOm8zsVzMZp0J7aZFzfKsyhbtlyvD/JVpQpp3d1bUvwy4sk=
2022-06-24T16:49:04.050 INFO:teuthology.kill:2022-06-24 16:49:04,048.048 INFO:teuthology.nuke:Checking targets against current locks
2022-06-24T16:49:04.108 INFO:teuthology.kill:2022-06-24 16:49:04,108.108 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-06-24T16:49:04.145 INFO:teuthology.kill:2022-06-24 16:49:04,145.145 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-06-24T16:49:04.205 INFO:teuthology.kill:2022-06-24 16:49:04,204.204 INFO:teuthology.orchestra.console:Power off smithi105
2022-06-24T16:49:04.249 INFO:teuthology.kill:2022-06-24 16:49:04,249.249 INFO:teuthology.orchestra.console:Power off smithi149
2022-06-24T16:49:12.586 INFO:teuthology.kill:2022-06-24 16:49:12,586.586 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2022-06-24T16:49:12.736 INFO:teuthology.kill:2022-06-24 16:49:12,736.736 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2022-06-24T16:49:16.728 INFO:teuthology.kill:2022-06-24 16:49:16,727.727 INFO:teuthology.orchestra.console:Power off for smithi149 completed
2022-06-24T16:49:16.903 INFO:teuthology.kill:2022-06-24 16:49:16,903.903 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com
2022-06-24T16:51:17.309 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-06-24T16:51:17.417 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897520
2022-06-24T16:51:17.417 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi149 but it was locked by another job: /home/teuthworker/archive/adking-2022-06-24_15:22:09-orch:cephadm-wip-adk2-testing-2022-06-23-1421-pacific-distro-default-smithi/6897521