2022-01-10T17:22:50.000 INFO:root:teuthology version: 1.1.0-00e09f05
2022-01-10T17:22:50.119 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging
2022-01-10T17:22:50.121 INFO:teuthology.lock.ops:Updating [ubuntu@smithi090.front.sepia.ceph.com]: reset os type and version on server
2022-01-10T17:22:50.121 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-01-10T17:22:50.138 INFO:teuthology.lock.ops:Node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging is complete
2022-01-10T17:22:50.138 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging
2022-01-10T17:22:50.139 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server
2022-01-10T17:22:50.139 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-01-10T17:22:50.159 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete
2022-01-10T17:22:50.366 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream
2022-01-10T17:22:50.388 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream
2022-01-10T17:22:50.714 INFO:teuthology.orchestra.console:Power off smithi090
2022-01-10T17:22:50.759 INFO:teuthology.orchestra.console:Power off smithi142
2022-01-10T17:22:59.127 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-01-10T17:22:59.229 INFO:teuthology.orchestra.console:Power on smithi142
2022-01-10T17:23:03.203 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-01-10T17:23:03.305 INFO:teuthology.orchestra.console:Power on smithi090
2022-01-10T17:23:07.563 INFO:teuthology.orchestra.console:Power on for smithi090 completed
2022-01-10T17:23:07.595 INFO:teuthology.orchestra.console:Power on for smithi142 completed
2022-01-10T17:23:07.666 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2022-01-10T17:23:07.696 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2022-01-10T17:27:57.422 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-10T17:27:57.719 INFO:teuthology.provision.fog.smithi142:Node is ready
2022-01-10T17:27:57.735 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2022-01-10T17:27:57.792 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2022-01-10T17:27:58.110 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2022-01-10T17:28:24.533 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-10T17:28:24.882 INFO:teuthology.provision.fog.smithi090:Node is ready
2022-01-10T17:28:24.900 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2022-01-10T17:28:24.958 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2022-01-10T17:28:25.317 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2022-01-10T17:28:25.465 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2022-01-10T17:28:25.466 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-10T17:28:25.486 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2022-01-10T17:28:25.487 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-10T17:28:25.505 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2022-01-10T17:28:25.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-01-10T17:28:25.697 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2022-01-10T17:28:25.753 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2022-01-10T17:28:25.754 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8"
2022-01-10T17:28:25.754 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2022-01-10T17:28:25.755 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2022-01-10T17:28:25.755 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8"
2022-01-10T17:28:25.755 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8"
2022-01-10T17:28:25.755 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-10T17:28:25.756 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2022-01-10T17:28:25.756 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-10T17:28:25.756 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2022-01-10T17:28:25.756 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-10T17:28:25.757 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-10T17:28:25.757 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-10T17:28:25.758 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-01-10T17:28:25.790 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2022-01-10T17:28:25.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-01-10T17:28:26.039 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2022-01-10T17:28:26.096 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2022-01-10T17:28:26.097 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8"
2022-01-10T17:28:26.097 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2022-01-10T17:28:26.097 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2022-01-10T17:28:26.097 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8"
2022-01-10T17:28:26.098 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2022-01-10T17:28:26.098 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-10T17:28:26.098 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2022-01-10T17:28:26.098 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-10T17:28:26.098 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2022-01-10T17:28:26.099 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-10T17:28:26.099 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-10T17:28:26.099 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-10T17:28:26.100 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2022-01-10T17:28:26.199 INFO:teuthology.dispatcher.supervisor:Running job 6606129
2022-01-10T17:28:26.200 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_00e09f05e9fb2ab7c7f497f5e446613531743ae2/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-10_16:32:10-rados:cephadm-wip-guits-testing-2022-01-07-0853-bis-pacific-distro-default-smithi/6606129 --name gabrioux-2022-01-10_16:32:10-rados:cephadm-wip-guits-testing-2022-01-07-0853-bis-pacific-distro-default-smithi --description rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2022-01-10_16:32:10-rados:cephadm-wip-guits-testing-2022-01-07-0853-bis-pacific-distro-default-smithi/6606129/orig.config.yaml
2022-01-10T17:28:26.203 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-10_16:32:10-rados:cephadm-wip-guits-testing-2022-01-07-0853-bis-pacific-distro-default-smithi/6606129
2022-01-10T17:28:26.204 INFO:teuthology.dispatcher.supervisor:Job PID: 3497
2022-01-10T17:28:26.204 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-11T05:29:20.323 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-11T05:29:20.495 INFO:teuthology.kill:Killing Pids: {3497}
2022-01-11T05:29:21.673 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-11T05:29:21.674 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-11T05:29:21.675 INFO:teuthology.misc:Compressing logs...
2022-01-11T05:29:21.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-01-11T05:29:21.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2022-01-11T05:29:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-11T05:29:22.104 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-11T05:29:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-11T05:29:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:tar: Error is not recoverable: exiting now
2022-01-11T05:29:22.314 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-11T05:29:22.314 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now
2022-01-11T05:29:22.315 INFO:teuthology.misc:Compressing logs...
2022-01-11T05:29:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-11T05:29:22.912 INFO:teuthology.misc:Compressing logs...
2022-01-11T05:29:23.889 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-mon.smithi142.log: file size changed while zipping
2022-01-11T05:29:24.497 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-mgr.smithi090.mizcua.log: file size changed while zipping
2022-01-11T05:29:26.862 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-11T05:29:28.371 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-11T05:29:29.460 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-11T05:29:31.261 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-11T05:29:32.413 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-11T05:29:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-11T05:29:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-11T05:29:37.394 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-mon.smithi090.log: file size changed while zipping
2022-01-11T05:29:41.183 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/e1dfe0da-723b-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-11T05:30:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:tar: .: file changed as we read it
2022-01-11T05:30:32.570 INFO:teuthology.kill:No teuthology processes running
2022-01-11T05:30:33.809 INFO:teuthology.kill:Nuking machines: ['smithi090', 'smithi142']
2022-01-11T05:30:34.828 INFO:teuthology.kill:2022-01-11 05:30:34,828.828 INFO:teuthology.nuke:targets:
2022-01-11T05:30:34.829 INFO:teuthology.kill:  smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8b8xfMdmc73IBtiQagNlp58hnwg/hG88R4K6i5Zhc/MGElyMV1wlUnL+rNl4uc9sZ+4vr4PbFkqiDDuhicB8JTcJde7hje7+OaFQ0J3FYEl9yRY1bVEQwbiA5Rmz8f66GKgf6IFoJ/YmJv2jutSFcp4gLlyuV2946Ac3mW6FJaVUspYjV5UhhlpScE0DON2byWmcHPiaHs0Wo8edAMNtJTlCzo39yQkmOUCc2T3dUbENT5JznJgyB7WmKFh7H1CSi3snSMxCxiC4Elg2z4JJuqHlGPFhiK23FDrfEkAn124ZjZ/a3wrcXX9I9p2mrDRjCOZ9cn8c9XuyquwYuhoNq2hM52L5frhHlH74mixp1MJJeJPXdEIO1oJig5EIFAIQ0VIH1T3AOTP25T1L3gAzg+oq2em6PDntjsVeg0IO5EDfTsLLSflcBpABsDkp+45I2QMJxaUnk6UvrEsUUZhp5l0GayaAxNRAxCBR8vvrzS3uIcItMZFTkUDSARddwoec=
2022-01-11T05:30:34.829 INFO:teuthology.kill:  smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqo3gKvg6ra0HMMy0kx4kdupqx96RIvMpqGSk7xHdOPqeL2lfBEkFZ9K4rlu6UzOGqhlzmHlbudkehdL49J0BBUsEU06EwDigSvRz/WeYtYGOgjB+bQPQC8GNGjuB+Sc0Ag9VigMECvawWUTGbHG5S92ykHLOlSt3imf2+vDabfuJYeXyUxo6Q2PL0ryKZJ28+pe7DKfLodPizgzmIigSr1jYOV5d8omCBKrFbYsO7cE05ZYKPHC4l3Zlxh4OaAWJXaock1X645Vu5wIhLxWLO2ofF0l6qhEU1CW8vwLA3T2aaqFuPVx+pvWupUavT9ThkDcYC8K0/8cd4vKVaZziUkYT79jmt6rpnwsHQQWPFoArG6DF1VTO9r2nsdFn8joH5I9Ym0V1U7oFZ2gbd6CPOQF9MLmsDwgCAJHONe61/pwbXaYlDjLf6MZdu5sqwbgSDn7a90G7BPMWCoEgQGBe5KId0z26agK+9+ll7brtwILEAxI71QElz9sbQ00g0dsk=
2022-01-11T05:30:34.856 INFO:teuthology.kill:2022-01-11 05:30:34,856.856 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-11T05:30:34.871 INFO:teuthology.kill:2022-01-11 05:30:34,871.871 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-11T05:30:34.933 INFO:teuthology.kill:2022-01-11 05:30:34,933.933 INFO:teuthology.orchestra.console:Power off smithi090
2022-01-11T05:30:34.968 INFO:teuthology.kill:2022-01-11 05:30:34,968.968 INFO:teuthology.orchestra.console:Power off smithi142
2022-01-11T05:30:43.302 INFO:teuthology.kill:2022-01-11 05:30:43,301.301 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-01-11T05:30:43.457 INFO:teuthology.kill:2022-01-11 05:30:43,456.456 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com
2022-01-11T05:30:47.440 INFO:teuthology.kill:2022-01-11 05:30:47,439.439 INFO:teuthology.orchestra.console:Power off for smithi142 completed
2022-01-11T05:30:47.586 INFO:teuthology.kill:2022-01-11 05:30:47,586.586 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2022-01-11T05:32:47.889 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-11T05:32:47.987 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi090 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_04:17:02-fs-pacific-distro-default-smithi/6607070
2022-01-11T05:32:47.987 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-11_04:17:02-fs-pacific-distro-default-smithi/6607070