2021-11-19T20:34:46.057 INFO:root:teuthology version: 1.1.0-6cfddd5e
2021-11-19T20:34:46.178 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging
2021-11-19T20:34:46.180 INFO:teuthology.lock.ops:Updating [ubuntu@smithi081.front.sepia.ceph.com]: reset os type and version on server
2021-11-19T20:34:46.180 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2021-11-19T20:34:46.201 INFO:teuthology.lock.ops:Node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging is complete
2021-11-19T20:34:46.201 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging
2021-11-19T20:34:46.202 INFO:teuthology.lock.ops:Updating [ubuntu@smithi098.front.sepia.ceph.com]: reset os type and version on server
2021-11-19T20:34:46.202 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2021-11-19T20:34:46.220 INFO:teuthology.lock.ops:Node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging is complete
2021-11-19T20:34:46.429 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream
2021-11-19T20:34:46.432 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream
2021-11-19T20:34:46.825 INFO:teuthology.orchestra.console:Power off smithi098
2021-11-19T20:34:46.840 INFO:teuthology.orchestra.console:Power off smithi081
2021-11-19T20:34:55.194 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2021-11-19T20:34:55.204 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2021-11-19T20:34:55.296 INFO:teuthology.orchestra.console:Power on smithi098
2021-11-19T20:34:55.305 INFO:teuthology.orchestra.console:Power on smithi081
2021-11-19T20:35:03.674 INFO:teuthology.orchestra.console:Power on for smithi098 completed
2021-11-19T20:35:03.775 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2021-11-19T20:35:03.806 INFO:teuthology.orchestra.console:Power on for smithi081 completed
2021-11-19T20:35:03.907 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2021-11-19T20:39:53.767 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-19T20:39:53.861 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-19T20:39:54.047 INFO:teuthology.provision.fog.smithi098:Node is ready
2021-11-19T20:39:54.063 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2021-11-19T20:39:54.119 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2021-11-19T20:39:54.151 INFO:teuthology.provision.fog.smithi081:Node is ready
2021-11-19T20:39:54.168 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2021-11-19T20:39:54.226 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2021-11-19T20:39:54.450 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2021-11-19T20:39:54.573 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2021-11-19T20:39:54.718 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2021-11-19T20:39:54.719 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-19T20:39:54.738 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2021-11-19T20:39:54.739 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-19T20:39:54.757 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2021-11-19T20:39:54.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2021-11-19T20:39:54.985 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2021-11-19T20:39:55.040 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2021-11-19T20:39:55.040 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8"
2021-11-19T20:39:55.040 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2021-11-19T20:39:55.041 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2021-11-19T20:39:55.041 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8"
2021-11-19T20:39:55.041 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2021-11-19T20:39:55.041 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-19T20:39:55.041 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2021-11-19T20:39:55.042 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-19T20:39:55.042 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2021-11-19T20:39:55.042 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-19T20:39:55.042 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-19T20:39:55.043 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-19T20:39:55.044 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2021-11-19T20:39:55.061 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2021-11-19T20:39:55.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2021-11-19T20:39:55.287 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2021-11-19T20:39:55.342 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2021-11-19T20:39:55.342 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2021-11-19T20:39:55.343 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2021-11-19T20:39:55.343 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2021-11-19T20:39:55.343 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2021-11-19T20:39:55.343 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2021-11-19T20:39:55.343 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-19T20:39:55.344 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2021-11-19T20:39:55.344 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-19T20:39:55.344 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2021-11-19T20:39:55.344 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-19T20:39:55.344 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-19T20:39:55.345 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-19T20:39:55.345 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2021-11-19T20:39:55.441 INFO:teuthology.dispatcher.supervisor:Running job 6514326
2021-11-19T20:39:55.442 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi/6514326 --name ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi/6514326/orig.config.yaml
2021-11-19T20:39:55.446 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2021-11-19_19:14:07-rados-wip-autoscale-profile-scale-up-default-distro-basic-smithi/6514326
2021-11-19T20:39:55.446 INFO:teuthology.dispatcher.supervisor:Job PID: 7401
2021-11-19T20:39:55.447 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-20T08:40:50.215 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-20T08:40:50.486 INFO:teuthology.kill:Killing Pids: {7401}
2021-11-20T08:40:51.781 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-11-20T08:40:51.782 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-11-20T08:40:51.782 INFO:teuthology.misc:Compressing logs...
2021-11-20T08:40:51.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2021-11-20T08:40:52.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2021-11-20T08:40:52.147 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-11-20T08:40:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-11-20T08:40:52.586 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-11-20T08:40:52.587 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now
2021-11-20T08:40:52.632 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-11-20T08:40:52.632 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now
2021-11-20T08:40:52.633 INFO:teuthology.misc:Compressing logs...
2021-11-20T08:40:52.998 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-20T08:40:53.230 INFO:teuthology.misc:Compressing logs...
2021-11-20T08:41:25.124 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-11-20T08:41:26.238 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-20T08:41:58.611 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-20T08:42:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-20T08:42:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-mon.smithi098.log: file size changed while zipping
2021-11-20T08:42:06.060 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-mgr.smithi098.tozzwo.log: file size changed while zipping
2021-11-20T08:42:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-20T08:42:42.935 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-20T08:43:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-20T08:43:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-mon.smithi081.log: file size changed while zipping
2021-11-20T08:43:20.444 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/4461c1d2-497a-11ec-8c2c-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-11-20T08:45:49.488 INFO:teuthology.kill:No teuthology processes running
2021-11-20T08:45:50.827 INFO:teuthology.kill:Nuking machines: ['smithi081', 'smithi098']
2021-11-20T08:45:51.860 INFO:teuthology.kill:2021-11-20 08:45:51,859.859 INFO:teuthology.nuke:targets:
2021-11-20T08:45:51.861 INFO:teuthology.kill:  smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMPKX6iZ/ag53dvobz1JNK3QsUvmV/jiFrL4HUeDRUaFteOjhheNIsXm2fR+vXQ9692kgs6g8h27GhebUZaWAHnaZHLhTLAsfV+cbO7/yTQz1aLCxMWQtqXasSw5eGiFbFXaDmdXrN4HQGDaH47pVczNVX2OYc4DcyqBnnPIytB8OTVG3EUnwh2x3j5djwSgRM4UecGIfE3saNv4KnJ20XRvzS8PZZRmcCOCHe/Q6ttUfVvv2MHJJRFC5p0C/dNSFG5wyWjN/XtdhWyCcT9U+pn2dSeXbO1vRBzgr7Qx38b/qZp7OenwmO6GdeJoOhm2AroEktuor9r+Gv2MoiNK3/G8t1ZvEhspJhmM+BilkRuQa83fs4Ql0JUlqpydLlHajdgOExsd1TOdJfKtmLxxlYmw0Jlb8WF/jSZ+2LGmxXHOjsplqEnzlPE767N0x1ZUqNdED9AshzFpOFn5/S/TUEniQjcujbQIsqXtAolsr6Rgjzq0pPAJuh8iLA5avGFIc=
2021-11-20T08:45:51.861 INFO:teuthology.kill:  smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1noaegQLAOQEzHamhQAiwFW4BQeXIBzH61DV6wwdgiwjtHSnh1mALHukYZs+3DxdrIWCavWGWhc86kvHjqOosR+jqDQ+HEURYh6pG9owsKgk2YGITcTtIRVQTkJWFEM4DBaQrRZpdqnwETUpiWsBUGWkhsyOL5RPDwzlOT4FDRFwXBfuGu2FgZgoii3heQnt9hoMMnUJp0j1NvNPz6MAl+NOv4EHNHQ7ioEnPb2DWEUJizrnNTy2Q+wkQL60+TbY+DNeu7+iLunbLdpfh19AFFOGyUl2uvR4kIdcE40ZgY689Si2Z38JJZswqAraMCVnzqJ61IFBi7h/XY/p6RBdUBXaPaS+Y0t+F3H94I19NhJLg/27fPdL1xWvNvHVwCSwOWmrqzk/gs9FZvhbI4LI3BVU8nYrJySe3Oy/kAWmF3ZqKOOEOvW/hks/6TlG1mqZ2Dfaf/l0bR13eOGafCQ6TDsUBPqMQvjMvyMguSc94p8r3CWl3DHFLU2WA1i5m+L0=
2021-11-20T08:45:51.889 INFO:teuthology.kill:2021-11-20 08:45:51,889.889 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-20T08:45:51.893 INFO:teuthology.kill:2021-11-20 08:45:51,892.892 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-20T08:45:51.979 INFO:teuthology.kill:2021-11-20 08:45:51,979.979 INFO:teuthology.orchestra.console:Power off smithi098
2021-11-20T08:45:51.995 INFO:teuthology.kill:2021-11-20 08:45:51,995.995 INFO:teuthology.orchestra.console:Power off smithi081
2021-11-20T08:46:00.373 INFO:teuthology.kill:2021-11-20 08:46:00,372.372 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2021-11-20T08:46:00.523 INFO:teuthology.kill:2021-11-20 08:46:00,521.521 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2021-11-20T08:46:04.465 INFO:teuthology.kill:2021-11-20 08:46:04,464.464 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2021-11-20T08:46:04.614 INFO:teuthology.kill:2021-11-20 08:46:04,613.613 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2021-11-20T08:48:04.975 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-20T08:48:05.103 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-20_04:32:48-rados-wip-yuri2-testing-2021-11-19-1714-pacific-distro-basic-smithi/6515276
2021-11-20T08:48:05.104 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi098 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-20_04:32:48-rados-wip-yuri2-testing-2021-11-19-1714-pacific-distro-basic-smithi/6515276