2021-12-01T15:46:21.290 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-01T15:46:21.410 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi172.front.sepia.ceph.com' reimaging
2021-12-01T15:46:21.411 INFO:teuthology.lock.ops:Updating [ubuntu@smithi172.front.sepia.ceph.com]: reset os type and version on server
2021-12-01T15:46:21.411 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2021-12-01T15:46:21.430 INFO:teuthology.lock.ops:Node 'ubuntu@smithi172.front.sepia.ceph.com' reimaging is complete
2021-12-01T15:46:21.431 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging
2021-12-01T15:46:21.432 INFO:teuthology.lock.ops:Updating [ubuntu@smithi181.front.sepia.ceph.com]: reset os type and version on server
2021-12-01T15:46:21.432 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2021-12-01T15:46:21.453 INFO:teuthology.lock.ops:Node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging is complete
2021-12-01T15:46:21.646 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 8.stream
2021-12-01T15:46:21.662 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream
2021-12-01T15:46:22.056 INFO:teuthology.orchestra.console:Power off smithi172
2021-12-01T15:46:22.073 INFO:teuthology.orchestra.console:Power off smithi181
2021-12-01T15:46:22.216 INFO:teuthology.orchestra.console:Power off for smithi181 completed
2021-12-01T15:46:22.326 INFO:teuthology.orchestra.console:Power on smithi181
2021-12-01T15:46:30.433 INFO:teuthology.orchestra.console:Power off for smithi172 completed
2021-12-01T15:46:30.535 INFO:teuthology.orchestra.console:Power on smithi172
2021-12-01T15:46:30.695 INFO:teuthology.orchestra.console:Power on for smithi181 completed
2021-12-01T15:46:30.796 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2021-12-01T15:46:38.904 INFO:teuthology.orchestra.console:Power on for smithi172 completed
2021-12-01T15:46:39.006 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish
2021-12-01T15:51:21.505 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-01T15:51:21.811 INFO:teuthology.provision.fog.smithi181:Node is ready
2021-12-01T15:51:21.828 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2021-12-01T15:51:21.885 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2021-12-01T15:51:22.228 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2021-12-01T15:51:44.177 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-01T15:51:44.450 INFO:teuthology.provision.fog.smithi172:Node is ready
2021-12-01T15:51:44.466 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com
2021-12-01T15:51:44.522 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172
2021-12-01T15:51:44.859 INFO:teuthology.provision.fog.smithi172:Deploy complete!
2021-12-01T15:51:45.011 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com
2021-12-01T15:51:45.012 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-01T15:51:45.038 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2021-12-01T15:51:45.039 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-01T15:51:45.059 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server
2021-12-01T15:51:45.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2021-12-01T15:51:45.254 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64
2021-12-01T15:51:45.308 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream"
2021-12-01T15:51:45.309 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8"
2021-12-01T15:51:45.309 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos"
2021-12-01T15:51:45.309 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora"
2021-12-01T15:51:45.310 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8"
2021-12-01T15:51:45.310 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2021-12-01T15:51:45.310 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-01T15:51:45.310 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2021-12-01T15:51:45.311 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-01T15:51:45.311 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/"
2021-12-01T15:51:45.311 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-01T15:51:45.311 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-01T15:51:45.311 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-01T15:51:45.313 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2021-12-01T15:51:45.335 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2021-12-01T15:51:45.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2021-12-01T15:51:45.611 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2021-12-01T15:51:45.667 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream"
2021-12-01T15:51:45.667 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8"
2021-12-01T15:51:45.667 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos"
2021-12-01T15:51:45.668 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora"
2021-12-01T15:51:45.668 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8"
2021-12-01T15:51:45.669 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8"
2021-12-01T15:51:45.669 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-01T15:51:45.669 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2021-12-01T15:51:45.669 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-01T15:51:45.670 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/"
2021-12-01T15:51:45.671 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-01T15:51:45.671 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-01T15:51:45.671 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-01T15:51:45.672 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2021-12-01T15:51:45.795 INFO:teuthology.dispatcher.supervisor:Running job 6538321
2021-12-01T15:51:45.795 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_ifed01@teuthology --archive /home/teuthworker/archive/ifed01-2021-12-01_14:08:22-rados-wip-ifed-daemonhistogram-distro-default-smithi/6538321 --name ifed01-2021-12-01_14:08:22-rados-wip-ifed-daemonhistogram-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/ifed01-2021-12-01_14:08:22-rados-wip-ifed-daemonhistogram-distro-default-smithi/6538321/orig.config.yaml
2021-12-01T15:51:45.802 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ifed01-2021-12-01_14:08:22-rados-wip-ifed-daemonhistogram-distro-default-smithi/6538321
2021-12-01T15:51:45.803 INFO:teuthology.dispatcher.supervisor:Job PID: 27186
2021-12-01T15:51:45.804 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-02T03:52:39.658 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-02T03:52:40.709 INFO:teuthology.kill:Killing Pids: {27186}
2021-12-02T03:52:41.988 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-02T03:52:41.989 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-02T03:52:41.993 INFO:teuthology.misc:Compressing logs...
2021-12-02T03:52:42.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2021-12-02T03:52:42.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2021-12-02T03:52:42.756 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-02T03:52:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-02T03:52:42.991 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-02T03:52:42.991 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now
2021-12-02T03:52:43.044 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-02T03:52:43.044 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now
2021-12-02T03:52:43.046 INFO:teuthology.misc:Compressing logs...
2021-12-02T03:52:43.690 INFO:teuthology.misc:Compressing logs...
2021-12-02T03:52:44.047 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-02T03:52:44.534 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-02T03:52:44.723 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-02T03:52:45.029 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-02T03:52:45.389 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-02T03:52:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-02T03:52:46.541 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-02T03:52:47.612 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-mon.smithi172.log: file size changed while zipping
2021-12-02T03:52:48.698 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/02bd7b82-52c0-11ec-8c2d-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-02T03:53:38.169 INFO:teuthology.kill:No teuthology processes running
2021-12-02T03:53:39.375 INFO:teuthology.kill:Nuking machines: ['smithi172', 'smithi181']
2021-12-02T03:53:40.286 INFO:teuthology.kill:2021-12-02 03:53:40,286.286 INFO:teuthology.nuke:targets:
2021-12-02T03:53:40.287 INFO:teuthology.kill:  smithi172.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDHLCp6G4+Jf2GrujY9I6EvOKMVLyfnDuBIC0aE0fHGCRWD22dObz3N1c+8KfdDVoXv1OV08vkODotna4/jfMCUkxQiX0Pob3ggLSK+F65/i0ctrDxRjlmLYC8NMV0vNLNt9D9iE/uaKfll4fOkFT7oFk6o7igQ1U+b4AR2MPkfEhIU0/fYw3zm4Uh0xCe/GduQ+GzSns3NehMth3pcNIDk1mUsz+H0iRfkf8YzViw/XhBjKcxPgeVIe/SyepwVP9xRIaUufhw+2CyurWN+nn2ytpUzb5YmCSX/k+qbKoCwzoQBJhr2cwzAIi0DdokEnuuzr7s/nYYPkBzcoIUdXTaHMOi3V+NE6w/XiXg+aPIePJpI98S0UWTDcKJa0Fyqy5S5oHRITLP02P1aOaFEB3cKp91OPSrp+/akFj0dXq3bPnXWB8wWtCW5JZxU9gRS4Qr+PnlxehpGShT8SMNRqY0PXeqOnp4+T8fOviWbGMDbK3ev+VJk2gMwmvt0JouhUc=
2021-12-02T03:53:40.288 INFO:teuthology.kill:  smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ9TswdVRQwxpfVx928svX28o/cMUBb9NqcTORJ7hopeGhlXANg64Ed7PY8qj5RgnCQp1R1j84cIsiHQC0fnNa7WaPuGK+FJOktwzAELfmBz9QimrWREb8v21/Iw679VbCnuu2Mz+4WayHREbRkywgCXi4dKaev6V460Bar8Ut8ivRQhG8DzKixc1TvCFC8FBM/xOE0cNl6TXeuj6Otpn1LqECYWORg0aiQ+UddoQwqZklQykZNm+HNrZmrMeXqaaMkLkAg2Udqufb2ATbP4BlNxsePB0Izwkn0tyd14V/Tcz5Gg3k/CvcRuEhavd18iu+cdW2OX8ByIrCdx0a3elaU5XDuUVtLkI02GYoJqyeKefSOtVCxOp3KXD2zc9YTjYYVQz2XnsNP5it0ikMbplm4EVX0P5GNUf+FquuqCNF5UQKDz+SselIDOssihFGu6BCCb4yf0HQx86YbFRYsUT16+3DtxqJCepg0wK/ZiQVf4gOvb7Nuegwaqlbt+xp1M8=
2021-12-02T03:53:40.313 INFO:teuthology.kill:2021-12-02 03:53:40,313.313 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-02T03:53:40.317 INFO:teuthology.kill:2021-12-02 03:53:40,316.316 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-02T03:53:40.391 INFO:teuthology.kill:2021-12-02 03:53:40,390.390 INFO:teuthology.orchestra.console:Power off smithi172
2021-12-02T03:53:40.404 INFO:teuthology.kill:2021-12-02 03:53:40,404.404 INFO:teuthology.orchestra.console:Power off smithi181
2021-12-02T03:53:48.768 INFO:teuthology.kill:2021-12-02 03:53:48,767.767 INFO:teuthology.orchestra.console:Power off for smithi181 completed
2021-12-02T03:53:48.911 INFO:teuthology.kill:2021-12-02 03:53:48,910.910 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com
2021-12-02T03:53:52.874 INFO:teuthology.kill:2021-12-02 03:53:52,874.874 INFO:teuthology.orchestra.console:Power off for smithi172 completed
2021-12-02T03:53:53.017 INFO:teuthology.kill:2021-12-02 03:53:53,017.017 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com
2021-12-02T03:55:53.287 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15