2022-01-02T07:25:39.544 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-02T07:25:39.664 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging
2022-01-02T07:25:39.665 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server
2022-01-02T07:25:39.666 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2022-01-02T07:25:39.688 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete
2022-01-02T07:25:39.688 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging
2022-01-02T07:25:39.689 INFO:teuthology.lock.ops:Updating [ubuntu@smithi125.front.sepia.ceph.com]: reset os type and version on server
2022-01-02T07:25:39.690 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2022-01-02T07:25:39.710 INFO:teuthology.lock.ops:Node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging is complete
2022-01-02T07:25:39.921 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.stream
2022-01-02T07:25:39.939 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream
2022-01-02T07:25:40.424 INFO:teuthology.orchestra.console:Power off smithi125
2022-01-02T07:25:40.462 INFO:teuthology.orchestra.console:Power off smithi022
2022-01-02T07:25:48.797 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2022-01-02T07:25:48.830 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2022-01-02T07:25:48.899 INFO:teuthology.orchestra.console:Power on smithi125
2022-01-02T07:25:48.932 INFO:teuthology.orchestra.console:Power on smithi022
2022-01-02T07:25:57.270 INFO:teuthology.orchestra.console:Power on for smithi125 completed
2022-01-02T07:25:57.299 INFO:teuthology.orchestra.console:Power on for smithi022 completed
2022-01-02T07:25:57.372 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2022-01-02T07:25:57.400 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2022-01-02T07:29:41.336 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-02T07:30:01.649 INFO:teuthology.provision.fog.smithi022:Node is ready
2022-01-02T07:30:01.671 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2022-01-02T07:30:01.730 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2022-01-02T07:30:02.099 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2022-01-02T07:30:08.743 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-02T07:30:34.067 INFO:teuthology.provision.fog.smithi125:Node is ready
2022-01-02T07:30:34.089 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2022-01-02T07:30:34.148 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2022-01-02T07:30:34.504 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2022-01-02T07:30:34.651 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2022-01-02T07:30:34.652 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-02T07:30:34.670 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2022-01-02T07:30:34.671 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-02T07:30:34.689 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2022-01-02T07:30:34.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2022-01-02T07:30:34.937 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2022-01-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream"
2022-01-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8"
2022-01-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos"
2022-01-02T07:30:34.996 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora"
2022-01-02T07:30:34.996 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8"
2022-01-02T07:30:34.996 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2022-01-02T07:30:34.996 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-02T07:30:34.996 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2022-01-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/"
2022-01-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-02T07:30:34.998 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-02T07:30:34.999 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2022-01-02T07:30:35.017 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2022-01-02T07:30:35.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2022-01-02T07:30:35.220 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2022-01-02T07:30:35.279 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream"
2022-01-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8"
2022-01-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos"
2022-01-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora"
2022-01-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8"
2022-01-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8"
2022-01-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2022-01-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/"
2022-01-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-02T07:30:35.283 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2022-01-02T07:30:35.435 INFO:teuthology.dispatcher.supervisor:Running job 6590140
2022-01-02T07:30:35.436 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-02_03:31:02-rados-pacific-distro-default-smithi/6590140 --name teuthology-2022-01-02_03:31:02-rados-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/teuthology-2022-01-02_03:31:02-rados-pacific-distro-default-smithi/6590140/orig.config.yaml
2022-01-02T07:30:35.440 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-02_03:31:02-rados-pacific-distro-default-smithi/6590140
2022-01-02T07:30:35.441 INFO:teuthology.dispatcher.supervisor:Job PID: 28437
2022-01-02T07:30:35.441 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-02T19:30:55.410 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-02T19:30:55.613 INFO:teuthology.kill:Killing Pids: {28437}
2022-01-02T19:30:56.852 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-02T19:30:56.853 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-02T19:30:56.853 INFO:teuthology.misc:Compressing logs...
2022-01-02T19:30:56.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2022-01-02T19:30:57.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2022-01-02T19:30:57.099 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-02T19:30:57.284 INFO:teuthology.orchestra.run.smithi125.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-02T19:30:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-02T19:30:57.327 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now
2022-01-02T19:30:57.397 INFO:teuthology.orchestra.run.smithi125.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-02T19:30:57.398 INFO:teuthology.orchestra.run.smithi125.stderr:tar: Error is not recoverable: exiting now
2022-01-02T19:30:57.399 INFO:teuthology.misc:Compressing logs...
2022-01-02T19:30:57.825 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-02T19:30:58.050 INFO:teuthology.misc:Compressing logs...
2022-01-02T19:31:21.115 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-mon.smithi022.log: file size changed while zipping
2022-01-02T19:31:29.612 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-02T19:31:30.636 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-mgr.smithi022.pbxmdl.log: file size changed while zipping
2022-01-02T19:31:35.947 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-mon.smithi125.log: file size changed while zipping
2022-01-02T19:32:02.046 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-02T19:32:02.767 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-02T19:32:28.406 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-02T19:32:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-02T19:32:48.054 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-02T19:32:51.752 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-02T19:33:20.490 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/9c79d42c-6b9e-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-02T19:34:16.092 INFO:teuthology.kill:No teuthology processes running
2022-01-02T19:34:17.205 INFO:teuthology.kill:Nuking machines: ['smithi022', 'smithi125']
2022-01-02T19:34:18.214 INFO:teuthology.kill:2022-01-02 19:34:18,214.214 INFO:teuthology.nuke:targets:
2022-01-02T19:34:18.215 INFO:teuthology.kill:  smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV0bfLR2X+4smDJ8UikjWT2Oi4XL4DUIev5ZZ0PM1AvQxXwBi+cPQmARWLJG4C3rjUEot6akz9qW00ZurQUPj0VszLogyMDbSBEbHGRtAFp4sHFlWCmWksy1LIYpQ1H01OEk+sJO6sDoYHNNlnaptob4eUhGTF0ZffLhW+U4hBFbYnQ/9KmViMsS3+0KktQRM6sijQAItPRimuwYeb/CZQS803SBPZHIFr42Ks9TfJMEt8RcLNTIcRCI0Ub8RowsfwzV4xEkXGrBWjQX85YczTJ2iNQXNWArusKav1OPo2iAwDcYaX8NChgm7ykmBhhNn1AcqV4UD5178IqMIwRyCs0HUsL+Vml/z2T8Uq6CZklG875ymUMIMCUFZ1BXfEYDU331CTx42JqNFx2MsnGbif6pkqoJmPR074S6d/5QtZ45LhrBNZOJ/BM/QxDMJJOXHuQVR1I01KJhdmxGUwnnvBL3EZEyJljjR8QBcYLbIz4j7X6dmV+uCUEM7kIX8Wnpc=
2022-01-02T19:34:18.215 INFO:teuthology.kill:  smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXecC4KHYOt54HLfo3YEKPAv/fkeZOaVPuF1m9r+mWtADYG1+SAOpeHlH6lDCSomelJgz3DmVn3Po6/XRezSkNNhTYbCzH/SQZ8/ZHtcBxv6PzotI8kkyjDbTZJQaZ6rjNlLNg+5/oMDklFJD/DsYhixKJC+hyOnaXrDEjcV+K3Z69B3zLhG4f4/CI5xGVVjBAs1Lax5nEy4VgnNZ6BV/jy3ttpEBY38Td62rdp7P4bL2zz40wcWWuJKinZ1EzEqV3o53Ca96Pd3w43McRDPsiT3G+4XWad2l0jSdTOpHE/sAF4M04rjKzrgzd6dzH7tYByS9Ry5YSHDAyIRa+74STsrw64ucYD83l5BG+bUuifVyngNdR7JEeagh7Ric2xM0scVUATRWO6uUgqsHoOATS+UKd4PzuiJ+7BY/tjBANjZKPk6UjcxxvD0SwS96zoQFXnwc2v+KnXs0CLvDYl7fu1AVw3MG4VA0rzwgwVmZ5h+r4pXe5AFRD5Fsdl2PTdyU=
2022-01-02T19:34:18.240 INFO:teuthology.kill:2022-01-02 19:34:18,240.240 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-02T19:34:18.244 INFO:teuthology.kill:2022-01-02 19:34:18,243.243 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-02T19:34:18.322 INFO:teuthology.kill:2022-01-02 19:34:18,322.322 INFO:teuthology.orchestra.console:Power off smithi125
2022-01-02T19:34:18.337 INFO:teuthology.kill:2022-01-02 19:34:18,337.337 INFO:teuthology.orchestra.console:Power off smithi022
2022-01-02T19:34:30.814 INFO:teuthology.kill:2022-01-02 19:34:30,814.814 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2022-01-02T19:34:30.818 INFO:teuthology.kill:2022-01-02 19:34:30,817.817 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2022-01-02T19:34:30.967 INFO:teuthology.kill:2022-01-02 19:34:30,966.966 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com
2022-01-02T19:34:30.972 INFO:teuthology.kill:2022-01-02 19:34:30,971.971 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com
2022-01-02T19:36:31.315 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-02T19:36:31.412 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi022 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-02_16:21:55-rados-wip-yuriw-master-1.1.22-distro-default-smithi/6590975
2022-01-02T19:36:31.413 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi125 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-02_16:21:55-rados-wip-yuriw-master-1.1.22-distro-default-smithi/6590975