2022-01-23T15:37:17.884 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-23T15:37:18.023 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging
2022-01-23T15:37:18.025 INFO:teuthology.lock.ops:Updating [ubuntu@smithi065.front.sepia.ceph.com]: reset os type and version on server
2022-01-23T15:37:18.025 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server
2022-01-23T15:37:18.049 INFO:teuthology.lock.ops:Node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging is complete
2022-01-23T15:37:18.049 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging
2022-01-23T15:37:18.050 INFO:teuthology.lock.ops:Updating [ubuntu@smithi141.front.sepia.ceph.com]: reset os type and version on server
2022-01-23T15:37:18.051 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2022-01-23T15:37:18.085 INFO:teuthology.lock.ops:Node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging is complete
2022-01-23T15:37:18.255 INFO:teuthology.provision.fog.smithi065:Scheduling deploy of centos 8.stream
2022-01-23T15:37:18.308 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 8.stream
2022-01-23T15:37:18.625 INFO:teuthology.orchestra.console:Power off smithi065
2022-01-23T15:37:18.642 INFO:teuthology.orchestra.console:Power off smithi141
2022-01-23T15:37:27.007 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2022-01-23T15:37:27.108 INFO:teuthology.orchestra.console:Power on smithi141
2022-01-23T15:37:31.112 INFO:teuthology.orchestra.console:Power off for smithi065 completed
2022-01-23T15:37:31.214 INFO:teuthology.orchestra.console:Power on smithi065
2022-01-23T15:37:31.358 INFO:teuthology.orchestra.console:Power on for smithi141 completed
2022-01-23T15:37:31.459 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2022-01-23T15:37:35.471 INFO:teuthology.orchestra.console:Power on for smithi065 completed
2022-01-23T15:37:35.573 INFO:teuthology.provision.fog.smithi065:Waiting for deploy to finish
2022-01-23T15:42:18.594 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-23T15:42:18.879 INFO:teuthology.provision.fog.smithi141:Node is ready
2022-01-23T15:42:18.897 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2022-01-23T15:42:18.954 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2022-01-23T15:42:19.281 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2022-01-23T15:42:22.553 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-23T15:42:22.825 INFO:teuthology.provision.fog.smithi065:Node is ready
2022-01-23T15:42:22.843 INFO:teuthology.orchestra.run.smithi065.stdout:smithi065.front.sepia.ceph.com
2022-01-23T15:42:22.900 INFO:teuthology.orchestra.run.smithi065.stdout:172.21.15.65 smithi065.front.sepia.ceph.com smithi065
2022-01-23T15:42:23.225 INFO:teuthology.provision.fog.smithi065:Deploy complete!
2022-01-23T15:42:23.373 INFO:teuthology.lock.ops:Checking smithi065.front.sepia.ceph.com
2022-01-23T15:42:23.374 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-23T15:42:23.393 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2022-01-23T15:42:23.393 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-23T15:42:23.412 INFO:teuthology.lock.ops:Updating [smithi065.front.sepia.ceph.com]: set os type and version on server
2022-01-23T15:42:23.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi065.front.sepia.ceph.com'
2022-01-23T15:42:23.606 INFO:teuthology.orchestra.run.smithi065.stdout:x86_64
2022-01-23T15:42:23.660 INFO:teuthology.orchestra.run.smithi065.stdout:NAME="CentOS Stream"
2022-01-23T15:42:23.661 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION="8"
2022-01-23T15:42:23.662 INFO:teuthology.orchestra.run.smithi065.stdout:ID="centos"
2022-01-23T15:42:23.662 INFO:teuthology.orchestra.run.smithi065.stdout:ID_LIKE="rhel fedora"
2022-01-23T15:42:23.662 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_ID="8"
2022-01-23T15:42:23.663 INFO:teuthology.orchestra.run.smithi065.stdout:PLATFORM_ID="platform:el8"
2022-01-23T15:42:23.663 INFO:teuthology.orchestra.run.smithi065.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-23T15:42:23.663 INFO:teuthology.orchestra.run.smithi065.stdout:ANSI_COLOR="0;31"
2022-01-23T15:42:23.663 INFO:teuthology.orchestra.run.smithi065.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-23T15:42:23.663 INFO:teuthology.orchestra.run.smithi065.stdout:HOME_URL="https://centos.org/"
2022-01-23T15:42:23.664 INFO:teuthology.orchestra.run.smithi065.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-23T15:42:23.664 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-23T15:42:23.664 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-23T15:42:23.665 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server
2022-01-23T15:42:23.684 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2022-01-23T15:42:23.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2022-01-23T15:42:23.881 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2022-01-23T15:42:23.938 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2022-01-23T15:42:23.939 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8"
2022-01-23T15:42:23.939 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2022-01-23T15:42:23.939 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2022-01-23T15:42:23.939 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8"
2022-01-23T15:42:23.940 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2022-01-23T15:42:23.940 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-23T15:42:23.940 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2022-01-23T15:42:23.940 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-23T15:42:23.941 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2022-01-23T15:42:23.941 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-23T15:42:23.941 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-23T15:42:23.941 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-23T15:42:23.942 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2022-01-23T15:42:24.044 INFO:teuthology.dispatcher.supervisor:Running job 6635927
2022-01-23T15:42:24.044 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi/6635927 --name teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi/6635927/orig.config.yaml
2022-01-23T15:42:24.048 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi/6635927
2022-01-23T15:42:24.048 INFO:teuthology.dispatcher.supervisor:Job PID: 575
2022-01-23T15:42:24.049 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-23T22:12:52.638 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-23T22:12:52.845 INFO:teuthology.kill:Killing Pids: {575}
2022-01-23T22:12:54.019 INFO:teuthology.task.internal:roles: ubuntu@smithi065.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-01-23T22:12:54.020 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-01-23T22:12:54.020 INFO:teuthology.misc:Compressing logs...
2022-01-23T22:12:54.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi065.front.sepia.ceph.com'
2022-01-23T22:12:54.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2022-01-23T22:12:54.510 INFO:teuthology.misc:Compressing logs...
2022-01-23T22:12:55.254 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-23T22:12:55.524 INFO:teuthology.misc:Compressing logs...
2022-01-23T22:12:58.852 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi065.gtkpoh.log: file size changed while zipping
2022-01-23T22:13:04.974 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi065.ccjmrg.log: file size changed while zipping
2022-01-23T22:13:18.034 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-23T22:13:25.837 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi141.dofwkz.log: file size changed while zipping
2022-01-23T22:13:28.626 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-23T22:13:28.663 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-mon.smithi141.log: file size changed while zipping
2022-01-23T22:13:33.526 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-mgr.smithi065.fzhyvc.log: file size changed while zipping
2022-01-23T22:13:45.038 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-mon.smithi065.log: file size changed while zipping
2022-01-23T22:13:46.065 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-23T22:14:00.631 INFO:teuthology.orchestra.run.smithi065.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-23T22:14:00.958 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-23T22:14:27.621 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/979283f6-7c64-11ec-8c35-001a4aab830c/ceph-mds.cephfs.smithi141.gihjxj.log: file size changed while zipping
2022-01-23T22:15:00.687 INFO:teuthology.kill:No teuthology processes running
2022-01-23T22:15:01.790 INFO:teuthology.kill:Nuking machines: ['smithi065', 'smithi141']
2022-01-23T22:15:02.757 INFO:teuthology.kill:2022-01-23 22:15:02,756.756 INFO:teuthology.nuke:targets:
2022-01-23T22:15:02.758 INFO:teuthology.kill:  smithi065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtl/aDac0PhZlKUvcH+MkEddyCyx2qatq0EwPJTnx7KGOLAFwpHzB+LQy9afA7O2d04XaWITVb03odR0ZBy0sMe+MiB+d3dC//GsqCGBEmYeeIaXWKAl5TMe0K2Cd9xjowYXJuY5kqVFNYHootm8Ua94QS/HDugD4Gy7ZIOXwUaeOhFRAdK0rfPrtOBuDIZmhN9/LjnZTWBLfwt+qVnHO+K1VCtIbacdN42p5bWPLsX9gpFlb9n6er4FODBvHQqGUQUyiQEDYDWq6dU2b3/LadjwQbYhhO+QOi6zWt6OsaPgytBXez9zik3z6SNZJW+LRVfEruY9VPa+QuhK9WeflkyIJAKscfZL3aDmHJVj69Thh8arh02XowW2r2Tm31xr2DnOy8q6QPuOckvgfD/++Vi3fjyU8tBFlDz8knRG1AXy4JwGjMt/q+Hk9I74EakogcnFsL9lLBIJDHV7HdAMtwHBjaIxxGZNw9nbsYJLVUZ8fUGR0ARJVJL8WlcFDub7E=
2022-01-23T22:15:02.759 INFO:teuthology.kill:  smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDewfUCCZo2Io1w3mphJJ7TCQ3jOefkwX1JxVbdrC5JKUfF9rAMlUFUZAAAY3EtvShi9r168De15/BRK/cbDtLwMoBx9YoXfCPIPmpzw4luCMeER0CIullEeYh8YoG4U2UmIodkedLgiMTLHhUOWgwG6hIoMk++ViribrO8wm+jG9D/4duGVSM98MD0j0j5STQpp0JwyT4ruDF6BQMurQk5ANZIXIzzZNv/h/tCr1nIYCqkcBy6Zk2gqgte5JVjIwxT15tPJPM2SB4bfsN80gV7QMPeNP4N2u1kD3ihqMsEA7JzJ8P2LEM2jIGFpkBd5HdOz+UU+tP8pDeNeHQzpz/+nO5RTJJt0+UaiawFangkw3tVZo4iw96/GvgBJYHrLCKITHFDYXFKlOmqaJDpnBGwI6L7KoL0kTXBCK7RacZU/XiTfQC5fudKLLitwMCCTb24YGne/5duGZsGmU0vzW1nDvgRtlxbf4Spn6UMeOFORLDhUS9V7i4PB51HzJJnaJs=
2022-01-23T22:15:02.785 INFO:teuthology.kill:2022-01-23 22:15:02,784.784 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-23T22:15:02.788 INFO:teuthology.kill:2022-01-23 22:15:02,788.788 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-23T22:15:02.865 INFO:teuthology.kill:2022-01-23 22:15:02,865.865 INFO:teuthology.orchestra.console:Power off smithi141
2022-01-23T22:15:02.880 INFO:teuthology.kill:2022-01-23 22:15:02,879.879 INFO:teuthology.orchestra.console:Power off smithi065
2022-01-23T22:15:15.345 INFO:teuthology.kill:2022-01-23 22:15:15,344.344 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2022-01-23T22:15:15.348 INFO:teuthology.kill:2022-01-23 22:15:15,348.348 INFO:teuthology.orchestra.console:Power off for smithi065 completed
2022-01-23T22:15:15.500 INFO:teuthology.kill:2022-01-23 22:15:15,499.499 INFO:teuthology.lock.ops:unlocked: smithi065.front.sepia.ceph.com
2022-01-23T22:15:15.511 INFO:teuthology.kill:2022-01-23 22:15:15,511.511 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com
2022-01-23T22:17:15.900 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-23T22:17:16.011 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi065 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-20_06:00:02-rbd-octopus-distro-default-smithi/6628593
2022-01-23T22:17:16.012 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi141 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-20_06:00:02-rbd-octopus-distro-default-smithi/6628593