2022-02-10T07:59:51.955 INFO:root:teuthology version: 1.1.0-7cebb3f2
2022-02-10T07:59:52.091 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging
2022-02-10T07:59:52.092 INFO:teuthology.lock.ops:Updating [ubuntu@smithi155.front.sepia.ceph.com]: reset os type and version on server
2022-02-10T07:59:52.093 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2022-02-10T07:59:52.112 INFO:teuthology.lock.ops:Node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging is complete
2022-02-10T07:59:52.112 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging
2022-02-10T07:59:52.113 INFO:teuthology.lock.ops:Updating [ubuntu@smithi162.front.sepia.ceph.com]: reset os type and version on server
2022-02-10T07:59:52.113 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2022-02-10T07:59:52.131 INFO:teuthology.lock.ops:Node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging is complete
2022-02-10T07:59:52.327 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream
2022-02-10T07:59:52.339 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream
2022-02-10T07:59:52.764 INFO:teuthology.orchestra.console:Power off smithi155
2022-02-10T07:59:52.806 INFO:teuthology.orchestra.console:Power off smithi162
2022-02-10T08:00:01.162 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2022-02-10T08:00:01.264 INFO:teuthology.orchestra.console:Power on smithi162
2022-02-10T08:00:05.253 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2022-02-10T08:00:05.354 INFO:teuthology.orchestra.console:Power on smithi155
2022-02-10T08:00:09.713 INFO:teuthology.orchestra.console:Power on for smithi162 completed
2022-02-10T08:00:09.815 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2022-02-10T08:00:13.722 INFO:teuthology.orchestra.console:Power on for smithi155 completed
2022-02-10T08:00:13.823 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2022-02-10T08:04:34.379 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-10T08:04:59.997 INFO:teuthology.provision.fog.smithi162:Node is ready
2022-02-10T08:05:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2022-02-10T08:05:00.076 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2022-02-10T08:05:00.449 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2022-02-10T08:05:10.665 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-10T08:05:10.918 INFO:teuthology.provision.fog.smithi155:Node is ready
2022-02-10T08:05:10.976 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2022-02-10T08:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2022-02-10T08:05:11.378 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2022-02-10T08:05:11.527 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2022-02-10T08:05:11.528 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-10T08:05:11.550 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2022-02-10T08:05:11.550 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-10T08:05:11.569 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2022-02-10T08:05:11.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2022-02-10T08:05:11.760 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2022-02-10T08:05:11.816 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream"
2022-02-10T08:05:11.817 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8"
2022-02-10T08:05:11.817 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos"
2022-02-10T08:05:11.817 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora"
2022-02-10T08:05:11.817 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8"
2022-02-10T08:05:11.818 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2022-02-10T08:05:11.818 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-10T08:05:11.818 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2022-02-10T08:05:11.819 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-10T08:05:11.819 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/"
2022-02-10T08:05:11.819 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-10T08:05:11.819 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-10T08:05:11.819 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-10T08:05:11.821 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2022-02-10T08:05:11.841 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2022-02-10T08:05:11.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2022-02-10T08:05:12.042 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2022-02-10T08:05:12.102 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream"
2022-02-10T08:05:12.102 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8"
2022-02-10T08:05:12.102 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos"
2022-02-10T08:05:12.103 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora"
2022-02-10T08:05:12.103 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8"
2022-02-10T08:05:12.103 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2022-02-10T08:05:12.104 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-10T08:05:12.104 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2022-02-10T08:05:12.104 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-10T08:05:12.104 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/"
2022-02-10T08:05:12.104 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-10T08:05:12.105 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-10T08:05:12.105 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-10T08:05:12.106 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2022-02-10T08:05:12.203 INFO:teuthology.dispatcher.supervisor:Running job 6673163
2022-02-10T08:05:12.203 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi/6673163 --name amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi/6673163/orig.config.yaml
2022-02-10T08:05:12.207 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-02-10_06:16:41-rados-master-distro-default-smithi/6673163
2022-02-10T08:05:12.208 INFO:teuthology.dispatcher.supervisor:Job PID: 5706
2022-02-10T08:05:12.208 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-10T14:35:22.815 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-10T14:35:23.078 INFO:teuthology.kill:Killing Pids: {5706}
2022-02-10T14:35:24.296 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-10T14:35:24.297 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-10T14:35:24.297 INFO:teuthology.misc:Compressing logs...
2022-02-10T14:35:24.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2022-02-10T14:35:24.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2022-02-10T14:35:24.797 INFO:teuthology.misc:Compressing logs...
2022-02-10T14:35:25.182 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-10T14:35:28.838 INFO:teuthology.misc:Compressing logs...
2022-02-10T14:35:31.911 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/ceph-client.admin.39458.log: file size changed while zipping
2022-02-10T14:36:25.768 INFO:teuthology.kill:No teuthology processes running
2022-02-10T14:36:26.903 INFO:teuthology.kill:Nuking machines: ['smithi155', 'smithi162']
2022-02-10T14:36:27.952 INFO:teuthology.kill:2022-02-10 14:36:27,951.951 INFO:teuthology.nuke:targets:
2022-02-10T14:36:27.953 INFO:teuthology.kill:  smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIS5lpQSpLBORGwngIR+O5UNU3QaIoO3alJ5ElVUSBWtazsSaH0PT0n2yqW/N7NVBiz6N+q5I1jllIUAUIn4B3lcaM3csPmhZ9BEyDbpgqkOq0gMz42B7cAmBUAA8476NOrbvM9rTMWU5tM3vSKRFnXAbrFZ/r3pm7qusSmQoF9dQiegLB6km2Wi2Fq4goENn1NPPnONxaiRKwihRbXJ6Fan7F06Mo8yvdvYDpxvt4yrjXfh1D39bm+SbNYSjINqrDdRe5np+S078sOKC+iiaYXR9FDazhWB5n8dXGptMongfspx/VXqNkeSM4UdH+CoAHiG5EgcSE9hSNj/qaKOdwO7MdB36qoh1C22/g2uKBLyzBUg1TnPcAeOdRU4bfkj2BO7pi5o+Gcp9yQGVz0YTrYjpZRt/kHg1aHT8ijHW3eNtc5o6Hw4ERjXIYF5SKf/XCkawiyL9wW6n9/LLOfNIzXAyPB6JyxxgrJU3Y2oOgNyh0nRs2WCoP0E9dhIcuvS0=
2022-02-10T14:36:27.953 INFO:teuthology.kill:  smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmttJ0T2yUEAur7XXaBqKYGpUfzL+DI9FM/ENcTT2HiljMMkwLdlwrpKOl73gmlXIpbkddiMgDE/wDe06bAA/kmO5xxK9TEfBp+SFLhTAGI2j1QRzgp4/BTxPwXN5xli9FoUUJFcak68unJjRqQG9EvkkuX3Ow/t64pp82go4MxlvbAunvPYaSgIjhqkY/+m7dUpMi3fAs2LDk1wrzK1q1iA/U7n0rpFDnZjNklag9n9fZ2kPbzj2cmu+YJgmo2Yho/Nm60dzqhmq58AeIwiVAXlgxYZsZF0hIZ5RSBDCap5bwlO+zYRqjsgUzMpmt8UQPUgPfmK1y/fwsJVIkkberqWMv2wwipOlZN0lfkkJlF+U36RLeOA1tNa4vRE0R2KP2GToxVfGZOqJLDZi5fzYTlcIwH3MZYl53qFnNpFxN8FZuLeri0g0QGqFTS9UxgXqFIP2zAHIt0TX4tEFRkoXORW9U4DMgJs5Yi/gc/FdfbrOKQqnpX86IQ+ljqaAJCYk=
2022-02-10T14:36:27.979 INFO:teuthology.kill:2022-02-10 14:36:27,979.979 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-10T14:36:27.982 INFO:teuthology.kill:2022-02-10 14:36:27,982.982 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-10T14:36:28.060 INFO:teuthology.kill:2022-02-10 14:36:28,060.060 INFO:teuthology.orchestra.console:Power off smithi162
2022-02-10T14:36:28.075 INFO:teuthology.kill:2022-02-10 14:36:28,074.074 INFO:teuthology.orchestra.console:Power off smithi155
2022-02-10T14:36:36.438 INFO:teuthology.kill:2022-02-10 14:36:36,438.438 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2022-02-10T14:36:36.601 INFO:teuthology.kill:2022-02-10 14:36:36,600.600 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com
2022-02-10T14:36:40.543 INFO:teuthology.kill:2022-02-10 14:36:40,543.543 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2022-02-10T14:36:41.149 INFO:teuthology.kill:2022-02-10 14:36:40,688.688 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com
2022-02-10T14:38:41.354 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-10T14:38:41.459 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi155 but it was locked by another job: /home/teuthworker/archive/matan-2022-02-10_14:11:48-rados:thrash-master-distro-basic-smithi/6673707
2022-02-10T14:38:41.459 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi162 but it was locked by another job: /home/teuthworker/archive/matan-2022-02-10_14:11:48-rados:thrash-master-distro-basic-smithi/6673708