2022-10-22T14:38:57.353 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-22T14:38:57.624 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2022-10-22T14:38:57.626 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2022-10-22T14:38:57.626 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-10-22T14:38:57.653 INFO:teuthology.lock.ops:Node 'smithi167.front.sepia.ceph.com' reimaging is complete
2022-10-22T14:38:57.654 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2022-10-22T14:38:57.654 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2022-10-22T14:38:57.655 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-10-22T14:38:57.687 INFO:teuthology.lock.ops:Node 'smithi176.front.sepia.ceph.com' reimaging is complete
2022-10-22T14:38:57.903 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04
2022-10-22T14:38:57.960 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of ubuntu 20.04
2022-10-22T14:38:58.336 INFO:teuthology.orchestra.console:Power off smithi167
2022-10-22T14:38:58.425 INFO:teuthology.orchestra.console:Power off smithi176
2022-10-22T14:39:06.756 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-10-22T14:39:06.859 INFO:teuthology.orchestra.console:Power on smithi167
2022-10-22T14:39:10.991 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-10-22T14:39:11.095 INFO:teuthology.orchestra.console:Power on smithi176
2022-10-22T14:39:15.264 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2022-10-22T14:39:15.368 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2022-10-22T14:39:19.482 INFO:teuthology.orchestra.console:Power on for smithi176 completed
2022-10-22T14:39:19.585 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2022-10-22T14:44:15.335 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-22T14:44:15.817 INFO:teuthology.provision.fog.smithi176:Node is ready
2022-10-22T14:44:15.824 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2022-10-22T14:44:15.832 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2022-10-22T14:44:15.967 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2022-10-22T14:44:28.397 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-10-22T14:44:28.863 INFO:teuthology.provision.fog.smithi167:Node is ready
2022-10-22T14:44:28.870 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2022-10-22T14:44:28.921 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2022-10-22T14:44:29.141 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2022-10-22T14:44:29.394 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2022-10-22T14:44:29.396 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-22T14:44:29.421 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2022-10-22T14:44:29.421 INFO:teuthology.lock.ops:New key found. Updating...
2022-10-22T14:44:29.445 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2022-10-22T14:44:29.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-10-22T14:44:29.677 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2022-10-22T14:44:29.684 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu"
2022-10-22T14:44:29.684 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.5 LTS (Focal Fossa)"
2022-10-22T14:44:29.684 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu
2022-10-22T14:44:29.684 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian
2022-10-22T14:44:29.685 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS"
2022-10-22T14:44:29.685 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04"
2022-10-22T14:44:29.685 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/"
2022-10-22T14:44:29.685 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-10-22T14:44:29.686 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-10-22T14:44:29.686 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-10-22T14:44:29.686 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal
2022-10-22T14:44:29.686 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal
2022-10-22T14:44:29.687 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2022-10-22T14:44:29.708 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2022-10-22T14:44:29.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-10-22T14:44:30.054 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2022-10-22T14:44:30.061 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu"
2022-10-22T14:44:30.061 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="20.04.5 LTS (Focal Fossa)"
2022-10-22T14:44:30.061 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu
2022-10-22T14:44:30.062 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian
2022-10-22T14:44:30.062 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS"
2022-10-22T14:44:30.063 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="20.04"
2022-10-22T14:44:30.063 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/"
2022-10-22T14:44:30.063 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-10-22T14:44:30.063 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-10-22T14:44:30.063 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-10-22T14:44:30.064 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=focal
2022-10-22T14:44:30.064 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=focal
2022-10-22T14:44:30.064 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2022-10-22T14:44:30.199 INFO:teuthology.dispatcher.supervisor:Running job 7077382
2022-10-22T14:44:30.200 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:pacific-x-main-distro-default-smithi/7077382 --name teuthology-2022-10-22_14:23:03-upgrade:pacific-x-main-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:pacific-x-main-distro-default-smithi/7077382/orig.config.yaml
2022-10-22T14:44:30.205 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-10-22_14:23:03-upgrade:pacific-x-main-distro-default-smithi/7077382
2022-10-22T14:44:30.206 INFO:teuthology.dispatcher.supervisor:Job PID: 20260
2022-10-22T14:44:30.206 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-10-23T02:45:24.455 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-10-23T02:45:24.689 INFO:teuthology.kill:Killing Pids: {20260}
2022-10-23T02:45:26.163 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2022-10-23T02:45:26.164 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2022-10-23T02:45:26.165 INFO:teuthology.misc:Compressing logs...
2022-10-23T02:45:26.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2022-10-23T02:45:26.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2022-10-23T02:45:26.874 INFO:teuthology.misc:Compressing logs...
2022-10-23T02:45:27.349 INFO:teuthology.misc:Compressing logs...
2022-10-23T02:45:32.896 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-mgr.y.log: file size changed while zipping
2022-10-23T02:45:39.369 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-10-23T02:45:44.488 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-10-23T02:45:49.920 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-10-23T02:45:53.907 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-10-23T02:46:00.209 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-10-23T02:46:00.321 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-mgr.x.log: file size changed while zipping
2022-10-23T02:46:09.871 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-10-23T02:46:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-10-23T02:46:22.599 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-10-23T02:46:33.326 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-10-23T02:46:45.311 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-10-23T02:47:00.524 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/6ccd5ec6-5219-11ed-8438-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-10-23T02:47:38.941 INFO:teuthology.kill:No teuthology processes running
2022-10-23T02:47:40.621 INFO:teuthology.kill:Nuking machines: ['smithi167', 'smithi176']
2022-10-23T02:47:41.901 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-10-23T02:47:41.903 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-10-23T02:47:41.904 INFO:teuthology.kill:2022-10-23 02:47:41,898.898 INFO:teuthology.nuke:targets:
2022-10-23T02:47:41.904 INFO:teuthology.kill:  smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGOH51//syv/T0V1isnC1dvsypQtIOddXblId09C+8BuAW515304X5FoGWw+0nY+XFD8Z4janreC6/UkDpT35irUNjITfud3Kw5J630vpx9zyjdsxZMdyQVO3Rav2BGv4GVO8KWs/B5+AX5lycHVWOUsDPBMYnHo3SfO5mae5mjJrlpchMooBC9TkaYju9A4riCC9foqk9RIxuHTyCTYxrm7/Zx8C24kn94sD5iuREon6GYOxghLSHzDkYB+yWoIq/pxJlpLjDy7PKJQ2H4c6eMnFEX9+fnzLKbu49FQn59XmJY+Jq+7rrBb61hFxWJcqAxWAd8BENEXhI7cAGRjfK3dlzQYnJWscklPDiauxnfn/h7E3o+mtoSDgqRE3VzjXRAzUbmtFqJArdpumFL24TK/WB4chy23BavKvPvZvIDEr/a6d7q5D8bPpEvbwKasT/tIXjBYATzUWoSdXfQoEfxiIvsnVl3tumiCdk/2hCgB/xYeVPHiM8VS9KTzOzfH0=
2022-10-23T02:47:41.905 INFO:teuthology.kill:  smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDN2BUnfMxrMpqwIA3CHCv8dEljVO93JEYpe02PW89cngXHvEbNXpQymeYwB9PbpO5JUKIvewFyFaPsDVkHckjs+MpsQqDerraaaUQwOr41blNLCNV8jaTM/sB07Q2NwZ07aXlVyzr6+021Rs3qVC7UeL9zZWIBYdh7oEFxlqcq88puvH8KHf/y0nMpWa8fUbV+Yo8VhEfG5e21cG2gzXhHZ8T6JB1lWrpYR/5cMq69GI1ETzR2RaarPuZP5LhfvmCk5lCoVbdiY1ecSP5rpdGrC8n0AiXaJiSTFt5uol8hrk7yK0UFaK2gTvtAN+eLQCqkw6us17XoF8Rkpua1hzMAoWEtp8GBHmCeUopT3eMFNnqK4ZfG7RiXaerFRF3j5f6NXVfKU1LDqazf+WbBjiIN4oEnU9QaNPFgJHwLma0D2XrxbWeviCSThwAkFgcRdGQQGVD4mPaEK3JbTI08wriUykmG3WBLUJGUxdk4CBmQT6JnxTg1bBT46F9l98SbsVk=
2022-10-23T02:47:41.905 INFO:teuthology.kill:2022-10-23 02:47:41,898.898 INFO:teuthology.nuke:Checking targets against current locks
2022-10-23T02:47:41.961 INFO:teuthology.kill:2022-10-23 02:47:41,961.961 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-23T02:47:41.994 INFO:teuthology.kill:2022-10-23 02:47:41,993.993 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-10-23T02:47:42.058 INFO:teuthology.kill:2022-10-23 02:47:42,057.057 INFO:teuthology.orchestra.console:Power off smithi167
2022-10-23T02:47:42.102 INFO:teuthology.kill:2022-10-23 02:47:42,102.102 INFO:teuthology.orchestra.console:Power off smithi176
2022-10-23T02:47:54.567 INFO:teuthology.kill:2022-10-23 02:47:54,567.567 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2022-10-23T02:47:54.610 INFO:teuthology.kill:2022-10-23 02:47:54,609.609 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2022-10-23T02:47:54.730 INFO:teuthology.kill:2022-10-23 02:47:54,729.729 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com
2022-10-23T02:47:54.767 INFO:teuthology.kill:2022-10-23 02:47:54,767.767 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com
2022-10-23T02:49:55.232 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-10-23T02:49:55.387 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069343
2022-10-23T02:49:55.390 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi176 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069343