2022-09-05T17:23:13.011 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-05T17:23:13.149 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging
2022-09-05T17:23:13.150 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server
2022-09-05T17:23:13.150 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-09-05T17:23:13.170 INFO:teuthology.lock.ops:Node 'smithi170.front.sepia.ceph.com' reimaging is complete
2022-09-05T17:23:13.170 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2022-09-05T17:23:13.171 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2022-09-05T17:23:13.171 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2022-09-05T17:23:13.193 INFO:teuthology.lock.ops:Node 'smithi171.front.sepia.ceph.com' reimaging is complete
2022-09-05T17:23:13.392 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.stream
2022-09-05T17:23:13.408 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 8.stream
2022-09-05T17:23:13.710 INFO:teuthology.orchestra.console:Power off smithi171
2022-09-05T17:23:13.724 INFO:teuthology.orchestra.console:Power off smithi170
2022-09-05T17:23:22.088 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2022-09-05T17:23:22.092 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-09-05T17:23:22.190 INFO:teuthology.orchestra.console:Power on smithi171
2022-09-05T17:23:22.199 INFO:teuthology.orchestra.console:Power on smithi170
2022-09-05T17:23:30.560 INFO:teuthology.orchestra.console:Power on for smithi171 completed
2022-09-05T17:23:30.564 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2022-09-05T17:23:30.662 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2022-09-05T17:23:30.667 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2022-09-05T17:26:01.682 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: Authentication failed.
2022-09-05T17:27:36.084 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-05T17:28:01.445 INFO:teuthology.provision.fog.smithi170:Node is ready
2022-09-05T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2022-09-05T17:28:01.527 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2022-09-05T17:28:01.897 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2022-09-05T17:28:26.399 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-05T17:28:26.656 INFO:teuthology.provision.fog.smithi171:Node is ready
2022-09-05T17:28:26.673 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2022-09-05T17:28:26.731 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2022-09-05T17:28:27.072 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2022-09-05T17:28:27.317 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2022-09-05T17:28:27.318 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-05T17:28:27.341 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2022-09-05T17:28:27.341 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-05T17:28:27.361 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2022-09-05T17:28:27.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-09-05T17:28:27.573 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2022-09-05T17:28:27.632 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream"
2022-09-05T17:28:27.633 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8"
2022-09-05T17:28:27.633 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2022-09-05T17:28:27.633 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2022-09-05T17:28:27.633 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8"
2022-09-05T17:28:27.634 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2022-09-05T17:28:27.634 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8"
2022-09-05T17:28:27.634 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2022-09-05T17:28:27.634 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-09-05T17:28:27.635 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2022-09-05T17:28:27.635 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-05T17:28:27.635 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-05T17:28:27.635 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-09-05T17:28:27.638 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-09-05T17:28:27.661 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2022-09-05T17:28:27.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2022-09-05T17:28:27.860 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2022-09-05T17:28:27.918 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream"
2022-09-05T17:28:27.918 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8"
2022-09-05T17:28:27.918 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2022-09-05T17:28:27.919 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2022-09-05T17:28:27.919 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8"
2022-09-05T17:28:27.919 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8"
2022-09-05T17:28:27.919 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 8"
2022-09-05T17:28:27.920 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2022-09-05T17:28:27.920 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-09-05T17:28:27.920 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2022-09-05T17:28:27.920 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-05T17:28:27.921 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-05T17:28:27.921 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-09-05T17:28:27.922 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2022-09-05T17:28:28.021 INFO:teuthology.dispatcher.supervisor:Running job 7011132
2022-09-05T17:28:28.021 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi/7011132 --name benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} -- /home/teuthworker/archive/benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi/7011132/orig.config.yaml
2022-09-05T17:28:28.027 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-04_20:55:20-rados-WIP_GBH_snap_mapper_one_wayX1-distro-default-smithi/7011132
2022-09-05T17:28:28.028 INFO:teuthology.dispatcher.supervisor:Job PID: 17550
2022-09-05T17:28:28.028 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-06T05:28:50.804 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-06T05:28:50.981 INFO:teuthology.kill:Killing Pids: {17550}
2022-09-06T05:28:52.431 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-09-06T05:28:52.432 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-09-06T05:28:52.432 INFO:teuthology.misc:Compressing logs...
2022-09-06T05:28:52.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-09-06T05:28:52.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2022-09-06T05:28:53.181 INFO:teuthology.misc:Compressing logs...
2022-09-06T05:28:54.335 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-06T05:28:54.386 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-06T05:32:31.592 INFO:teuthology.misc:Compressing logs...
2022-09-06T05:32:38.799 INFO:teuthology.kill:No teuthology processes running
2022-09-06T05:32:40.196 INFO:teuthology.kill:Nuking machines: ['smithi170', 'smithi171']
2022-09-06T05:32:41.369 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-06T05:32:41.371 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-06T05:32:41.372 INFO:teuthology.kill:2022-09-06 05:32:41,368.368 INFO:teuthology.nuke:targets:
2022-09-06T05:32:41.373 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzLOokDB1f38UD4lr+aUybsxh65aSjqX912NvUk5vhMpTyHBEzyLYBLWNTixsVaIszf/tH7q4yPmPbh3dPopassGNLNJm1jrGH0QCfS5QSlp12o9fKpqUdVrRRGRP781zO28drekXRsrboUVUGBMAnnGXt26jJhmZbe2KiePejJeCZTbaNAcmpXhhbJqWMmw4LNFcaHbj4e94ckDh9gQd2xxx9yqUtVVyX4A1C6wRI6sqXKva9+DV2/LYotn47SqsiPYWhcjQC0zCheC6iBOpnydT5tbatMuRrgWTEpBUcZBtscJBXy1E8i1NwVjLxUGE6BAHTWP/elOECOvZs+A9+kcn5jnkzD3sA5W0OOXB+MVtIG24S1ix5tpohgFRixb66z1wsZe3eA9UTjGu/qigp/ZnJTG2DusW+AdjzYmxVlBDJ66xnfla5DuY0hae6qxtw8hX/305IuTDKgIQjhaYzO1UQe2FQds6xgZkX6cGOE7a21dR+jxIxxyrG6rvm+Ms=
2022-09-06T05:32:41.373 INFO:teuthology.kill:  smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWJP3jfLO0l801JXK120VpXnTr/MCJdJQX+eoKPrXDyydGkufnmOyW1NnUp+hu5+QF3yxObNZVFET0s7F6PGnMfU10wQOvl3oz8n8AOomQvAtKFr7W5EpFDG/bKrOKeajHt74OIP0l60KzCkOeAPi8bPSLFMeLAXjyWa1TUdYMLdib/4h6hCiv3Sfhc/drdVeAFPNZ//LzsVq2CVa7O5Ipr5ieMOXSxm+CBJZcIKYqTYTEA71pF74HjQWP0bFR2bz2vDWhwWXblc2gswB+IxBaThlOvyi8ZnNSU1Y8FKEyBtTQExFJCazckB/ZljAf1qiiu+KPsyudVAcqm3fQT88kzQAyD2oTHstIMqPh+vYZxP0qXY7zIu2lUEJWdPSSTktGlW5hc/xJ908JzUbBtlS86zi5pKPVZ/blsumYtzpMX53DyTOjtWzmHlZDyrJc3RE7T6/7qpsJ80i0IY+Xbd47VkKAHsnySkthP8HOhg9CmmJXbo5OIhYses1yNMhQ+uM=
2022-09-06T05:32:41.373 INFO:teuthology.kill:2022-09-06 05:32:41,368.368 INFO:teuthology.nuke:Checking targets against current locks
2022-09-06T05:32:41.429 INFO:teuthology.kill:2022-09-06 05:32:41,428.428 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-06T05:32:41.451 INFO:teuthology.kill:2022-09-06 05:32:41,451.451 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-06T05:32:41.526 INFO:teuthology.kill:2022-09-06 05:32:41,525.525 INFO:teuthology.orchestra.console:Power off smithi170
2022-09-06T05:32:41.569 INFO:teuthology.kill:2022-09-06 05:32:41,569.569 INFO:teuthology.orchestra.console:Power off smithi171
2022-09-06T05:32:49.905 INFO:teuthology.kill:2022-09-06 05:32:49,904.904 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-09-06T05:32:50.056 INFO:teuthology.kill:2022-09-06 05:32:50,055.055 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com
2022-09-06T05:32:54.052 INFO:teuthology.kill:2022-09-06 05:32:54,052.052 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2022-09-06T05:32:54.214 INFO:teuthology.kill:2022-09-06 05:32:54,213.213 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com
2022-09-06T05:34:54.530 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-06T05:34:54.653 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2022-09-06_05:12:45-rgw-wip-cbodley-testing-distro-default-smithi/7013706
2022-09-06T05:34:54.653 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi171 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2022-09-06_05:12:45-rgw-wip-cbodley-testing-distro-default-smithi/7013706