2022-05-11T00:19:22.141 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-11T00:19:22.263 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2022-05-11T00:19:22.265 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2022-05-11T00:19:22.265 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2022-05-11T00:19:22.283 INFO:teuthology.lock.ops:Node 'smithi052.front.sepia.ceph.com' reimaging is complete 2022-05-11T00:19:22.283 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2022-05-11T00:19:22.283 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2022-05-11T00:19:22.284 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2022-05-11T00:19:22.302 INFO:teuthology.lock.ops:Node 'smithi188.front.sepia.ceph.com' reimaging is complete 2022-05-11T00:19:22.494 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 8.stream 2022-05-11T00:19:22.514 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream 2022-05-11T00:19:22.809 INFO:teuthology.orchestra.console:Power off smithi052 2022-05-11T00:19:22.820 INFO:teuthology.orchestra.console:Power off smithi188 2022-05-11T00:19:22.956 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2022-05-11T00:19:23.057 INFO:teuthology.orchestra.console:Power on smithi188 2022-05-11T00:19:31.413 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2022-05-11T00:19:31.515 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2022-05-11T00:19:35.284 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2022-05-11T00:19:35.385 INFO:teuthology.orchestra.console:Power on smithi052 2022-05-11T00:19:43.748 INFO:teuthology.orchestra.console:Power on for smithi052 completed 2022-05-11T00:19:43.849 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2022-05-11T00:23:51.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-11T00:23:51.709 INFO:teuthology.provision.fog.smithi052:Node is ready 2022-05-11T00:23:51.729 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2022-05-11T00:23:51.788 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2022-05-11T00:23:52.143 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2022-05-11T00:24:09.491 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-11T00:24:09.764 INFO:teuthology.provision.fog.smithi188:Node is ready 2022-05-11T00:24:09.783 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2022-05-11T00:24:09.842 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2022-05-11T00:24:10.211 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2022-05-11T00:24:10.387 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2022-05-11T00:24:10.388 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-11T00:24:10.407 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2022-05-11T00:24:10.407 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-11T00:24:10.425 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2022-05-11T00:24:10.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T00:24:10.686 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2022-05-11T00:24:10.744 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2022-05-11T00:24:10.744 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8" 2022-05-11T00:24:10.744 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2022-05-11T00:24:10.744 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2022-05-11T00:24:10.745 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8" 2022-05-11T00:24:10.745 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2022-05-11T00:24:10.745 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-11T00:24:10.745 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2022-05-11T00:24:10.746 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-11T00:24:10.746 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2022-05-11T00:24:10.746 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-11T00:24:10.746 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-11T00:24:10.746 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-11T00:24:10.747 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2022-05-11T00:24:10.766 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2022-05-11T00:24:10.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T00:24:10.968 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2022-05-11T00:24:11.026 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2022-05-11T00:24:11.027 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8" 2022-05-11T00:24:11.027 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2022-05-11T00:24:11.027 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2022-05-11T00:24:11.027 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8" 2022-05-11T00:24:11.027 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2022-05-11T00:24:11.028 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-11T00:24:11.028 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2022-05-11T00:24:11.028 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-11T00:24:11.028 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2022-05-11T00:24:11.028 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-11T00:24:11.029 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-11T00:24:11.029 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-11T00:24:11.029 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2022-05-11T00:24:11.169 INFO:teuthology.dispatcher.supervisor:Running job 6830248 2022-05-11T00:24:11.169 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_soumyakoduri@teuthology --archive /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830248 --name soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830248/orig.config.yaml 2022-05-11T00:24:11.172 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/soumyakoduri-2022-05-10_18:23:47-rgw-wip-skoduri-dbstore-vstart-distro-basic-smithi/6830248 2022-05-11T00:24:11.173 INFO:teuthology.dispatcher.supervisor:Job PID: 26338 2022-05-11T00:24:11.173 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-11T06:54:35.261 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T07:38:15.737 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:38:17.371 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T07:38:17.371 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T07:38:17.372 INFO:teuthology.misc:Compressing logs... 2022-05-11T07:38:17.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T07:38:17.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T07:38:25.434 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:38:26.813 INFO:teuthology.kill:Nuking machines: ['smithi052', 'smithi188'] 2022-05-11T07:38:28.233 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-11T07:38:28.234 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-11T07:38:28.234 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-11T07:38:28.235 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-11T07:38:28.235 INFO:teuthology.kill:2022-05-11 07:38:28,233.233 INFO:teuthology.nuke:targets: 2022-05-11T07:38:28.235 INFO:teuthology.kill: smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmvfR2DQyCSr2uIRcijbfPrfl4EC7bEZICzBy37GBjKChf9tE2WDMBXWpqIDxRkmQ67pBVrdSwszMKx9MuFUnSHyCwFX6gu3F/qgQWCxZxo5DmGndrocJ1LtjOIxE/EgKAeTQ+CwBoyzcdX63d9EgS4RqosXOBXC94B8l/O3Mr1zHMs3Q/EtGe3FmpjUdNC+1nbrMDXuN5XiZCfB8xH9xO4tRYdl6CkRSpu/SkCamsfFORF+XJtlj9HR9nIicA/hcuqt7+DTxhUk0fJ4dO/0dOreHtINk4eIwb8+pR81EshQi0YG+n4HxoHdI+vMenZjcfiauOCCXVVMZdmq20aOlTckppnNvv2RpCgwD2E8I323vxGcK1pPmWlhlqpA2H5LpBgTy8B97m3/pXCyqwSehnfMzypUWXkz3S98M+wMtioA2Ws2mQxec+NOlBlcU55Be7AYeSAI6GVGdx9F3kK3HMrG8/S5lg7/FvVVk/mwgv0fYJbyN0bHZJh1mkyxABpP8= 2022-05-11T07:38:28.236 INFO:teuthology.kill: smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/pXISVBHPfbFW5zmb6WBkROQK3eq78psPbcGuTcn/xmLejo+CakJssoJIpXZ198FQ/Wu4eTsXVVm9slgqFu46Wea/g+9BKj28YC8gUFLTHMmjiVfEjIFh+DFQ+X5S58lqCSmSr44UbIns4BsPtOyGYRz7ovSiyltjRqaCftfvPbBtfLohqcTLqp4IG1KL3C6FOQWkSL1GUtWwkb8/8n9u8J7gXxEPhnxDV+nMWJp+zSUMIc/0U2DQOhV2MuVKpekZnZ2nlt4VcaeFwY4TeCDEnZ2P4/W/0M44fpyF9A0kBCBFWBWDyzAGn58Pg0fbRQK6MwarDPAhD/bkMEArSTiwrB94D0V8FoTahI/vJDGUZ3X9pwVUKleUDcKg06dS0dD9qmjYmlZCupVreMAQYE3GTlOBgAPhPoz1g+QeMvbptQvos9DiZAuD5Z4d96RGBeDy4zC76TLjhn+89Pbiwg1QSoTH2StBO5YYLpeHnfgFy9w5nXEwbWGUbgnCs9yn8w0= 2022-05-11T07:38:28.262 INFO:teuthology.kill:2022-05-11 07:38:28,262.262 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-11T07:38:28.265 INFO:teuthology.kill:2022-05-11 07:38:28,265.265 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-11T07:38:28.342 INFO:teuthology.kill:2022-05-11 07:38:28,342.342 INFO:teuthology.orchestra.console:Power off smithi188 2022-05-11T07:38:28.354 INFO:teuthology.kill:2022-05-11 07:38:28,353.353 INFO:teuthology.orchestra.console:Power off smithi052 2022-05-11T07:38:36.718 INFO:teuthology.kill:2022-05-11 07:38:36,718.718 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2022-05-11T07:38:36.873 INFO:teuthology.kill:2022-05-11 07:38:36,872.872 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com 2022-05-11T07:38:40.814 INFO:teuthology.kill:2022-05-11 07:38:40,814.814 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2022-05-11T07:38:41.022 INFO:teuthology.kill:2022-05-11 07:38:40,961.961 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com 2022-05-11T07:40:41.131 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T07:53:23.693 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:53:25.290 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T07:53:25.291 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T07:53:25.291 INFO:teuthology.misc:Compressing logs... 2022-05-11T07:53:25.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T07:53:25.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T07:53:25.524 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:53:26.148 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:53:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:53:26.222 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:53:26.260 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:53:26.260 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:53:26.313 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:53:27.564 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T07:55:27.675 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T07:55:42.213 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:55:43.438 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T07:55:43.439 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T07:55:43.440 INFO:teuthology.misc:Compressing logs... 2022-05-11T07:55:43.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T07:55:43.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T07:55:43.760 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:55:43.914 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:55:43.946 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:55:43.946 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:55:43.984 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:55:43.984 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:55:44.035 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:55:45.236 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T07:57:45.362 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T07:57:45.464 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:57:46.788 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T07:57:46.990 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T07:57:46.991 INFO:teuthology.misc:Compressing logs... 2022-05-11T07:57:46.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T07:57:47.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T07:57:47.310 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:57:47.466 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:57:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:57:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:57:47.537 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:57:47.537 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:57:47.589 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:57:48.887 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T07:59:49.052 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T07:59:49.108 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:59:50.564 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T07:59:50.564 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T07:59:50.565 INFO:teuthology.misc:Compressing logs... 2022-05-11T07:59:50.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T07:59:50.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T07:59:50.916 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:59:51.097 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T07:59:51.129 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:59:51.129 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:59:51.158 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T07:59:51.158 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T07:59:51.217 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T07:59:52.529 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:15:22.955 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:15:23.010 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:15:24.182 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:15:24.183 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:15:24.183 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:15:24.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:15:24.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:15:24.511 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:15:24.685 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:15:24.716 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:15:24.716 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:15:24.744 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:15:24.745 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:15:24.795 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:15:26.017 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:17:26.154 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:17:26.205 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:17:27.409 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:17:27.410 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:17:27.410 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:17:27.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:17:27.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:17:27.731 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:17:27.890 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:17:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:17:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:17:27.960 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:17:27.960 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:17:28.010 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:17:29.182 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:19:29.323 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:19:29.374 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:19:30.612 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:19:30.613 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:19:30.613 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:19:30.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:19:30.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:19:30.943 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:19:31.101 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:19:31.133 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:19:31.134 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:19:31.172 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:19:31.172 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:19:31.223 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:19:32.427 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:21:32.522 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:21:32.585 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:21:33.838 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:21:33.839 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:21:33.839 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:21:33.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:21:34.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:21:34.164 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:21:34.341 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:21:34.373 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:21:34.374 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:21:34.403 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:21:34.403 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:21:34.456 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:21:35.693 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:23:35.833 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:23:35.888 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:23:37.062 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:23:37.063 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:23:37.063 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:23:37.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:23:37.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:23:37.384 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:23:37.536 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:23:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:23:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:23:37.607 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:23:37.607 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:23:37.656 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:23:38.826 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:25:38.971 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:25:39.027 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:25:40.274 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:25:40.275 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:25:40.275 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:25:40.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:25:40.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:25:40.598 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:25:40.751 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:25:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:25:40.782 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:25:40.820 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:25:40.821 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:25:40.869 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:25:42.098 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:27:42.243 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:27:42.298 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:27:43.595 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:27:43.596 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:27:43.596 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:27:43.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:27:43.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:27:43.861 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:27:44.034 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:27:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:27:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:27:44.096 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:27:44.097 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:27:44.160 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:27:45.454 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:29:45.583 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:29:45.638 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:29:46.880 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:29:46.880 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:29:46.881 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:29:46.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:29:47.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:29:47.170 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:29:47.326 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:29:47.357 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:29:47.358 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:29:47.399 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:29:47.399 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:29:47.451 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:29:48.629 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:31:48.764 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:31:48.817 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:31:50.017 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:33:39.911 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:33:41.747 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:33:41.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:33:41.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:33:42.007 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:33:42.181 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:33:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:33:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:33:42.244 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:33:42.244 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:33:42.296 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:33:43.518 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:35:43.588 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:35:43.639 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:35:44.979 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:35:44.980 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:35:45.182 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:35:45.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:35:45.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:35:45.441 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:35:45.598 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:35:45.629 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:35:45.630 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:35:45.669 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:35:45.669 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:35:45.721 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:35:46.931 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:37:47.055 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:37:47.104 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:37:48.425 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:37:48.426 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:37:48.426 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:37:48.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:37:48.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:37:48.671 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:37:48.824 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:37:48.858 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:37:48.858 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:37:48.894 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:37:48.894 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:37:48.944 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:37:50.129 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:39:50.239 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:39:50.293 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:39:51.530 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:39:51.531 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:39:51.531 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:39:51.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:39:51.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:39:51.793 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:39:51.967 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:39:52.001 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:39:52.002 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:39:52.030 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:39:52.031 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:39:52.087 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:39:53.261 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:41:53.347 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:41:53.398 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:41:54.585 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:41:54.586 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:41:54.586 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:41:54.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:41:54.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:41:54.841 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:41:54.999 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:41:55.031 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:41:55.031 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:41:55.069 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:41:55.070 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:41:55.153 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:41:56.313 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:43:56.369 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:43:56.419 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:43:57.637 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:43:57.638 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:43:57.638 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:43:57.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:43:57.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:43:57.888 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:43:58.044 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:43:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:43:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:43:58.313 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:43:58.313 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:43:58.370 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:43:59.563 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:45:59.717 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:45:59.769 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:46:01.027 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:46:01.028 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:46:01.028 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:46:01.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:46:01.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:46:01.291 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:46:01.463 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:46:01.496 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:46:01.497 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:46:01.525 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:46:01.526 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:46:01.578 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:46:02.766 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:48:02.918 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:48:02.975 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:48:04.377 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:48:04.378 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:48:04.378 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:48:04.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:48:04.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:48:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:48:04.796 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:48:04.829 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:48:04.829 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:48:04.866 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:48:04.866 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:48:04.923 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:48:06.331 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:50:06.488 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:50:06.538 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:50:07.772 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:50:07.773 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:50:07.773 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:50:07.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:50:07.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:50:08.025 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:50:08.183 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:50:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:50:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:50:08.253 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:50:08.254 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:50:08.307 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:50:09.493 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:52:09.635 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-11T08:52:09.689 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:52:10.925 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-11T08:52:10.926 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-11T08:52:10.926 INFO:teuthology.misc:Compressing logs... 2022-05-11T08:52:10.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2022-05-11T08:52:11.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2022-05-11T08:52:11.183 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:52:11.357 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-11T08:52:11.391 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:52:11.391 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:52:11.420 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-11T08:52:11.420 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2022-05-11T08:52:11.470 INFO:teuthology.kill:Killing Pids: {26338} 2022-05-11T08:52:12.644 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-11T08:54:12.852 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-11T08:54:12.940 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi052 but it was locked by another job: /home/teuthworker/archive/adking-2022-05-11_03:57:34-orch:cephadm-wip-adk-testing-2022-05-10-2040-distro-basic-smithi/6830298 2022-05-11T08:54:12.941 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi188 but it was locked by another job: /home/teuthworker/archive/adking-2022-05-11_03:57:34-orch:cephadm-wip-adk-testing-2022-05-10-2040-distro-basic-smithi/6830298