2022-03-20T06:39:48.633 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-20T06:39:48.761 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging 2022-03-20T06:39:48.762 INFO:teuthology.lock.ops:Updating [ubuntu@smithi114.front.sepia.ceph.com]: reset os type and version on server 2022-03-20T06:39:48.762 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2022-03-20T06:39:48.781 INFO:teuthology.lock.ops:Node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging is complete 2022-03-20T06:39:48.781 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging 2022-03-20T06:39:48.781 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server 2022-03-20T06:39:48.782 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2022-03-20T06:39:48.802 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete 2022-03-20T06:39:48.990 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of ubuntu 20.04 2022-03-20T06:39:49.005 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 20.04 2022-03-20T06:39:49.335 INFO:teuthology.orchestra.console:Power off smithi114 2022-03-20T06:39:49.421 INFO:teuthology.orchestra.console:Power off smithi183 2022-03-20T06:39:57.710 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2022-03-20T06:39:57.812 INFO:teuthology.orchestra.console:Power on smithi114 2022-03-20T06:40:01.903 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2022-03-20T06:40:02.005 INFO:teuthology.orchestra.console:Power on smithi183 2022-03-20T06:40:06.183 INFO:teuthology.orchestra.console:Power on for smithi114 completed 2022-03-20T06:40:06.257 INFO:teuthology.orchestra.console:Power on for smithi183 completed 2022-03-20T06:40:06.285 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2022-03-20T06:40:06.358 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2022-03-20T06:45:06.787 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-20T06:45:06.862 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-20T06:45:07.153 INFO:teuthology.provision.fog.smithi183:Node is ready 2022-03-20T06:45:07.160 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2022-03-20T06:45:07.213 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2022-03-20T06:45:07.244 INFO:teuthology.provision.fog.smithi114:Node is ready 2022-03-20T06:45:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2022-03-20T06:45:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2022-03-20T06:45:07.400 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2022-03-20T06:45:07.466 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2022-03-20T06:45:07.691 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2022-03-20T06:45:07.692 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-20T06:45:07.710 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2022-03-20T06:45:07.711 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-20T06:45:07.729 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2022-03-20T06:45:07.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2022-03-20T06:45:07.925 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2022-03-20T06:45:07.932 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2022-03-20T06:45:07.932 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-03-20T06:45:07.932 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2022-03-20T06:45:07.932 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2022-03-20T06:45:07.933 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-03-20T06:45:07.933 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="20.04" 2022-03-20T06:45:07.933 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-20T06:45:07.933 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-20T06:45:07.934 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-20T06:45:07.934 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-20T06:45:07.934 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=focal 2022-03-20T06:45:07.934 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=focal 2022-03-20T06:45:07.935 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2022-03-20T06:45:07.954 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2022-03-20T06:45:07.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2022-03-20T06:45:08.130 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2022-03-20T06:45:08.135 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2022-03-20T06:45:08.136 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-03-20T06:45:08.136 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2022-03-20T06:45:08.136 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2022-03-20T06:45:08.136 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-03-20T06:45:08.137 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2022-03-20T06:45:08.137 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-20T06:45:08.137 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-20T06:45:08.137 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-20T06:45:08.138 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-20T06:45:08.138 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2022-03-20T06:45:08.138 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2022-03-20T06:45:08.139 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2022-03-20T06:45:08.230 INFO:teuthology.dispatcher.supervisor:Running job 6747621 2022-03-20T06:45:08.230 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747621 --name vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747621/orig.config.yaml 2022-03-20T06:45:08.233 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747621 2022-03-20T06:45:08.234 INFO:teuthology.dispatcher.supervisor:Job PID: 25559 2022-03-20T06:45:08.234 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-20T13:15:36.044 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-20T13:15:36.233 INFO:teuthology.kill:Killing Pids: {25559} 2022-03-20T13:15:37.356 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-03-20T13:15:37.357 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-03-20T13:15:37.357 INFO:teuthology.misc:Compressing logs... 2022-03-20T13:15:37.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2022-03-20T13:15:43.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2022-03-20T13:15:44.066 INFO:teuthology.misc:Compressing logs... 2022-03-20T13:15:44.416 INFO:teuthology.misc:Compressing logs... 2022-03-20T13:25:04.579 INFO:teuthology.kill:No teuthology processes running 2022-03-20T13:25:05.708 INFO:teuthology.kill:Nuking machines: ['smithi114', 'smithi183'] 2022-03-20T13:25:06.654 INFO:teuthology.kill:2022-03-20 13:25:06,654.654 INFO:teuthology.nuke:targets: 2022-03-20T13:25:06.655 INFO:teuthology.kill: smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEvXpFv6S0DQcy9dhMNJ5E50js2D9RBIcv63jBuZZKnePEqIyAmgYDV6o4qtiswwjWOhKsYCB9/Ddt0mGmknU1b/jWFweT+LlbmhIuZRxTg/YKBUlzt6fvepsRAoW/zfZljtwC7x/iBoVQYsGXCFmi3EyYv7KQzjIP7F8U7YkBO6C9vPc1JI3F53+UU9D1zSk+jUjNKt2GWPlKPbPlKJlHmPtbYgLviiAsCN8LMiYBVNaj3QFC2pdorY9qNxGjHgI0syjZuamq4d5OxRdnAzYATkXwR5qqjW5VYrPbzXczb06/L2dNe53oIcroZECSjzwaSHMAfYD7yLLnjCYRkAq3gFmYiggYyuJu1i7PA3M6LdqyWcupnt9snxpaD+rvv1YfbCWTevNIOyHYpm8t1+3s+7n7Dgw/VOnthpHf7QsPl/My9ZFbe6EeJ94ahJsYBCEnJgzm6fJ5lj8sbI6vMHNNOVRxVVs4dvTEmMJWUfRYzn+f0JL+9qS4R80dDvo+1l0= 2022-03-20T13:25:06.655 INFO:teuthology.kill: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7KkM8d8mHHNwsuDaiB5j1p2udAkWBVZLQrrmvzk2RwlDB9oHA/f+cK3O8HkKT6K2PEagikpv5KN5Z1nidH8izgJSPfS7Kw6rwgNf2Xv2kSKcFzqpFzwtSgXdsiQ80JubP6XhrOxQ+NAbLha7wRlJRySpdwVU/xPvokv/T0T5oK932Kis1uY1RMgDc4EZAiL/w5OvMxAUSEvgQnI0Rlg17gd62d0S4Mq68AWNdDJlmZh2NLq7x98S5ZIwn5rtV8pPcTUO+yI22QRCHshwRfpJn5URRDttTLj+sUo8DECxhzY0vIF/VYK5l+v0UIMyN1hR9SbD+OT8/ZF0OAorvm4VoX+6mpU+/Qbwfp5YmpTZzmc3qHVuBWuJEvvh/qWK6cPDueWSkbIBpORSc++0b6q0znhpxrz/B8uHe3WeagIv2M7sbgsDIjSO0pCAcwy7Nf7QzI+Z7iFFIhXoavBhrrMlovvPrsbXQKWCdFu9Zji+P7zFq6d7yLL1EhWAKoX9cnwU= 2022-03-20T13:25:06.680 INFO:teuthology.kill:2022-03-20 13:25:06,679.679 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-20T13:25:06.682 INFO:teuthology.kill:2022-03-20 13:25:06,682.682 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-20T13:25:06.754 INFO:teuthology.kill:2022-03-20 13:25:06,753.753 INFO:teuthology.orchestra.console:Power off smithi114 2022-03-20T13:25:06.765 INFO:teuthology.kill:2022-03-20 13:25:06,765.765 INFO:teuthology.orchestra.console:Power off smithi183 2022-03-20T13:25:15.124 INFO:teuthology.kill:2022-03-20 13:25:15,124.124 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2022-03-20T13:25:15.269 INFO:teuthology.kill:2022-03-20 13:25:15,268.268 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2022-03-20T13:25:19.232 INFO:teuthology.kill:2022-03-20 13:25:19,232.232 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2022-03-20T13:25:19.377 INFO:teuthology.kill:2022-03-20 13:25:19,376.376 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2022-03-20T13:27:19.644 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15