2022-01-24T06:11:50.608 INFO:root:teuthology version: 1.1.0-75f1bcd2 2022-01-24T06:11:50.610 DEBUG:teuthology.run:Teuthology command: teuthology --description multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} --verbose --owner scheduled_teuthology@teuthology --name teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi/6634138 -- /home/teuthworker/archive/teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi/6634138/orig.config.yaml 2022-01-24T06:11:50.665 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-01-24T06:11:50.735 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi/6634138 branch: octopus description: multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} email: ceph-qa@ceph.io first_in_suite: false job_id: '6634138' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.3' overrides: admin_socket: branch: octopus ceph: cephfs: max_mds: 9 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 fuse default permissions: false rados mon op timeout: 15m rados osd op timeout: 15m global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 6d0261fcb9458c90b6f509c036c9df47e35eb281 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6d0261fcb9458c90b6f509c036c9df47e35eb281 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: 4d29e4caec1870b870492d17110d34996b9335e6 owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.c - mgr.y - mds.a - mds.b - mds.c - mds.d - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mgr.x - mds.e - mds.f - mds.g - mds.h - mds.i - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - client.1 sha1: 6d0261fcb9458c90b6f509c036c9df47e35eb281 sleep_before_teardown: 0 suite: multimds suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_4d29e4caec1870b870492d17110d34996b9335e6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 4d29e4caec1870b870492d17110d34996b9335e6 targets: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBel4Hmyrc8BsbN1n/kivbcZ/cklLTPttFIUArdc5sw1mx+Szd1A1KiSLtBTICmt4pkn9XY1e1sXzYQ63lgxVE8VnmUOH5C0Id8wDvd5AcC1Vab3i4ODuv+2Yn8wi9ppelLzf8WjjHTUIYm+WUVDKoxPfkmpsH5GpOaz3TdorXtWEdcQ9mTs9lbHyNA+aHvAU8MVIzirMDYRB/FJq0by0JgSlRTIbkXJNZJx4lwQyjLrR/zlAd5U4UekR90g5RWCi11x9UTS7CCYKCbuRK9wRgzqFdTr93A27T9XgE7e2VmEAXuQpJXLdgZCquJdEbMuxyaGX6RSvZ043ysuKH27+o5Gt5LPFb7TNOS2LHoLfNVoqrn0201bvrKhL/gJf6/U2SGDyE11yIqkPzg8C81yGWija7WRVK7wq0I9MTihOjqL0a9CkmthRtNkkT5BiIuuX5FyhRYDdwa6rhK4A8NyEdMftqH7kOKGEEafMAuCGtwm71zPjCjufrBBRa9M1Zz20= smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC76Sm3BQswAARBmilOyzcKK4wQM+QRlO3wngZ9buhzuGYiQVNxaI6m5dDjEBYHZDT4Q7q2o+k5ZSin3+E79biMmeoMQCMA+mHgHo7XDcFo9t9SlG/sCdPSI/gCEjbgvbJh2fComoJ9ow+wfl9X128+GNYK9Qqe0McG5ZOv0QtWhB6BUWH8gMsAhnWaWXHibcclgibe7yoD93f1+fQhK9r8OAol8d36gnN+SRV1m3sF+c7Run2YUYzwcE1pPlfHmQtje62CByGJl8+L4otRiIDs0goRsBab2dZ61WuhQRjboVRWHo4wWfAC/GVps8xMJjkSPbLiVvyBJ8BWpaU+/FM7SBVGECSO4xccGKnn2s15oJohLtYNfMn9HF+atIag67j3NM7gj88C7HGqV4tU8FLl03JUD7+TYsDhOytKYjhRI8dDwZyaKrLQzkvqwLkMNk/Kv2n6xTvKt4hH3vf9A0FPqB7mIxUQvJGGc7t9L1lQhNNlfMRJP3oCDyzuM3FeF7k= smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4GK/1ykojrxfSiA6YTCcuU5/FafDndeSjXb290fDEime1NR9rijx2s97RYArFdpK0mVhyG6DUtVrlJl/AQjNluMTpn4prEYmky1rT8CwkZNhIL1p0Kkim5dYiuCOiAw7O+C89OPmUF6KjFdQqmcdUO+1rU9Yq3lISqLUVn8gRIL7k8r9krB3juaKBnEBJEKg0hg1ZJrXhvt5IuhkvzlX5jtRwoLH6+Qfz3+BLNYmxyLP/cewCgqZFC23zKIOQhps81qqMNPvPO+EIq4YViHTGz2c8ndkWKf+P2W1m+yQIkaewPCAsc9dlb4tv/A6GuieTuaaChPY5cv00LdYjUJOenbrSEHAyMo0+tBzdRiNoVxz/l4TpGPVKxw7VsmqBwKK9gJ9RfON1usn78V0QUNzFDIE/Rey0EcJpg8Uq46fuuLRrbwyKXmw26hsBreGYZG4QXBuNHKxAPIjfv3l+wbupIVe/qt/HQSd6KtjdQkKP+nKxeVzJVTes4VpEYvfJdxM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - exec: client.0: - sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - kclient: null - check-counter: counters: mds: - mds.exported - mds.imported - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - suites/blogbench.sh teuthology_branch: master teuthology_sha1: 75f1bcd237a8b6022305cd53ba87e106d45aa665 timestamp: 2022-01-22_13:15:03 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20261 2022-01-24T06:11:50.736 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_4d29e4caec1870b870492d17110d34996b9335e6/qa; will attempt to use it 2022-01-24T06:11:50.737 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_4d29e4caec1870b870492d17110d34996b9335e6/qa/tasks 2022-01-24T06:11:50.737 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-01-24T06:11:50.740 INFO:teuthology.task.internal:Checking packages... 2022-01-24T06:11:50.761 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6d0261fcb9458c90b6f509c036c9df47e35eb281' 2022-01-24T06:11:50.761 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-01-24T06:11:50.762 INFO:teuthology.packaging:ref: None 2022-01-24T06:11:50.762 INFO:teuthology.packaging:tag: None 2022-01-24T06:11:50.762 INFO:teuthology.packaging:branch: octopus 2022-01-24T06:11:50.763 INFO:teuthology.packaging:sha1: 6d0261fcb9458c90b6f509c036c9df47e35eb281 2022-01-24T06:11:50.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2022-01-24T06:11:51.067 INFO:teuthology.task.internal:Found packages for ceph version 15.2.15-161.g4d29e4ca 2022-01-24T06:11:51.068 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-01-24T06:11:51.080 INFO:teuthology.task.internal:no buildpackages task found 2022-01-24T06:11:51.080 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-01-24T06:11:51.115 INFO:teuthology.task.internal:Saving configuration 2022-01-24T06:11:51.133 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-01-24T06:11:51.169 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-24T06:11:51.193 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi/6634138', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-01-24 06:06:28.280280', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuJydOnl9zD/zhXXG/XqgPd11SFlkDHaFLYByMkf6pByraiuw1gBUZaENdZvD++o3KCUBaVpSKwJoDjGGhh5V8='} 2022-01-24T06:11:51.215 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi/6634138', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-01-24 06:06:28.279227', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLh/MWHU67KdntRLw3WalHAMR31NtwWkc9h86R4gNZH50/JpHVVtplE+xzBWKg208u030rY3gP9lQsczzglzQvA='} 2022-01-24T06:11:51.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi/6634138', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-01-24 06:06:28.277888', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrwrhv6hgLeaKwQf31wvYscKq67i/SS8lhwBfGs2JA+CO2TpHdOg+5QwfwcGX5BxY8fbS/YnsYNX2IHDl6h87c='} 2022-01-24T06:11:51.237 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-01-24T06:11:51.249 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-01-24T06:11:51.250 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'mds.e', 'mds.f', 'mds.g', 'mds.h', 'mds.i', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-01-24T06:11:51.250 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['client.0', 'client.1'] 2022-01-24T06:11:51.250 INFO:teuthology.run_tasks:Running task console_log... 2022-01-24T06:11:51.363 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4b23fd3d08>, signals=[15]) 2022-01-24T06:11:51.364 INFO:teuthology.run_tasks:Running task internal.connect... 2022-01-24T06:11:51.375 INFO:teuthology.task.internal:Opening connections... 2022-01-24T06:11:51.376 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2022-01-24T06:11:51.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:11:51.447 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2022-01-24T06:11:51.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:11:51.518 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2022-01-24T06:11:51.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:11:51.588 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-01-24T06:11:51.601 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2022-01-24T06:11:51.617 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2022-01-24T06:11:51.618 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2022-01-24T06:11:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Linux" 2022-01-24T06:11:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2022-01-24T06:11:51.673 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2022-01-24T06:11:51.673 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2022-01-24T06:11:51.673 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2022-01-24T06:11:51.673 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2022-01-24T06:11:51.673 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-24T06:11:51.674 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2022-01-24T06:11:51.674 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-24T06:11:51.674 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2022-01-24T06:11:51.674 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-24T06:11:51.675 INFO:teuthology.orchestra.run.smithi142.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-24T06:11:51.675 INFO:teuthology.orchestra.run.smithi142.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-24T06:11:51.676 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-01-24T06:11:51.693 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2022-01-24T06:11:51.711 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2022-01-24T06:11:51.712 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2022-01-24T06:11:51.766 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Linux" 2022-01-24T06:11:51.766 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2022-01-24T06:11:51.767 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2022-01-24T06:11:51.767 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2022-01-24T06:11:51.767 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2022-01-24T06:11:51.767 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2022-01-24T06:11:51.768 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-24T06:11:51.768 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2022-01-24T06:11:51.768 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-24T06:11:51.768 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2022-01-24T06:11:51.768 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-24T06:11:51.769 INFO:teuthology.orchestra.run.smithi145.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-24T06:11:51.769 INFO:teuthology.orchestra.run.smithi145.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-24T06:11:51.769 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2022-01-24T06:11:51.786 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2022-01-24T06:11:51.802 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2022-01-24T06:11:51.802 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2022-01-24T06:11:51.856 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Linux" 2022-01-24T06:11:51.857 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8" 2022-01-24T06:11:51.857 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2022-01-24T06:11:51.857 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2022-01-24T06:11:51.857 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2022-01-24T06:11:51.858 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2022-01-24T06:11:51.858 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-24T06:11:51.858 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2022-01-24T06:11:51.858 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-24T06:11:51.859 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2022-01-24T06:11:51.859 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-24T06:11:51.859 INFO:teuthology.orchestra.run.smithi164.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-24T06:11:51.859 INFO:teuthology.orchestra.run.smithi164.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-24T06:11:51.860 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2022-01-24T06:11:51.877 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-01-24T06:11:51.893 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-01-24T06:11:51.915 INFO:teuthology.task.internal:Checking for old test directory... 2022-01-24T06:11:51.916 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2022-01-24T06:11:51.919 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2022-01-24T06:11:51.921 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2022-01-24T06:11:51.935 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-01-24T06:11:51.946 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-01-24T06:11:51.947 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2022-01-24T06:11:51.973 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2022-01-24T06:11:51.976 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2022-01-24T06:11:52.023 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-01-24T06:11:52.100 INFO:teuthology.run_tasks:Running task kernel... 2022-01-24T06:11:52.118 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2022-01-24T06:11:52.118 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2022-01-24T06:11:52.119 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2022-01-24T06:11:52.119 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-01-24T06:11:52.172 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS 2022-01-24T06:11:52.173 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:11:52.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2022-01-24T06:11:52.467 DEBUG:teuthology.task.kernel:sha1 for client.0 is b6c65ca4359ba439fa2b2b0f0866c97688fa3a89 2022-01-24T06:11:52.468 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b6c65ca4359ba439fa2b2b0f0866c97688fa3a89"... 2022-01-24T06:11:52.468 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2022-01-24T06:11:52.483 INFO:teuthology.orchestra.run.smithi164.stdout:4.18.0-305.10.2.el8_4.x86_64 2022-01-24T06:11:52.483 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.10.2.el8_4.x86_64 vs b6c65ca4359ba439fa2b2b0f0866c97688fa3a89 2022-01-24T06:11:52.484 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2022-01-24T06:11:52.484 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum upgrade -y linux-firmware 2022-01-24T06:11:54.818 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - AppStream 27 MB/s | 8.4 MB 00:00 2022-01-24T06:11:56.276 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - Base 31 MB/s | 4.6 MB 00:00 2022-01-24T06:11:56.993 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - Extras 146 kB/s | 10 kB 00:00 2022-01-24T06:22:33.483 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Linux 8 - AppStream 14 kB/s | 8.4 MB 10:36 2022-01-24T06:22:35.333 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Linux 8 - BaseOS 9.8 MB/s | 4.6 MB 00:00 2022-01-24T06:22:36.419 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Linux 8 - Extras 24 kB/s | 10 kB 00:00 2022-01-24T06:22:36.580 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - PowerTools 23 MB/s | 2.3 MB 00:00 2022-01-24T06:22:39.626 INFO:teuthology.orchestra.run.smithi164.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2022-01-24T06:22:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 13 MB/s | 11 MB 00:00 2022-01-24T06:22:42.923 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2022-01-24T06:22:45.162 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2022-01-24T06:22:45.163 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2022-01-24T06:22:45.163 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2022-01-24T06:22:45.164 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2022-01-24T06:22:45.164 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2022-01-24T06:22:45.164 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware noarch 20210702-103.gitd79c2677.el8 CentOS-Base 161 M 2022-01-24T06:22:45.164 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:22:45.164 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2022-01-24T06:22:45.165 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2022-01-24T06:22:45.165 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 1 Package 2022-01-24T06:22:45.165 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:22:45.165 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 161 M 2022-01-24T06:22:45.166 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2022-01-24T06:22:48.076 INFO:teuthology.orchestra.run.smithi164.stdout:linux-firmware-20210702-103.gitd79c2677.el8.noa 55 MB/s | 161 MB 00:02 2022-01-24T06:22:48.077 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2022-01-24T06:22:48.078 INFO:teuthology.orchestra.run.smithi164.stdout:Total 55 MB/s | 161 MB 00:02 2022-01-24T06:22:48.082 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2022-01-24T06:22:48.171 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2022-01-24T06:22:48.171 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2022-01-24T06:22:49.541 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2022-01-24T06:22:49.566 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2022-01-24T06:23:02.258 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2022-01-24T06:23:02.581 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : linux-firmware-20210702-103.gitd79c2677.el8.noarch 1/2 2022-01-24T06:23:02.798 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : linux-firmware-20200619-99.git3890db36.el8.noarch 2/2 2022-01-24T06:23:03.022 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: linux-firmware-20200619-99.git3890db36.el8.noarch 2/2 2022-01-24T06:23:03.023 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20210702-103.gitd79c2677.el8.noarch 1/2 2022-01-24T06:23:03.432 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20200619-99.git3890db36.el8.noarch 2/2 2022-01-24T06:23:03.432 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:23:03.432 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2022-01-24T06:23:03.432 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware-20210702-103.gitd79c2677.el8.noarch 2022-01-24T06:23:03.433 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:23:03.433 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2022-01-24T06:23:03.508 INFO:teuthology.task.kernel:Downloading kernel b6c65ca4359ba439fa2b2b0f0866c97688fa3a89 on client.0... 2022-01-24T06:23:03.509 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-01-24T06:23:03.589 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS 2022-01-24T06:23:03.591 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:23:03.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b6c65ca4359ba439fa2b2b0f0866c97688fa3a89 2022-01-24T06:23:03.813 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b6c65ca4359ba439fa2b2b0f0866c97688fa3a89/centos/8/flavors/default/x86_64/ 2022-01-24T06:23:03.813 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.16.0_ceph_gb6c65ca4359b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/b6c65ca4359ba439fa2b2b0f0866c97688fa3a89/centos/8/flavors/default/x86_64/ --input-file=- 2022-01-24T06:23:03.816 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi164.front.sepia.ceph.com to complete... 2022-01-24T06:23:21.631 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24 06:23:21 URL:https://2.chacra.ceph.com/r/kernel/testing/b6c65ca4359ba439fa2b2b0f0866c97688fa3a89/centos/8/flavors/default/x86_64/kernel-5.16.0_ceph_gb6c65ca4359b-1.x86_64.rpm [527345724/527345724] -> "/tmp/kernel.x86_64.rpm" [1] 2022-01-24T06:23:21.632 INFO:teuthology.orchestra.run.smithi164.stderr:FINISHED --2022-01-24 06:23:21-- 2022-01-24T06:23:21.632 INFO:teuthology.orchestra.run.smithi164.stderr:Total wall clock time: 18s 2022-01-24T06:23:21.633 INFO:teuthology.orchestra.run.smithi164.stderr:Downloaded: 1 files, 503M in 17s (28.8 MB/s) 2022-01-24T06:23:21.634 INFO:teuthology.task.kernel:Installing kernel b6c65ca4359ba439fa2b2b0f0866c97688fa3a89 on client.0... 2022-01-24T06:23:21.635 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2022-01-24T06:23:23.726 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying... ######################################## 2022-01-24T06:23:23.973 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing... ######################################## 2022-01-24T06:23:24.042 INFO:teuthology.orchestra.run.smithi164.stdout:Updating / installing... 2022-01-24T06:24:03.813 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.16.0_ceph_gb6c65ca4359b-1 ######################################## 2022-01-24T06:24:24.206 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2022-01-24T06:24:24.207 DEBUG:teuthology.orchestra.run.smithi164:> rpm -qlp /tmp/kernel.x86_64.rpm 2022-01-24T06:24:24.264 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/System.map-5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.264 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/config-5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.264 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/vmlinux-5.16.0-ceph-gb6c65ca4359b.bz2 2022-01-24T06:24:24.265 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/vmlinuz-5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.265 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.265 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel 2022-01-24T06:24:24.265 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch 2022-01-24T06:24:24.266 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86 2022-01-24T06:24:24.266 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto 2022-01-24T06:24:24.266 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2022-01-24T06:24:24.266 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2022-01-24T06:24:24.266 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2022-01-24T06:24:24.267 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/camellia-x86_64.ko 2022-01-24T06:24:24.267 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2022-01-24T06:24:24.267 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2022-01-24T06:24:24.267 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/crc32-pclmul.ko 2022-01-24T06:24:24.267 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/crc32c-intel.ko 2022-01-24T06:24:24.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2022-01-24T06:24:24.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2022-01-24T06:24:24.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2022-01-24T06:24:24.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2022-01-24T06:24:24.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/serpent-avx2.ko 2022-01-24T06:24:24.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2022-01-24T06:24:24.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/sha1-ssse3.ko 2022-01-24T06:24:24.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/sha256-ssse3.ko 2022-01-24T06:24:24.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/sha512-ssse3.ko 2022-01-24T06:24:24.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2022-01-24T06:24:24.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2022-01-24T06:24:24.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/crypto/twofish-x86_64.ko 2022-01-24T06:24:24.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kernel 2022-01-24T06:24:24.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kernel/cpu 2022-01-24T06:24:24.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kernel/cpu/mce 2022-01-24T06:24:24.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2022-01-24T06:24:24.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kvm 2022-01-24T06:24:24.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kvm/kvm-amd.ko 2022-01-24T06:24:24.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kvm/kvm-intel.ko 2022-01-24T06:24:24.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/arch/x86/kvm/kvm.ko 2022-01-24T06:24:24.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto 2022-01-24T06:24:24.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/ansi_cprng.ko 2022-01-24T06:24:24.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/anubis.ko 2022-01-24T06:24:24.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/arc4.ko 2022-01-24T06:24:24.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/async_tx 2022-01-24T06:24:24.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/async_tx/async_memcpy.ko 2022-01-24T06:24:24.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/async_tx/async_pq.ko 2022-01-24T06:24:24.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/async_tx/async_raid6_recov.ko 2022-01-24T06:24:24.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/async_tx/async_tx.ko 2022-01-24T06:24:24.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/async_tx/async_xor.ko 2022-01-24T06:24:24.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/async_tx/raid6test.ko 2022-01-24T06:24:24.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/authenc.ko 2022-01-24T06:24:24.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/authencesn.ko 2022-01-24T06:24:24.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/blake2b_generic.ko 2022-01-24T06:24:24.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/blowfish_common.ko 2022-01-24T06:24:24.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/blowfish_generic.ko 2022-01-24T06:24:24.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/camellia_generic.ko 2022-01-24T06:24:24.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/cast5_generic.ko 2022-01-24T06:24:24.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/cast6_generic.ko 2022-01-24T06:24:24.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/cast_common.ko 2022-01-24T06:24:24.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/ccm.ko 2022-01-24T06:24:24.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/cmac.ko 2022-01-24T06:24:24.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/crc32_generic.ko 2022-01-24T06:24:24.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/crypto_engine.ko 2022-01-24T06:24:24.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/crypto_user.ko 2022-01-24T06:24:24.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/cts.ko 2022-01-24T06:24:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/des_generic.ko 2022-01-24T06:24:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/dh_generic.ko 2022-01-24T06:24:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/echainiv.ko 2022-01-24T06:24:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/essiv.ko 2022-01-24T06:24:24.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/fcrypt.ko 2022-01-24T06:24:24.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/khazad.ko 2022-01-24T06:24:24.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/lz4.ko 2022-01-24T06:24:24.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/lz4hc.ko 2022-01-24T06:24:24.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/md4.ko 2022-01-24T06:24:24.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/michael_mic.ko 2022-01-24T06:24:24.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/pcbc.ko 2022-01-24T06:24:24.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/pcrypt.ko 2022-01-24T06:24:24.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/rmd160.ko 2022-01-24T06:24:24.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/seed.ko 2022-01-24T06:24:24.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/serpent_generic.ko 2022-01-24T06:24:24.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/tcrypt.ko 2022-01-24T06:24:24.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/tea.ko 2022-01-24T06:24:24.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/twofish_common.ko 2022-01-24T06:24:24.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/twofish_generic.ko 2022-01-24T06:24:24.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/vmac.ko 2022-01-24T06:24:24.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/wp512.ko 2022-01-24T06:24:24.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/xcbc.ko 2022-01-24T06:24:24.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/xor.ko 2022-01-24T06:24:24.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/crypto/xxhash_generic.ko 2022-01-24T06:24:24.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers 2022-01-24T06:24:24.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi 2022-01-24T06:24:24.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/acpi_ipmi.ko 2022-01-24T06:24:24.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/acpi_pad.ko 2022-01-24T06:24:24.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/custom_method.ko 2022-01-24T06:24:24.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/ec_sys.ko 2022-01-24T06:24:24.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/platform_profile.ko 2022-01-24T06:24:24.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/sbs.ko 2022-01-24T06:24:24.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/sbshc.ko 2022-01-24T06:24:24.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/acpi/video.ko 2022-01-24T06:24:24.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata 2022-01-24T06:24:24.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/acard-ahci.ko 2022-01-24T06:24:24.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/ahci_platform.ko 2022-01-24T06:24:24.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/ata_generic.ko 2022-01-24T06:24:24.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/libahci_platform.ko 2022-01-24T06:24:24.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_acpi.ko 2022-01-24T06:24:24.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_ali.ko 2022-01-24T06:24:24.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_amd.ko 2022-01-24T06:24:24.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_artop.ko 2022-01-24T06:24:24.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_atiixp.ko 2022-01-24T06:24:24.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_atp867x.ko 2022-01-24T06:24:24.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_cmd640.ko 2022-01-24T06:24:24.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_cmd64x.ko 2022-01-24T06:24:24.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_cypress.ko 2022-01-24T06:24:24.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_efar.ko 2022-01-24T06:24:24.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_hpt366.ko 2022-01-24T06:24:24.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_hpt37x.ko 2022-01-24T06:24:24.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_hpt3x2n.ko 2022-01-24T06:24:24.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_hpt3x3.ko 2022-01-24T06:24:24.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_it8213.ko 2022-01-24T06:24:24.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_it821x.ko 2022-01-24T06:24:24.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_jmicron.ko 2022-01-24T06:24:24.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_marvell.ko 2022-01-24T06:24:24.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_mpiix.ko 2022-01-24T06:24:24.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_netcell.ko 2022-01-24T06:24:24.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_ninja32.ko 2022-01-24T06:24:24.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_ns87410.ko 2022-01-24T06:24:24.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_ns87415.ko 2022-01-24T06:24:24.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_oldpiix.ko 2022-01-24T06:24:24.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_opti.ko 2022-01-24T06:24:24.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_optidma.ko 2022-01-24T06:24:24.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_pcmcia.ko 2022-01-24T06:24:24.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_pdc2027x.ko 2022-01-24T06:24:24.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_pdc202xx_old.ko 2022-01-24T06:24:24.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_piccolo.ko 2022-01-24T06:24:24.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_rdc.ko 2022-01-24T06:24:24.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_sch.ko 2022-01-24T06:24:24.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_serverworks.ko 2022-01-24T06:24:24.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_sil680.ko 2022-01-24T06:24:24.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_sis.ko 2022-01-24T06:24:24.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_sl82c105.ko 2022-01-24T06:24:24.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_triflex.ko 2022-01-24T06:24:24.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pata_via.ko 2022-01-24T06:24:24.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/pdc_adma.ko 2022-01-24T06:24:24.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_inic162x.ko 2022-01-24T06:24:24.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_mv.ko 2022-01-24T06:24:24.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_nv.ko 2022-01-24T06:24:24.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_promise.ko 2022-01-24T06:24:24.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_qstor.ko 2022-01-24T06:24:24.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_sil.ko 2022-01-24T06:24:24.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_sil24.ko 2022-01-24T06:24:24.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_sis.ko 2022-01-24T06:24:24.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_svw.ko 2022-01-24T06:24:24.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_sx4.ko 2022-01-24T06:24:24.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_uli.ko 2022-01-24T06:24:24.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_via.ko 2022-01-24T06:24:24.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ata/sata_vsc.ko 2022-01-24T06:24:24.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/auxdisplay 2022-01-24T06:24:24.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/auxdisplay/ks0108.ko 2022-01-24T06:24:24.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/base 2022-01-24T06:24:24.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/base/regmap 2022-01-24T06:24:24.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/base/regmap/regmap-i2c.ko 2022-01-24T06:24:24.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/bcma 2022-01-24T06:24:24.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/bcma/bcma.ko 2022-01-24T06:24:24.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block 2022-01-24T06:24:24.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/aoe 2022-01-24T06:24:24.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/aoe/aoe.ko 2022-01-24T06:24:24.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/brd.ko 2022-01-24T06:24:24.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/drbd 2022-01-24T06:24:24.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/drbd/drbd.ko 2022-01-24T06:24:24.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/floppy.ko 2022-01-24T06:24:24.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/loop.ko 2022-01-24T06:24:24.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/mtip32xx 2022-01-24T06:24:24.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2022-01-24T06:24:24.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/nbd.ko 2022-01-24T06:24:24.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/null_blk 2022-01-24T06:24:24.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/null_blk/null_blk.ko 2022-01-24T06:24:24.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/pktcdvd.ko 2022-01-24T06:24:24.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/rbd.ko 2022-01-24T06:24:24.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/sx8.ko 2022-01-24T06:24:24.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/virtio_blk.ko 2022-01-24T06:24:24.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/xen-blkback 2022-01-24T06:24:24.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2022-01-24T06:24:24.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/xen-blkfront.ko 2022-01-24T06:24:24.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/zram 2022-01-24T06:24:24.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/block/zram/zram.ko 2022-01-24T06:24:24.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char 2022-01-24T06:24:24.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/hangcheck-timer.ko 2022-01-24T06:24:24.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/hw_random 2022-01-24T06:24:24.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/hw_random/amd-rng.ko 2022-01-24T06:24:24.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/hw_random/intel-rng.ko 2022-01-24T06:24:24.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2022-01-24T06:24:24.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/hw_random/via-rng.ko 2022-01-24T06:24:24.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/hw_random/virtio-rng.ko 2022-01-24T06:24:24.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ipmi 2022-01-24T06:24:24.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2022-01-24T06:24:24.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2022-01-24T06:24:24.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2022-01-24T06:24:24.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ipmi/ipmi_si.ko 2022-01-24T06:24:24.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2022-01-24T06:24:24.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2022-01-24T06:24:24.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/lp.ko 2022-01-24T06:24:24.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/mwave 2022-01-24T06:24:24.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/mwave/mwave.ko 2022-01-24T06:24:24.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/pcmcia 2022-01-24T06:24:24.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/pcmcia/cm4000_cs.ko 2022-01-24T06:24:24.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/pcmcia/cm4040_cs.ko 2022-01-24T06:24:24.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/ppdev.ko 2022-01-24T06:24:24.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tlclk.ko 2022-01-24T06:24:24.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tpm 2022-01-24T06:24:24.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tpm/tpm.ko 2022-01-24T06:24:24.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tpm/tpm_atmel.ko 2022-01-24T06:24:24.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tpm/tpm_infineon.ko 2022-01-24T06:24:24.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tpm/tpm_nsc.ko 2022-01-24T06:24:24.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tpm/tpm_tis.ko 2022-01-24T06:24:24.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/tpm/tpm_tis_core.ko 2022-01-24T06:24:24.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/uv_mmtimer.ko 2022-01-24T06:24:24.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/char/virtio_console.ko 2022-01-24T06:24:24.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/cpufreq 2022-01-24T06:24:24.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2022-01-24T06:24:24.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2022-01-24T06:24:24.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/cpufreq/p4-clockmod.ko 2022-01-24T06:24:24.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2022-01-24T06:24:24.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/cpufreq/powernow-k8.ko 2022-01-24T06:24:24.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/cpufreq/speedstep-lib.ko 2022-01-24T06:24:24.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto 2022-01-24T06:24:24.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/ccp 2022-01-24T06:24:24.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2022-01-24T06:24:24.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/ccp/ccp.ko 2022-01-24T06:24:24.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/padlock-aes.ko 2022-01-24T06:24:24.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/padlock-sha.ko 2022-01-24T06:24:24.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/qat 2022-01-24T06:24:24.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/qat/qat_common 2022-01-24T06:24:24.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2022-01-24T06:24:24.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/qat/qat_dh895xcc 2022-01-24T06:24:24.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2022-01-24T06:24:24.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/virtio 2022-01-24T06:24:24.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2022-01-24T06:24:24.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/dca 2022-01-24T06:24:24.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/dca/dca.ko 2022-01-24T06:24:24.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/devfreq 2022-01-24T06:24:24.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/devfreq/governor_simpleondemand.ko 2022-01-24T06:24:24.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/dma 2022-01-24T06:24:24.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/dma/dw 2022-01-24T06:24:24.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/dma/dw/dw_dmac.ko 2022-01-24T06:24:24.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/dma/ioat 2022-01-24T06:24:24.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/dma/ioat/ioatdma.ko 2022-01-24T06:24:24.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac 2022-01-24T06:24:24.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/amd64_edac.ko 2022-01-24T06:24:24.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/e752x_edac.ko 2022-01-24T06:24:24.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/edac_mce_amd.ko 2022-01-24T06:24:24.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i3000_edac.ko 2022-01-24T06:24:24.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i3200_edac.ko 2022-01-24T06:24:24.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i5000_edac.ko 2022-01-24T06:24:24.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i5100_edac.ko 2022-01-24T06:24:24.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i5400_edac.ko 2022-01-24T06:24:24.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i7300_edac.ko 2022-01-24T06:24:24.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i7core_edac.ko 2022-01-24T06:24:24.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/i82975x_edac.ko 2022-01-24T06:24:24.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/ie31200_edac.ko 2022-01-24T06:24:24.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/sb_edac.ko 2022-01-24T06:24:24.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/edac/x38_edac.ko 2022-01-24T06:24:24.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/firmware 2022-01-24T06:24:24.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/firmware/edd.ko 2022-01-24T06:24:24.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/firmware/iscsi_ibft.ko 2022-01-24T06:24:24.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/gpio 2022-01-24T06:24:24.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/gpio/gpio-ich.ko 2022-01-24T06:24:24.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/gpio/gpio-viperboard.ko 2022-01-24T06:24:24.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid 2022-01-24T06:24:24.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-appleir.ko 2022-01-24T06:24:24.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-aureal.ko 2022-01-24T06:24:24.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-axff.ko 2022-01-24T06:24:24.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-dr.ko 2022-01-24T06:24:24.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-elecom.ko 2022-01-24T06:24:24.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-elo.ko 2022-01-24T06:24:24.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-emsff.ko 2022-01-24T06:24:24.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-gaff.ko 2022-01-24T06:24:24.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-gt683r.ko 2022-01-24T06:24:24.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-gyration.ko 2022-01-24T06:24:24.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-holtek-kbd.ko 2022-01-24T06:24:24.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-holtek-mouse.ko 2022-01-24T06:24:24.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-holtekff.ko 2022-01-24T06:24:24.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-hyperv.ko 2022-01-24T06:24:24.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-icade.ko 2022-01-24T06:24:24.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-keytouch.ko 2022-01-24T06:24:24.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-kye.ko 2022-01-24T06:24:24.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-lcpower.ko 2022-01-24T06:24:24.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-led.ko 2022-01-24T06:24:24.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-lenovo.ko 2022-01-24T06:24:24.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-logitech-dj.ko 2022-01-24T06:24:24.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-logitech-hidpp.ko 2022-01-24T06:24:24.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-multitouch.ko 2022-01-24T06:24:24.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-ortek.ko 2022-01-24T06:24:24.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-penmount.ko 2022-01-24T06:24:24.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-petalynx.ko 2022-01-24T06:24:24.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-picolcd.ko 2022-01-24T06:24:24.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-pl.ko 2022-01-24T06:24:24.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-plantronics.ko 2022-01-24T06:24:24.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-primax.ko 2022-01-24T06:24:24.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-rmi.ko 2022-01-24T06:24:24.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-arvo.ko 2022-01-24T06:24:24.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-common.ko 2022-01-24T06:24:24.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-isku.ko 2022-01-24T06:24:24.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-kone.ko 2022-01-24T06:24:24.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-koneplus.ko 2022-01-24T06:24:24.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-konepure.ko 2022-01-24T06:24:24.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2022-01-24T06:24:24.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-lua.ko 2022-01-24T06:24:24.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-pyra.ko 2022-01-24T06:24:24.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-ryos.ko 2022-01-24T06:24:24.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat-savu.ko 2022-01-24T06:24:24.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-roccat.ko 2022-01-24T06:24:24.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-saitek.ko 2022-01-24T06:24:24.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-samsung.ko 2022-01-24T06:24:24.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-sensor-hub.ko 2022-01-24T06:24:24.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-sjoy.ko 2022-01-24T06:24:24.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-sony.ko 2022-01-24T06:24:24.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-speedlink.ko 2022-01-24T06:24:24.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-steelseries.ko 2022-01-24T06:24:24.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-sunplus.ko 2022-01-24T06:24:24.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-thrustmaster.ko 2022-01-24T06:24:24.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-tivo.ko 2022-01-24T06:24:24.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-tmff.ko 2022-01-24T06:24:24.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-topseed.ko 2022-01-24T06:24:24.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-twinhan.ko 2022-01-24T06:24:24.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-uclogic.ko 2022-01-24T06:24:24.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-waltop.ko 2022-01-24T06:24:24.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-wiimote.ko 2022-01-24T06:24:24.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-xinmo.ko 2022-01-24T06:24:24.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-zpff.ko 2022-01-24T06:24:24.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/hid-zydacron.ko 2022-01-24T06:24:24.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/uhid.ko 2022-01-24T06:24:24.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hid/wacom.ko 2022-01-24T06:24:24.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hv 2022-01-24T06:24:24.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hv/hv_balloon.ko 2022-01-24T06:24:24.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hv/hv_utils.ko 2022-01-24T06:24:24.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hv/hv_vmbus.ko 2022-01-24T06:24:24.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon 2022-01-24T06:24:24.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/abituguru.ko 2022-01-24T06:24:24.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/abituguru3.ko 2022-01-24T06:24:24.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/acpi_power_meter.ko 2022-01-24T06:24:24.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ad7414.ko 2022-01-24T06:24:24.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ad7418.ko 2022-01-24T06:24:24.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adc128d818.ko 2022-01-24T06:24:24.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adm1021.ko 2022-01-24T06:24:24.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adm1025.ko 2022-01-24T06:24:24.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adm1026.ko 2022-01-24T06:24:24.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adm1029.ko 2022-01-24T06:24:24.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adm1031.ko 2022-01-24T06:24:24.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adm9240.ko 2022-01-24T06:24:24.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ads7828.ko 2022-01-24T06:24:24.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adt7410.ko 2022-01-24T06:24:24.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adt7411.ko 2022-01-24T06:24:24.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adt7462.ko 2022-01-24T06:24:24.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adt7470.ko 2022-01-24T06:24:24.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adt7475.ko 2022-01-24T06:24:24.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/adt7x10.ko 2022-01-24T06:24:24.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/amc6821.ko 2022-01-24T06:24:24.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/applesmc.ko 2022-01-24T06:24:24.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/asb100.ko 2022-01-24T06:24:24.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/asc7621.ko 2022-01-24T06:24:24.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/asus_atk0110.ko 2022-01-24T06:24:24.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/atxp1.ko 2022-01-24T06:24:24.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/coretemp.ko 2022-01-24T06:24:24.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2022-01-24T06:24:24.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/dme1737.ko 2022-01-24T06:24:24.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ds1621.ko 2022-01-24T06:24:24.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ds620.ko 2022-01-24T06:24:24.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/emc1403.ko 2022-01-24T06:24:24.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/emc6w201.ko 2022-01-24T06:24:24.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/f71805f.ko 2022-01-24T06:24:24.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/f71882fg.ko 2022-01-24T06:24:24.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/f75375s.ko 2022-01-24T06:24:24.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/fam15h_power.ko 2022-01-24T06:24:24.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/fschmd.ko 2022-01-24T06:24:24.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/g760a.ko 2022-01-24T06:24:24.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/g762.ko 2022-01-24T06:24:24.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/gl518sm.ko 2022-01-24T06:24:24.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/gl520sm.ko 2022-01-24T06:24:24.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/hwmon-vid.ko 2022-01-24T06:24:24.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/i5500_temp.ko 2022-01-24T06:24:24.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/i5k_amb.ko 2022-01-24T06:24:24.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ibmaem.ko 2022-01-24T06:24:24.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ibmpex.ko 2022-01-24T06:24:24.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ina209.ko 2022-01-24T06:24:24.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ina2xx.ko 2022-01-24T06:24:24.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/it87.ko 2022-01-24T06:24:24.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/k10temp.ko 2022-01-24T06:24:24.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/k8temp.ko 2022-01-24T06:24:24.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lineage-pem.ko 2022-01-24T06:24:24.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm63.ko 2022-01-24T06:24:24.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm73.ko 2022-01-24T06:24:24.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm75.ko 2022-01-24T06:24:24.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm77.ko 2022-01-24T06:24:24.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm78.ko 2022-01-24T06:24:24.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm80.ko 2022-01-24T06:24:24.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm83.ko 2022-01-24T06:24:24.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm85.ko 2022-01-24T06:24:24.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm87.ko 2022-01-24T06:24:24.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm90.ko 2022-01-24T06:24:24.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm92.ko 2022-01-24T06:24:24.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm93.ko 2022-01-24T06:24:24.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm95234.ko 2022-01-24T06:24:24.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm95241.ko 2022-01-24T06:24:24.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/lm95245.ko 2022-01-24T06:24:24.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ltc2945.ko 2022-01-24T06:24:24.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ltc4151.ko 2022-01-24T06:24:24.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ltc4215.ko 2022-01-24T06:24:24.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ltc4222.ko 2022-01-24T06:24:24.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ltc4245.ko 2022-01-24T06:24:24.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ltc4260.ko 2022-01-24T06:24:24.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ltc4261.ko 2022-01-24T06:24:24.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max16065.ko 2022-01-24T06:24:24.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max1619.ko 2022-01-24T06:24:24.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max1668.ko 2022-01-24T06:24:24.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max197.ko 2022-01-24T06:24:24.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max6639.ko 2022-01-24T06:24:24.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max6642.ko 2022-01-24T06:24:24.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max6650.ko 2022-01-24T06:24:24.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/max6697.ko 2022-01-24T06:24:24.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/mcp3021.ko 2022-01-24T06:24:24.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/nct6683.ko 2022-01-24T06:24:24.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/nct6775.ko 2022-01-24T06:24:24.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/nct7802.ko 2022-01-24T06:24:24.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/ntc_thermistor.ko 2022-01-24T06:24:24.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pc87360.ko 2022-01-24T06:24:24.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pc87427.ko 2022-01-24T06:24:24.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pcf8591.ko 2022-01-24T06:24:24.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus 2022-01-24T06:24:24.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/adm1275.ko 2022-01-24T06:24:24.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/lm25066.ko 2022-01-24T06:24:24.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2022-01-24T06:24:24.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/max16064.ko 2022-01-24T06:24:24.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/max34440.ko 2022-01-24T06:24:24.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/max8688.ko 2022-01-24T06:24:24.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/pmbus.ko 2022-01-24T06:24:24.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2022-01-24T06:24:24.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/tps40422.ko 2022-01-24T06:24:24.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2022-01-24T06:24:24.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2022-01-24T06:24:24.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/pmbus/zl6100.ko 2022-01-24T06:24:24.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/powr1220.ko 2022-01-24T06:24:24.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/sch5627.ko 2022-01-24T06:24:24.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/sch5636.ko 2022-01-24T06:24:24.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/sch56xx-common.ko 2022-01-24T06:24:24.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/sht15.ko 2022-01-24T06:24:24.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/sht21.ko 2022-01-24T06:24:24.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/shtc1.ko 2022-01-24T06:24:24.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/sis5595.ko 2022-01-24T06:24:24.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/smsc47b397.ko 2022-01-24T06:24:24.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/smsc47m1.ko 2022-01-24T06:24:24.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/smsc47m192.ko 2022-01-24T06:24:24.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/thmc50.ko 2022-01-24T06:24:24.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/tmp102.ko 2022-01-24T06:24:24.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/tmp103.ko 2022-01-24T06:24:24.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/tmp401.ko 2022-01-24T06:24:24.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/tmp421.ko 2022-01-24T06:24:24.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/via-cputemp.ko 2022-01-24T06:24:24.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/via686a.ko 2022-01-24T06:24:24.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/vt1211.ko 2022-01-24T06:24:24.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/vt8231.ko 2022-01-24T06:24:24.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83627ehf.ko 2022-01-24T06:24:24.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83627hf.ko 2022-01-24T06:24:24.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83781d.ko 2022-01-24T06:24:24.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83791d.ko 2022-01-24T06:24:24.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83792d.ko 2022-01-24T06:24:24.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83793.ko 2022-01-24T06:24:24.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83795.ko 2022-01-24T06:24:24.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83l785ts.ko 2022-01-24T06:24:24.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/hwmon/w83l786ng.ko 2022-01-24T06:24:24.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c 2022-01-24T06:24:24.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/algos 2022-01-24T06:24:24.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2022-01-24T06:24:24.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2022-01-24T06:24:24.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses 2022-01-24T06:24:24.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2022-01-24T06:24:24.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-amd756.ko 2022-01-24T06:24:24.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2022-01-24T06:24:24.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2022-01-24T06:24:24.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2022-01-24T06:24:24.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2022-01-24T06:24:24.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2022-01-24T06:24:24.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-i801.ko 2022-01-24T06:24:24.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-isch.ko 2022-01-24T06:24:24.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-ismt.ko 2022-01-24T06:24:24.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2022-01-24T06:24:24.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2022-01-24T06:24:24.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-parport.ko 2022-01-24T06:24:24.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2022-01-24T06:24:24.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-piix4.ko 2022-01-24T06:24:24.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-scmi.ko 2022-01-24T06:24:24.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-simtec.ko 2022-01-24T06:24:24.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2022-01-24T06:24:24.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2022-01-24T06:24:24.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-via.ko 2022-01-24T06:24:24.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-viapro.ko 2022-01-24T06:24:24.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2022-01-24T06:24:24.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/i2c-dev.ko 2022-01-24T06:24:24.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/i2c-mux.ko 2022-01-24T06:24:24.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2022-01-24T06:24:24.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/i2c-smbus.ko 2022-01-24T06:24:24.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/i2c/i2c-stub.ko 2022-01-24T06:24:24.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband 2022-01-24T06:24:24.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core 2022-01-24T06:24:24.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core/ib_cm.ko 2022-01-24T06:24:24.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core/ib_core.ko 2022-01-24T06:24:24.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core/ib_umad.ko 2022-01-24T06:24:24.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core/ib_uverbs.ko 2022-01-24T06:24:24.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core/iw_cm.ko 2022-01-24T06:24:24.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core/rdma_cm.ko 2022-01-24T06:24:24.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/core/rdma_ucm.ko 2022-01-24T06:24:24.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw 2022-01-24T06:24:24.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/cxgb4 2022-01-24T06:24:24.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2022-01-24T06:24:24.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/mlx4 2022-01-24T06:24:24.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2022-01-24T06:24:24.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/mlx5 2022-01-24T06:24:24.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2022-01-24T06:24:24.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/mthca 2022-01-24T06:24:24.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2022-01-24T06:24:24.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp 2022-01-24T06:24:24.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/ipoib 2022-01-24T06:24:24.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2022-01-24T06:24:24.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/iser 2022-01-24T06:24:24.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2022-01-24T06:24:24.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/isert 2022-01-24T06:24:24.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2022-01-24T06:24:24.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/srp 2022-01-24T06:24:24.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2022-01-24T06:24:24.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/srpt 2022-01-24T06:24:24.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2022-01-24T06:24:24.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input 2022-01-24T06:24:24.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/gameport 2022-01-24T06:24:24.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/gameport/emu10k1-gp.ko 2022-01-24T06:24:24.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/gameport/fm801-gp.ko 2022-01-24T06:24:24.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/gameport/gameport.ko 2022-01-24T06:24:24.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/gameport/lightning.ko 2022-01-24T06:24:24.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/gameport/ns558.ko 2022-01-24T06:24:24.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/joydev.ko 2022-01-24T06:24:24.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/keyboard 2022-01-24T06:24:24.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/keyboard/gpio_keys.ko 2022-01-24T06:24:24.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse 2022-01-24T06:24:24.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/appletouch.ko 2022-01-24T06:24:24.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/bcm5974.ko 2022-01-24T06:24:24.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/cyapatp.ko 2022-01-24T06:24:24.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/elan_i2c.ko 2022-01-24T06:24:24.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/sermouse.ko 2022-01-24T06:24:24.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/synaptics_i2c.ko 2022-01-24T06:24:24.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/synaptics_usb.ko 2022-01-24T06:24:24.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/mouse/vsxxxaa.ko 2022-01-24T06:24:24.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/rmi4 2022-01-24T06:24:24.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/rmi4/rmi_core.ko 2022-01-24T06:24:24.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/serio 2022-01-24T06:24:24.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/serio/altera_ps2.ko 2022-01-24T06:24:24.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/serio/arc_ps2.ko 2022-01-24T06:24:24.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/serio/hyperv-keyboard.ko 2022-01-24T06:24:24.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/serio/serio_raw.ko 2022-01-24T06:24:24.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/input/sparse-keymap.ko 2022-01-24T06:24:24.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/iommu 2022-01-24T06:24:24.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/iommu/amd 2022-01-24T06:24:24.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/iommu/amd/iommu_v2.ko 2022-01-24T06:24:24.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds 2022-01-24T06:24:24.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/leds-blinkm.ko 2022-01-24T06:24:24.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/leds-clevo-mail.ko 2022-01-24T06:24:24.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/leds-lm3530.ko 2022-01-24T06:24:24.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/leds-lp3944.ko 2022-01-24T06:24:24.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/leds-ss4200.ko 2022-01-24T06:24:24.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger 2022-01-24T06:24:24.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2022-01-24T06:24:24.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2022-01-24T06:24:24.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2022-01-24T06:24:24.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2022-01-24T06:24:24.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2022-01-24T06:24:24.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2022-01-24T06:24:24.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2022-01-24T06:24:24.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2022-01-24T06:24:24.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2022-01-24T06:24:24.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md 2022-01-24T06:24:24.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/bcache 2022-01-24T06:24:24.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/bcache/bcache.ko 2022-01-24T06:24:24.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-bio-prison.ko 2022-01-24T06:24:24.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-cache-smq.ko 2022-01-24T06:24:24.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-cache.ko 2022-01-24T06:24:24.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-crypt.ko 2022-01-24T06:24:24.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-delay.ko 2022-01-24T06:24:24.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-flakey.ko 2022-01-24T06:24:24.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-log-userspace.ko 2022-01-24T06:24:24.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-multipath.ko 2022-01-24T06:24:24.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-queue-length.ko 2022-01-24T06:24:24.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-raid.ko 2022-01-24T06:24:24.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-round-robin.ko 2022-01-24T06:24:24.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-service-time.ko 2022-01-24T06:24:24.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-switch.ko 2022-01-24T06:24:24.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-thin-pool.ko 2022-01-24T06:24:24.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/dm-verity.ko 2022-01-24T06:24:24.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/faulty.ko 2022-01-24T06:24:24.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/linear.ko 2022-01-24T06:24:24.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/multipath.ko 2022-01-24T06:24:24.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/persistent-data 2022-01-24T06:24:24.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2022-01-24T06:24:24.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/raid0.ko 2022-01-24T06:24:24.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/raid1.ko 2022-01-24T06:24:24.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/raid10.ko 2022-01-24T06:24:24.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/md/raid456.ko 2022-01-24T06:24:24.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message 2022-01-24T06:24:24.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion 2022-01-24T06:24:24.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion/mptbase.ko 2022-01-24T06:24:24.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion/mptctl.ko 2022-01-24T06:24:24.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion/mptfc.ko 2022-01-24T06:24:24.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion/mptlan.ko 2022-01-24T06:24:24.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion/mptsas.ko 2022-01-24T06:24:24.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion/mptscsih.ko 2022-01-24T06:24:24.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/message/fusion/mptspi.ko 2022-01-24T06:24:24.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd 2022-01-24T06:24:24.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd/lpc_ich.ko 2022-01-24T06:24:24.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd/lpc_sch.ko 2022-01-24T06:24:24.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd/mfd-core.ko 2022-01-24T06:24:24.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd/sm501.ko 2022-01-24T06:24:24.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd/viperboard.ko 2022-01-24T06:24:24.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd/vx855.ko 2022-01-24T06:24:24.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/mfd/wl1273-core.ko 2022-01-24T06:24:24.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc 2022-01-24T06:24:24.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/altera-stapl 2022-01-24T06:24:24.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2022-01-24T06:24:24.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/apds9802als.ko 2022-01-24T06:24:24.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/apds990x.ko 2022-01-24T06:24:24.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/bh1770glc.ko 2022-01-24T06:24:24.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/cb710 2022-01-24T06:24:24.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/cb710/cb710.ko 2022-01-24T06:24:24.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/eeprom 2022-01-24T06:24:24.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/eeprom/at24.ko 2022-01-24T06:24:24.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/eeprom/eeprom.ko 2022-01-24T06:24:24.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2022-01-24T06:24:24.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/eeprom/max6875.ko 2022-01-24T06:24:24.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/enclosure.ko 2022-01-24T06:24:24.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/hpilo.ko 2022-01-24T06:24:24.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/isl29003.ko 2022-01-24T06:24:24.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/isl29020.ko 2022-01-24T06:24:24.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/lis3lv02d 2022-01-24T06:24:24.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2022-01-24T06:24:24.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2022-01-24T06:24:24.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/mei 2022-01-24T06:24:24.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/mei/mei-me.ko 2022-01-24T06:24:24.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/mei/mei-txe.ko 2022-01-24T06:24:24.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/mei/mei.ko 2022-01-24T06:24:24.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/sgi-gru 2022-01-24T06:24:24.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/sgi-gru/gru.ko 2022-01-24T06:24:24.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/sgi-xp 2022-01-24T06:24:24.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/sgi-xp/xp.ko 2022-01-24T06:24:24.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/sgi-xp/xpc.ko 2022-01-24T06:24:24.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/sgi-xp/xpnet.ko 2022-01-24T06:24:24.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/tifm_7xx1.ko 2022-01-24T06:24:24.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/tifm_core.ko 2022-01-24T06:24:24.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/tsl2550.ko 2022-01-24T06:24:24.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/vmw_balloon.ko 2022-01-24T06:24:24.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/vmw_vmci 2022-01-24T06:24:24.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2022-01-24T06:24:24.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net 2022-01-24T06:24:24.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/bonding 2022-01-24T06:24:24.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/bonding/bonding.ko 2022-01-24T06:24:24.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dsa 2022-01-24T06:24:24.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dsa/b53 2022-01-24T06:24:24.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dsa/b53/b53_common.ko 2022-01-24T06:24:24.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dsa/bcm-sf2.ko 2022-01-24T06:24:24.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dsa/mv88e6060.ko 2022-01-24T06:24:24.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dsa/mv88e6xxx 2022-01-24T06:24:24.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2022-01-24T06:24:24.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/dummy.ko 2022-01-24T06:24:24.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/eql.ko 2022-01-24T06:24:24.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet 2022-01-24T06:24:24.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/3com 2022-01-24T06:24:24.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2022-01-24T06:24:24.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2022-01-24T06:24:24.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/3com/3c59x.ko 2022-01-24T06:24:24.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/3com/typhoon.ko 2022-01-24T06:24:24.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/8390 2022-01-24T06:24:24.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/8390/8390.ko 2022-01-24T06:24:24.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2022-01-24T06:24:24.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2022-01-24T06:24:24.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2022-01-24T06:24:24.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/adaptec 2022-01-24T06:24:24.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2022-01-24T06:24:24.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/agere 2022-01-24T06:24:24.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/agere/et131x.ko 2022-01-24T06:24:24.412 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/alteon 2022-01-24T06:24:24.412 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/alteon/acenic.ko 2022-01-24T06:24:24.412 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/altera 2022-01-24T06:24:24.412 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2022-01-24T06:24:24.412 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/amd 2022-01-24T06:24:24.413 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2022-01-24T06:24:24.413 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2022-01-24T06:24:24.413 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2022-01-24T06:24:24.413 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros 2022-01-24T06:24:24.413 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/alx 2022-01-24T06:24:24.414 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2022-01-24T06:24:24.414 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/atl1c 2022-01-24T06:24:24.414 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2022-01-24T06:24:24.414 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/atl1e 2022-01-24T06:24:24.414 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2022-01-24T06:24:24.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/atlx 2022-01-24T06:24:24.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2022-01-24T06:24:24.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2022-01-24T06:24:24.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom 2022-01-24T06:24:24.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/b44.ko 2022-01-24T06:24:24.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2022-01-24T06:24:24.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/bnx2x 2022-01-24T06:24:24.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2022-01-24T06:24:24.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2022-01-24T06:24:24.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/genet 2022-01-24T06:24:24.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2022-01-24T06:24:24.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2022-01-24T06:24:24.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/brocade 2022-01-24T06:24:24.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/brocade/bna 2022-01-24T06:24:24.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2022-01-24T06:24:24.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio 2022-01-24T06:24:24.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb 2022-01-24T06:24:24.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2022-01-24T06:24:24.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb3 2022-01-24T06:24:24.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2022-01-24T06:24:24.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb4 2022-01-24T06:24:24.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2022-01-24T06:24:24.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2022-01-24T06:24:24.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2022-01-24T06:24:24.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/libcxgb 2022-01-24T06:24:24.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2022-01-24T06:24:24.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/cisco 2022-01-24T06:24:24.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/cisco/enic 2022-01-24T06:24:24.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2022-01-24T06:24:24.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec 2022-01-24T06:24:24.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip 2022-01-24T06:24:24.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2022-01-24T06:24:24.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2022-01-24T06:24:24.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2022-01-24T06:24:24.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2022-01-24T06:24:24.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2022-01-24T06:24:24.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2022-01-24T06:24:24.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2022-01-24T06:24:24.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dlink 2022-01-24T06:24:24.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2022-01-24T06:24:24.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dlink/sundance.ko 2022-01-24T06:24:24.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/dnet.ko 2022-01-24T06:24:24.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/emulex 2022-01-24T06:24:24.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/emulex/benet 2022-01-24T06:24:24.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2022-01-24T06:24:24.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/ethoc.ko 2022-01-24T06:24:24.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/fealnx.ko 2022-01-24T06:24:24.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel 2022-01-24T06:24:24.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/e100.ko 2022-01-24T06:24:24.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/e1000 2022-01-24T06:24:24.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2022-01-24T06:24:24.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/e1000e 2022-01-24T06:24:24.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2022-01-24T06:24:24.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/fm10k 2022-01-24T06:24:24.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2022-01-24T06:24:24.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/i40e 2022-01-24T06:24:24.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2022-01-24T06:24:24.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/iavf 2022-01-24T06:24:24.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2022-01-24T06:24:24.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/igb 2022-01-24T06:24:24.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2022-01-24T06:24:24.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/igbvf 2022-01-24T06:24:24.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2022-01-24T06:24:24.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/ixgb 2022-01-24T06:24:24.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2022-01-24T06:24:24.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/ixgbe 2022-01-24T06:24:24.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2022-01-24T06:24:24.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/ixgbevf 2022-01-24T06:24:24.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2022-01-24T06:24:24.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/jme.ko 2022-01-24T06:24:24.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/marvell 2022-01-24T06:24:24.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2022-01-24T06:24:24.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/marvell/skge.ko 2022-01-24T06:24:24.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/marvell/sky2.ko 2022-01-24T06:24:24.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/mellanox 2022-01-24T06:24:24.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/mellanox/mlx4 2022-01-24T06:24:24.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2022-01-24T06:24:24.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2022-01-24T06:24:24.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/mellanox/mlx5 2022-01-24T06:24:24.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2022-01-24T06:24:24.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2022-01-24T06:24:24.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/micrel 2022-01-24T06:24:24.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2022-01-24T06:24:24.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/myricom 2022-01-24T06:24:24.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/myricom/myri10ge 2022-01-24T06:24:24.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2022-01-24T06:24:24.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/natsemi 2022-01-24T06:24:24.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2022-01-24T06:24:24.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2022-01-24T06:24:24.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/neterion 2022-01-24T06:24:24.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/neterion/s2io.ko 2022-01-24T06:24:24.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/neterion/vxge 2022-01-24T06:24:24.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2022-01-24T06:24:24.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/nvidia 2022-01-24T06:24:24.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2022-01-24T06:24:24.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/packetengines 2022-01-24T06:24:24.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2022-01-24T06:24:24.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2022-01-24T06:24:24.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/qlogic 2022-01-24T06:24:24.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/qlogic/netxen 2022-01-24T06:24:24.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2022-01-24T06:24:24.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2022-01-24T06:24:24.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/qlogic/qlcnic 2022-01-24T06:24:24.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2022-01-24T06:24:24.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/rdc 2022-01-24T06:24:24.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/rdc/r6040.ko 2022-01-24T06:24:24.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/realtek 2022-01-24T06:24:24.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2022-01-24T06:24:24.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/realtek/8139too.ko 2022-01-24T06:24:24.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/realtek/atp.ko 2022-01-24T06:24:24.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/realtek/r8169.ko 2022-01-24T06:24:24.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/rocker 2022-01-24T06:24:24.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/rocker/rocker.ko 2022-01-24T06:24:24.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sfc 2022-01-24T06:24:24.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sfc/sfc.ko 2022-01-24T06:24:24.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/silan 2022-01-24T06:24:24.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/silan/sc92031.ko 2022-01-24T06:24:24.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sis 2022-01-24T06:24:24.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sis/sis190.ko 2022-01-24T06:24:24.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sis/sis900.ko 2022-01-24T06:24:24.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/smsc 2022-01-24T06:24:24.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/smsc/epic100.ko 2022-01-24T06:24:24.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2022-01-24T06:24:24.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2022-01-24T06:24:24.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2022-01-24T06:24:24.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/stmicro 2022-01-24T06:24:24.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/stmicro/stmmac 2022-01-24T06:24:24.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2022-01-24T06:24:24.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2022-01-24T06:24:24.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sun 2022-01-24T06:24:24.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sun/cassini.ko 2022-01-24T06:24:24.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sun/niu.ko 2022-01-24T06:24:24.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sun/sungem.ko 2022-01-24T06:24:24.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/sun/sunhme.ko 2022-01-24T06:24:24.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/tehuti 2022-01-24T06:24:24.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2022-01-24T06:24:24.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/ti 2022-01-24T06:24:24.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/ti/tlan.ko 2022-01-24T06:24:24.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/via 2022-01-24T06:24:24.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/via/via-rhine.ko 2022-01-24T06:24:24.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/via/via-velocity.ko 2022-01-24T06:24:24.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/wiznet 2022-01-24T06:24:24.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2022-01-24T06:24:24.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2022-01-24T06:24:24.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/xircom 2022-01-24T06:24:24.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2022-01-24T06:24:24.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/geneve.ko 2022-01-24T06:24:24.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/hyperv 2022-01-24T06:24:24.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/hyperv/hv_netvsc.ko 2022-01-24T06:24:24.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ieee802154 2022-01-24T06:24:24.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ieee802154/fakelb.ko 2022-01-24T06:24:24.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ifb.ko 2022-01-24T06:24:24.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ipvlan 2022-01-24T06:24:24.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ipvlan/ipvlan.ko 2022-01-24T06:24:24.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/macvlan.ko 2022-01-24T06:24:24.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/macvtap.ko 2022-01-24T06:24:24.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/mdio 2022-01-24T06:24:24.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/mdio.ko 2022-01-24T06:24:24.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2022-01-24T06:24:24.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/mdio/mdio-bitbang.ko 2022-01-24T06:24:24.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/mii.ko 2022-01-24T06:24:24.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/net_failover.ko 2022-01-24T06:24:24.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/netconsole.ko 2022-01-24T06:24:24.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/nlmon.ko 2022-01-24T06:24:24.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/pcs 2022-01-24T06:24:24.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/pcs/pcs_xpcs.ko 2022-01-24T06:24:24.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy 2022-01-24T06:24:24.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/amd.ko 2022-01-24T06:24:24.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/bcm-phy-lib.ko 2022-01-24T06:24:24.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/bcm7xxx.ko 2022-01-24T06:24:24.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/bcm87xx.ko 2022-01-24T06:24:24.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/broadcom.ko 2022-01-24T06:24:24.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/cicada.ko 2022-01-24T06:24:24.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/davicom.ko 2022-01-24T06:24:24.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/dp83640.ko 2022-01-24T06:24:24.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/et1011c.ko 2022-01-24T06:24:24.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/icplus.ko 2022-01-24T06:24:24.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/lxt.ko 2022-01-24T06:24:24.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/marvell.ko 2022-01-24T06:24:24.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/micrel.ko 2022-01-24T06:24:24.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/national.ko 2022-01-24T06:24:24.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/phylink.ko 2022-01-24T06:24:24.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/qsemi.ko 2022-01-24T06:24:24.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/realtek.ko 2022-01-24T06:24:24.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/smsc.ko 2022-01-24T06:24:24.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/ste10Xp.ko 2022-01-24T06:24:24.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/phy/vitesse.ko 2022-01-24T06:24:24.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp 2022-01-24T06:24:24.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/bsd_comp.ko 2022-01-24T06:24:24.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/ppp_async.ko 2022-01-24T06:24:24.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/ppp_deflate.ko 2022-01-24T06:24:24.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/ppp_generic.ko 2022-01-24T06:24:24.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/ppp_mppe.ko 2022-01-24T06:24:24.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/ppp_synctty.ko 2022-01-24T06:24:24.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/pppoe.ko 2022-01-24T06:24:24.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/pppox.ko 2022-01-24T06:24:24.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/ppp/pptp.ko 2022-01-24T06:24:24.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/slip 2022-01-24T06:24:24.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/slip/slhc.ko 2022-01-24T06:24:24.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/slip/slip.ko 2022-01-24T06:24:24.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/sungem_phy.ko 2022-01-24T06:24:24.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/tap.ko 2022-01-24T06:24:24.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/team 2022-01-24T06:24:24.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/team/team.ko 2022-01-24T06:24:24.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/team/team_mode_activebackup.ko 2022-01-24T06:24:24.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/team/team_mode_broadcast.ko 2022-01-24T06:24:24.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/team/team_mode_loadbalance.ko 2022-01-24T06:24:24.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/team/team_mode_random.ko 2022-01-24T06:24:24.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/team/team_mode_roundrobin.ko 2022-01-24T06:24:24.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/tun.ko 2022-01-24T06:24:24.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/veth.ko 2022-01-24T06:24:24.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/virtio_net.ko 2022-01-24T06:24:24.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/vmxnet3 2022-01-24T06:24:24.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2022-01-24T06:24:24.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/vxlan.ko 2022-01-24T06:24:24.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/xen-netback 2022-01-24T06:24:24.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/xen-netback/xen-netback.ko 2022-01-24T06:24:24.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/net/xen-netfront.ko 2022-01-24T06:24:24.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ntb 2022-01-24T06:24:24.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ntb/ntb.ko 2022-01-24T06:24:24.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/nvme 2022-01-24T06:24:24.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/nvme/host 2022-01-24T06:24:24.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/nvme/host/nvme-core.ko 2022-01-24T06:24:24.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/nvme/host/nvme.ko 2022-01-24T06:24:24.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/parport 2022-01-24T06:24:24.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/parport/parport.ko 2022-01-24T06:24:24.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/parport/parport_cs.ko 2022-01-24T06:24:24.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/parport/parport_pc.ko 2022-01-24T06:24:24.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/parport/parport_serial.ko 2022-01-24T06:24:24.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pci 2022-01-24T06:24:24.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pci/hotplug 2022-01-24T06:24:24.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2022-01-24T06:24:24.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pci/pcie 2022-01-24T06:24:24.465 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pci/pcie/aer_inject.ko 2022-01-24T06:24:24.465 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pci/xen-pcifront.ko 2022-01-24T06:24:24.465 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pcmcia 2022-01-24T06:24:24.465 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pcmcia/i82092.ko 2022-01-24T06:24:24.465 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pcmcia/pd6729.ko 2022-01-24T06:24:24.466 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pcmcia/yenta_socket.ko 2022-01-24T06:24:24.466 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pinctrl 2022-01-24T06:24:24.466 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pinctrl/intel 2022-01-24T06:24:24.466 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2022-01-24T06:24:24.466 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform 2022-01-24T06:24:24.467 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86 2022-01-24T06:24:24.467 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/acer-wmi.ko 2022-01-24T06:24:24.467 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/acerhdf.ko 2022-01-24T06:24:24.467 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/apple-gmux.ko 2022-01-24T06:24:24.467 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/asus-laptop.ko 2022-01-24T06:24:24.468 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2022-01-24T06:24:24.468 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/asus-wmi.ko 2022-01-24T06:24:24.468 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/classmate-laptop.ko 2022-01-24T06:24:24.468 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/eeepc-laptop.ko 2022-01-24T06:24:24.469 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/eeepc-wmi.ko 2022-01-24T06:24:24.469 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2022-01-24T06:24:24.469 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2022-01-24T06:24:24.469 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/hdaps.ko 2022-01-24T06:24:24.469 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/hp-wmi.ko 2022-01-24T06:24:24.470 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/hp_accel.ko 2022-01-24T06:24:24.470 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/intel 2022-01-24T06:24:24.470 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/intel/intel-rst.ko 2022-01-24T06:24:24.470 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/intel_ips.ko 2022-01-24T06:24:24.470 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/msi-wmi.ko 2022-01-24T06:24:24.471 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/mxm-wmi.ko 2022-01-24T06:24:24.471 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/panasonic-laptop.ko 2022-01-24T06:24:24.471 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/samsung-laptop.ko 2022-01-24T06:24:24.471 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/samsung-q10.ko 2022-01-24T06:24:24.471 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/thinkpad_acpi.ko 2022-01-24T06:24:24.472 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/topstar-laptop.ko 2022-01-24T06:24:24.472 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2022-01-24T06:24:24.472 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/toshiba_haps.ko 2022-01-24T06:24:24.472 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/wmi-bmof.ko 2022-01-24T06:24:24.472 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/platform/x86/wmi.ko 2022-01-24T06:24:24.473 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/powercap 2022-01-24T06:24:24.473 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/powercap/intel_rapl_common.ko 2022-01-24T06:24:24.473 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/powercap/intel_rapl_msr.ko 2022-01-24T06:24:24.473 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pps 2022-01-24T06:24:24.473 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pps/clients 2022-01-24T06:24:24.474 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pps/clients/pps-gpio.ko 2022-01-24T06:24:24.474 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pps/clients/pps-ldisc.ko 2022-01-24T06:24:24.474 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pps/clients/pps_parport.ko 2022-01-24T06:24:24.474 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/pps/pps_core.ko 2022-01-24T06:24:24.475 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ptp 2022-01-24T06:24:24.475 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ptp/ptp.ko 2022-01-24T06:24:24.475 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ptp/ptp_kvm.ko 2022-01-24T06:24:24.475 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc 2022-01-24T06:24:24.475 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-bq32k.ko 2022-01-24T06:24:24.476 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-bq4802.ko 2022-01-24T06:24:24.476 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds1286.ko 2022-01-24T06:24:24.476 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds1307.ko 2022-01-24T06:24:24.476 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds1374.ko 2022-01-24T06:24:24.476 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds1511.ko 2022-01-24T06:24:24.477 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds1553.ko 2022-01-24T06:24:24.477 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds1672.ko 2022-01-24T06:24:24.477 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds1742.ko 2022-01-24T06:24:24.477 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds2404.ko 2022-01-24T06:24:24.478 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-ds3232.ko 2022-01-24T06:24:24.478 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-em3027.ko 2022-01-24T06:24:24.478 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-fm3130.ko 2022-01-24T06:24:24.478 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-isl12022.ko 2022-01-24T06:24:24.479 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-isl1208.ko 2022-01-24T06:24:24.479 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-m41t80.ko 2022-01-24T06:24:24.479 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-m48t35.ko 2022-01-24T06:24:24.479 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-m48t59.ko 2022-01-24T06:24:24.479 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-max6900.ko 2022-01-24T06:24:24.480 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-msm6242.ko 2022-01-24T06:24:24.480 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-pcf2127.ko 2022-01-24T06:24:24.480 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-pcf85063.ko 2022-01-24T06:24:24.480 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-pcf8523.ko 2022-01-24T06:24:24.480 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-pcf8563.ko 2022-01-24T06:24:24.481 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-pcf8583.ko 2022-01-24T06:24:24.481 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-rp5c01.ko 2022-01-24T06:24:24.481 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-rs5c372.ko 2022-01-24T06:24:24.481 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-rv3029c2.ko 2022-01-24T06:24:24.481 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-rx8025.ko 2022-01-24T06:24:24.482 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-rx8581.ko 2022-01-24T06:24:24.482 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-stk17ta8.ko 2022-01-24T06:24:24.482 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-v3020.ko 2022-01-24T06:24:24.482 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/rtc/rtc-x1205.ko 2022-01-24T06:24:24.482 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi 2022-01-24T06:24:24.483 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/3w-9xxx.ko 2022-01-24T06:24:24.483 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/3w-sas.ko 2022-01-24T06:24:24.483 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/3w-xxxx.ko 2022-01-24T06:24:24.483 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/BusLogic.ko 2022-01-24T06:24:24.483 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/a100u2w.ko 2022-01-24T06:24:24.484 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/aacraid 2022-01-24T06:24:24.484 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/aacraid/aacraid.ko 2022-01-24T06:24:24.484 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/advansys.ko 2022-01-24T06:24:24.484 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/aic7xxx 2022-01-24T06:24:24.485 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2022-01-24T06:24:24.485 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2022-01-24T06:24:24.485 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/am53c974.ko 2022-01-24T06:24:24.485 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/arcmsr 2022-01-24T06:24:24.485 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2022-01-24T06:24:24.486 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/atp870u.ko 2022-01-24T06:24:24.486 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/be2iscsi 2022-01-24T06:24:24.486 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2022-01-24T06:24:24.486 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/bfa 2022-01-24T06:24:24.487 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/bfa/bfa.ko 2022-01-24T06:24:24.487 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/bnx2fc 2022-01-24T06:24:24.487 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2022-01-24T06:24:24.487 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/bnx2i 2022-01-24T06:24:24.487 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2022-01-24T06:24:24.488 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/ch.ko 2022-01-24T06:24:24.488 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/csiostor 2022-01-24T06:24:24.488 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/csiostor/csiostor.ko 2022-01-24T06:24:24.488 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/cxgbi 2022-01-24T06:24:24.488 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/cxgbi/cxgb3i 2022-01-24T06:24:24.489 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2022-01-24T06:24:24.489 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/cxgbi/cxgb4i 2022-01-24T06:24:24.489 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2022-01-24T06:24:24.489 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2022-01-24T06:24:24.489 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/dc395x.ko 2022-01-24T06:24:24.490 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/device_handler 2022-01-24T06:24:24.490 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2022-01-24T06:24:24.490 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2022-01-24T06:24:24.490 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2022-01-24T06:24:24.491 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2022-01-24T06:24:24.491 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/dmx3191d.ko 2022-01-24T06:24:24.491 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/esas2r 2022-01-24T06:24:24.491 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/esas2r/esas2r.ko 2022-01-24T06:24:24.491 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/esp_scsi.ko 2022-01-24T06:24:24.492 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/fcoe 2022-01-24T06:24:24.492 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/fcoe/fcoe.ko 2022-01-24T06:24:24.492 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/fcoe/libfcoe.ko 2022-01-24T06:24:24.492 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/fnic 2022-01-24T06:24:24.493 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/fnic/fnic.ko 2022-01-24T06:24:24.493 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/hpsa.ko 2022-01-24T06:24:24.493 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/hptiop.ko 2022-01-24T06:24:24.493 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/hv_storvsc.ko 2022-01-24T06:24:24.493 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/initio.ko 2022-01-24T06:24:24.494 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/ipr.ko 2022-01-24T06:24:24.494 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/ips.ko 2022-01-24T06:24:24.494 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/isci 2022-01-24T06:24:24.494 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/isci/isci.ko 2022-01-24T06:24:24.494 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2022-01-24T06:24:24.495 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/iscsi_tcp.ko 2022-01-24T06:24:24.495 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/libfc 2022-01-24T06:24:24.495 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/libfc/libfc.ko 2022-01-24T06:24:24.495 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/libiscsi.ko 2022-01-24T06:24:24.496 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/libiscsi_tcp.ko 2022-01-24T06:24:24.496 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/libsas 2022-01-24T06:24:24.496 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/libsas/libsas.ko 2022-01-24T06:24:24.496 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/lpfc 2022-01-24T06:24:24.496 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/lpfc/lpfc.ko 2022-01-24T06:24:24.497 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/megaraid 2022-01-24T06:24:24.497 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/megaraid.ko 2022-01-24T06:24:24.497 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2022-01-24T06:24:24.497 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2022-01-24T06:24:24.498 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2022-01-24T06:24:24.498 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/mpt3sas 2022-01-24T06:24:24.498 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2022-01-24T06:24:24.498 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/mvsas 2022-01-24T06:24:24.498 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/mvsas/mvsas.ko 2022-01-24T06:24:24.499 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/mvumi.ko 2022-01-24T06:24:24.499 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/pm8001 2022-01-24T06:24:24.499 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/pm8001/pm80xx.ko 2022-01-24T06:24:24.499 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/pmcraid.ko 2022-01-24T06:24:24.499 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/qla1280.ko 2022-01-24T06:24:24.500 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/qla2xxx 2022-01-24T06:24:24.500 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2022-01-24T06:24:24.500 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2022-01-24T06:24:24.500 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/qla4xxx 2022-01-24T06:24:24.501 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2022-01-24T06:24:24.501 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/raid_class.ko 2022-01-24T06:24:24.501 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/scsi_debug.ko 2022-01-24T06:24:24.501 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/scsi_transport_fc.ko 2022-01-24T06:24:24.502 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2022-01-24T06:24:24.502 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/scsi_transport_sas.ko 2022-01-24T06:24:24.502 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/scsi_transport_spi.ko 2022-01-24T06:24:24.502 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/scsi_transport_srp.ko 2022-01-24T06:24:24.503 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/ses.ko 2022-01-24T06:24:24.503 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/st.ko 2022-01-24T06:24:24.503 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/stex.ko 2022-01-24T06:24:24.503 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/sym53c8xx_2 2022-01-24T06:24:24.503 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2022-01-24T06:24:24.504 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/ufs 2022-01-24T06:24:24.504 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/ufs/ufshcd-core.ko 2022-01-24T06:24:24.504 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2022-01-24T06:24:24.504 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/virtio_scsi.ko 2022-01-24T06:24:24.505 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/vmw_pvscsi.ko 2022-01-24T06:24:24.505 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/scsi/wd719x.ko 2022-01-24T06:24:24.505 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ssb 2022-01-24T06:24:24.505 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/ssb/ssb.ko 2022-01-24T06:24:24.505 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target 2022-01-24T06:24:24.506 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/iscsi 2022-01-24T06:24:24.506 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2022-01-24T06:24:24.506 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/loopback 2022-01-24T06:24:24.506 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/loopback/tcm_loop.ko 2022-01-24T06:24:24.506 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/target_core_file.ko 2022-01-24T06:24:24.507 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/target_core_iblock.ko 2022-01-24T06:24:24.507 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/target_core_mod.ko 2022-01-24T06:24:24.507 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/target_core_pscsi.ko 2022-01-24T06:24:24.507 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/target_core_user.ko 2022-01-24T06:24:24.507 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/tcm_fc 2022-01-24T06:24:24.508 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2022-01-24T06:24:24.508 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal 2022-01-24T06:24:24.508 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel 2022-01-24T06:24:24.508 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal 2022-01-24T06:24:24.508 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2022-01-24T06:24:24.509 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2022-01-24T06:24:24.509 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2022-01-24T06:24:24.509 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2022-01-24T06:24:24.509 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2022-01-24T06:24:24.509 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2022-01-24T06:24:24.510 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2022-01-24T06:24:24.510 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2022-01-24T06:24:24.510 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2022-01-24T06:24:24.510 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2022-01-24T06:24:24.511 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2022-01-24T06:24:24.511 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2022-01-24T06:24:24.511 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2022-01-24T06:24:24.511 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2022-01-24T06:24:24.511 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2022-01-24T06:24:24.512 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty 2022-01-24T06:24:24.512 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/ipwireless 2022-01-24T06:24:24.512 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/ipwireless/ipwireless.ko 2022-01-24T06:24:24.512 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/n_gsm.ko 2022-01-24T06:24:24.512 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/n_hdlc.ko 2022-01-24T06:24:24.513 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/nozomi.ko 2022-01-24T06:24:24.513 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/serial 2022-01-24T06:24:24.513 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/serial/8250 2022-01-24T06:24:24.513 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/serial/8250/serial_cs.ko 2022-01-24T06:24:24.513 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/serial/arc_uart.ko 2022-01-24T06:24:24.514 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/serial/jsm 2022-01-24T06:24:24.514 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/serial/jsm/jsm.ko 2022-01-24T06:24:24.514 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/tty/synclink_gt.ko 2022-01-24T06:24:24.514 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/uio 2022-01-24T06:24:24.515 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/uio/uio.ko 2022-01-24T06:24:24.515 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/uio/uio_aec.ko 2022-01-24T06:24:24.515 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/uio/uio_cif.ko 2022-01-24T06:24:24.515 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/uio/uio_pci_generic.ko 2022-01-24T06:24:24.515 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/uio/uio_sercos3.ko 2022-01-24T06:24:24.516 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb 2022-01-24T06:24:24.516 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/class 2022-01-24T06:24:24.516 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/class/cdc-acm.ko 2022-01-24T06:24:24.516 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/class/cdc-wdm.ko 2022-01-24T06:24:24.516 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/class/usblp.ko 2022-01-24T06:24:24.517 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/class/usbtmc.ko 2022-01-24T06:24:24.517 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/host 2022-01-24T06:24:24.517 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/host/sl811-hcd.ko 2022-01-24T06:24:24.517 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/host/u132-hcd.ko 2022-01-24T06:24:24.517 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/image 2022-01-24T06:24:24.518 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/image/mdc800.ko 2022-01-24T06:24:24.518 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/image/microtek.ko 2022-01-24T06:24:24.518 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc 2022-01-24T06:24:24.518 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/adutux.ko 2022-01-24T06:24:24.519 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/appledisplay.ko 2022-01-24T06:24:24.519 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/emi26.ko 2022-01-24T06:24:24.519 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/emi62.ko 2022-01-24T06:24:24.519 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/ezusb.ko 2022-01-24T06:24:24.519 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/ftdi-elan.ko 2022-01-24T06:24:24.520 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/idmouse.ko 2022-01-24T06:24:24.520 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/iowarrior.ko 2022-01-24T06:24:24.520 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/isight_firmware.ko 2022-01-24T06:24:24.520 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/ldusb.ko 2022-01-24T06:24:24.520 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/legousbtower.ko 2022-01-24T06:24:24.521 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/sisusbvga 2022-01-24T06:24:24.521 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2022-01-24T06:24:24.521 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/trancevibrator.ko 2022-01-24T06:24:24.521 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/usb3503.ko 2022-01-24T06:24:24.521 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/usblcd.ko 2022-01-24T06:24:24.522 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/usbsevseg.ko 2022-01-24T06:24:24.522 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/uss720.ko 2022-01-24T06:24:24.522 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/misc/yurex.ko 2022-01-24T06:24:24.522 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/phy 2022-01-24T06:24:24.523 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/phy/phy-generic.ko 2022-01-24T06:24:24.523 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial 2022-01-24T06:24:24.523 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/aircable.ko 2022-01-24T06:24:24.523 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ark3116.ko 2022-01-24T06:24:24.523 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/belkin_sa.ko 2022-01-24T06:24:24.524 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ch341.ko 2022-01-24T06:24:24.524 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/cp210x.ko 2022-01-24T06:24:24.524 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/cyberjack.ko 2022-01-24T06:24:24.524 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/cypress_m8.ko 2022-01-24T06:24:24.525 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/digi_acceleport.ko 2022-01-24T06:24:24.525 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/empeg.ko 2022-01-24T06:24:24.525 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ftdi_sio.ko 2022-01-24T06:24:24.525 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/garmin_gps.ko 2022-01-24T06:24:24.525 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/io_edgeport.ko 2022-01-24T06:24:24.526 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/io_ti.ko 2022-01-24T06:24:24.526 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ipaq.ko 2022-01-24T06:24:24.526 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ipw.ko 2022-01-24T06:24:24.526 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ir-usb.ko 2022-01-24T06:24:24.526 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/iuu_phoenix.ko 2022-01-24T06:24:24.527 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/keyspan.ko 2022-01-24T06:24:24.527 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/keyspan_pda.ko 2022-01-24T06:24:24.527 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/kl5kusb105.ko 2022-01-24T06:24:24.527 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/kobil_sct.ko 2022-01-24T06:24:24.528 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/mct_u232.ko 2022-01-24T06:24:24.528 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/mos7720.ko 2022-01-24T06:24:24.528 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/mos7840.ko 2022-01-24T06:24:24.528 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/navman.ko 2022-01-24T06:24:24.528 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/omninet.ko 2022-01-24T06:24:24.529 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/opticon.ko 2022-01-24T06:24:24.529 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/option.ko 2022-01-24T06:24:24.529 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/oti6858.ko 2022-01-24T06:24:24.529 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/pl2303.ko 2022-01-24T06:24:24.529 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/qcaux.ko 2022-01-24T06:24:24.530 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/qcserial.ko 2022-01-24T06:24:24.530 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/quatech2.ko 2022-01-24T06:24:24.530 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/safe_serial.ko 2022-01-24T06:24:24.530 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/sierra.ko 2022-01-24T06:24:24.530 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/spcp8x5.ko 2022-01-24T06:24:24.531 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ssu100.ko 2022-01-24T06:24:24.531 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/symbolserial.ko 2022-01-24T06:24:24.531 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2022-01-24T06:24:24.531 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/usb-serial-simple.ko 2022-01-24T06:24:24.531 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/usb_debug.ko 2022-01-24T06:24:24.532 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/usb_wwan.ko 2022-01-24T06:24:24.532 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/visor.ko 2022-01-24T06:24:24.532 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/whiteheat.ko 2022-01-24T06:24:24.532 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/serial/xsens_mt.ko 2022-01-24T06:24:24.532 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage 2022-01-24T06:24:24.533 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/uas.ko 2022-01-24T06:24:24.533 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-alauda.ko 2022-01-24T06:24:24.533 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-cypress.ko 2022-01-24T06:24:24.533 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-datafab.ko 2022-01-24T06:24:24.534 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-eneub6250.ko 2022-01-24T06:24:24.534 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-freecom.ko 2022-01-24T06:24:24.534 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-isd200.ko 2022-01-24T06:24:24.534 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-jumpshot.ko 2022-01-24T06:24:24.534 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-karma.ko 2022-01-24T06:24:24.535 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-onetouch.ko 2022-01-24T06:24:24.535 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-realtek.ko 2022-01-24T06:24:24.535 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-sddr09.ko 2022-01-24T06:24:24.535 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-sddr55.ko 2022-01-24T06:24:24.535 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/ums-usbat.ko 2022-01-24T06:24:24.536 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/storage/usb-storage.ko 2022-01-24T06:24:24.536 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/usbip 2022-01-24T06:24:24.536 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/usbip/usbip-core.ko 2022-01-24T06:24:24.536 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/usbip/usbip-host.ko 2022-01-24T06:24:24.536 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/usb/usbip/vhci-hcd.ko 2022-01-24T06:24:24.536 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vfio 2022-01-24T06:24:24.537 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vfio/pci 2022-01-24T06:24:24.537 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2022-01-24T06:24:24.537 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vfio/pci/vfio-pci.ko 2022-01-24T06:24:24.537 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vfio/vfio.ko 2022-01-24T06:24:24.537 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vfio/vfio_iommu_type1.ko 2022-01-24T06:24:24.538 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vfio/vfio_virqfd.ko 2022-01-24T06:24:24.538 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vhost 2022-01-24T06:24:24.538 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vhost/vhost.ko 2022-01-24T06:24:24.538 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vhost/vhost_iotlb.ko 2022-01-24T06:24:24.538 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vhost/vhost_net.ko 2022-01-24T06:24:24.539 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/vhost/vhost_scsi.ko 2022-01-24T06:24:24.539 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/video 2022-01-24T06:24:24.539 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/video/backlight 2022-01-24T06:24:24.539 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/video/backlight/apple_bl.ko 2022-01-24T06:24:24.540 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/video/backlight/lcd.ko 2022-01-24T06:24:24.540 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/video/backlight/platform_lcd.ko 2022-01-24T06:24:24.540 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio 2022-01-24T06:24:24.540 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio/virtio.ko 2022-01-24T06:24:24.540 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio/virtio_balloon.ko 2022-01-24T06:24:24.541 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio/virtio_mmio.ko 2022-01-24T06:24:24.541 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio/virtio_pci.ko 2022-01-24T06:24:24.541 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2022-01-24T06:24:24.541 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2022-01-24T06:24:24.541 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/virtio/virtio_ring.ko 2022-01-24T06:24:24.542 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1 2022-01-24T06:24:24.542 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/masters 2022-01-24T06:24:24.542 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/masters/ds1wm.ko 2022-01-24T06:24:24.542 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/masters/ds2482.ko 2022-01-24T06:24:24.542 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/masters/ds2490.ko 2022-01-24T06:24:24.543 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves 2022-01-24T06:24:24.543 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2406.ko 2022-01-24T06:24:24.543 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2408.ko 2022-01-24T06:24:24.543 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2413.ko 2022-01-24T06:24:24.543 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2423.ko 2022-01-24T06:24:24.544 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2431.ko 2022-01-24T06:24:24.544 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2433.ko 2022-01-24T06:24:24.544 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2780.ko 2022-01-24T06:24:24.544 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds2781.ko 2022-01-24T06:24:24.544 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2022-01-24T06:24:24.545 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_smem.ko 2022-01-24T06:24:24.545 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/slaves/w1_therm.ko 2022-01-24T06:24:24.545 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/w1/wire.ko 2022-01-24T06:24:24.545 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog 2022-01-24T06:24:24.545 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/alim1535_wdt.ko 2022-01-24T06:24:24.546 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/alim7101_wdt.ko 2022-01-24T06:24:24.546 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/f71808e_wdt.ko 2022-01-24T06:24:24.546 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/hpwdt.ko 2022-01-24T06:24:24.546 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/i6300esb.ko 2022-01-24T06:24:24.547 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2022-01-24T06:24:24.547 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/iTCO_wdt.ko 2022-01-24T06:24:24.547 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/ib700wdt.ko 2022-01-24T06:24:24.547 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/ibmasr.ko 2022-01-24T06:24:24.547 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/ie6xx_wdt.ko 2022-01-24T06:24:24.548 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/it8712f_wdt.ko 2022-01-24T06:24:24.548 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/it87_wdt.ko 2022-01-24T06:24:24.548 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/machzwd.ko 2022-01-24T06:24:24.548 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/nv_tco.ko 2022-01-24T06:24:24.548 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/pcwd_pci.ko 2022-01-24T06:24:24.549 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/pcwd_usb.ko 2022-01-24T06:24:24.549 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2022-01-24T06:24:24.549 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/sch311x_wdt.ko 2022-01-24T06:24:24.549 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/softdog.ko 2022-01-24T06:24:24.549 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/sp5100_tco.ko 2022-01-24T06:24:24.550 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/via_wdt.ko 2022-01-24T06:24:24.550 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/w83627hf_wdt.ko 2022-01-24T06:24:24.550 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/w83877f_wdt.ko 2022-01-24T06:24:24.550 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/w83977f_wdt.ko 2022-01-24T06:24:24.551 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/wdt_pci.ko 2022-01-24T06:24:24.551 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/watchdog/xen_wdt.ko 2022-01-24T06:24:24.551 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen 2022-01-24T06:24:24.551 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xen-acpi-processor.ko 2022-01-24T06:24:24.551 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xen-evtchn.ko 2022-01-24T06:24:24.552 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xen-gntalloc.ko 2022-01-24T06:24:24.552 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xen-gntdev.ko 2022-01-24T06:24:24.552 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xen-pciback 2022-01-24T06:24:24.552 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2022-01-24T06:24:24.553 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xen-privcmd.ko 2022-01-24T06:24:24.553 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xenfs 2022-01-24T06:24:24.553 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/drivers/xen/xenfs/xenfs.ko 2022-01-24T06:24:24.553 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs 2022-01-24T06:24:24.553 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/9p 2022-01-24T06:24:24.554 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/9p/9p.ko 2022-01-24T06:24:24.554 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/affs 2022-01-24T06:24:24.554 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/affs/affs.ko 2022-01-24T06:24:24.554 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/befs 2022-01-24T06:24:24.554 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/befs/befs.ko 2022-01-24T06:24:24.555 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/binfmt_misc.ko 2022-01-24T06:24:24.555 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/btrfs 2022-01-24T06:24:24.555 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/btrfs/btrfs.ko 2022-01-24T06:24:24.555 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/cachefiles 2022-01-24T06:24:24.555 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/cachefiles/cachefiles.ko 2022-01-24T06:24:24.556 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ceph 2022-01-24T06:24:24.556 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ceph/ceph.ko 2022-01-24T06:24:24.556 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/cifs 2022-01-24T06:24:24.556 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/cifs/cifs.ko 2022-01-24T06:24:24.556 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/coda 2022-01-24T06:24:24.556 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/coda/coda.ko 2022-01-24T06:24:24.557 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/cramfs 2022-01-24T06:24:24.557 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/cramfs/cramfs.ko 2022-01-24T06:24:24.557 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/dlm 2022-01-24T06:24:24.557 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/dlm/dlm.ko 2022-01-24T06:24:24.557 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ecryptfs 2022-01-24T06:24:24.558 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ecryptfs/ecryptfs.ko 2022-01-24T06:24:24.558 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/f2fs 2022-01-24T06:24:24.558 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/f2fs/f2fs.ko 2022-01-24T06:24:24.558 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fat 2022-01-24T06:24:24.558 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fat/fat.ko 2022-01-24T06:24:24.559 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fat/msdos.ko 2022-01-24T06:24:24.559 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fat/vfat.ko 2022-01-24T06:24:24.559 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fscache 2022-01-24T06:24:24.559 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fscache/fscache.ko 2022-01-24T06:24:24.559 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fuse 2022-01-24T06:24:24.560 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fuse/cuse.ko 2022-01-24T06:24:24.560 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/fuse/fuse.ko 2022-01-24T06:24:24.560 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/gfs2 2022-01-24T06:24:24.560 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/gfs2/gfs2.ko 2022-01-24T06:24:24.561 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/hfs 2022-01-24T06:24:24.561 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/hfs/hfs.ko 2022-01-24T06:24:24.561 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/hfsplus 2022-01-24T06:24:24.561 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/hfsplus/hfsplus.ko 2022-01-24T06:24:24.561 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/isofs 2022-01-24T06:24:24.562 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/isofs/isofs.ko 2022-01-24T06:24:24.562 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/jfs 2022-01-24T06:24:24.562 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/jfs/jfs.ko 2022-01-24T06:24:24.562 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/lockd 2022-01-24T06:24:24.562 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/lockd/lockd.ko 2022-01-24T06:24:24.563 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/minix 2022-01-24T06:24:24.563 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/minix/minix.ko 2022-01-24T06:24:24.563 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/netfs 2022-01-24T06:24:24.563 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/netfs/netfs.ko 2022-01-24T06:24:24.564 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs 2022-01-24T06:24:24.564 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/blocklayout 2022-01-24T06:24:24.564 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2022-01-24T06:24:24.564 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/filelayout 2022-01-24T06:24:24.564 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2022-01-24T06:24:24.565 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/flexfilelayout 2022-01-24T06:24:24.565 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2022-01-24T06:24:24.565 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/nfs.ko 2022-01-24T06:24:24.565 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/nfsv3.ko 2022-01-24T06:24:24.565 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs/nfsv4.ko 2022-01-24T06:24:24.566 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs_common 2022-01-24T06:24:24.566 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs_common/grace.ko 2022-01-24T06:24:24.566 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfs_common/nfs_acl.ko 2022-01-24T06:24:24.566 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfsd 2022-01-24T06:24:24.566 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nfsd/nfsd.ko 2022-01-24T06:24:24.567 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nilfs2 2022-01-24T06:24:24.567 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nilfs2/nilfs2.ko 2022-01-24T06:24:24.567 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls 2022-01-24T06:24:24.567 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-celtic.ko 2022-01-24T06:24:24.567 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-centeuro.ko 2022-01-24T06:24:24.568 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-croatian.ko 2022-01-24T06:24:24.568 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-cyrillic.ko 2022-01-24T06:24:24.568 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-gaelic.ko 2022-01-24T06:24:24.568 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-greek.ko 2022-01-24T06:24:24.568 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-iceland.ko 2022-01-24T06:24:24.569 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-inuit.ko 2022-01-24T06:24:24.569 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-roman.ko 2022-01-24T06:24:24.569 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-romanian.ko 2022-01-24T06:24:24.569 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/mac-turkish.ko 2022-01-24T06:24:24.569 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp1250.ko 2022-01-24T06:24:24.570 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp1251.ko 2022-01-24T06:24:24.570 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp1255.ko 2022-01-24T06:24:24.570 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp737.ko 2022-01-24T06:24:24.570 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp775.ko 2022-01-24T06:24:24.570 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp850.ko 2022-01-24T06:24:24.571 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp852.ko 2022-01-24T06:24:24.571 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp855.ko 2022-01-24T06:24:24.571 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp857.ko 2022-01-24T06:24:24.571 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp860.ko 2022-01-24T06:24:24.571 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp861.ko 2022-01-24T06:24:24.572 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp862.ko 2022-01-24T06:24:24.572 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp863.ko 2022-01-24T06:24:24.572 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp864.ko 2022-01-24T06:24:24.572 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp865.ko 2022-01-24T06:24:24.572 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp866.ko 2022-01-24T06:24:24.573 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp869.ko 2022-01-24T06:24:24.573 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp874.ko 2022-01-24T06:24:24.573 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp932.ko 2022-01-24T06:24:24.573 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp936.ko 2022-01-24T06:24:24.573 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp949.ko 2022-01-24T06:24:24.574 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_cp950.ko 2022-01-24T06:24:24.574 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_euc-jp.ko 2022-01-24T06:24:24.574 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-1.ko 2022-01-24T06:24:24.574 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-13.ko 2022-01-24T06:24:24.574 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-14.ko 2022-01-24T06:24:24.575 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-15.ko 2022-01-24T06:24:24.575 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-2.ko 2022-01-24T06:24:24.575 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-3.ko 2022-01-24T06:24:24.575 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-4.ko 2022-01-24T06:24:24.575 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-5.ko 2022-01-24T06:24:24.576 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-6.ko 2022-01-24T06:24:24.576 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-7.ko 2022-01-24T06:24:24.576 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_iso8859-9.ko 2022-01-24T06:24:24.576 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_koi8-r.ko 2022-01-24T06:24:24.576 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_koi8-ru.ko 2022-01-24T06:24:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_koi8-u.ko 2022-01-24T06:24:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/nls/nls_utf8.ko 2022-01-24T06:24:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2 2022-01-24T06:24:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/cluster 2022-01-24T06:24:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2022-01-24T06:24:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/dlm 2022-01-24T06:24:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2022-01-24T06:24:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/dlmfs 2022-01-24T06:24:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2022-01-24T06:24:24.579 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/ocfs2.ko 2022-01-24T06:24:24.579 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2022-01-24T06:24:24.579 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2022-01-24T06:24:24.579 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2022-01-24T06:24:24.579 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/overlayfs 2022-01-24T06:24:24.580 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/overlayfs/overlay.ko 2022-01-24T06:24:24.580 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/pstore 2022-01-24T06:24:24.580 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/pstore/ramoops.ko 2022-01-24T06:24:24.580 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/reiserfs 2022-01-24T06:24:24.580 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/reiserfs/reiserfs.ko 2022-01-24T06:24:24.581 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/romfs 2022-01-24T06:24:24.581 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/romfs/romfs.ko 2022-01-24T06:24:24.581 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/smbfs_common 2022-01-24T06:24:24.581 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/smbfs_common/cifs_arc4.ko 2022-01-24T06:24:24.581 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/smbfs_common/cifs_md4.ko 2022-01-24T06:24:24.582 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/squashfs 2022-01-24T06:24:24.582 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/squashfs/squashfs.ko 2022-01-24T06:24:24.582 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/sysv 2022-01-24T06:24:24.582 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/sysv/sysv.ko 2022-01-24T06:24:24.583 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/udf 2022-01-24T06:24:24.583 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/udf/udf.ko 2022-01-24T06:24:24.583 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ufs 2022-01-24T06:24:24.583 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/ufs/ufs.ko 2022-01-24T06:24:24.583 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/xfs 2022-01-24T06:24:24.584 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/fs/xfs/xfs.ko 2022-01-24T06:24:24.584 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/kernel 2022-01-24T06:24:24.584 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/kernel/rcu 2022-01-24T06:24:24.584 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/kernel/rcu/rcutorture.ko 2022-01-24T06:24:24.585 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/kernel/torture.ko 2022-01-24T06:24:24.585 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/kernel/trace 2022-01-24T06:24:24.585 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/kernel/trace/ring_buffer_benchmark.ko 2022-01-24T06:24:24.585 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib 2022-01-24T06:24:24.585 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/asn1_encoder.ko 2022-01-24T06:24:24.586 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/crc-itu-t.ko 2022-01-24T06:24:24.586 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/crc64.ko 2022-01-24T06:24:24.586 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/crc8.ko 2022-01-24T06:24:24.586 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/crypto 2022-01-24T06:24:24.587 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/crypto/libarc4.ko 2022-01-24T06:24:24.587 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/crypto/libdes.ko 2022-01-24T06:24:24.587 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/libcrc32c.ko 2022-01-24T06:24:24.587 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/lru_cache.ko 2022-01-24T06:24:24.587 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/lz4 2022-01-24T06:24:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/lz4/lz4_compress.ko 2022-01-24T06:24:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/lz4/lz4hc_compress.ko 2022-01-24T06:24:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/math 2022-01-24T06:24:24.588 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/math/cordic.ko 2022-01-24T06:24:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/raid6 2022-01-24T06:24:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/raid6/raid6_pq.ko 2022-01-24T06:24:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/reed_solomon 2022-01-24T06:24:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/reed_solomon/reed_solomon.ko 2022-01-24T06:24:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/ts_bm.ko 2022-01-24T06:24:24.589 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/ts_fsm.ko 2022-01-24T06:24:24.590 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/ts_kmp.ko 2022-01-24T06:24:24.590 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/zstd 2022-01-24T06:24:24.590 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/lib/zstd/zstd_compress.ko 2022-01-24T06:24:24.590 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/mm 2022-01-24T06:24:24.591 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/mm/hwpoison-inject.ko 2022-01-24T06:24:24.591 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net 2022-01-24T06:24:24.591 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan 2022-01-24T06:24:24.591 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/6lowpan.ko 2022-01-24T06:24:24.591 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/nhc_dest.ko 2022-01-24T06:24:24.592 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/nhc_fragment.ko 2022-01-24T06:24:24.592 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/nhc_hop.ko 2022-01-24T06:24:24.592 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/nhc_ipv6.ko 2022-01-24T06:24:24.592 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/nhc_mobility.ko 2022-01-24T06:24:24.592 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/nhc_routing.ko 2022-01-24T06:24:24.593 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/6lowpan/nhc_udp.ko 2022-01-24T06:24:24.593 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/802 2022-01-24T06:24:24.593 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/802/garp.ko 2022-01-24T06:24:24.593 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/802/mrp.ko 2022-01-24T06:24:24.593 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/802/p8022.ko 2022-01-24T06:24:24.594 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/802/psnap.ko 2022-01-24T06:24:24.594 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/802/stp.ko 2022-01-24T06:24:24.594 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/8021q 2022-01-24T06:24:24.594 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/8021q/8021q.ko 2022-01-24T06:24:24.594 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/9p 2022-01-24T06:24:24.595 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/9p/9pnet.ko 2022-01-24T06:24:24.595 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/9p/9pnet_rdma.ko 2022-01-24T06:24:24.595 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/9p/9pnet_virtio.ko 2022-01-24T06:24:24.595 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/batman-adv 2022-01-24T06:24:24.595 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/batman-adv/batman-adv.ko 2022-01-24T06:24:24.596 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge 2022-01-24T06:24:24.596 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/br_netfilter.ko 2022-01-24T06:24:24.596 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/bridge.ko 2022-01-24T06:24:24.596 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter 2022-01-24T06:24:24.596 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_802_3.ko 2022-01-24T06:24:24.597 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_among.ko 2022-01-24T06:24:24.597 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_arp.ko 2022-01-24T06:24:24.597 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2022-01-24T06:24:24.597 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_dnat.ko 2022-01-24T06:24:24.597 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_ip.ko 2022-01-24T06:24:24.598 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_ip6.ko 2022-01-24T06:24:24.598 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_limit.ko 2022-01-24T06:24:24.598 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_log.ko 2022-01-24T06:24:24.598 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_mark.ko 2022-01-24T06:24:24.598 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2022-01-24T06:24:24.599 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_nflog.ko 2022-01-24T06:24:24.599 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2022-01-24T06:24:24.599 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_redirect.ko 2022-01-24T06:24:24.599 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_snat.ko 2022-01-24T06:24:24.599 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_stp.ko 2022-01-24T06:24:24.600 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebt_vlan.ko 2022-01-24T06:24:24.600 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebtable_broute.ko 2022-01-24T06:24:24.600 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebtable_filter.ko 2022-01-24T06:24:24.600 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebtable_nat.ko 2022-01-24T06:24:24.600 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/ebtables.ko 2022-01-24T06:24:24.601 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2022-01-24T06:24:24.601 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2022-01-24T06:24:24.601 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2022-01-24T06:24:24.601 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ceph 2022-01-24T06:24:24.601 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ceph/libceph.ko 2022-01-24T06:24:24.602 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/core 2022-01-24T06:24:24.602 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/core/failover.ko 2022-01-24T06:24:24.602 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/core/pktgen.ko 2022-01-24T06:24:24.602 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dccp 2022-01-24T06:24:24.602 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dccp/dccp.ko 2022-01-24T06:24:24.603 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dccp/dccp_diag.ko 2022-01-24T06:24:24.603 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dccp/dccp_ipv4.ko 2022-01-24T06:24:24.603 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dccp/dccp_ipv6.ko 2022-01-24T06:24:24.603 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dns_resolver 2022-01-24T06:24:24.603 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dns_resolver/dns_resolver.ko 2022-01-24T06:24:24.604 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dsa 2022-01-24T06:24:24.604 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dsa/dsa_core.ko 2022-01-24T06:24:24.604 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dsa/tag_brcm.ko 2022-01-24T06:24:24.604 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dsa/tag_dsa.ko 2022-01-24T06:24:24.605 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/dsa/tag_trailer.ko 2022-01-24T06:24:24.605 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ieee802154 2022-01-24T06:24:24.605 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ieee802154/6lowpan 2022-01-24T06:24:24.605 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2022-01-24T06:24:24.605 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ieee802154/ieee802154.ko 2022-01-24T06:24:24.606 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ieee802154/ieee802154_socket.ko 2022-01-24T06:24:24.606 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4 2022-01-24T06:24:24.606 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/ah4.ko 2022-01-24T06:24:24.606 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/esp4.ko 2022-01-24T06:24:24.606 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/fou.ko 2022-01-24T06:24:24.607 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/gre.ko 2022-01-24T06:24:24.607 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/inet_diag.ko 2022-01-24T06:24:24.607 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/ip_gre.ko 2022-01-24T06:24:24.607 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/ip_tunnel.ko 2022-01-24T06:24:24.607 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/ip_vti.ko 2022-01-24T06:24:24.608 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/ipcomp.ko 2022-01-24T06:24:24.608 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/ipip.ko 2022-01-24T06:24:24.608 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter 2022-01-24T06:24:24.608 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/arp_tables.ko 2022-01-24T06:24:24.608 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2022-01-24T06:24:24.608 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/arptable_filter.ko 2022-01-24T06:24:24.609 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2022-01-24T06:24:24.609 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2022-01-24T06:24:24.609 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2022-01-24T06:24:24.609 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/ipt_ah.ko 2022-01-24T06:24:24.609 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2022-01-24T06:24:24.610 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2022-01-24T06:24:24.610 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/iptable_nat.ko 2022-01-24T06:24:24.610 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/iptable_raw.ko 2022-01-24T06:24:24.610 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/iptable_security.ko 2022-01-24T06:24:24.611 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2022-01-24T06:24:24.611 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2022-01-24T06:24:24.611 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2022-01-24T06:24:24.611 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2022-01-24T06:24:24.612 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2022-01-24T06:24:24.612 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2022-01-24T06:24:24.612 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2022-01-24T06:24:24.612 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2022-01-24T06:24:24.613 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2022-01-24T06:24:24.613 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2022-01-24T06:24:24.613 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_bic.ko 2022-01-24T06:24:24.613 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_dctcp.ko 2022-01-24T06:24:24.613 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_diag.ko 2022-01-24T06:24:24.614 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_highspeed.ko 2022-01-24T06:24:24.614 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_htcp.ko 2022-01-24T06:24:24.614 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_hybla.ko 2022-01-24T06:24:24.614 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_illinois.ko 2022-01-24T06:24:24.615 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_lp.ko 2022-01-24T06:24:24.615 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_scalable.ko 2022-01-24T06:24:24.615 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_vegas.ko 2022-01-24T06:24:24.615 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_veno.ko 2022-01-24T06:24:24.615 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_westwood.ko 2022-01-24T06:24:24.616 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tcp_yeah.ko 2022-01-24T06:24:24.616 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/tunnel4.ko 2022-01-24T06:24:24.616 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/udp_diag.ko 2022-01-24T06:24:24.616 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/udp_tunnel.ko 2022-01-24T06:24:24.617 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv4/xfrm4_tunnel.ko 2022-01-24T06:24:24.617 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6 2022-01-24T06:24:24.617 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/ah6.ko 2022-01-24T06:24:24.617 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/esp6.ko 2022-01-24T06:24:24.617 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/fou6.ko 2022-01-24T06:24:24.618 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/ip6_tunnel.ko 2022-01-24T06:24:24.618 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/ip6_udp_tunnel.ko 2022-01-24T06:24:24.618 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/ip6_vti.ko 2022-01-24T06:24:24.618 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/ipcomp6.ko 2022-01-24T06:24:24.618 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter 2022-01-24T06:24:24.619 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6_tables.ko 2022-01-24T06:24:24.619 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2022-01-24T06:24:24.619 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2022-01-24T06:24:24.619 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2022-01-24T06:24:24.619 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2022-01-24T06:24:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2022-01-24T06:24:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2022-01-24T06:24:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2022-01-24T06:24:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2022-01-24T06:24:24.621 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2022-01-24T06:24:24.621 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2022-01-24T06:24:24.621 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2022-01-24T06:24:24.621 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2022-01-24T06:24:24.621 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2022-01-24T06:24:24.622 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2022-01-24T06:24:24.622 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/ip6table_security.ko 2022-01-24T06:24:24.622 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2022-01-24T06:24:24.622 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2022-01-24T06:24:24.622 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nf_flow_table_ipv6.ko 2022-01-24T06:24:24.623 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2022-01-24T06:24:24.623 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2022-01-24T06:24:24.623 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2022-01-24T06:24:24.623 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2022-01-24T06:24:24.623 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2022-01-24T06:24:24.624 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2022-01-24T06:24:24.624 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/sit.ko 2022-01-24T06:24:24.624 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/tunnel6.ko 2022-01-24T06:24:24.624 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/ipv6/xfrm6_tunnel.ko 2022-01-24T06:24:24.624 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/key 2022-01-24T06:24:24.625 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/key/af_key.ko 2022-01-24T06:24:24.625 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp 2022-01-24T06:24:24.625 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp/l2tp_core.ko 2022-01-24T06:24:24.625 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp/l2tp_debugfs.ko 2022-01-24T06:24:24.625 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp/l2tp_eth.ko 2022-01-24T06:24:24.626 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp/l2tp_ip.ko 2022-01-24T06:24:24.626 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp/l2tp_ip6.ko 2022-01-24T06:24:24.626 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp/l2tp_netlink.ko 2022-01-24T06:24:24.626 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/l2tp/l2tp_ppp.ko 2022-01-24T06:24:24.627 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/llc 2022-01-24T06:24:24.627 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/llc/llc.ko 2022-01-24T06:24:24.627 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/mac802154 2022-01-24T06:24:24.627 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/mac802154/mac802154.ko 2022-01-24T06:24:24.627 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/mpls 2022-01-24T06:24:24.628 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/mpls/mpls_gso.ko 2022-01-24T06:24:24.628 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter 2022-01-24T06:24:24.628 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset 2022-01-24T06:24:24.628 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set.ko 2022-01-24T06:24:24.628 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2022-01-24T06:24:24.629 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2022-01-24T06:24:24.629 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2022-01-24T06:24:24.629 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2022-01-24T06:24:24.629 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2022-01-24T06:24:24.629 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2022-01-24T06:24:24.630 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2022-01-24T06:24:24.630 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2022-01-24T06:24:24.630 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2022-01-24T06:24:24.630 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2022-01-24T06:24:24.631 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2022-01-24T06:24:24.631 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2022-01-24T06:24:24.631 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2022-01-24T06:24:24.631 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2022-01-24T06:24:24.631 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2022-01-24T06:24:24.632 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs 2022-01-24T06:24:24.632 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs.ko 2022-01-24T06:24:24.632 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2022-01-24T06:24:24.632 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2022-01-24T06:24:24.632 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2022-01-24T06:24:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2022-01-24T06:24:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2022-01-24T06:24:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2022-01-24T06:24:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2022-01-24T06:24:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2022-01-24T06:24:24.634 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2022-01-24T06:24:24.634 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2022-01-24T06:24:24.634 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2022-01-24T06:24:24.634 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2022-01-24T06:24:24.634 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2022-01-24T06:24:24.635 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conncount.ko 2022-01-24T06:24:24.635 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack.ko 2022-01-24T06:24:24.635 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_amanda.ko 2022-01-24T06:24:24.635 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2022-01-24T06:24:24.635 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_ftp.ko 2022-01-24T06:24:24.636 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_h323.ko 2022-01-24T06:24:24.636 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_irc.ko 2022-01-24T06:24:24.636 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2022-01-24T06:24:24.636 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_netlink.ko 2022-01-24T06:24:24.636 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_pptp.ko 2022-01-24T06:24:24.637 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_sane.ko 2022-01-24T06:24:24.637 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_sip.ko 2022-01-24T06:24:24.637 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_snmp.ko 2022-01-24T06:24:24.637 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_conntrack_tftp.ko 2022-01-24T06:24:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_dup_netdev.ko 2022-01-24T06:24:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_flow_table.ko 2022-01-24T06:24:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_flow_table_inet.ko 2022-01-24T06:24:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_log_syslog.ko 2022-01-24T06:24:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_nat.ko 2022-01-24T06:24:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_nat_amanda.ko 2022-01-24T06:24:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_nat_ftp.ko 2022-01-24T06:24:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_nat_irc.ko 2022-01-24T06:24:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_nat_sip.ko 2022-01-24T06:24:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_nat_tftp.ko 2022-01-24T06:24:24.640 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_synproxy_core.ko 2022-01-24T06:24:24.640 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nf_tables.ko 2022-01-24T06:24:24.640 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nfnetlink.ko 2022-01-24T06:24:24.640 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nfnetlink_acct.ko 2022-01-24T06:24:24.640 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nfnetlink_log.ko 2022-01-24T06:24:24.641 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nfnetlink_osf.ko 2022-01-24T06:24:24.641 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nfnetlink_queue.ko 2022-01-24T06:24:24.641 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_chain_nat.ko 2022-01-24T06:24:24.641 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_compat.ko 2022-01-24T06:24:24.641 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_counter.ko 2022-01-24T06:24:24.642 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_ct.ko 2022-01-24T06:24:24.642 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_dup_netdev.ko 2022-01-24T06:24:24.642 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_fib.ko 2022-01-24T06:24:24.642 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_fwd_netdev.ko 2022-01-24T06:24:24.642 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_hash.ko 2022-01-24T06:24:24.643 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_limit.ko 2022-01-24T06:24:24.643 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_log.ko 2022-01-24T06:24:24.643 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_masq.ko 2022-01-24T06:24:24.643 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_nat.ko 2022-01-24T06:24:24.643 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_numgen.ko 2022-01-24T06:24:24.643 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_objref.ko 2022-01-24T06:24:24.644 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_queue.ko 2022-01-24T06:24:24.644 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_quota.ko 2022-01-24T06:24:24.644 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_redir.ko 2022-01-24T06:24:24.644 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_reject.ko 2022-01-24T06:24:24.644 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_reject_inet.ko 2022-01-24T06:24:24.645 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_socket.ko 2022-01-24T06:24:24.645 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/nft_tunnel.ko 2022-01-24T06:24:24.645 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_AUDIT.ko 2022-01-24T06:24:24.645 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_CHECKSUM.ko 2022-01-24T06:24:24.645 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_CLASSIFY.ko 2022-01-24T06:24:24.646 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_CONNSECMARK.ko 2022-01-24T06:24:24.646 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_CT.ko 2022-01-24T06:24:24.646 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_DSCP.ko 2022-01-24T06:24:24.646 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_HL.ko 2022-01-24T06:24:24.647 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_HMARK.ko 2022-01-24T06:24:24.647 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_IDLETIMER.ko 2022-01-24T06:24:24.647 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_LED.ko 2022-01-24T06:24:24.647 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_LOG.ko 2022-01-24T06:24:24.647 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_MASQUERADE.ko 2022-01-24T06:24:24.648 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_NETMAP.ko 2022-01-24T06:24:24.648 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_NFLOG.ko 2022-01-24T06:24:24.648 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_NFQUEUE.ko 2022-01-24T06:24:24.648 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_RATEEST.ko 2022-01-24T06:24:24.648 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_REDIRECT.ko 2022-01-24T06:24:24.649 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_SECMARK.ko 2022-01-24T06:24:24.649 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_TCPMSS.ko 2022-01-24T06:24:24.649 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2022-01-24T06:24:24.649 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_TEE.ko 2022-01-24T06:24:24.649 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_TPROXY.ko 2022-01-24T06:24:24.650 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_TRACE.ko 2022-01-24T06:24:24.650 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_addrtype.ko 2022-01-24T06:24:24.650 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_bpf.ko 2022-01-24T06:24:24.650 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_cgroup.ko 2022-01-24T06:24:24.650 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_cluster.ko 2022-01-24T06:24:24.651 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_comment.ko 2022-01-24T06:24:24.651 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_connbytes.ko 2022-01-24T06:24:24.651 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_connlabel.ko 2022-01-24T06:24:24.651 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_connlimit.ko 2022-01-24T06:24:24.652 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_connmark.ko 2022-01-24T06:24:24.652 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_conntrack.ko 2022-01-24T06:24:24.652 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_cpu.ko 2022-01-24T06:24:24.652 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_dccp.ko 2022-01-24T06:24:24.652 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_devgroup.ko 2022-01-24T06:24:24.653 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_dscp.ko 2022-01-24T06:24:24.653 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_ecn.ko 2022-01-24T06:24:24.653 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_esp.ko 2022-01-24T06:24:24.653 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_hashlimit.ko 2022-01-24T06:24:24.653 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_helper.ko 2022-01-24T06:24:24.654 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_hl.ko 2022-01-24T06:24:24.654 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_ipcomp.ko 2022-01-24T06:24:24.654 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_iprange.ko 2022-01-24T06:24:24.654 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_ipvs.ko 2022-01-24T06:24:24.654 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_l2tp.ko 2022-01-24T06:24:24.655 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_length.ko 2022-01-24T06:24:24.655 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_limit.ko 2022-01-24T06:24:24.655 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_mac.ko 2022-01-24T06:24:24.655 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_mark.ko 2022-01-24T06:24:24.655 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_multiport.ko 2022-01-24T06:24:24.656 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_nat.ko 2022-01-24T06:24:24.656 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_nfacct.ko 2022-01-24T06:24:24.656 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_osf.ko 2022-01-24T06:24:24.656 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_owner.ko 2022-01-24T06:24:24.657 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_physdev.ko 2022-01-24T06:24:24.657 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_pkttype.ko 2022-01-24T06:24:24.657 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_policy.ko 2022-01-24T06:24:24.657 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_quota.ko 2022-01-24T06:24:24.657 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_rateest.ko 2022-01-24T06:24:24.657 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_realm.ko 2022-01-24T06:24:24.658 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_recent.ko 2022-01-24T06:24:24.658 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_sctp.ko 2022-01-24T06:24:24.658 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_set.ko 2022-01-24T06:24:24.658 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_socket.ko 2022-01-24T06:24:24.659 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_state.ko 2022-01-24T06:24:24.659 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_statistic.ko 2022-01-24T06:24:24.659 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_string.ko 2022-01-24T06:24:24.659 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_tcpmss.ko 2022-01-24T06:24:24.659 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_time.ko 2022-01-24T06:24:24.659 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netfilter/xt_u32.ko 2022-01-24T06:24:24.660 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netlink 2022-01-24T06:24:24.660 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/netlink/netlink_diag.ko 2022-01-24T06:24:24.660 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/nsh 2022-01-24T06:24:24.660 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/nsh/nsh.ko 2022-01-24T06:24:24.660 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/openvswitch 2022-01-24T06:24:24.661 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/openvswitch/openvswitch.ko 2022-01-24T06:24:24.661 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/openvswitch/vport-geneve.ko 2022-01-24T06:24:24.661 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/openvswitch/vport-gre.ko 2022-01-24T06:24:24.661 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/openvswitch/vport-vxlan.ko 2022-01-24T06:24:24.661 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/packet 2022-01-24T06:24:24.662 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/packet/af_packet_diag.ko 2022-01-24T06:24:24.662 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/rds 2022-01-24T06:24:24.662 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/rds/rds.ko 2022-01-24T06:24:24.662 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/rds/rds_rdma.ko 2022-01-24T06:24:24.663 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/rds/rds_tcp.ko 2022-01-24T06:24:24.663 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched 2022-01-24T06:24:24.663 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_csum.ko 2022-01-24T06:24:24.663 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_gact.ko 2022-01-24T06:24:24.663 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_ipt.ko 2022-01-24T06:24:24.664 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_mirred.ko 2022-01-24T06:24:24.664 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_nat.ko 2022-01-24T06:24:24.664 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_pedit.ko 2022-01-24T06:24:24.664 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_police.ko 2022-01-24T06:24:24.664 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_simple.ko 2022-01-24T06:24:24.665 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_skbedit.ko 2022-01-24T06:24:24.665 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/act_vlan.ko 2022-01-24T06:24:24.665 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_basic.ko 2022-01-24T06:24:24.665 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_bpf.ko 2022-01-24T06:24:24.665 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_flow.ko 2022-01-24T06:24:24.666 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_fw.ko 2022-01-24T06:24:24.666 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_route.ko 2022-01-24T06:24:24.666 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_rsvp.ko 2022-01-24T06:24:24.666 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_rsvp6.ko 2022-01-24T06:24:24.666 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_tcindex.ko 2022-01-24T06:24:24.667 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/cls_u32.ko 2022-01-24T06:24:24.667 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/em_cmp.ko 2022-01-24T06:24:24.667 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/em_ipset.ko 2022-01-24T06:24:24.667 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/em_meta.ko 2022-01-24T06:24:24.667 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/em_nbyte.ko 2022-01-24T06:24:24.668 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/em_text.ko 2022-01-24T06:24:24.668 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/em_u32.ko 2022-01-24T06:24:24.668 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_cbq.ko 2022-01-24T06:24:24.668 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_choke.ko 2022-01-24T06:24:24.669 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_codel.ko 2022-01-24T06:24:24.669 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_drr.ko 2022-01-24T06:24:24.669 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_dsmark.ko 2022-01-24T06:24:24.669 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_fq.ko 2022-01-24T06:24:24.669 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_gred.ko 2022-01-24T06:24:24.669 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_hfsc.ko 2022-01-24T06:24:24.670 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_hhf.ko 2022-01-24T06:24:24.670 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_htb.ko 2022-01-24T06:24:24.670 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_ingress.ko 2022-01-24T06:24:24.670 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_mqprio.ko 2022-01-24T06:24:24.670 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_multiq.ko 2022-01-24T06:24:24.671 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_netem.ko 2022-01-24T06:24:24.671 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_pie.ko 2022-01-24T06:24:24.671 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_plug.ko 2022-01-24T06:24:24.671 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_prio.ko 2022-01-24T06:24:24.672 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_qfq.ko 2022-01-24T06:24:24.672 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_red.ko 2022-01-24T06:24:24.672 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_sfb.ko 2022-01-24T06:24:24.672 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_sfq.ko 2022-01-24T06:24:24.672 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_tbf.ko 2022-01-24T06:24:24.673 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sched/sch_teql.ko 2022-01-24T06:24:24.673 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sctp 2022-01-24T06:24:24.673 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sctp/sctp.ko 2022-01-24T06:24:24.673 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sctp/sctp_diag.ko 2022-01-24T06:24:24.673 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sunrpc 2022-01-24T06:24:24.674 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sunrpc/auth_gss 2022-01-24T06:24:24.674 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2022-01-24T06:24:24.674 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2022-01-24T06:24:24.674 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sunrpc/sunrpc.ko 2022-01-24T06:24:24.675 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sunrpc/xprtrdma 2022-01-24T06:24:24.675 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2022-01-24T06:24:24.675 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/tipc 2022-01-24T06:24:24.675 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/tipc/diag.ko 2022-01-24T06:24:24.675 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/tipc/tipc.ko 2022-01-24T06:24:24.676 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/unix 2022-01-24T06:24:24.676 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/unix/unix_diag.ko 2022-01-24T06:24:24.676 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/vmw_vsock 2022-01-24T06:24:24.676 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2022-01-24T06:24:24.677 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2022-01-24T06:24:24.677 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/vmw_vsock/vsock.ko 2022-01-24T06:24:24.677 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/vmw_vsock/vsock_diag.ko 2022-01-24T06:24:24.677 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/vmw_vsock/vsock_loopback.ko 2022-01-24T06:24:24.677 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/xfrm 2022-01-24T06:24:24.678 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/net/xfrm/xfrm_ipcomp.ko 2022-01-24T06:24:24.678 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/security 2022-01-24T06:24:24.678 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/security/keys 2022-01-24T06:24:24.678 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/security/keys/encrypted-keys 2022-01-24T06:24:24.678 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2022-01-24T06:24:24.679 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/security/keys/trusted-keys 2022-01-24T06:24:24.679 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/security/keys/trusted-keys/trusted.ko 2022-01-24T06:24:24.679 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/virt 2022-01-24T06:24:24.679 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/virt/lib 2022-01-24T06:24:24.679 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/kernel/virt/lib/irqbypass.ko 2022-01-24T06:24:24.680 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.alias 2022-01-24T06:24:24.680 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.alias.bin 2022-01-24T06:24:24.680 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.builtin 2022-01-24T06:24:24.680 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.builtin.bin 2022-01-24T06:24:24.680 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.builtin.modinfo 2022-01-24T06:24:24.681 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.dep 2022-01-24T06:24:24.681 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.dep.bin 2022-01-24T06:24:24.681 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.devname 2022-01-24T06:24:24.681 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.order 2022-01-24T06:24:24.681 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.softdep 2022-01-24T06:24:24.682 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.symbols 2022-01-24T06:24:24.682 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/5.16.0-ceph-gb6c65ca4359b/modules.symbols.bin 2022-01-24T06:24:24.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/lib/.build-id 2022-01-24T06:24:24.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/lib/.build-id/a9 2022-01-24T06:24:24.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/lib/.build-id/a9/c06057c542ee4129872e3f7f14daa592e55548 2022-01-24T06:24:24.683 DEBUG:teuthology.task.kernel:get_image_version: 5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.684 DEBUG:teuthology.orchestra.run.smithi164:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2022-01-24T06:24:24.707 INFO:teuthology.orchestra.run.smithi164.stdout:postinstall scriptlet (using /bin/sh): 2022-01-24T06:24:24.707 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-5.16.0-ceph-gb6c65ca4359b -a -r /boot/System.map-5.16.0-ceph-gb6c65ca4359b ]; then 2022-01-24T06:24:24.707 INFO:teuthology.orchestra.run.smithi164.stdout:cp /boot/vmlinuz-5.16.0-ceph-gb6c65ca4359b /boot/.vmlinuz-5.16.0-ceph-gb6c65ca4359b-rpm 2022-01-24T06:24:24.707 INFO:teuthology.orchestra.run.smithi164.stdout:cp /boot/System.map-5.16.0-ceph-gb6c65ca4359b /boot/.System.map-5.16.0-ceph-gb6c65ca4359b-rpm 2022-01-24T06:24:24.708 INFO:teuthology.orchestra.run.smithi164.stdout:rm -f /boot/vmlinuz-5.16.0-ceph-gb6c65ca4359b /boot/System.map-5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.708 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/installkernel 5.16.0-ceph-gb6c65ca4359b /boot/.vmlinuz-5.16.0-ceph-gb6c65ca4359b-rpm /boot/.System.map-5.16.0-ceph-gb6c65ca4359b-rpm 2022-01-24T06:24:24.708 INFO:teuthology.orchestra.run.smithi164.stdout:rm -f /boot/.vmlinuz-5.16.0-ceph-gb6c65ca4359b-rpm /boot/.System.map-5.16.0-ceph-gb6c65ca4359b-rpm 2022-01-24T06:24:24.708 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2022-01-24T06:24:24.708 INFO:teuthology.orchestra.run.smithi164.stdout:preuninstall scriptlet (using /bin/sh): 2022-01-24T06:24:24.709 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2022-01-24T06:24:24.709 INFO:teuthology.orchestra.run.smithi164.stdout:new-kernel-pkg --remove 5.16.0-ceph-gb6c65ca4359b --rminitrd --initrdfile=/boot/initramfs-5.16.0-ceph-gb6c65ca4359b.img 2022-01-24T06:24:24.709 INFO:teuthology.orchestra.run.smithi164.stdout:elif [ -x /usr/bin/kernel-install ]; then 2022-01-24T06:24:24.709 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-install remove 5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.709 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2022-01-24T06:24:24.710 INFO:teuthology.orchestra.run.smithi164.stdout:postuninstall scriptlet (using /bin/sh): 2022-01-24T06:24:24.710 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /sbin/update-bootloader ]; then 2022-01-24T06:24:24.710 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/update-bootloader --remove 5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.710 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2022-01-24T06:24:24.711 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2022-01-24T06:24:24.784 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2022-01-24T06:24:24.784 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2022-01-24T06:24:24.784 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.02 2022-01-24T06:24:24.784 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 90.el8 2022-01-24T06:24:24.785 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2022-01-24T06:24:24.785 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2022-01-24T06:24:24.785 INFO:teuthology.orchestra.run.smithi164.stdout:Group : System Environment/Base 2022-01-24T06:24:24.785 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 9197207 2022-01-24T06:24:24.786 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2022-01-24T06:24:24.786 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2022-01-24T06:24:24.786 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2022-01-24T06:24:24.786 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2022-01-24T06:24:24.786 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : kbuilder.bsys.centos.org 2022-01-24T06:24:24.787 INFO:teuthology.orchestra.run.smithi164.stdout:Relocations : (not relocatable) 2022-01-24T06:24:24.787 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : CentOS BuildSystem 2022-01-24T06:24:24.787 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2022-01-24T06:24:24.787 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2022-01-24T06:24:24.787 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2022-01-24T06:24:24.788 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2022-01-24T06:24:24.788 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:24:24.788 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-01-24T06:24:24.788 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2022-01-24T06:24:24.788 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2022-01-24T06:24:24.789 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2022-01-24T06:24:24.789 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:24:24.789 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2022-01-24T06:24:24.790 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-01-24T06:24:24.790 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:24.791 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-01-24T06:24:30.685 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2022-01-24T06:24:32.570 INFO:teuthology.orchestra.run.smithi164.stderr:done 2022-01-24T06:24:32.572 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2022-01-24T06:24:32.596 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.uAXfSO2Uw4 2022-01-24T06:24:32.597 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uAXfSO2Uw4 2022-01-24T06:24:32.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.uAXfSO2Uw4 2022-01-24T06:24:32.838 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.uAXfSO2Uw4 is 6KB 2022-01-24T06:24:32.887 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.uAXfSO2Uw4 2022-01-24T06:24:32.901 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2022-01-24T06:24:32.970 INFO:teuthology.orchestra.run.smithi164.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2022-01-24T06:24:32.970 INFO:teuthology.orchestra.run.smithi164.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2022-01-24T06:24:32.970 INFO:teuthology.orchestra.run.smithi164.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2022-01-24T06:24:32.971 INFO:teuthology.orchestra.run.smithi164.stdout:ecc66dffcd264e5181894e69c53ff13c-5.16.0-ceph-gb6c65ca4359b.conf 2022-01-24T06:24:32.972 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:24:33.126 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2022-01-24T06:25:03.128 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2022-01-24T06:25:03.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-01-24T06:25:03.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:25:37.739 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2022-01-24T06:26:07.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-01-24T06:26:07.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:26:26.123 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2022-01-24T06:26:56.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-01-24T06:26:56.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:26:56.412 DEBUG:teuthology.orchestra.run.smithi164:> true 2022-01-24T06:26:56.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-01-24T06:26:56.851 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.16.0-ceph-gb6c65ca4359b"... 2022-01-24T06:26:56.851 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2022-01-24T06:26:56.894 INFO:teuthology.orchestra.run.smithi164.stdout:5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:26:56.895 DEBUG:teuthology.task.kernel:current kernel version is 5.16.0-ceph-gb6c65ca4359b vs 5.16.0-ceph-gb6c65ca4359b 2022-01-24T06:26:56.895 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-01-24T06:26:56.895 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-01-24T06:26:57.896 DEBUG:teuthology.parallel:result is None 2022-01-24T06:26:57.897 INFO:teuthology.run_tasks:Running task internal.base... 2022-01-24T06:26:57.912 INFO:teuthology.task.internal:Creating test directory... 2022-01-24T06:26:57.913 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-01-24T06:26:57.918 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-01-24T06:26:57.921 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-01-24T06:26:57.969 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-01-24T06:26:57.980 INFO:teuthology.run_tasks:Running task internal.archive... 2022-01-24T06:26:58.003 INFO:teuthology.task.internal:Creating archive directory... 2022-01-24T06:26:58.004 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-01-24T06:26:58.007 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-01-24T06:26:58.010 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-01-24T06:26:58.086 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-01-24T06:26:58.097 INFO:teuthology.task.internal:Enabling coredump saving... 2022-01-24T06:26:58.098 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-01-24T06:26:58.101 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-01-24T06:26:58.103 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-01-24T06:26:58.147 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-24T06:26:58.151 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-24T06:26:58.166 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-24T06:26:58.168 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-24T06:26:58.238 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-24T06:26:58.277 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-24T06:26:58.282 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-01-24T06:26:58.293 INFO:teuthology.task.internal:Configuring sudo... 2022-01-24T06:26:58.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-01-24T06:26:58.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-01-24T06:26:58.299 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-01-24T06:26:58.370 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-01-24T06:26:58.384 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-01-24T06:26:58.385 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-01-24T06:26:58.387 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-01-24T06:26:58.390 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-01-24T06:26:58.433 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-24T06:26:58.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-24T06:26:58.544 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-24T06:26:58.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-24T06:26:58.664 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:26:58.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-01-24T06:26:58.728 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-24T06:26:58.771 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-24T06:26:58.816 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-24T06:26:58.898 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-24T06:26:58.939 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:26:58.939 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-01-24T06:26:59.004 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-24T06:26:59.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-24T06:26:59.163 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-24T06:26:59.235 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-24T06:26:59.305 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:26:59.306 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-01-24T06:26:59.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2022-01-24T06:26:59.391 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2022-01-24T06:26:59.394 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2022-01-24T06:26:59.453 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-01-24T06:26:59.456 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-01-24T06:26:59.569 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-01-24T06:26:59.907 INFO:teuthology.run_tasks:Running task internal.timer... 2022-01-24T06:26:59.922 INFO:teuthology.task.internal:Starting timer... 2022-01-24T06:26:59.923 INFO:teuthology.run_tasks:Running task pcp... 2022-01-24T06:26:59.973 INFO:teuthology.run_tasks:Running task selinux... 2022-01-24T06:27:00.007 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2022-01-24T06:27:00.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2022-01-24T06:27:00.104 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: [ OK ] 2022-01-24T06:27:00.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2022-01-24T06:27:00.156 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: [ OK ] 2022-01-24T06:27:00.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2022-01-24T06:27:00.273 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: [ OK ] 2022-01-24T06:27:00.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-01-24T06:27:00.278 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2022-01-24T06:27:00.304 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2022-01-24T06:27:00.305 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2022-01-24T06:27:00.327 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2022-01-24T06:27:00.328 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2022-01-24T06:27:00.375 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2022-01-24T06:27:00.376 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2022-01-24T06:27:00.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-01-24T06:27:00.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-24T06:27:00.403 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-01-24T06:27:00.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-24T06:27:00.436 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-01-24T06:27:00.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-24T06:27:00.510 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-01-24T06:27:00.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2022-01-24T06:27:00.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2022-01-24T06:27:00.559 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2022-01-24T06:27:00.640 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-01-24T06:27:00.654 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-01-24T06:27:00.663 INFO:teuthology.repo_utils:Fetching master from origin 2022-01-24T06:27:00.695 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-01-24T06:48:12.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-01-24T06:48:12.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:48:12.696 DEBUG:teuthology.orchestra.run.smithi142:> true 2022-01-24T06:48:12.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2022-01-24T06:48:12.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:48:12.851 DEBUG:teuthology.orchestra.run.smithi145:> true 2022-01-24T06:48:12.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-01-24T06:48:12.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-24T06:48:13.030 DEBUG:teuthology.orchestra.run.smithi164:> true 2022-01-24T06:48:13.151 INFO:teuthology.run_tasks:Running task clock... 2022-01-24T06:48:13.160 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-01-24T06:48:13.160 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-01-24T06:48:13.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-24T06:48:13.165 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-01-24T06:48:13.165 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-24T06:48:13.168 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-01-24T06:48:13.168 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-24T06:48:13.199 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-01-24T06:48:13.200 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-01-24T06:48:13.214 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-01-24T06:48:13.215 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-01-24T06:48:13.249 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2022-01-24T06:48:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2022-01-24T06:48:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2022-01-24T06:48:13.270 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2022-01-24T06:48:13.271 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-01-24T06:48:13.274 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-01-24T06:48:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-01-24T06:48:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-01-24T06:48:13.294 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-01-24T06:48:13.307 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-01-24T06:48:13.353 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2022-01-24T06:48:13.355 INFO:teuthology.orchestra.run.smithi142.stdout:210 Number of sources = 4 2022-01-24T06:48:13.356 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-01-24T06:48:13.356 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2022-01-24T06:48:13.356 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.356 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.357 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.357 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.367 INFO:teuthology.orchestra.run.smithi145.stderr:bash: ntpq: command not found 2022-01-24T06:48:13.371 INFO:teuthology.orchestra.run.smithi145.stdout:210 Number of sources = 4 2022-01-24T06:48:13.371 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-01-24T06:48:13.371 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2022-01-24T06:48:13.372 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.372 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.372 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.372 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.373 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2022-01-24T06:48:13.400 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2022-01-24T06:48:13.436 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-01-24T06:48:13.472 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-01-24T06:48:13.556 INFO:teuthology.orchestra.run.smithi164.stderr:bash: ntpq: command not found 2022-01-24T06:48:13.562 INFO:teuthology.orchestra.run.smithi164.stdout:210 Number of sources = 4 2022-01-24T06:48:13.562 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-01-24T06:48:13.562 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2022-01-24T06:48:13.563 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.563 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.563 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.563 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-01-24T06:48:13.564 INFO:teuthology.run_tasks:Running task install... 2022-01-24T06:48:13.576 DEBUG:teuthology.task.install:project ceph 2022-01-24T06:48:13.577 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281'}} 2022-01-24T06:48:13.577 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281'} 2022-01-24T06:48:13.577 INFO:teuthology.task.install:Using flavor: default 2022-01-24T06:48:13.584 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-01-24T06:48:13.585 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2022-01-24T06:48:13.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2022-01-24T06:48:13.621 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS 2022-01-24T06:48:13.623 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:48:13.623 DEBUG:teuthology.orchestra.run.smithi145:> sudo lsb_release -is 2022-01-24T06:48:13.624 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281', 'tag': None, 'wait_for_package': False} 2022-01-24T06:48:13.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2022-01-24T06:48:13.659 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS 2022-01-24T06:48:13.660 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:48:13.661 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-01-24T06:48:13.662 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281', 'tag': None, 'wait_for_package': False} 2022-01-24T06:48:13.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo lsb_release -is 2022-01-24T06:48:13.695 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS 2022-01-24T06:48:13.696 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:48:13.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6d0261fcb9458c90b6f509c036c9df47e35eb281 2022-01-24T06:48:13.734 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS 2022-01-24T06:48:13.735 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:48:13.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6d0261fcb9458c90b6f509c036c9df47e35eb281 2022-01-24T06:48:13.761 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS 2022-01-24T06:48:13.765 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:48:13.765 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281', 'tag': None, 'wait_for_package': False} 2022-01-24T06:48:13.766 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-01-24T06:48:13.864 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS 2022-01-24T06:48:13.868 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:48:13.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6d0261fcb9458c90b6f509c036c9df47e35eb281 2022-01-24T06:48:13.934 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/ 2022-01-24T06:48:13.934 INFO:teuthology.task.install.rpm:Package version is 15.2.15-156.g6d0261fc 2022-01-24T06:48:13.964 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/ 2022-01-24T06:48:13.965 INFO:teuthology.task.install.rpm:Package version is 15.2.15-156.g6d0261fc 2022-01-24T06:48:14.102 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/ 2022-01-24T06:48:14.103 INFO:teuthology.task.install.rpm:Package version is 15.2.15-156.g6d0261fc 2022-01-24T06:48:14.108 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-01-24T06:48:14.108 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:48:14.108 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-01-24T06:48:14.125 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-01-24T06:48:14.125 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:48:14.126 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-01-24T06:48:14.133 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-01-24T06:48:14.134 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6d0261fcb9458c90b6f509c036c9df47e35eb281/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-01-24T06:48:14.151 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-01-24T06:48:14.151 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6d0261fcb9458c90b6f509c036c9df47e35eb281/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-01-24T06:48:14.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-01-24T06:48:14.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-01-24T06:48:14.264 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/6d0261fcb9458c90b6f509c036c9df47e35eb281/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-01-24T06:48:14.264 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:48:14.265 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-01-24T06:48:14.275 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-01-24T06:48:14.290 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-01-24T06:48:14.336 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-01-24T06:48:14.337 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6d0261fcb9458c90b6f509c036c9df47e35eb281/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-01-24T06:48:14.339 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2022-01-24T06:48:14.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2022-01-24T06:48:14.354 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2022-01-24T06:48:14.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2022-01-24T06:48:14.449 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-01-24T06:48:14.548 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-01-24T06:48:14.578 INFO:teuthology.orchestra.run.smithi142.stdout:93 files removed 2022-01-24T06:48:14.595 INFO:teuthology.orchestra.run.smithi145.stdout:93 files removed 2022-01-24T06:48:14.598 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-01-24T06:48:14.615 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-01-24T06:48:14.618 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2022-01-24T06:48:14.622 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2022-01-24T06:48:14.958 INFO:teuthology.orchestra.run.smithi164.stdout:93 files removed 2022-01-24T06:48:14.990 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-01-24T06:48:15.459 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 124 kB/s | 69 kB 00:00 2022-01-24T06:48:15.462 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 127 kB/s | 69 kB 00:00 2022-01-24T06:48:15.910 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 36 kB/s | 15 kB 00:00 2022-01-24T06:48:15.941 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 34 kB/s | 15 kB 00:00 2022-01-24T06:48:15.985 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 134 kB/s | 69 kB 00:00 2022-01-24T06:48:16.249 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2022-01-24T06:48:16.283 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2022-01-24T06:48:16.341 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 47 kB/s | 15 kB 00:00 2022-01-24T06:48:16.452 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - AppStream 47 MB/s | 8.4 MB 00:00 2022-01-24T06:48:16.516 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS-8 - AppStream 40 MB/s | 8.4 MB 00:00 2022-01-24T06:48:16.738 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 3.8 kB/s | 1.4 kB 00:00 2022-01-24T06:48:16.939 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - AppStream 47 MB/s | 8.4 MB 00:00 2022-01-24T06:48:17.876 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - Base 35 MB/s | 4.6 MB 00:00 2022-01-24T06:48:18.017 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS-8 - Base 38 MB/s | 4.6 MB 00:00 2022-01-24T06:48:18.485 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - Base 38 MB/s | 4.6 MB 00:00 2022-01-24T06:48:18.584 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - Extras 168 kB/s | 10 kB 00:00 2022-01-24T06:48:18.734 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS-8 - Extras 168 kB/s | 10 kB 00:00 2022-01-24T06:48:19.254 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - Extras 141 kB/s | 10 kB 00:00 2022-01-24T06:53:52.983 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Linux 8 - AppStream 26 kB/s | 8.4 MB 05:33 2022-01-24T06:53:54.756 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Linux 8 - BaseOS 15 MB/s | 4.6 MB 00:00 2022-01-24T06:53:55.916 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Linux 8 - Extras 22 kB/s | 10 kB 00:00 2022-01-24T06:53:56.089 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - PowerTools 21 MB/s | 2.3 MB 00:00 2022-01-24T06:53:58.855 INFO:teuthology.orchestra.run.smithi164.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-01-24T06:53:59.902 INFO:teuthology.orchestra.run.smithi164.stdout:Apache Arrow 188 kB/s | 184 kB 00:00 2022-01-24T06:54:01.129 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 11 MB 00:01 2022-01-24T06:54:03.757 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 2.1 MB/s | 24 kB 00:00 2022-01-24T06:54:05.869 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-01-24T06:54:05.869 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-01-24T06:54:05.875 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-01-24T06:54:05.876 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-01-24T06:54:05.878 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-01-24T06:54:05.878 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2022-01-24T06:54:06.155 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2022-01-24T06:54:06.171 INFO:teuthology.orchestra.run.smithi164.stdout:===================================================================================================== 2022-01-24T06:54:06.171 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2022-01-24T06:54:06.172 INFO:teuthology.orchestra.run.smithi164.stdout:===================================================================================================== 2022-01-24T06:54:06.172 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2022-01-24T06:54:06.172 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-01-24T06:54:06.172 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 6.4 k 2022-01-24T06:54:06.173 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 5.6 M 2022-01-24T06:54:06.173 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 574 k 2022-01-24T06:54:06.173 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 203 k 2022-01-24T06:54:06.173 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 1.4 M 2022-01-24T06:54:06.174 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 68 k 2022-01-24T06:54:06.174 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 3.6 M 2022-01-24T06:54:06.174 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 8.6 M 2022-01-24T06:54:06.174 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 27 k 2022-01-24T06:54:06.175 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 10 M 2022-01-24T06:54:06.175 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 42 M 2022-01-24T06:54:06.175 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 59 k 2022-01-24T06:54:06.175 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.185-1.el8 CentOS-Base 59 k 2022-01-24T06:54:06.175 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-01-24T06:54:06.176 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2022-01-24T06:54:06.176 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 22 k 2022-01-24T06:54:06.176 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 509 k 2022-01-24T06:54:06.176 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 141 k 2022-01-24T06:54:06.177 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-01-24T06:54:06.177 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.32.1-28.el8 CentOS-Base 97 k 2022-01-24T06:54:06.177 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:1.1.1k-5.el8_5 CentOS-Base 2.3 M 2022-01-24T06:54:06.177 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 164 k 2022-01-24T06:54:06.178 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 364 k 2022-01-24T06:54:06.178 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 349 k 2022-01-24T06:54:06.178 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 113 k 2022-01-24T06:54:06.179 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 72 k 2022-01-24T06:54:06.179 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 2.7 M 2022-01-24T06:54:06.179 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 140 k 2022-01-24T06:54:06.179 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 5.0.0-9.el8 CentOS-Base 70 k 2022-01-24T06:54:06.180 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2022-01-24T06:54:06.180 INFO:teuthology.orchestra.run.smithi164.stdout: chkconfig x86_64 1.19.1-1.el8 CentOS-Base 198 k 2022-01-24T06:54:06.180 INFO:teuthology.orchestra.run.smithi164.stdout: e2fsprogs x86_64 1.45.6-2.el8 CentOS-Base 1.0 M 2022-01-24T06:54:06.181 INFO:teuthology.orchestra.run.smithi164.stdout: e2fsprogs-libs x86_64 1.45.6-2.el8 CentOS-Base 233 k 2022-01-24T06:54:06.181 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf x86_64 0.185-1.el8 CentOS-Base 221 k 2022-01-24T06:54:06.181 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs x86_64 0.185-1.el8 CentOS-Base 292 k 2022-01-24T06:54:06.181 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils x86_64 1.5.10-9.el8 CentOS-Base 66 k 2022-01-24T06:54:06.182 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs x86_64 1.5.10-9.el8 CentOS-Base 34 k 2022-01-24T06:54:06.182 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-libs x86_64 1.18.2-14.el8 CentOS-Base 840 k 2022-01-24T06:54:06.182 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-workstation x86_64 1.18.2-14.el8 CentOS-Base 957 k 2022-01-24T06:54:06.182 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid x86_64 2.32.1-28.el8 CentOS-Base 217 k 2022-01-24T06:54:06.183 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err x86_64 1.45.6-2.el8 CentOS-Base 49 k 2022-01-24T06:54:06.183 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk x86_64 2.32.1-28.el8 CentOS-Base 251 k 2022-01-24T06:54:06.183 INFO:teuthology.orchestra.run.smithi164.stdout: libkadm5 x86_64 1.18.2-14.el8 CentOS-Base 187 k 2022-01-24T06:54:06.184 INFO:teuthology.orchestra.run.smithi164.stdout: libmount x86_64 2.32.1-28.el8 CentOS-Base 234 k 2022-01-24T06:54:06.184 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 3.5 M 2022-01-24T06:54:06.184 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 1.9 M 2022-01-24T06:54:06.185 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux x86_64 2.9-5.el8 CentOS-Base 165 k 2022-01-24T06:54:06.185 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-utils x86_64 2.9-5.el8 CentOS-Base 243 k 2022-01-24T06:54:06.185 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol x86_64 2.9-3.el8 CentOS-Base 340 k 2022-01-24T06:54:06.185 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols x86_64 2.32.1-28.el8 CentOS-Base 177 k 2022-01-24T06:54:06.185 INFO:teuthology.orchestra.run.smithi164.stdout: libss x86_64 1.45.6-2.el8 CentOS-Base 54 k 2022-01-24T06:54:06.186 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid x86_64 2.32.1-28.el8 CentOS-Base 96 k 2022-01-24T06:54:06.186 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:1.1.1k-5.el8_5 CentOS-Base 709 k 2022-01-24T06:54:06.186 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:1.1.1k-5.el8_5 CentOS-Base 1.5 M 2022-01-24T06:54:06.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-libselinux x86_64 2.9-5.el8 CentOS-Base 283 k 2022-01-24T06:54:06.187 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux x86_64 2.32.1-28.el8 CentOS-Base 2.5 M 2022-01-24T06:54:06.187 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user x86_64 2.32.1-28.el8 CentOS-Base 100 k 2022-01-24T06:54:06.187 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs x86_64 5.0.0-9.el8 CentOS-Base 1.1 M 2022-01-24T06:54:06.187 INFO:teuthology.orchestra.run.smithi164.stdout: zlib x86_64 1.2.11-17.el8 CentOS-Base 102 k 2022-01-24T06:54:06.188 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2022-01-24T06:54:06.188 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-01-24T06:54:06.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 21 M 2022-01-24T06:54:06.188 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 24 k 2022-01-24T06:54:06.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 2.0 M 2022-01-24T06:54:06.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 192 k 2022-01-24T06:54:06.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 4.4 M 2022-01-24T06:54:06.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 17 M 2022-01-24T06:54:06.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 9.0 k 2022-01-24T06:54:06.190 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 26 k 2022-01-24T06:54:06.190 INFO:teuthology.orchestra.run.smithi164.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-01-24T06:54:06.190 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-01-24T06:54:06.190 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-01-24T06:54:06.191 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2022-01-24T06:54:06.191 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-Base 48 k 2022-01-24T06:54:06.191 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel x86_64 1.18.2-14.el8 CentOS-Base 560 k 2022-01-24T06:54:06.191 INFO:teuthology.orchestra.run.smithi164.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-01-24T06:54:06.192 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel x86_64 1.45.6-2.el8 CentOS-Base 38 k 2022-01-24T06:54:06.192 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 8.5.0-4.el8_5 CentOS-Base 643 k 2022-01-24T06:54:06.192 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-01-24T06:54:06.193 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 8.5.0-4.el8_5 CentOS-Base 170 k 2022-01-24T06:54:06.193 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-01-24T06:54:06.193 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 381 k 2022-01-24T06:54:06.193 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2022-01-24T06:54:06.194 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 3.2 M 2022-01-24T06:54:06.194 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel x86_64 2.9-5.el8 CentOS-Base 200 k 2022-01-24T06:54:06.194 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-Base 87 k 2022-01-24T06:54:06.194 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-01-24T06:54:06.195 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2022-01-24T06:54:06.195 INFO:teuthology.orchestra.run.smithi164.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2022-01-24T06:54:06.195 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-01-24T06:54:06.195 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-01-24T06:54:06.196 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2022-01-24T06:54:06.196 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2022-01-24T06:54:06.196 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2022-01-24T06:54:06.196 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2022-01-24T06:54:06.197 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2022-01-24T06:54:06.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-01-24T06:54:06.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-01-24T06:54:06.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-01-24T06:54:06.197 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-01-24T06:54:06.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-01-24T06:54:06.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 40 k 2022-01-24T06:54:06.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 77 k 2022-01-24T06:54:06.198 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-01-24T06:54:06.199 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-01-24T06:54:06.199 INFO:teuthology.orchestra.run.smithi164.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2022-01-24T06:54:06.199 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-01-24T06:54:06.199 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-01-24T06:54:06.200 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-01-24T06:54:06.200 INFO:teuthology.orchestra.run.smithi164.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-01-24T06:54:06.200 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-01-24T06:54:06.200 INFO:teuthology.orchestra.run.smithi164.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2022-01-24T06:54:06.201 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-01-24T06:54:06.201 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-01-24T06:54:06.201 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-01-24T06:54:06.201 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-01-24T06:54:06.202 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-01-24T06:54:06.202 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-01-24T06:54:06.202 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-01-24T06:54:06.202 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-01-24T06:54:06.202 INFO:teuthology.orchestra.run.smithi164.stdout: python3-lxml x86_64 4.2.3-3.el8 CentOS-AppStream 1.5 M 2022-01-24T06:54:06.203 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-01-24T06:54:06.203 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-01-24T06:54:06.203 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-01-24T06:54:06.203 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-01-24T06:54:06.204 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-01-24T06:54:06.204 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-01-24T06:54:06.204 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-01-24T06:54:06.204 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-01-24T06:54:06.205 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-01-24T06:54:06.205 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-01-24T06:54:06.205 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-01-24T06:54:06.205 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-01-24T06:54:06.205 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-01-24T06:54:06.206 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2022-01-24T06:54:06.206 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-01-24T06:54:06.206 INFO:teuthology.orchestra.run.smithi164.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-01-24T06:54:06.206 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-01-24T06:54:06.207 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2022-01-24T06:54:06.207 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-01-24T06:54:06.207 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-01-24T06:54:06.207 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-01-24T06:54:06.207 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-01-24T06:54:06.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-01-24T06:54:06.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-01-24T06:54:06.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-01-24T06:54:06.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-01-24T06:54:06.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2022-01-24T06:54:06.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-01-24T06:54:06.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2022-01-24T06:54:06.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-01-24T06:54:06.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-01-24T06:54:06.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-01-24T06:54:06.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-01-24T06:54:06.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-01-24T06:54:06.210 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-01-24T06:54:06.211 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-01-24T06:54:06.211 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-17.el8 CentOS-Base 58 k 2022-01-24T06:54:06.211 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2022-01-24T06:54:06.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2022-01-24T06:54:06.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2022-01-24T06:54:06.212 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:54:06.212 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2022-01-24T06:54:06.212 INFO:teuthology.orchestra.run.smithi164.stdout:===================================================================================================== 2022-01-24T06:54:06.213 INFO:teuthology.orchestra.run.smithi164.stdout:Install 130 Packages 2022-01-24T06:54:06.213 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 29 Packages 2022-01-24T06:54:06.213 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:54:06.214 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 193 M 2022-01-24T06:54:06.214 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2022-01-24T06:54:06.340 INFO:teuthology.orchestra.run.smithi164.stdout:(1/159): ceph-15.2.15-156.g6d0261fc.el8.x86_64. 45 kB/s | 6.4 kB 00:00 2022-01-24T06:54:06.549 INFO:teuthology.orchestra.run.smithi164.stdout:(2/159): ceph-fuse-15.2.15-156.g6d0261fc.el8.x8 2.7 MB/s | 574 kB 00:00 2022-01-24T06:54:06.601 INFO:teuthology.orchestra.run.smithi164.stdout:(3/159): ceph-immutable-object-cache-15.2.15-15 3.8 MB/s | 203 kB 00:00 2022-01-24T06:54:06.893 INFO:teuthology.orchestra.run.smithi164.stdout:(4/159): ceph-mds-15.2.15-156.g6d0261fc.el8.x86 7.0 MB/s | 2.0 MB 00:00 2022-01-24T06:54:07.029 INFO:teuthology.orchestra.run.smithi164.stdout:(5/159): ceph-base-15.2.15-156.g6d0261fc.el8.x8 6.7 MB/s | 5.6 MB 00:00 2022-01-24T06:54:07.082 INFO:teuthology.orchestra.run.smithi164.stdout:(6/159): ceph-mgr-15.2.15-156.g6d0261fc.el8.x86 7.6 MB/s | 1.4 MB 00:00 2022-01-24T06:54:07.478 INFO:teuthology.orchestra.run.smithi164.stdout:(7/159): ceph-mon-15.2.15-156.g6d0261fc.el8.x86 9.7 MB/s | 4.4 MB 00:00 2022-01-24T06:54:08.357 INFO:teuthology.orchestra.run.smithi164.stdout:(8/159): ceph-common-15.2.15-156.g6d0261fc.el8. 9.6 MB/s | 21 MB 00:02 2022-01-24T06:54:08.415 INFO:teuthology.orchestra.run.smithi164.stdout:(9/159): ceph-selinux-15.2.15-156.g6d0261fc.el8 447 kB/s | 26 kB 00:00 2022-01-24T06:54:08.507 INFO:teuthology.orchestra.run.smithi164.stdout:(10/159): ceph-radosgw-15.2.15-156.g6d0261fc.el 9.7 MB/s | 10 MB 00:01 2022-01-24T06:54:08.583 INFO:teuthology.orchestra.run.smithi164.stdout:(11/159): libcephfs-devel-15.2.15-156.g6d0261fc 287 kB/s | 22 kB 00:00 2022-01-24T06:54:08.660 INFO:teuthology.orchestra.run.smithi164.stdout:(12/159): libcephfs2-15.2.15-156.g6d0261fc.el8. 6.5 MB/s | 509 kB 00:00 2022-01-24T06:54:08.725 INFO:teuthology.orchestra.run.smithi164.stdout:(13/159): librados-devel-15.2.15-156.g6d0261fc. 2.1 MB/s | 141 kB 00:00 2022-01-24T06:54:08.798 INFO:teuthology.orchestra.run.smithi164.stdout:(14/159): libradosstriper1-15.2.15-156.g6d0261f 5.1 MB/s | 381 kB 00:00 2022-01-24T06:54:08.909 INFO:teuthology.orchestra.run.smithi164.stdout:(15/159): ceph-osd-15.2.15-156.g6d0261fc.el8.x8 9.2 MB/s | 17 MB 00:01 2022-01-24T06:54:08.971 INFO:teuthology.orchestra.run.smithi164.stdout:(16/159): python3-ceph-argparse-15.2.15-156.g6d 649 kB/s | 40 kB 00:00 2022-01-24T06:54:09.034 INFO:teuthology.orchestra.run.smithi164.stdout:(17/159): python3-ceph-common-15.2.15-156.g6d02 1.2 MB/s | 77 kB 00:00 2022-01-24T06:54:09.084 INFO:teuthology.orchestra.run.smithi164.stdout:(18/159): librgw2-15.2.15-156.g6d0261fc.el8.x86 11 MB/s | 3.2 MB 00:00 2022-01-24T06:54:09.099 INFO:teuthology.orchestra.run.smithi164.stdout:(19/159): python3-cephfs-15.2.15-156.g6d0261fc. 2.5 MB/s | 164 kB 00:00 2022-01-24T06:54:09.139 INFO:teuthology.orchestra.run.smithi164.stdout:(20/159): python3-rados-15.2.15-156.g6d0261fc.e 6.4 MB/s | 364 kB 00:00 2022-01-24T06:54:09.155 INFO:teuthology.orchestra.run.smithi164.stdout:(21/159): python3-rbd-15.2.15-156.g6d0261fc.el8 6.0 MB/s | 349 kB 00:00 2022-01-24T06:54:09.191 INFO:teuthology.orchestra.run.smithi164.stdout:(22/159): python3-rgw-15.2.15-156.g6d0261fc.el8 2.2 MB/s | 113 kB 00:00 2022-01-24T06:54:09.194 INFO:teuthology.orchestra.run.smithi164.stdout:(23/159): rbd-fuse-15.2.15-156.g6d0261fc.el8.x8 1.9 MB/s | 72 kB 00:00 2022-01-24T06:54:09.262 INFO:teuthology.orchestra.run.smithi164.stdout:(24/159): rbd-nbd-15.2.15-156.g6d0261fc.el8.x86 2.0 MB/s | 140 kB 00:00 2022-01-24T06:54:09.323 INFO:teuthology.orchestra.run.smithi164.stdout:(25/159): ceph-grafana-dashboards-15.2.15-156.g 390 kB/s | 24 kB 00:00 2022-01-24T06:54:09.387 INFO:teuthology.orchestra.run.smithi164.stdout:(26/159): ceph-mgr-cephadm-15.2.15-156.g6d0261f 1.1 MB/s | 68 kB 00:00 2022-01-24T06:54:09.434 INFO:teuthology.orchestra.run.smithi164.stdout:(27/159): rbd-mirror-15.2.15-156.g6d0261fc.el8. 11 MB/s | 2.7 MB 00:00 2022-01-24T06:54:09.841 INFO:teuthology.orchestra.run.smithi164.stdout:(28/159): ceph-mgr-dashboard-15.2.15-156.g6d026 7.9 MB/s | 3.6 MB 00:00 2022-01-24T06:54:09.910 INFO:teuthology.orchestra.run.smithi164.stdout:(29/159): ceph-mgr-modules-core-15.2.15-156.g6d 2.7 MB/s | 192 kB 00:00 2022-01-24T06:54:09.972 INFO:teuthology.orchestra.run.smithi164.stdout:(30/159): ceph-mgr-rook-15.2.15-156.g6d0261fc.e 437 kB/s | 27 kB 00:00 2022-01-24T06:54:10.033 INFO:teuthology.orchestra.run.smithi164.stdout:(31/159): ceph-prometheus-alerts-15.2.15-156.g6 148 kB/s | 9.0 kB 00:00 2022-01-24T06:54:10.096 INFO:teuthology.orchestra.run.smithi164.stdout:(32/159): cephadm-15.2.15-156.g6d0261fc.el8.noa 947 kB/s | 59 kB 00:00 2022-01-24T06:54:10.137 INFO:teuthology.orchestra.run.smithi164.stdout:(33/159): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2022-01-24T06:54:10.151 INFO:teuthology.orchestra.run.smithi164.stdout:(34/159): bison-3.0.4-10.el8.x86_64.rpm 53 MB/s | 688 kB 00:00 2022-01-24T06:54:10.157 INFO:teuthology.orchestra.run.smithi164.stdout:(35/159): flex-2.6.1-9.el8.x86_64.rpm 46 MB/s | 320 kB 00:00 2022-01-24T06:54:10.162 INFO:teuthology.orchestra.run.smithi164.stdout:(36/159): jq-1.5-12.el8.x86_64.rpm 37 MB/s | 161 kB 00:00 2022-01-24T06:54:10.170 INFO:teuthology.orchestra.run.smithi164.stdout:(37/159): librdkafka-0.11.4-1.el8.x86_64.rpm 48 MB/s | 353 kB 00:00 2022-01-24T06:54:10.185 INFO:teuthology.orchestra.run.smithi164.stdout:(38/159): libtool-2.4.6-25.el8.x86_64.rpm 48 MB/s | 709 kB 00:00 2022-01-24T06:54:10.190 INFO:teuthology.orchestra.run.smithi164.stdout:(39/159): lttng-ust-2.8.1-11.el8.x86_64.rpm 46 MB/s | 259 kB 00:00 2022-01-24T06:54:10.195 INFO:teuthology.orchestra.run.smithi164.stdout:(40/159): oniguruma-6.8.2-2.el8.x86_64.rpm 48 MB/s | 187 kB 00:00 2022-01-24T06:54:10.252 INFO:teuthology.orchestra.run.smithi164.stdout:(41/159): ceph-mgr-diskprediction-local-15.2.15 11 MB/s | 8.6 MB 00:00 2022-01-24T06:54:10.323 INFO:teuthology.orchestra.run.smithi164.stdout:(42/159): openblas-0.3.12-1.el8.x86_64.rpm 36 MB/s | 4.6 MB 00:00 2022-01-24T06:54:10.423 INFO:teuthology.orchestra.run.smithi164.stdout:(43/159): openblas-threads-0.3.12-1.el8.x86_64. 28 MB/s | 4.7 MB 00:00 2022-01-24T06:54:10.431 INFO:teuthology.orchestra.run.smithi164.stdout:(44/159): python3-html5lib-0.999999999-6.el8.no 27 MB/s | 214 kB 00:00 2022-01-24T06:54:10.445 INFO:teuthology.orchestra.run.smithi164.stdout:(45/159): python3-jinja2-2.10.1-3.el8.noarch.rp 37 MB/s | 538 kB 00:00 2022-01-24T06:54:10.447 INFO:teuthology.orchestra.run.smithi164.stdout:(46/159): python3-jsonpatch-1.21-2.el8.noarch.r 17 MB/s | 27 kB 00:00 2022-01-24T06:54:10.449 INFO:teuthology.orchestra.run.smithi164.stdout:(47/159): python3-jsonpointer-1.10-11.el8.noarc 13 MB/s | 20 kB 00:00 2022-01-24T06:54:10.470 INFO:teuthology.orchestra.run.smithi164.stdout:(48/159): python3-babel-2.5.1-7.el8.noarch.rpm 33 MB/s | 4.8 MB 00:00 2022-01-24T06:54:10.476 INFO:teuthology.orchestra.run.smithi164.stdout:(49/159): python3-mako-1.0.6-13.el8.noarch.rpm 24 MB/s | 157 kB 00:00 2022-01-24T06:54:10.479 INFO:teuthology.orchestra.run.smithi164.stdout:(50/159): python3-markupsafe-0.23-19.el8.x86_64 15 MB/s | 39 kB 00:00 2022-01-24T06:54:10.509 INFO:teuthology.orchestra.run.smithi164.stdout:(51/159): python3-lxml-4.2.3-3.el8.x86_64.rpm 25 MB/s | 1.5 MB 00:00 2022-01-24T06:54:10.520 INFO:teuthology.orchestra.run.smithi164.stdout:(52/159): python3-numpy-f2py-1.14.3-10.el8.x86_ 20 MB/s | 225 kB 00:00 2022-01-24T06:54:10.524 INFO:teuthology.orchestra.run.smithi164.stdout:(53/159): python3-prettytable-0.7.2-14.el8.noar 14 MB/s | 44 kB 00:00 2022-01-24T06:54:10.528 INFO:teuthology.orchestra.run.smithi164.stdout:(54/159): python3-pyOpenSSL-19.0.0-1.el8.noarch 26 MB/s | 103 kB 00:00 2022-01-24T06:54:10.535 INFO:teuthology.orchestra.run.smithi164.stdout:(55/159): python3-pyasn1-0.3.7-6.el8.noarch.rpm 17 MB/s | 126 kB 00:00 2022-01-24T06:54:10.541 INFO:teuthology.orchestra.run.smithi164.stdout:(56/159): python3-pyasn1-modules-0.3.7-6.el8.no 21 MB/s | 110 kB 00:00 2022-01-24T06:54:10.551 INFO:teuthology.orchestra.run.smithi164.stdout:(57/159): python3-pytz-2017.2-9.el8.noarch.rpm 5.7 MB/s | 54 kB 00:00 2022-01-24T06:54:10.568 INFO:teuthology.orchestra.run.smithi164.stdout:(58/159): python3-numpy-1.14.3-10.el8.x86_64.rp 42 MB/s | 3.7 MB 00:00 2022-01-24T06:54:10.576 INFO:teuthology.orchestra.run.smithi164.stdout:(59/159): python3-webencodings-0.5.1-6.el8.noar 3.5 MB/s | 27 kB 00:00 2022-01-24T06:54:10.604 INFO:teuthology.orchestra.run.smithi164.stdout:(60/159): python3-werkzeug-0.12.2-4.el8.noarch. 16 MB/s | 457 kB 00:00 2022-01-24T06:54:10.615 INFO:teuthology.orchestra.run.smithi164.stdout:(61/159): socat-1.7.4.1-1.el8.x86_64.rpm 30 MB/s | 323 kB 00:00 2022-01-24T06:54:10.619 INFO:teuthology.orchestra.run.smithi164.stdout:(62/159): elfutils-libelf-devel-0.185-1.el8.x86 15 MB/s | 59 kB 00:00 2022-01-24T06:54:10.625 INFO:teuthology.orchestra.run.smithi164.stdout:(63/159): fuse-2.9.7-12.el8.x86_64.rpm 17 MB/s | 82 kB 00:00 2022-01-24T06:54:10.628 INFO:teuthology.orchestra.run.smithi164.stdout:(64/159): keyutils-libs-devel-1.5.10-9.el8.x86_ 18 MB/s | 48 kB 00:00 2022-01-24T06:54:10.643 INFO:teuthology.orchestra.run.smithi164.stdout:(65/159): krb5-devel-1.18.2-14.el8.x86_64.rpm 38 MB/s | 560 kB 00:00 2022-01-24T06:54:10.645 INFO:teuthology.orchestra.run.smithi164.stdout:(66/159): libaio-devel-0.3.112-1.el8.x86_64.rpm 9.5 MB/s | 19 kB 00:00 2022-01-24T06:54:10.648 INFO:teuthology.orchestra.run.smithi164.stdout:(67/159): libcom_err-devel-1.45.6-2.el8.x86_64. 14 MB/s | 38 kB 00:00 2022-01-24T06:54:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:(68/159): libgfortran-8.5.0-4.el8_5.x86_64.rpm 36 MB/s | 643 kB 00:00 2022-01-24T06:54:10.672 INFO:teuthology.orchestra.run.smithi164.stdout:(69/159): libquadmath-8.5.0-4.el8_5.x86_64.rpm 33 MB/s | 170 kB 00:00 2022-01-24T06:54:10.674 INFO:teuthology.orchestra.run.smithi164.stdout:(70/159): librabbitmq-0.9.0-3.el8.x86_64.rpm 20 MB/s | 47 kB 00:00 2022-01-24T06:54:10.682 INFO:teuthology.orchestra.run.smithi164.stdout:(71/159): libselinux-devel-2.9-5.el8.x86_64.rpm 28 MB/s | 200 kB 00:00 2022-01-24T06:54:10.685 INFO:teuthology.orchestra.run.smithi164.stdout:(72/159): libsepol-devel-2.9-3.el8.x86_64.rpm 25 MB/s | 87 kB 00:00 2022-01-24T06:54:10.690 INFO:teuthology.orchestra.run.smithi164.stdout:(73/159): libuuid-devel-2.32.1-28.el8.x86_64.rp 25 MB/s | 97 kB 00:00 2022-01-24T06:54:10.692 INFO:teuthology.orchestra.run.smithi164.stdout:(74/159): libverto-devel-0.3.0-5.el8.x86_64.rpm 9.1 MB/s | 18 kB 00:00 2022-01-24T06:54:10.700 INFO:teuthology.orchestra.run.smithi164.stdout:(75/159): libxslt-1.1.32-6.el8.x86_64.rpm 34 MB/s | 250 kB 00:00 2022-01-24T06:54:10.760 INFO:teuthology.orchestra.run.smithi164.stdout:(76/159): openssl-devel-1.1.1k-5.el8_5.x86_64.r 39 MB/s | 2.3 MB 00:00 2022-01-24T06:54:10.776 INFO:teuthology.orchestra.run.smithi164.stdout:(77/159): pcre2-devel-10.32-2.el8.x86_64.rpm 37 MB/s | 605 kB 00:00 2022-01-24T06:54:10.785 INFO:teuthology.orchestra.run.smithi164.stdout:(78/159): pcre2-utf16-10.32-2.el8.x86_64.rpm 29 MB/s | 229 kB 00:00 2022-01-24T06:54:10.791 INFO:teuthology.orchestra.run.smithi164.stdout:(79/159): pcre2-utf32-10.32-2.el8.x86_64.rpm 35 MB/s | 220 kB 00:00 2022-01-24T06:54:10.799 INFO:teuthology.orchestra.run.smithi164.stdout:(80/159): python3-cffi-1.11.5-5.el8.x86_64.rpm 30 MB/s | 237 kB 00:00 2022-01-24T06:54:10.806 INFO:teuthology.orchestra.run.smithi164.stdout:(81/159): python3-chardet-3.0.4-7.el8.noarch.rp 30 MB/s | 195 kB 00:00 2022-01-24T06:54:10.822 INFO:teuthology.orchestra.run.smithi164.stdout:(82/159): python3-cryptography-3.2.1-5.el8.x86_ 36 MB/s | 559 kB 00:00 2022-01-24T06:54:10.826 INFO:teuthology.orchestra.run.smithi164.stdout:(83/159): python3-idna-2.5-5.el8.noarch.rpm 25 MB/s | 97 kB 00:00 2022-01-24T06:54:10.829 INFO:teuthology.orchestra.run.smithi164.stdout:(84/159): python3-jwt-1.6.1-2.el8.noarch.rpm 17 MB/s | 43 kB 00:00 2022-01-24T06:54:10.835 INFO:teuthology.orchestra.run.smithi164.stdout:(85/159): python3-oauthlib-2.1.0-1.el8.noarch.r 28 MB/s | 155 kB 00:00 2022-01-24T06:54:10.839 INFO:teuthology.orchestra.run.smithi164.stdout:(86/159): python3-pycparser-2.14-14.el8.noarch. 26 MB/s | 109 kB 00:00 2022-01-24T06:54:10.842 INFO:teuthology.orchestra.run.smithi164.stdout:(87/159): python3-pysocks-1.6.8-3.el8.noarch.rp 17 MB/s | 34 kB 00:00 2022-01-24T06:54:10.847 INFO:teuthology.orchestra.run.smithi164.stdout:(88/159): python3-requests-2.20.0-2.1.el8_1.noa 24 MB/s | 123 kB 00:00 2022-01-24T06:54:10.850 INFO:teuthology.orchestra.run.smithi164.stdout:(89/159): python3-requests-oauthlib-1.0.0-1.el8 19 MB/s | 43 kB 00:00 2022-01-24T06:54:10.858 INFO:teuthology.orchestra.run.smithi164.stdout:(90/159): python3-urllib3-1.24.2-5.el8.noarch.r 22 MB/s | 177 kB 00:00 2022-01-24T06:54:10.862 INFO:teuthology.orchestra.run.smithi164.stdout:(91/159): xfsprogs-devel-5.0.0-9.el8.x86_64.rpm 21 MB/s | 70 kB 00:00 2022-01-24T06:54:11.016 INFO:teuthology.orchestra.run.smithi164.stdout:(92/159): ceph-test-15.2.15-156.g6d0261fc.el8.x 16 MB/s | 42 MB 00:02 2022-01-24T06:54:11.017 INFO:teuthology.orchestra.run.smithi164.stdout:(93/159): zlib-devel-1.2.11-17.el8.x86_64.rpm 372 kB/s | 58 kB 00:00 2022-01-24T06:54:11.092 INFO:teuthology.orchestra.run.smithi164.stdout:(94/159): python3-scipy-1.0.0-21.module_el8.5.0 25 MB/s | 14 MB 00:00 2022-01-24T06:54:11.206 INFO:teuthology.orchestra.run.smithi164.stdout:(95/159): fmt-6.2.1-1.el8.x86_64.rpm 613 kB/s | 116 kB 00:00 2022-01-24T06:54:11.231 INFO:teuthology.orchestra.run.smithi164.stdout:(96/159): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2022-01-24T06:54:11.233 INFO:teuthology.orchestra.run.smithi164.stdout:(97/159): leveldb-1.22-1.el8.x86_64.rpm 1.3 MB/s | 181 kB 00:00 2022-01-24T06:54:11.235 INFO:teuthology.orchestra.run.smithi164.stdout:(98/159): liboath-2.6.2-3.el8.x86_64.rpm 2.0 MB/s | 59 kB 00:00 2022-01-24T06:54:11.260 INFO:teuthology.orchestra.run.smithi164.stdout:(99/159): libunwind-1.3.1-3.el8.x86_64.rpm 2.6 MB/s | 75 kB 00:00 2022-01-24T06:54:11.261 INFO:teuthology.orchestra.run.smithi164.stdout:(100/159): python3-apipkg-1.5-6.el8.noarch.rpm 746 kB/s | 21 kB 00:00 2022-01-24T06:54:11.264 INFO:teuthology.orchestra.run.smithi164.stdout:(101/159): python3-bcrypt-3.1.6-2.el8.1.x86_64. 1.5 MB/s | 44 kB 00:00 2022-01-24T06:54:11.291 INFO:teuthology.orchestra.run.smithi164.stdout:(102/159): python3-beautifulsoup4-4.6.3-2.el8.1 5.9 MB/s | 185 kB 00:00 2022-01-24T06:54:11.292 INFO:teuthology.orchestra.run.smithi164.stdout:(103/159): python3-cachetools-3.1.1-4.el8.noarc 1.1 MB/s | 33 kB 00:00 2022-01-24T06:54:11.294 INFO:teuthology.orchestra.run.smithi164.stdout:(104/159): python3-certifi-2018.10.15-7.el8.noa 551 kB/s | 16 kB 00:00 2022-01-24T06:54:11.321 INFO:teuthology.orchestra.run.smithi164.stdout:(105/159): python3-cheroot-8.5.2-1.el8.noarch.r 5.6 MB/s | 173 kB 00:00 2022-01-24T06:54:11.325 INFO:teuthology.orchestra.run.smithi164.stdout:(106/159): python3-cssselect-0.9.2-10.el8.noarc 1.3 MB/s | 40 kB 00:00 2022-01-24T06:54:11.356 INFO:teuthology.orchestra.run.smithi164.stdout:(107/159): python3-google-auth-1.1.1-10.el8.noa 2.6 MB/s | 81 kB 00:00 2022-01-24T06:54:11.377 INFO:teuthology.orchestra.run.smithi164.stdout:(108/159): python3-cherrypy-18.4.0-1.el8.noarch 4.4 MB/s | 384 kB 00:00 2022-01-24T06:54:11.381 INFO:teuthology.orchestra.run.smithi164.stdout:(109/159): python3-execnet-1.7.1-1.el8.noarch.r 5.8 MB/s | 355 kB 00:00 2022-01-24T06:54:11.386 INFO:teuthology.orchestra.run.smithi164.stdout:(110/159): python3-jaraco-6.2-6.el8.noarch.rpm 373 kB/s | 11 kB 00:00 2022-01-24T06:54:11.406 INFO:teuthology.orchestra.run.smithi164.stdout:(111/159): python3-jaraco-functools-2.0-4.el8.n 618 kB/s | 18 kB 00:00 2022-01-24T06:54:11.416 INFO:teuthology.orchestra.run.smithi164.stdout:(112/159): python3-logutils-0.3.5-11.el8.noarch 1.6 MB/s | 49 kB 00:00 2022-01-24T06:54:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:(113/159): python3-more-itertools-7.2.0-3.el8.n 2.0 MB/s | 59 kB 00:00 2022-01-24T06:54:11.463 INFO:teuthology.orchestra.run.smithi164.stdout:(114/159): python3-portend-2.6-1.el8.noarch.rpm 557 kB/s | 16 kB 00:00 2022-01-24T06:54:11.476 INFO:teuthology.orchestra.run.smithi164.stdout:(115/159): python3-pecan-1.3.2-9.el8.noarch.rpm 4.6 MB/s | 283 kB 00:00 2022-01-24T06:54:11.493 INFO:teuthology.orchestra.run.smithi164.stdout:(116/159): python3-remoto-1.2.1-1.el8.noarch.rp 1.6 MB/s | 49 kB 00:00 2022-01-24T06:54:11.506 INFO:teuthology.orchestra.run.smithi164.stdout:(117/159): python3-repoze-lru-0.7-6.el8.noarch. 1.1 MB/s | 34 kB 00:00 2022-01-24T06:54:11.524 INFO:teuthology.orchestra.run.smithi164.stdout:(118/159): python3-routes-2.4.1-12.el8.noarch.r 6.2 MB/s | 196 kB 00:00 2022-01-24T06:54:11.536 INFO:teuthology.orchestra.run.smithi164.stdout:(119/159): python3-rsa-4.8-1.el8.noarch.rpm 2.0 MB/s | 61 kB 00:00 2022-01-24T06:54:11.554 INFO:teuthology.orchestra.run.smithi164.stdout:(120/159): python3-simplegeneric-0.8.1-17.el8.n 641 kB/s | 19 kB 00:00 2022-01-24T06:54:11.559 INFO:teuthology.orchestra.run.smithi164.stdout:(121/159): python3-kubernetes-11.0.0-6.el8.noar 6.6 MB/s | 1.2 MB 00:00 2022-01-24T06:54:11.564 INFO:teuthology.orchestra.run.smithi164.stdout:(122/159): python3-singledispatch-3.4.0.3-18.el 827 kB/s | 24 kB 00:00 2022-01-24T06:54:11.582 INFO:teuthology.orchestra.run.smithi164.stdout:(123/159): python3-tempora-1.14.1-5.el8.noarch. 1.0 MB/s | 29 kB 00:00 2022-01-24T06:54:11.587 INFO:teuthology.orchestra.run.smithi164.stdout:(124/159): python3-trustme-0.6.0-4.el8.noarch.r 965 kB/s | 27 kB 00:00 2022-01-24T06:54:11.616 INFO:teuthology.orchestra.run.smithi164.stdout:(125/159): python3-websocket-client-0.56.0-5.el 2.1 MB/s | 61 kB 00:00 2022-01-24T06:54:11.623 INFO:teuthology.orchestra.run.smithi164.stdout:(126/159): python3-waitress-1.2.1-2.el8.1.noarc 4.1 MB/s | 241 kB 00:00 2022-01-24T06:54:11.640 INFO:teuthology.orchestra.run.smithi164.stdout:(127/159): python3-webob-1.8.5-1.el8.1.noarch.r 4.3 MB/s | 251 kB 00:00 2022-01-24T06:54:11.645 INFO:teuthology.orchestra.run.smithi164.stdout:(128/159): python3-webtest-2.0.33-1.el8.noarch. 2.9 MB/s | 85 kB 00:00 2022-01-24T06:54:11.653 INFO:teuthology.orchestra.run.smithi164.stdout:(129/159): python3-zc-lockfile-2.0-2.el8.noarch 764 kB/s | 23 kB 00:00 2022-01-24T06:54:11.668 INFO:teuthology.orchestra.run.smithi164.stdout:(130/159): xmlstarlet-1.6.1-11.el8.x86_64.rpm 2.4 MB/s | 69 kB 00:00 2022-01-24T06:54:11.673 INFO:teuthology.orchestra.run.smithi164.stdout:(131/159): chkconfig-1.19.1-1.el8.x86_64.rpm 45 MB/s | 198 kB 00:00 2022-01-24T06:54:11.693 INFO:teuthology.orchestra.run.smithi164.stdout:(132/159): e2fsprogs-1.45.6-2.el8.x86_64.rpm 53 MB/s | 1.0 MB 00:00 2022-01-24T06:54:11.698 INFO:teuthology.orchestra.run.smithi164.stdout:(133/159): e2fsprogs-libs-1.45.6-2.el8.x86_64.r 47 MB/s | 233 kB 00:00 2022-01-24T06:54:11.707 INFO:teuthology.orchestra.run.smithi164.stdout:(134/159): elfutils-libelf-0.185-1.el8.x86_64.r 24 MB/s | 221 kB 00:00 2022-01-24T06:54:11.712 INFO:teuthology.orchestra.run.smithi164.stdout:(135/159): elfutils-libs-0.185-1.el8.x86_64.rpm 57 MB/s | 292 kB 00:00 2022-01-24T06:54:11.715 INFO:teuthology.orchestra.run.smithi164.stdout:(136/159): keyutils-1.5.10-9.el8.x86_64.rpm 28 MB/s | 66 kB 00:00 2022-01-24T06:54:11.717 INFO:teuthology.orchestra.run.smithi164.stdout:(137/159): keyutils-libs-1.5.10-9.el8.x86_64.rp 19 MB/s | 34 kB 00:00 2022-01-24T06:54:11.731 INFO:teuthology.orchestra.run.smithi164.stdout:(138/159): krb5-libs-1.18.2-14.el8.x86_64.rpm 60 MB/s | 840 kB 00:00 2022-01-24T06:54:11.746 INFO:teuthology.orchestra.run.smithi164.stdout:(139/159): krb5-workstation-1.18.2-14.el8.x86_6 65 MB/s | 957 kB 00:00 2022-01-24T06:54:11.750 INFO:teuthology.orchestra.run.smithi164.stdout:(140/159): libblkid-2.32.1-28.el8.x86_64.rpm 50 MB/s | 217 kB 00:00 2022-01-24T06:54:11.757 INFO:teuthology.orchestra.run.smithi164.stdout:(141/159): libcom_err-1.45.6-2.el8.x86_64.rpm 6.7 MB/s | 49 kB 00:00 2022-01-24T06:54:11.762 INFO:teuthology.orchestra.run.smithi164.stdout:(142/159): libfdisk-2.32.1-28.el8.x86_64.rpm 57 MB/s | 251 kB 00:00 2022-01-24T06:54:11.766 INFO:teuthology.orchestra.run.smithi164.stdout:(143/159): libkadm5-1.18.2-14.el8.x86_64.rpm 46 MB/s | 187 kB 00:00 2022-01-24T06:54:11.771 INFO:teuthology.orchestra.run.smithi164.stdout:(144/159): libmount-2.32.1-28.el8.x86_64.rpm 50 MB/s | 234 kB 00:00 2022-01-24T06:54:11.775 INFO:teuthology.orchestra.run.smithi164.stdout:(145/159): libselinux-2.9-5.el8.x86_64.rpm 47 MB/s | 165 kB 00:00 2022-01-24T06:54:11.779 INFO:teuthology.orchestra.run.smithi164.stdout:(146/159): libselinux-utils-2.9-5.el8.x86_64.rp 52 MB/s | 243 kB 00:00 2022-01-24T06:54:11.785 INFO:teuthology.orchestra.run.smithi164.stdout:(147/159): libsepol-2.9-3.el8.x86_64.rpm 60 MB/s | 340 kB 00:00 2022-01-24T06:54:11.789 INFO:teuthology.orchestra.run.smithi164.stdout:(148/159): libsmartcols-2.32.1-28.el8.x86_64.rp 49 MB/s | 177 kB 00:00 2022-01-24T06:54:11.791 INFO:teuthology.orchestra.run.smithi164.stdout:(149/159): libss-1.45.6-2.el8.x86_64.rpm 29 MB/s | 54 kB 00:00 2022-01-24T06:54:11.794 INFO:teuthology.orchestra.run.smithi164.stdout:(150/159): libuuid-2.32.1-28.el8.x86_64.rpm 38 MB/s | 96 kB 00:00 2022-01-24T06:54:11.806 INFO:teuthology.orchestra.run.smithi164.stdout:(151/159): openssl-1.1.1k-5.el8_5.x86_64.rpm 58 MB/s | 709 kB 00:00 2022-01-24T06:54:11.828 INFO:teuthology.orchestra.run.smithi164.stdout:(152/159): openssl-libs-1.1.1k-5.el8_5.x86_64.r 67 MB/s | 1.5 MB 00:00 2022-01-24T06:54:11.834 INFO:teuthology.orchestra.run.smithi164.stdout:(153/159): python3-libselinux-2.9-5.el8.x86_64. 55 MB/s | 283 kB 00:00 2022-01-24T06:54:11.883 INFO:teuthology.orchestra.run.smithi164.stdout:(154/159): util-linux-2.32.1-28.el8.x86_64.rpm 51 MB/s | 2.5 MB 00:00 2022-01-24T06:54:11.886 INFO:teuthology.orchestra.run.smithi164.stdout:(155/159): util-linux-user-2.32.1-28.el8.x86_64 31 MB/s | 100 kB 00:00 2022-01-24T06:54:11.909 INFO:teuthology.orchestra.run.smithi164.stdout:(156/159): xfsprogs-5.0.0-9.el8.x86_64.rpm 48 MB/s | 1.1 MB 00:00 2022-01-24T06:54:11.911 INFO:teuthology.orchestra.run.smithi164.stdout:(157/159): zlib-1.2.11-17.el8.x86_64.rpm 34 MB/s | 102 kB 00:00 2022-01-24T06:54:11.931 INFO:teuthology.orchestra.run.smithi164.stdout:(158/159): librbd1-15.2.15-156.g6d0261fc.el8.x8 6.9 MB/s | 1.9 MB 00:00 2022-01-24T06:54:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:(159/159): librados2-15.2.15-156.g6d0261fc.el8. 9.2 MB/s | 3.5 MB 00:00 2022-01-24T06:54:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2022-01-24T06:54:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:Total 33 MB/s | 193 MB 00:05 2022-01-24T06:54:12.301 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2022-01-24T06:54:12.754 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2022-01-24T06:54:12.754 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2022-01-24T06:54:14.272 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2022-01-24T06:54:14.276 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2022-01-24T06:54:20.412 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Linux 8 - AppStream 24 kB/s | 8.4 MB 06:01 2022-01-24T06:54:20.550 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2022-01-24T06:54:20.635 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: zlib-1.2.11-17.el8.x86_64 1/1 2022-01-24T06:54:20.926 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : zlib-1.2.11-17.el8.x86_64 1/188 2022-01-24T06:54:21.153 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:1.1.1k-5.el8_5.x86_64 2/188 2022-01-24T06:54:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:1.1.1k-5.el8_5.x86_64 2/188 2022-01-24T06:54:21.407 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fmt-6.2.1-1.el8.x86_64 3/188 2022-01-24T06:54:21.576 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libcom_err-1.45.6-2.el8.x86_64 4/188 2022-01-24T06:54:21.692 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcom_err-1.45.6-2.el8.x86_64 4/188 2022-01-24T06:54:21.848 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : keyutils-libs-1.5.10-9.el8.x86_64 5/188 2022-01-24T06:54:22.043 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libuuid-2.32.1-28.el8.x86_64 6/188 2022-01-24T06:54:22.150 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libuuid-2.32.1-28.el8.x86_64 6/188 2022-01-24T06:54:22.301 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libblkid-2.32.1-28.el8.x86_64 7/188 2022-01-24T06:54:22.389 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libblkid-2.32.1-28.el8.x86_64 7/188 2022-01-24T06:54:22.399 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Linux 8 - BaseOS 9.8 MB/s | 4.6 MB 00:00 2022-01-24T06:54:22.580 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.2-3.el8.x86_64 8/188 2022-01-24T06:54:22.762 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/188 2022-01-24T06:54:22.959 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/188 2022-01-24T06:54:23.044 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/188 2022-01-24T06:54:23.205 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 11/188 2022-01-24T06:54:23.401 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libsepol-2.9-3.el8.x86_64 12/188 2022-01-24T06:54:23.501 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libsepol-2.9-3.el8.x86_64 12/188 2022-01-24T06:54:23.551 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Linux 8 - Extras 21 kB/s | 10 kB 00:00 2022-01-24T06:54:23.645 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libselinux-2.9-5.el8.x86_64 13/188 2022-01-24T06:54:23.696 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - PowerTools 27 MB/s | 2.3 MB 00:00 2022-01-24T06:54:23.757 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libselinux-2.9-5.el8.x86_64 13/188 2022-01-24T06:54:23.975 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 14/188 2022-01-24T06:54:24.415 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 14/188 2022-01-24T06:54:24.584 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 15/188 2022-01-24T06:54:24.867 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 15/188 2022-01-24T06:54:25.059 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 16/188 2022-01-24T06:54:25.199 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 16/188 2022-01-24T06:54:25.367 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:54:25.485 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:54:25.995 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 18/188 2022-01-24T06:54:26.009 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2022-01-24T06:54:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 19/188 2022-01-24T06:54:26.438 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 19/188 2022-01-24T06:54:26.692 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : krb5-libs-1.18.2-14.el8.x86_64 20/188 2022-01-24T06:54:26.909 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 21/188 2022-01-24T06:54:27.136 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 22/188 2022-01-24T06:54:27.602 INFO:teuthology.orchestra.run.smithi142.stdout:Apache Arrow 172 kB/s | 184 kB 00:01 2022-01-24T06:54:27.602 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libkadm5-1.18.2-14.el8.x86_64 23/188 2022-01-24T06:54:27.603 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 24/188 2022-01-24T06:54:27.758 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 24/188 2022-01-24T06:54:28.033 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsprogs-5.0.0-9.el8.x86_64 25/188 2022-01-24T06:54:28.145 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: xfsprogs-5.0.0-9.el8.x86_64 25/188 2022-01-24T06:54:28.300 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libss-1.45.6-2.el8.x86_64 26/188 2022-01-24T06:54:28.407 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libss-1.45.6-2.el8.x86_64 26/188 2022-01-24T06:54:28.637 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 27/188 2022-01-24T06:54:28.913 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libelf-0.185-1.el8.x86_64 28/188 2022-01-24T06:54:29.126 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 29/188 2022-01-24T06:54:29.199 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 11 MB 00:01 2022-01-24T06:54:29.312 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-idna-2.5-5.el8.noarch 30/188 2022-01-24T06:54:29.554 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 31/188 2022-01-24T06:54:29.666 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-8.5.0-4.el8_5.x86_64 32/188 2022-01-24T06:54:29.842 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libquadmath-8.5.0-4.el8_5.x86_64 32/188 2022-01-24T06:54:30.041 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-8.5.0-4.el8_5.x86_64 33/188 2022-01-24T06:54:30.663 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libgfortran-8.5.0-4.el8_5.x86_64 33/188 2022-01-24T06:54:30.866 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.12-1.el8.x86_64 34/188 2022-01-24T06:54:31.511 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 34/188 2022-01-24T06:54:31.604 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2022-01-24T06:54:31.666 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 35/188 2022-01-24T06:54:32.594 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 35/188 2022-01-24T06:54:32.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 36/188 2022-01-24T06:54:33.252 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 37/188 2022-01-24T06:54:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 38/188 2022-01-24T06:54:33.585 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-01-24T06:54:33.586 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-01-24T06:54:33.591 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-01-24T06:54:33.592 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-01-24T06:54:33.594 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-01-24T06:54:33.594 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2022-01-24T06:54:33.723 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 39/188 2022-01-24T06:54:33.861 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-01-24T06:54:33.876 INFO:teuthology.orchestra.run.smithi142.stdout:===================================================================================================== 2022-01-24T06:54:33.876 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-01-24T06:54:33.876 INFO:teuthology.orchestra.run.smithi142.stdout:===================================================================================================== 2022-01-24T06:54:33.877 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-01-24T06:54:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-01-24T06:54:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 6.4 k 2022-01-24T06:54:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 5.6 M 2022-01-24T06:54:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 574 k 2022-01-24T06:54:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 203 k 2022-01-24T06:54:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 1.4 M 2022-01-24T06:54:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 68 k 2022-01-24T06:54:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 3.6 M 2022-01-24T06:54:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 8.6 M 2022-01-24T06:54:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 27 k 2022-01-24T06:54:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 10 M 2022-01-24T06:54:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 42 M 2022-01-24T06:54:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 59 k 2022-01-24T06:54:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.185-1.el8 CentOS-Base 59 k 2022-01-24T06:54:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-01-24T06:54:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2022-01-24T06:54:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 22 k 2022-01-24T06:54:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 509 k 2022-01-24T06:54:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 141 k 2022-01-24T06:54:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-01-24T06:54:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.32.1-28.el8 CentOS-Base 97 k 2022-01-24T06:54:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:1.1.1k-5.el8_5 CentOS-Base 2.3 M 2022-01-24T06:54:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 164 k 2022-01-24T06:54:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 364 k 2022-01-24T06:54:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 349 k 2022-01-24T06:54:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 113 k 2022-01-24T06:54:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 72 k 2022-01-24T06:54:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 2.7 M 2022-01-24T06:54:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 140 k 2022-01-24T06:54:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 5.0.0-9.el8 CentOS-Base 70 k 2022-01-24T06:54:33.884 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2022-01-24T06:54:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: chkconfig x86_64 1.19.1-1.el8 CentOS-Base 198 k 2022-01-24T06:54:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: e2fsprogs x86_64 1.45.6-2.el8 CentOS-Base 1.0 M 2022-01-24T06:54:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: e2fsprogs-libs x86_64 1.45.6-2.el8 CentOS-Base 233 k 2022-01-24T06:54:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.185-1.el8 CentOS-Base 221 k 2022-01-24T06:54:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.185-1.el8 CentOS-Base 292 k 2022-01-24T06:54:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils x86_64 1.5.10-9.el8 CentOS-Base 66 k 2022-01-24T06:54:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs x86_64 1.5.10-9.el8 CentOS-Base 34 k 2022-01-24T06:54:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-libs x86_64 1.18.2-14.el8 CentOS-Base 840 k 2022-01-24T06:54:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-workstation x86_64 1.18.2-14.el8 CentOS-Base 957 k 2022-01-24T06:54:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.32.1-28.el8 CentOS-Base 217 k 2022-01-24T06:54:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err x86_64 1.45.6-2.el8 CentOS-Base 49 k 2022-01-24T06:54:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.32.1-28.el8 CentOS-Base 251 k 2022-01-24T06:54:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: libkadm5 x86_64 1.18.2-14.el8 CentOS-Base 187 k 2022-01-24T06:54:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.32.1-28.el8 CentOS-Base 234 k 2022-01-24T06:54:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 3.5 M 2022-01-24T06:54:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 1.9 M 2022-01-24T06:54:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux x86_64 2.9-5.el8 CentOS-Base 165 k 2022-01-24T06:54:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-utils x86_64 2.9-5.el8 CentOS-Base 243 k 2022-01-24T06:54:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol x86_64 2.9-3.el8 CentOS-Base 340 k 2022-01-24T06:54:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.32.1-28.el8 CentOS-Base 177 k 2022-01-24T06:54:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: libss x86_64 1.45.6-2.el8 CentOS-Base 54 k 2022-01-24T06:54:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.32.1-28.el8 CentOS-Base 96 k 2022-01-24T06:54:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:1.1.1k-5.el8_5 CentOS-Base 709 k 2022-01-24T06:54:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:1.1.1k-5.el8_5 CentOS-Base 1.5 M 2022-01-24T06:54:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: python3-libselinux x86_64 2.9-5.el8 CentOS-Base 283 k 2022-01-24T06:54:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.32.1-28.el8 CentOS-Base 2.5 M 2022-01-24T06:54:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.32.1-28.el8 CentOS-Base 100 k 2022-01-24T06:54:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 5.0.0-9.el8 CentOS-Base 1.1 M 2022-01-24T06:54:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: zlib x86_64 1.2.11-17.el8 CentOS-Base 102 k 2022-01-24T06:54:33.892 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-01-24T06:54:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-01-24T06:54:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 21 M 2022-01-24T06:54:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 24 k 2022-01-24T06:54:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 2.0 M 2022-01-24T06:54:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 192 k 2022-01-24T06:54:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 4.4 M 2022-01-24T06:54:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 17 M 2022-01-24T06:54:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 9.0 k 2022-01-24T06:54:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 26 k 2022-01-24T06:54:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-01-24T06:54:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-01-24T06:54:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-01-24T06:54:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2022-01-24T06:54:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-Base 48 k 2022-01-24T06:54:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel x86_64 1.18.2-14.el8 CentOS-Base 560 k 2022-01-24T06:54:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-01-24T06:54:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel x86_64 1.45.6-2.el8 CentOS-Base 38 k 2022-01-24T06:54:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 8.5.0-4.el8_5 CentOS-Base 643 k 2022-01-24T06:54:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-01-24T06:54:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 8.5.0-4.el8_5 CentOS-Base 170 k 2022-01-24T06:54:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-01-24T06:54:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 381 k 2022-01-24T06:54:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2022-01-24T06:54:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 3.2 M 2022-01-24T06:54:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel x86_64 2.9-5.el8 CentOS-Base 200 k 2022-01-24T06:54:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-Base 87 k 2022-01-24T06:54:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-01-24T06:54:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2022-01-24T06:54:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2022-01-24T06:54:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-01-24T06:54:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-01-24T06:54:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2022-01-24T06:54:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2022-01-24T06:54:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2022-01-24T06:54:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2022-01-24T06:54:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2022-01-24T06:54:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-01-24T06:54:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-01-24T06:54:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-01-24T06:54:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-01-24T06:54:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-01-24T06:54:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 40 k 2022-01-24T06:54:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 77 k 2022-01-24T06:54:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-01-24T06:54:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-01-24T06:54:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2022-01-24T06:54:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-01-24T06:54:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-01-24T06:54:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-01-24T06:54:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-01-24T06:54:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-01-24T06:54:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2022-01-24T06:54:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-01-24T06:54:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-01-24T06:54:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-01-24T06:54:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-01-24T06:54:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-01-24T06:54:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-01-24T06:54:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-01-24T06:54:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-01-24T06:54:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: python3-lxml x86_64 4.2.3-3.el8 CentOS-AppStream 1.5 M 2022-01-24T06:54:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-01-24T06:54:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-01-24T06:54:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-01-24T06:54:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-01-24T06:54:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-01-24T06:54:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-01-24T06:54:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-01-24T06:54:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-01-24T06:54:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-01-24T06:54:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-01-24T06:54:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-01-24T06:54:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-01-24T06:54:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-01-24T06:54:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2022-01-24T06:54:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-01-24T06:54:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-01-24T06:54:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-01-24T06:54:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2022-01-24T06:54:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-01-24T06:54:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-01-24T06:54:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-01-24T06:54:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-01-24T06:54:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-01-24T06:54:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-01-24T06:54:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-01-24T06:54:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-01-24T06:54:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2022-01-24T06:54:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-01-24T06:54:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2022-01-24T06:54:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-01-24T06:54:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-01-24T06:54:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-01-24T06:54:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-01-24T06:54:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-01-24T06:54:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-01-24T06:54:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-01-24T06:54:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-17.el8 CentOS-Base 58 k 2022-01-24T06:54:33.915 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2022-01-24T06:54:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2022-01-24T06:54:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2022-01-24T06:54:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:54:33.916 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-01-24T06:54:33.916 INFO:teuthology.orchestra.run.smithi142.stdout:===================================================================================================== 2022-01-24T06:54:33.917 INFO:teuthology.orchestra.run.smithi142.stdout:Install 130 Packages 2022-01-24T06:54:33.917 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 29 Packages 2022-01-24T06:54:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:54:33.918 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:15.2.15-156.g6d0261fc.el8. 40/188 2022-01-24T06:54:33.918 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 193 M 2022-01-24T06:54:33.919 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-01-24T06:54:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el 41/188 2022-01-24T06:54:34.140 INFO:teuthology.orchestra.run.smithi142.stdout:(1/159): ceph-15.2.15-156.g6d0261fc.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2022-01-24T06:54:34.451 INFO:teuthology.orchestra.run.smithi142.stdout:(2/159): ceph-fuse-15.2.15-156.g6d0261fc.el8.x8 1.8 MB/s | 574 kB 00:00 2022-01-24T06:54:34.505 INFO:teuthology.orchestra.run.smithi142.stdout:(3/159): ceph-immutable-object-cache-15.2.15-15 3.7 MB/s | 203 kB 00:00 2022-01-24T06:54:34.693 INFO:teuthology.orchestra.run.smithi142.stdout:(4/159): ceph-mds-15.2.15-156.g6d0261fc.el8.x86 11 MB/s | 2.0 MB 00:00 2022-01-24T06:54:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_6 42/188 2022-01-24T06:54:34.840 INFO:teuthology.orchestra.run.smithi142.stdout:(5/159): ceph-mgr-15.2.15-156.g6d0261fc.el8.x86 9.8 MB/s | 1.4 MB 00:00 2022-01-24T06:54:35.222 INFO:teuthology.orchestra.run.smithi142.stdout:(6/159): ceph-mon-15.2.15-156.g6d0261fc.el8.x86 11 MB/s | 4.4 MB 00:00 2022-01-24T06:54:35.934 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 43/188 2022-01-24T06:54:36.004 INFO:teuthology.orchestra.run.smithi142.stdout:(7/159): ceph-common-15.2.15-156.g6d0261fc.el8. 9.9 MB/s | 21 MB 00:02 2022-01-24T06:54:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 44/188 2022-01-24T06:54:36.564 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 45/188 2022-01-24T06:54:36.631 INFO:teuthology.orchestra.run.smithi142.stdout:(8/159): ceph-osd-15.2.15-156.g6d0261fc.el8.x86 12 MB/s | 17 MB 00:01 2022-01-24T06:54:36.733 INFO:teuthology.orchestra.run.smithi142.stdout:(9/159): ceph-radosgw-15.2.15-156.g6d0261fc.el8 14 MB/s | 10 MB 00:00 2022-01-24T06:54:36.733 INFO:teuthology.orchestra.run.smithi142.stdout:(10/159): ceph-selinux-15.2.15-156.g6d0261fc.el 252 kB/s | 26 kB 00:00 2022-01-24T06:54:36.751 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 46/188 2022-01-24T06:54:36.836 INFO:teuthology.orchestra.run.smithi142.stdout:(11/159): libcephfs-devel-15.2.15-156.g6d0261fc 212 kB/s | 22 kB 00:00 2022-01-24T06:54:36.910 INFO:teuthology.orchestra.run.smithi142.stdout:(12/159): libcephfs2-15.2.15-156.g6d0261fc.el8. 6.8 MB/s | 509 kB 00:00 2022-01-24T06:54:36.971 INFO:teuthology.orchestra.run.smithi142.stdout:(13/159): librados-devel-15.2.15-156.g6d0261fc. 2.2 MB/s | 141 kB 00:00 2022-01-24T06:54:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 47/188 2022-01-24T06:54:37.044 INFO:teuthology.orchestra.run.smithi142.stdout:(14/159): libradosstriper1-15.2.15-156.g6d0261f 5.1 MB/s | 381 kB 00:00 2022-01-24T06:54:37.062 INFO:teuthology.orchestra.run.smithi142.stdout:(15/159): ceph-base-15.2.15-156.g6d0261fc.el8.x 1.8 MB/s | 5.6 MB 00:03 2022-01-24T06:54:37.155 INFO:teuthology.orchestra.run.smithi142.stdout:(16/159): python3-ceph-argparse-15.2.15-156.g6d 432 kB/s | 40 kB 00:00 2022-01-24T06:54:37.204 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.8-1.el8.noarch 48/188 2022-01-24T06:54:37.245 INFO:teuthology.orchestra.run.smithi142.stdout:(17/159): python3-ceph-common-15.2.15-156.g6d02 848 kB/s | 77 kB 00:00 2022-01-24T06:54:37.308 INFO:teuthology.orchestra.run.smithi142.stdout:(18/159): librgw2-15.2.15-156.g6d0261fc.el8.x86 12 MB/s | 3.2 MB 00:00 2022-01-24T06:54:37.326 INFO:teuthology.orchestra.run.smithi142.stdout:(19/159): python3-cephfs-15.2.15-156.g6d0261fc. 2.0 MB/s | 164 kB 00:00 2022-01-24T06:54:37.378 INFO:teuthology.orchestra.run.smithi142.stdout:(20/159): python3-rados-15.2.15-156.g6d0261fc.e 5.1 MB/s | 364 kB 00:00 2022-01-24T06:54:37.436 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 49/188 2022-01-24T06:54:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:(21/159): python3-rgw-15.2.15-156.g6d0261fc.el8 1.7 MB/s | 113 kB 00:00 2022-01-24T06:54:37.454 INFO:teuthology.orchestra.run.smithi142.stdout:(22/159): python3-rbd-15.2.15-156.g6d0261fc.el8 2.7 MB/s | 349 kB 00:00 2022-01-24T06:54:37.498 INFO:teuthology.orchestra.run.smithi142.stdout:(23/159): rbd-fuse-15.2.15-156.g6d0261fc.el8.x8 1.2 MB/s | 72 kB 00:00 2022-01-24T06:54:37.558 INFO:teuthology.orchestra.run.smithi142.stdout:(24/159): rbd-nbd-15.2.15-156.g6d0261fc.el8.x86 2.3 MB/s | 140 kB 00:00 2022-01-24T06:54:37.599 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 50/188 2022-01-24T06:54:37.619 INFO:teuthology.orchestra.run.smithi142.stdout:(25/159): ceph-grafana-dashboards-15.2.15-156.g 392 kB/s | 24 kB 00:00 2022-01-24T06:54:37.680 INFO:teuthology.orchestra.run.smithi142.stdout:(26/159): ceph-mgr-cephadm-15.2.15-156.g6d0261f 1.1 MB/s | 68 kB 00:00 2022-01-24T06:54:37.865 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_6 51/188 2022-01-24T06:54:38.006 INFO:teuthology.orchestra.run.smithi142.stdout:(27/159): ceph-mgr-dashboard-15.2.15-156.g6d026 11 MB/s | 3.6 MB 00:00 2022-01-24T06:54:38.023 INFO:teuthology.orchestra.run.smithi142.stdout:(28/159): rbd-mirror-15.2.15-156.g6d0261fc.el8. 4.8 MB/s | 2.7 MB 00:00 2022-01-24T06:54:38.122 INFO:teuthology.orchestra.run.smithi142.stdout:(29/159): ceph-mgr-modules-core-15.2.15-156.g6d 1.9 MB/s | 192 kB 00:00 2022-01-24T06:54:38.221 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : chkconfig-1.19.1-1.el8.x86_64 52/188 2022-01-24T06:54:38.230 INFO:teuthology.orchestra.run.smithi142.stdout:(30/159): ceph-mgr-rook-15.2.15-156.g6d0261fc.e 253 kB/s | 27 kB 00:00 2022-01-24T06:54:38.329 INFO:teuthology.orchestra.run.smithi142.stdout:(31/159): ceph-prometheus-alerts-15.2.15-156.g6 90 kB/s | 9.0 kB 00:00 2022-01-24T06:54:38.426 INFO:teuthology.orchestra.run.smithi142.stdout:(32/159): cephadm-15.2.15-156.g6d0261fc.el8.noa 609 kB/s | 59 kB 00:00 2022-01-24T06:54:38.448 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:54:38.463 INFO:teuthology.orchestra.run.smithi142.stdout:(33/159): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2022-01-24T06:54:38.472 INFO:teuthology.orchestra.run.smithi142.stdout:(34/159): bison-3.0.4-10.el8.x86_64.rpm 76 MB/s | 688 kB 00:00 2022-01-24T06:54:38.476 INFO:teuthology.orchestra.run.smithi142.stdout:(35/159): flex-2.6.1-9.el8.x86_64.rpm 69 MB/s | 320 kB 00:00 2022-01-24T06:54:38.479 INFO:teuthology.orchestra.run.smithi142.stdout:(36/159): jq-1.5-12.el8.x86_64.rpm 59 MB/s | 161 kB 00:00 2022-01-24T06:54:38.484 INFO:teuthology.orchestra.run.smithi142.stdout:(37/159): librdkafka-0.11.4-1.el8.x86_64.rpm 71 MB/s | 353 kB 00:00 2022-01-24T06:54:38.494 INFO:teuthology.orchestra.run.smithi142.stdout:(38/159): libtool-2.4.6-25.el8.x86_64.rpm 75 MB/s | 709 kB 00:00 2022-01-24T06:54:38.498 INFO:teuthology.orchestra.run.smithi142.stdout:(39/159): lttng-ust-2.8.1-11.el8.x86_64.rpm 68 MB/s | 259 kB 00:00 2022-01-24T06:54:38.501 INFO:teuthology.orchestra.run.smithi142.stdout:(40/159): oniguruma-6.8.2-2.el8.x86_64.rpm 65 MB/s | 187 kB 00:00 2022-01-24T06:54:38.556 INFO:teuthology.orchestra.run.smithi142.stdout:(41/159): openblas-0.3.12-1.el8.x86_64.rpm 83 MB/s | 4.6 MB 00:00 2022-01-24T06:54:38.619 INFO:teuthology.orchestra.run.smithi142.stdout:(42/159): openblas-threads-0.3.12-1.el8.x86_64. 76 MB/s | 4.7 MB 00:00 2022-01-24T06:54:38.676 INFO:teuthology.orchestra.run.smithi142.stdout:(43/159): python3-babel-2.5.1-7.el8.noarch.rpm 84 MB/s | 4.8 MB 00:00 2022-01-24T06:54:38.679 INFO:teuthology.orchestra.run.smithi142.stdout:(44/159): python3-html5lib-0.999999999-6.el8.no 62 MB/s | 214 kB 00:00 2022-01-24T06:54:38.686 INFO:teuthology.orchestra.run.smithi142.stdout:(45/159): python3-jinja2-2.10.1-3.el8.noarch.rp 78 MB/s | 538 kB 00:00 2022-01-24T06:54:38.688 INFO:teuthology.orchestra.run.smithi142.stdout:(46/159): python3-jsonpatch-1.21-2.el8.noarch.r 16 MB/s | 27 kB 00:00 2022-01-24T06:54:38.689 INFO:teuthology.orchestra.run.smithi142.stdout:(47/159): python3-jsonpointer-1.10-11.el8.noarc 18 MB/s | 20 kB 00:00 2022-01-24T06:54:38.707 INFO:teuthology.orchestra.run.smithi142.stdout:(48/159): python3-lxml-4.2.3-3.el8.x86_64.rpm 84 MB/s | 1.5 MB 00:00 2022-01-24T06:54:38.710 INFO:teuthology.orchestra.run.smithi142.stdout:(49/159): python3-mako-1.0.6-13.el8.noarch.rpm 62 MB/s | 157 kB 00:00 2022-01-24T06:54:38.712 INFO:teuthology.orchestra.run.smithi142.stdout:(50/159): python3-markupsafe-0.23-19.el8.x86_64 31 MB/s | 39 kB 00:00 2022-01-24T06:54:38.760 INFO:teuthology.orchestra.run.smithi142.stdout:(51/159): ceph-mgr-diskprediction-local-15.2.15 11 MB/s | 8.6 MB 00:00 2022-01-24T06:54:38.861 INFO:teuthology.orchestra.run.smithi142.stdout:(52/159): python3-numpy-1.14.3-10.el8.x86_64.rp 25 MB/s | 3.7 MB 00:00 2022-01-24T06:54:38.864 INFO:teuthology.orchestra.run.smithi142.stdout:(53/159): python3-prettytable-0.7.2-14.el8.noar 20 MB/s | 44 kB 00:00 2022-01-24T06:54:38.867 INFO:teuthology.orchestra.run.smithi142.stdout:(54/159): python3-pyOpenSSL-19.0.0-1.el8.noarch 36 MB/s | 103 kB 00:00 2022-01-24T06:54:38.868 INFO:teuthology.orchestra.run.smithi142.stdout:(55/159): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2022-01-24T06:54:38.870 INFO:teuthology.orchestra.run.smithi142.stdout:(56/159): python3-pyasn1-0.3.7-6.el8.noarch.rpm 50 MB/s | 126 kB 00:00 2022-01-24T06:54:38.871 INFO:teuthology.orchestra.run.smithi142.stdout:(57/159): python3-pyasn1-modules-0.3.7-6.el8.no 44 MB/s | 110 kB 00:00 2022-01-24T06:54:38.872 INFO:teuthology.orchestra.run.smithi142.stdout:(58/159): python3-pytz-2017.2-9.el8.noarch.rpm 30 MB/s | 54 kB 00:00 2022-01-24T06:54:38.874 INFO:teuthology.orchestra.run.smithi142.stdout:(59/159): python3-webencodings-0.5.1-6.el8.noar 16 MB/s | 27 kB 00:00 2022-01-24T06:54:38.882 INFO:teuthology.orchestra.run.smithi142.stdout:(60/159): python3-werkzeug-0.12.2-4.el8.noarch. 53 MB/s | 457 kB 00:00 2022-01-24T06:54:38.889 INFO:teuthology.orchestra.run.smithi142.stdout:(61/159): socat-1.7.4.1-1.el8.x86_64.rpm 49 MB/s | 323 kB 00:00 2022-01-24T06:54:38.892 INFO:teuthology.orchestra.run.smithi142.stdout:(62/159): elfutils-libelf-devel-0.185-1.el8.x86 23 MB/s | 59 kB 00:00 2022-01-24T06:54:38.895 INFO:teuthology.orchestra.run.smithi142.stdout:(63/159): fuse-2.9.7-12.el8.x86_64.rpm 26 MB/s | 82 kB 00:00 2022-01-24T06:54:38.898 INFO:teuthology.orchestra.run.smithi142.stdout:(64/159): keyutils-libs-devel-1.5.10-9.el8.x86_ 16 MB/s | 48 kB 00:00 2022-01-24T06:54:38.908 INFO:teuthology.orchestra.run.smithi142.stdout:(65/159): krb5-devel-1.18.2-14.el8.x86_64.rpm 55 MB/s | 560 kB 00:00 2022-01-24T06:54:38.911 INFO:teuthology.orchestra.run.smithi142.stdout:(66/159): libaio-devel-0.3.112-1.el8.x86_64.rpm 7.1 MB/s | 19 kB 00:00 2022-01-24T06:54:38.913 INFO:teuthology.orchestra.run.smithi142.stdout:(67/159): libcom_err-devel-1.45.6-2.el8.x86_64. 17 MB/s | 38 kB 00:00 2022-01-24T06:54:38.926 INFO:teuthology.orchestra.run.smithi142.stdout:(68/159): libgfortran-8.5.0-4.el8_5.x86_64.rpm 53 MB/s | 643 kB 00:00 2022-01-24T06:54:38.930 INFO:teuthology.orchestra.run.smithi142.stdout:(69/159): libquadmath-8.5.0-4.el8_5.x86_64.rpm 36 MB/s | 170 kB 00:00 2022-01-24T06:54:38.934 INFO:teuthology.orchestra.run.smithi142.stdout:(70/159): librabbitmq-0.9.0-3.el8.x86_64.rpm 15 MB/s | 47 kB 00:00 2022-01-24T06:54:38.939 INFO:teuthology.orchestra.run.smithi142.stdout:(71/159): libselinux-devel-2.9-5.el8.x86_64.rpm 36 MB/s | 200 kB 00:00 2022-01-24T06:54:38.943 INFO:teuthology.orchestra.run.smithi142.stdout:(72/159): libsepol-devel-2.9-3.el8.x86_64.rpm 23 MB/s | 87 kB 00:00 2022-01-24T06:54:38.947 INFO:teuthology.orchestra.run.smithi142.stdout:(73/159): libuuid-devel-2.32.1-28.el8.x86_64.rp 23 MB/s | 97 kB 00:00 2022-01-24T06:54:38.951 INFO:teuthology.orchestra.run.smithi142.stdout:(74/159): libverto-devel-0.3.0-5.el8.x86_64.rpm 5.6 MB/s | 18 kB 00:00 2022-01-24T06:54:38.957 INFO:teuthology.orchestra.run.smithi142.stdout:(75/159): libxslt-1.1.32-6.el8.x86_64.rpm 39 MB/s | 250 kB 00:00 2022-01-24T06:54:38.998 INFO:teuthology.orchestra.run.smithi142.stdout:(76/159): openssl-devel-1.1.1k-5.el8_5.x86_64.r 58 MB/s | 2.3 MB 00:00 2022-01-24T06:54:39.012 INFO:teuthology.orchestra.run.smithi142.stdout:(77/159): pcre2-devel-10.32-2.el8.x86_64.rpm 42 MB/s | 605 kB 00:00 2022-01-24T06:54:39.020 INFO:teuthology.orchestra.run.smithi142.stdout:(78/159): pcre2-utf16-10.32-2.el8.x86_64.rpm 30 MB/s | 229 kB 00:00 2022-01-24T06:54:39.028 INFO:teuthology.orchestra.run.smithi142.stdout:(79/159): pcre2-utf32-10.32-2.el8.x86_64.rpm 28 MB/s | 220 kB 00:00 2022-01-24T06:54:39.036 INFO:teuthology.orchestra.run.smithi142.stdout:(80/159): python3-cffi-1.11.5-5.el8.x86_64.rpm 29 MB/s | 237 kB 00:00 2022-01-24T06:54:39.044 INFO:teuthology.orchestra.run.smithi142.stdout:(81/159): python3-chardet-3.0.4-7.el8.noarch.rp 24 MB/s | 195 kB 00:00 2022-01-24T06:54:39.058 INFO:teuthology.orchestra.run.smithi142.stdout:(82/159): python3-cryptography-3.2.1-5.el8.x86_ 42 MB/s | 559 kB 00:00 2022-01-24T06:54:39.333 INFO:teuthology.orchestra.run.smithi142.stdout:(83/159): ceph-test-15.2.15-156.g6d0261fc.el8.x 16 MB/s | 42 MB 00:02 2022-01-24T06:54:39.334 INFO:teuthology.orchestra.run.smithi142.stdout:(84/159): python3-idna-2.5-5.el8.noarch.rpm 352 kB/s | 97 kB 00:00 2022-01-24T06:54:39.341 INFO:teuthology.orchestra.run.smithi142.stdout:(85/159): python3-oauthlib-2.1.0-1.el8.noarch.r 57 MB/s | 155 kB 00:00 2022-01-24T06:54:39.343 INFO:teuthology.orchestra.run.smithi142.stdout:(86/159): python3-pycparser-2.14-14.el8.noarch. 54 MB/s | 109 kB 00:00 2022-01-24T06:54:39.345 INFO:teuthology.orchestra.run.smithi142.stdout:(87/159): python3-pysocks-1.6.8-3.el8.noarch.rp 29 MB/s | 34 kB 00:00 2022-01-24T06:54:39.390 INFO:teuthology.orchestra.run.smithi142.stdout:(88/159): python3-requests-2.20.0-2.1.el8_1.noa 2.7 MB/s | 123 kB 00:00 2022-01-24T06:54:39.507 INFO:teuthology.orchestra.run.smithi142.stdout:(89/159): python3-scipy-1.0.0-21.module_el8.5.0 22 MB/s | 14 MB 00:00 2022-01-24T06:54:39.507 INFO:teuthology.orchestra.run.smithi142.stdout:(90/159): python3-requests-oauthlib-1.0.0-1.el8 364 kB/s | 43 kB 00:00 2022-01-24T06:54:39.510 INFO:teuthology.orchestra.run.smithi142.stdout:(91/159): python3-urllib3-1.24.2-5.el8.noarch.r 49 MB/s | 177 kB 00:00 2022-01-24T06:54:39.511 INFO:teuthology.orchestra.run.smithi142.stdout:(92/159): python3-jwt-1.6.1-2.el8.noarch.rpm 239 kB/s | 43 kB 00:00 2022-01-24T06:54:39.512 INFO:teuthology.orchestra.run.smithi142.stdout:(93/159): xfsprogs-devel-5.0.0-9.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2022-01-24T06:54:39.513 INFO:teuthology.orchestra.run.smithi142.stdout:(94/159): zlib-devel-1.2.11-17.el8.x86_64.rpm 29 MB/s | 58 kB 00:00 2022-01-24T06:54:39.727 INFO:teuthology.orchestra.run.smithi142.stdout:(95/159): fmt-6.2.1-1.el8.x86_64.rpm 540 kB/s | 116 kB 00:00 2022-01-24T06:54:39.730 INFO:teuthology.orchestra.run.smithi142.stdout:(96/159): leveldb-1.22-1.el8.x86_64.rpm 834 kB/s | 181 kB 00:00 2022-01-24T06:54:39.758 INFO:teuthology.orchestra.run.smithi142.stdout:(97/159): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2022-01-24T06:54:39.760 INFO:teuthology.orchestra.run.smithi142.stdout:(98/159): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2022-01-24T06:54:39.764 INFO:teuthology.orchestra.run.smithi142.stdout:(99/159): libunwind-1.3.1-3.el8.x86_64.rpm 2.1 MB/s | 75 kB 00:00 2022-01-24T06:54:39.793 INFO:teuthology.orchestra.run.smithi142.stdout:(100/159): python3-apipkg-1.5-6.el8.noarch.rpm 612 kB/s | 21 kB 00:00 2022-01-24T06:54:39.796 INFO:teuthology.orchestra.run.smithi142.stdout:(101/159): python3-bcrypt-3.1.6-2.el8.1.x86_64. 1.2 MB/s | 44 kB 00:00 2022-01-24T06:54:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:(102/159): python3-beautifulsoup4-4.6.3-2.el8.1 4.8 MB/s | 185 kB 00:00 2022-01-24T06:54:39.830 INFO:teuthology.orchestra.run.smithi142.stdout:(103/159): python3-cachetools-3.1.1-4.el8.noarc 886 kB/s | 33 kB 00:00 2022-01-24T06:54:39.836 INFO:teuthology.orchestra.run.smithi142.stdout:(104/159): python3-certifi-2018.10.15-7.el8.noa 402 kB/s | 16 kB 00:00 2022-01-24T06:54:39.847 INFO:teuthology.orchestra.run.smithi142.stdout:(105/159): python3-cheroot-8.5.2-1.el8.noarch.r 3.8 MB/s | 173 kB 00:00 2022-01-24T06:54:39.882 INFO:teuthology.orchestra.run.smithi142.stdout:(106/159): python3-cssselect-0.9.2-10.el8.noarc 885 kB/s | 40 kB 00:00 2022-01-24T06:54:39.911 INFO:teuthology.orchestra.run.smithi142.stdout:(107/159): python3-cherrypy-18.4.0-1.el8.noarch 4.6 MB/s | 384 kB 00:00 2022-01-24T06:54:39.917 INFO:teuthology.orchestra.run.smithi142.stdout:(108/159): python3-google-auth-1.1.1-10.el8.noa 2.2 MB/s | 81 kB 00:00 2022-01-24T06:54:39.927 INFO:teuthology.orchestra.run.smithi142.stdout:(109/159): python3-execnet-1.7.1-1.el8.noarch.r 4.3 MB/s | 355 kB 00:00 2022-01-24T06:54:39.943 INFO:teuthology.orchestra.run.smithi142.stdout:(110/159): python3-jaraco-6.2-6.el8.noarch.rpm 354 kB/s | 11 kB 00:00 2022-01-24T06:54:39.950 INFO:teuthology.orchestra.run.smithi142.stdout:(111/159): python3-jaraco-functools-2.0-4.el8.n 536 kB/s | 18 kB 00:00 2022-01-24T06:54:39.975 INFO:teuthology.orchestra.run.smithi142.stdout:(112/159): python3-logutils-0.3.5-11.el8.noarch 1.5 MB/s | 49 kB 00:00 2022-01-24T06:54:39.983 INFO:teuthology.orchestra.run.smithi142.stdout:(113/159): python3-more-itertools-7.2.0-3.el8.n 1.8 MB/s | 59 kB 00:00 2022-01-24T06:54:40.018 INFO:teuthology.orchestra.run.smithi142.stdout:(114/159): python3-portend-2.6-1.el8.noarch.rpm 454 kB/s | 16 kB 00:00 2022-01-24T06:54:40.041 INFO:teuthology.orchestra.run.smithi142.stdout:(115/159): python3-pecan-1.3.2-9.el8.noarch.rpm 4.2 MB/s | 283 kB 00:00 2022-01-24T06:54:40.051 INFO:teuthology.orchestra.run.smithi142.stdout:(116/159): python3-remoto-1.2.1-1.el8.noarch.rp 1.4 MB/s | 49 kB 00:00 2022-01-24T06:54:40.074 INFO:teuthology.orchestra.run.smithi142.stdout:(117/159): python3-repoze-lru-0.7-6.el8.noarch. 1.0 MB/s | 34 kB 00:00 2022-01-24T06:54:40.107 INFO:teuthology.orchestra.run.smithi142.stdout:(118/159): python3-rsa-4.8-1.el8.noarch.rpm 1.8 MB/s | 61 kB 00:00 2022-01-24T06:54:40.116 INFO:teuthology.orchestra.run.smithi142.stdout:(119/159): python3-routes-2.4.1-12.el8.noarch.r 3.0 MB/s | 196 kB 00:00 2022-01-24T06:54:40.131 INFO:teuthology.orchestra.run.smithi142.stdout:(120/159): python3-kubernetes-11.0.0-6.el8.noar 5.7 MB/s | 1.2 MB 00:00 2022-01-24T06:54:40.138 INFO:teuthology.orchestra.run.smithi142.stdout:(121/159): python3-simplegeneric-0.8.1-17.el8.n 595 kB/s | 19 kB 00:00 2022-01-24T06:54:40.148 INFO:teuthology.orchestra.run.smithi142.stdout:(122/159): python3-singledispatch-3.4.0.3-18.el 745 kB/s | 24 kB 00:00 2022-01-24T06:54:40.163 INFO:teuthology.orchestra.run.smithi142.stdout:(123/159): python3-tempora-1.14.1-5.el8.noarch. 928 kB/s | 29 kB 00:00 2022-01-24T06:54:40.169 INFO:teuthology.orchestra.run.smithi142.stdout:(124/159): python3-trustme-0.6.0-4.el8.noarch.r 902 kB/s | 27 kB 00:00 2022-01-24T06:54:40.203 INFO:teuthology.orchestra.run.smithi142.stdout:(125/159): python3-websocket-client-0.56.0-5.el 1.7 MB/s | 61 kB 00:00 2022-01-24T06:54:40.215 INFO:teuthology.orchestra.run.smithi142.stdout:(126/159): python3-waitress-1.2.1-2.el8.1.noarc 3.5 MB/s | 241 kB 00:00 2022-01-24T06:54:40.229 INFO:teuthology.orchestra.run.smithi142.stdout:(127/159): python3-webob-1.8.5-1.el8.1.noarch.r 3.7 MB/s | 251 kB 00:00 2022-01-24T06:54:40.236 INFO:teuthology.orchestra.run.smithi142.stdout:(128/159): python3-webtest-2.0.33-1.el8.noarch. 2.6 MB/s | 85 kB 00:00 2022-01-24T06:54:40.247 INFO:teuthology.orchestra.run.smithi142.stdout:(129/159): python3-zc-lockfile-2.0-2.el8.noarch 715 kB/s | 23 kB 00:00 2022-01-24T06:54:40.261 INFO:teuthology.orchestra.run.smithi142.stdout:(130/159): xmlstarlet-1.6.1-11.el8.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2022-01-24T06:54:40.265 INFO:teuthology.orchestra.run.smithi142.stdout:(131/159): chkconfig-1.19.1-1.el8.x86_64.rpm 56 MB/s | 198 kB 00:00 2022-01-24T06:54:40.278 INFO:teuthology.orchestra.run.smithi142.stdout:(132/159): e2fsprogs-1.45.6-2.el8.x86_64.rpm 80 MB/s | 1.0 MB 00:00 2022-01-24T06:54:40.282 INFO:teuthology.orchestra.run.smithi142.stdout:(133/159): e2fsprogs-libs-1.45.6-2.el8.x86_64.r 63 MB/s | 233 kB 00:00 2022-01-24T06:54:40.285 INFO:teuthology.orchestra.run.smithi142.stdout:(134/159): elfutils-libelf-0.185-1.el8.x86_64.r 66 MB/s | 221 kB 00:00 2022-01-24T06:54:40.289 INFO:teuthology.orchestra.run.smithi142.stdout:(135/159): elfutils-libs-0.185-1.el8.x86_64.rpm 69 MB/s | 292 kB 00:00 2022-01-24T06:54:40.291 INFO:teuthology.orchestra.run.smithi142.stdout:(136/159): keyutils-1.5.10-9.el8.x86_64.rpm 41 MB/s | 66 kB 00:00 2022-01-24T06:54:40.293 INFO:teuthology.orchestra.run.smithi142.stdout:(137/159): keyutils-libs-1.5.10-9.el8.x86_64.rp 31 MB/s | 34 kB 00:00 2022-01-24T06:54:40.303 INFO:teuthology.orchestra.run.smithi142.stdout:(138/159): krb5-libs-1.18.2-14.el8.x86_64.rpm 81 MB/s | 840 kB 00:00 2022-01-24T06:54:40.315 INFO:teuthology.orchestra.run.smithi142.stdout:(139/159): krb5-workstation-1.18.2-14.el8.x86_6 80 MB/s | 957 kB 00:00 2022-01-24T06:54:40.318 INFO:teuthology.orchestra.run.smithi142.stdout:(140/159): libblkid-2.32.1-28.el8.x86_64.rpm 68 MB/s | 217 kB 00:00 2022-01-24T06:54:40.319 INFO:teuthology.orchestra.run.smithi142.stdout:(141/159): libcom_err-1.45.6-2.el8.x86_64.rpm 36 MB/s | 49 kB 00:00 2022-01-24T06:54:40.323 INFO:teuthology.orchestra.run.smithi142.stdout:(142/159): libfdisk-2.32.1-28.el8.x86_64.rpm 69 MB/s | 251 kB 00:00 2022-01-24T06:54:40.326 INFO:teuthology.orchestra.run.smithi142.stdout:(143/159): libkadm5-1.18.2-14.el8.x86_64.rpm 63 MB/s | 187 kB 00:00 2022-01-24T06:54:40.330 INFO:teuthology.orchestra.run.smithi142.stdout:(144/159): libmount-2.32.1-28.el8.x86_64.rpm 67 MB/s | 234 kB 00:00 2022-01-24T06:54:40.333 INFO:teuthology.orchestra.run.smithi142.stdout:(145/159): libselinux-2.9-5.el8.x86_64.rpm 62 MB/s | 165 kB 00:00 2022-01-24T06:54:40.336 INFO:teuthology.orchestra.run.smithi142.stdout:(146/159): libselinux-utils-2.9-5.el8.x86_64.rp 69 MB/s | 243 kB 00:00 2022-01-24T06:54:40.341 INFO:teuthology.orchestra.run.smithi142.stdout:(147/159): libsepol-2.9-3.el8.x86_64.rpm 72 MB/s | 340 kB 00:00 2022-01-24T06:54:40.344 INFO:teuthology.orchestra.run.smithi142.stdout:(148/159): libsmartcols-2.32.1-28.el8.x86_64.rp 63 MB/s | 177 kB 00:00 2022-01-24T06:54:40.346 INFO:teuthology.orchestra.run.smithi142.stdout:(149/159): libss-1.45.6-2.el8.x86_64.rpm 29 MB/s | 54 kB 00:00 2022-01-24T06:54:40.348 INFO:teuthology.orchestra.run.smithi142.stdout:(150/159): libuuid-2.32.1-28.el8.x86_64.rpm 50 MB/s | 96 kB 00:00 2022-01-24T06:54:40.357 INFO:teuthology.orchestra.run.smithi142.stdout:(151/159): openssl-1.1.1k-5.el8_5.x86_64.rpm 77 MB/s | 709 kB 00:00 2022-01-24T06:54:40.375 INFO:teuthology.orchestra.run.smithi142.stdout:(152/159): openssl-libs-1.1.1k-5.el8_5.x86_64.r 82 MB/s | 1.5 MB 00:00 2022-01-24T06:54:40.379 INFO:teuthology.orchestra.run.smithi142.stdout:(153/159): python3-libselinux-2.9-5.el8.x86_64. 71 MB/s | 283 kB 00:00 2022-01-24T06:54:40.409 INFO:teuthology.orchestra.run.smithi142.stdout:(154/159): util-linux-2.32.1-28.el8.x86_64.rpm 84 MB/s | 2.5 MB 00:00 2022-01-24T06:54:40.411 INFO:teuthology.orchestra.run.smithi142.stdout:(155/159): util-linux-user-2.32.1-28.el8.x86_64 49 MB/s | 100 kB 00:00 2022-01-24T06:54:40.424 INFO:teuthology.orchestra.run.smithi142.stdout:(156/159): xfsprogs-5.0.0-9.el8.x86_64.rpm 82 MB/s | 1.1 MB 00:00 2022-01-24T06:54:40.426 INFO:teuthology.orchestra.run.smithi142.stdout:(157/159): zlib-1.2.11-17.el8.x86_64.rpm 50 MB/s | 102 kB 00:00 2022-01-24T06:54:40.589 INFO:teuthology.orchestra.run.smithi142.stdout:(158/159): librados2-15.2.15-156.g6d0261fc.el8. 10 MB/s | 3.5 MB 00:00 2022-01-24T06:54:40.643 INFO:teuthology.orchestra.run.smithi142.stdout:(159/159): librbd1-15.2.15-156.g6d0261fc.el8.x8 4.9 MB/s | 1.9 MB 00:00 2022-01-24T06:54:40.648 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-01-24T06:54:40.648 INFO:teuthology.orchestra.run.smithi142.stdout:Total 29 MB/s | 193 MB 00:06 2022-01-24T06:54:40.732 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:54:40.792 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-01-24T06:54:41.034 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 54/188 2022-01-24T06:54:41.182 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-01-24T06:54:41.182 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-01-24T06:54:41.289 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libmount-2.32.1-28.el8.x86_64 55/188 2022-01-24T06:54:41.462 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libmount-2.32.1-28.el8.x86_64 55/188 2022-01-24T06:54:41.731 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libselinux-utils-2.9-5.el8.x86_64 56/188 2022-01-24T06:54:41.909 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/188 2022-01-24T06:54:42.114 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libfdisk-2.32.1-28.el8.x86_64 58/188 2022-01-24T06:54:42.221 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libfdisk-2.32.1-28.el8.x86_64 58/188 2022-01-24T06:54:42.374 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.32.1-28.el8.x86_64 59/188 2022-01-24T06:54:42.534 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-01-24T06:54:42.538 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-01-24T06:54:42.587 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/188 2022-01-24T06:54:42.754 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcom_err-devel-1.45.6-2.el8.x86_64 61/188 2022-01-24T06:54:42.947 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : e2fsprogs-libs-1.45.6-2.el8.x86_64 62/188 2022-01-24T06:54:43.209 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-2.el8.x86_64 62/188 2022-01-24T06:54:43.521 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : e2fsprogs-1.45.6-2.el8.x86_64 63/188 2022-01-24T06:54:43.668 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 64/188 2022-01-24T06:54:43.847 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libsmartcols-2.32.1-28.el8.x86_64 65/188 2022-01-24T06:54:44.532 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libsmartcols-2.32.1-28.el8.x86_64 65/188 2022-01-24T06:54:44.765 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-2.32.1-28.el8.x86_64 66/188 2022-01-24T06:54:44.842 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: util-linux-2.32.1-28.el8.x86_64 66/188 2022-01-24T06:54:45.101 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 67/188 2022-01-24T06:54:45.353 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 68/188 2022-01-24T06:54:45.531 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 69/188 2022-01-24T06:54:45.678 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 70/188 2022-01-24T06:54:45.895 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 71/188 2022-01-24T06:54:46.082 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 72/188 2022-01-24T06:54:46.339 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 73/188 2022-01-24T06:54:46.501 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 74/188 2022-01-24T06:54:46.647 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 75/188 2022-01-24T06:54:46.848 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 76/188 2022-01-24T06:54:47.023 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/188 2022-01-24T06:54:47.223 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/188 2022-01-24T06:54:47.393 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 79/188 2022-01-24T06:54:47.581 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/188 2022-01-24T06:54:47.827 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/188 2022-01-24T06:54:47.999 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/188 2022-01-24T06:54:48.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/188 2022-01-24T06:54:48.574 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/188 2022-01-24T06:54:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-01-24T06:54:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: zlib-1.2.11-17.el8.x86_64 1/1 2022-01-24T06:54:48.825 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/188 2022-01-24T06:54:49.013 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : zlib-1.2.11-17.el8.x86_64 1/188 2022-01-24T06:54:49.089 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/188 2022-01-24T06:54:49.195 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:1.1.1k-5.el8_5.x86_64 2/188 2022-01-24T06:54:49.685 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/188 2022-01-24T06:54:49.686 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 88/188 2022-01-24T06:54:49.686 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:1.1.1k-5.el8_5.x86_64 2/188 2022-01-24T06:54:49.686 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fmt-6.2.1-1.el8.x86_64 3/188 2022-01-24T06:54:49.687 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libcom_err-1.45.6-2.el8.x86_64 4/188 2022-01-24T06:54:49.687 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcom_err-1.45.6-2.el8.x86_64 4/188 2022-01-24T06:54:49.763 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 89/188 2022-01-24T06:54:49.883 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : keyutils-libs-1.5.10-9.el8.x86_64 5/188 2022-01-24T06:54:50.020 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.32.1-28.el8.x86_64 6/188 2022-01-24T06:54:50.031 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 90/188 2022-01-24T06:54:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libuuid-2.32.1-28.el8.x86_64 6/188 2022-01-24T06:54:50.320 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.32.1-28.el8.x86_64 7/188 2022-01-24T06:54:50.374 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.32.1-28.el8.x86_64 7/188 2022-01-24T06:54:50.456 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 91/188 2022-01-24T06:54:50.512 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.2-3.el8.x86_64 8/188 2022-01-24T06:54:50.685 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/188 2022-01-24T06:54:50.748 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 92/188 2022-01-24T06:54:50.853 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/188 2022-01-24T06:54:50.925 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/188 2022-01-24T06:54:50.973 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/188 2022-01-24T06:54:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 11/188 2022-01-24T06:54:51.277 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 94/188 2022-01-24T06:54:51.295 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsepol-2.9-3.el8.x86_64 12/188 2022-01-24T06:54:51.387 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsepol-2.9-3.el8.x86_64 12/188 2022-01-24T06:54:51.533 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 95/188 2022-01-24T06:54:51.547 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libselinux-2.9-5.el8.x86_64 13/188 2022-01-24T06:54:51.616 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libselinux-2.9-5.el8.x86_64 13/188 2022-01-24T06:54:51.774 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 96/188 2022-01-24T06:54:51.820 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 14/188 2022-01-24T06:54:52.117 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 97/188 2022-01-24T06:54:52.192 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 14/188 2022-01-24T06:54:52.378 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 15/188 2022-01-24T06:54:52.392 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 98/188 2022-01-24T06:54:52.597 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 15/188 2022-01-24T06:54:52.675 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 99/188 2022-01-24T06:54:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 16/188 2022-01-24T06:54:52.908 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 16/188 2022-01-24T06:54:52.929 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 100/188 2022-01-24T06:54:53.069 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:54:53.143 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 101/188 2022-01-24T06:54:53.164 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:54:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 18/188 2022-01-24T06:54:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 19/188 2022-01-24T06:54:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 19/188 2022-01-24T06:54:54.250 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : krb5-libs-1.18.2-14.el8.x86_64 20/188 2022-01-24T06:54:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 21/188 2022-01-24T06:54:54.599 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/188 2022-01-24T06:54:54.648 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 22/188 2022-01-24T06:54:54.885 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libkadm5-1.18.2-14.el8.x86_64 23/188 2022-01-24T06:54:54.911 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 103/188 2022-01-24T06:54:55.036 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 24/188 2022-01-24T06:54:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 24/188 2022-01-24T06:54:55.403 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 104/188 2022-01-24T06:54:55.478 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-5.0.0-9.el8.x86_64 25/188 2022-01-24T06:54:55.527 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xfsprogs-5.0.0-9.el8.x86_64 25/188 2022-01-24T06:54:55.727 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libss-1.45.6-2.el8.x86_64 26/188 2022-01-24T06:54:55.794 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libss-1.45.6-2.el8.x86_64 26/188 2022-01-24T06:54:55.808 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 105/188 2022-01-24T06:54:55.980 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 27/188 2022-01-24T06:54:56.111 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 106/188 2022-01-24T06:54:56.263 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.185-1.el8.x86_64 28/188 2022-01-24T06:54:56.323 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 107/188 2022-01-24T06:54:56.571 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 108/188 2022-01-24T06:54:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 29/188 2022-01-24T06:54:56.842 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 109/188 2022-01-24T06:54:56.919 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-idna-2.5-5.el8.noarch 30/188 2022-01-24T06:54:57.137 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.7-12.el8.x86_64 110/188 2022-01-24T06:54:57.160 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 31/188 2022-01-24T06:54:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-8.5.0-4.el8_5.x86_64 32/188 2022-01-24T06:54:57.398 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 111/188 2022-01-24T06:54:57.436 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libquadmath-8.5.0-4.el8_5.x86_64 32/188 2022-01-24T06:54:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-8.5.0-4.el8_5.x86_64 33/188 2022-01-24T06:54:57.645 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 112/188 2022-01-24T06:54:58.061 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 113/188 2022-01-24T06:54:58.153 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libgfortran-8.5.0-4.el8_5.x86_64 33/188 2022-01-24T06:54:58.311 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.12-1.el8.x86_64 34/188 2022-01-24T06:54:58.349 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-lxml-4.2.3-3.el8.x86_64 114/188 2022-01-24T06:54:58.732 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 115/188 2022-01-24T06:54:58.838 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 34/188 2022-01-24T06:54:58.985 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 35/188 2022-01-24T06:54:58.997 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 116/188 2022-01-24T06:54:59.137 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 117/188 2022-01-24T06:54:59.741 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 35/188 2022-01-24T06:55:00.040 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 36/188 2022-01-24T06:55:00.283 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 37/188 2022-01-24T06:55:00.456 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 38/188 2022-01-24T06:55:00.696 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 39/188 2022-01-24T06:55:00.873 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:15.2.15-156.g6d0261fc.el8. 40/188 2022-01-24T06:55:01.036 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el 41/188 2022-01-24T06:55:01.274 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_6 42/188 2022-01-24T06:55:02.245 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 43/188 2022-01-24T06:55:02.604 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 44/188 2022-01-24T06:55:02.820 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 45/188 2022-01-24T06:55:02.998 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 46/188 2022-01-24T06:55:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 47/188 2022-01-24T06:55:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.8-1.el8.noarch 48/188 2022-01-24T06:55:03.609 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 49/188 2022-01-24T06:55:03.765 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 50/188 2022-01-24T06:55:04.027 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_6 51/188 2022-01-24T06:55:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : chkconfig-1.19.1-1.el8.x86_64 52/188 2022-01-24T06:55:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:55:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:55:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:55:06.675 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 54/188 2022-01-24T06:55:06.678 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:55:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.32.1-28.el8.x86_64 55/188 2022-01-24T06:55:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libmount-2.32.1-28.el8.x86_64 55/188 2022-01-24T06:55:07.240 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libselinux-utils-2.9-5.el8.x86_64 56/188 2022-01-24T06:55:07.442 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/188 2022-01-24T06:55:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:55:07.634 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.32.1-28.el8.x86_64 58/188 2022-01-24T06:55:07.688 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libfdisk-2.32.1-28.el8.x86_64 58/188 2022-01-24T06:55:07.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 119/188 2022-01-24T06:55:07.838 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.32.1-28.el8.x86_64 59/188 2022-01-24T06:55:08.021 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/188 2022-01-24T06:55:08.045 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 119/188 2022-01-24T06:55:08.170 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcom_err-devel-1.45.6-2.el8.x86_64 61/188 2022-01-24T06:55:08.193 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 120/188 2022-01-24T06:55:08.333 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : e2fsprogs-libs-1.45.6-2.el8.x86_64 62/188 2022-01-24T06:55:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-2.el8.x86_64 62/188 2022-01-24T06:55:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : e2fsprogs-1.45.6-2.el8.x86_64 63/188 2022-01-24T06:55:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 64/188 2022-01-24T06:55:09.211 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.32.1-28.el8.x86_64 65/188 2022-01-24T06:55:09.721 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsmartcols-2.32.1-28.el8.x86_64 65/188 2022-01-24T06:55:10.042 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.32.1-28.el8.x86_64 66/188 2022-01-24T06:55:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-2.32.1-28.el8.x86_64 66/188 2022-01-24T06:55:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 67/188 2022-01-24T06:55:10.525 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 68/188 2022-01-24T06:55:10.707 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 69/188 2022-01-24T06:55:10.855 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 70/188 2022-01-24T06:55:11.069 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 71/188 2022-01-24T06:55:11.259 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 72/188 2022-01-24T06:55:11.503 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 73/188 2022-01-24T06:55:11.653 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 74/188 2022-01-24T06:55:11.823 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 75/188 2022-01-24T06:55:12.031 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 76/188 2022-01-24T06:55:12.190 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/188 2022-01-24T06:55:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/188 2022-01-24T06:55:12.626 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 79/188 2022-01-24T06:55:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/188 2022-01-24T06:55:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/188 2022-01-24T06:55:13.700 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/188 2022-01-24T06:55:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/188 2022-01-24T06:55:14.182 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/188 2022-01-24T06:55:14.375 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/188 2022-01-24T06:55:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/188 2022-01-24T06:55:14.825 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/188 2022-01-24T06:55:15.110 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 88/188 2022-01-24T06:55:15.359 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 89/188 2022-01-24T06:55:15.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 90/188 2022-01-24T06:55:16.052 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 91/188 2022-01-24T06:55:16.311 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 92/188 2022-01-24T06:55:16.559 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/188 2022-01-24T06:55:16.831 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 94/188 2022-01-24T06:55:17.083 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 95/188 2022-01-24T06:55:17.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 96/188 2022-01-24T06:55:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 97/188 2022-01-24T06:55:17.842 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 98/188 2022-01-24T06:55:18.168 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 99/188 2022-01-24T06:55:18.371 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 100/188 2022-01-24T06:55:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 101/188 2022-01-24T06:55:19.669 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/188 2022-01-24T06:55:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 103/188 2022-01-24T06:55:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 104/188 2022-01-24T06:55:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 105/188 2022-01-24T06:55:20.784 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 106/188 2022-01-24T06:55:21.060 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 107/188 2022-01-24T06:55:21.273 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 108/188 2022-01-24T06:55:21.516 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 109/188 2022-01-24T06:55:21.735 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.7-12.el8.x86_64 110/188 2022-01-24T06:55:21.955 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 111/188 2022-01-24T06:55:22.195 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 112/188 2022-01-24T06:55:22.546 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 113/188 2022-01-24T06:55:22.849 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-lxml-4.2.3-3.el8.x86_64 114/188 2022-01-24T06:55:23.197 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 115/188 2022-01-24T06:55:23.506 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 116/188 2022-01-24T06:55:24.082 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 117/188 2022-01-24T06:55:26.107 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 120/188 2022-01-24T06:55:26.108 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2022-01-24T06:55:26.108 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2022-01-24T06:55:26.108 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2022-01-24T06:55:26.109 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /run 2022-01-24T06:55:26.109 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2022-01-24T06:55:26.109 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2022-01-24T06:55:26.109 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2022-01-24T06:55:26.110 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2022-01-24T06:55:26.110 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2022-01-24T06:55:26.110 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:55:26.808 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 121/188 2022-01-24T06:55:27.267 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 121/188 2022-01-24T06:55:27.424 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 122/188 2022-01-24T06:55:27.952 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:55:28.181 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:55:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:55:28.986 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 122/188 2022-01-24T06:55:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 119/188 2022-01-24T06:55:29.215 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 123/188 2022-01-24T06:55:29.295 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 123/188 2022-01-24T06:55:29.534 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 124/188 2022-01-24T06:55:29.714 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 125/188 2022-01-24T06:55:29.734 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 119/188 2022-01-24T06:55:29.948 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 126/188 2022-01-24T06:55:30.043 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 126/188 2022-01-24T06:55:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 120/188 2022-01-24T06:55:30.347 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.5-12.el8.x86_64 127/188 2022-01-24T06:55:30.607 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.1-7.el8.noarch 128/188 2022-01-24T06:55:34.824 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 129/188 2022-01-24T06:55:35.087 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 129/188 2022-01-24T06:55:35.266 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.e 130/188 2022-01-24T06:55:35.532 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc. 131/188 2022-01-24T06:55:35.732 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 132/188 2022-01-24T06:55:36.972 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 132/188 2022-01-24T06:55:37.850 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 133/188 2022-01-24T06:55:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 133/188 2022-01-24T06:55:39.355 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 134/188 2022-01-24T06:55:39.483 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 134/188 2022-01-24T06:55:39.894 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el 135/188 2022-01-24T06:55:40.175 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 136/188 2022-01-24T06:55:40.244 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 136/188 2022-01-24T06:55:40.439 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 137/188 2022-01-24T06:55:40.477 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 137/188 2022-01-24T06:55:40.726 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 138/188 2022-01-24T06:55:40.913 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-25.el8.x86_64 139/188 2022-01-24T06:55:45.061 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 139/188 2022-01-24T06:55:45.733 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 120/188 2022-01-24T06:55:45.734 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2022-01-24T06:55:45.734 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2022-01-24T06:55:45.734 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2022-01-24T06:55:45.734 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /run 2022-01-24T06:55:45.735 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2022-01-24T06:55:45.735 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2022-01-24T06:55:45.735 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2022-01-24T06:55:45.735 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2022-01-24T06:55:45.736 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2022-01-24T06:55:45.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:55:46.119 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 121/188 2022-01-24T06:55:46.311 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 140/188 2022-01-24T06:55:46.490 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 121/188 2022-01-24T06:55:46.549 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 141/188 2022-01-24T06:55:46.725 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 141/188 2022-01-24T06:55:46.904 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:15.2.15-156.g6d026 142/188 2022-01-24T06:55:47.224 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 122/188 2022-01-24T06:55:47.229 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.15-156.g6d026 142/188 2022-01-24T06:55:47.404 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 143/188 2022-01-24T06:55:47.519 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 143/188 2022-01-24T06:55:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 122/188 2022-01-24T06:55:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 123/188 2022-01-24T06:55:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 123/188 2022-01-24T06:55:48.942 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 144/188 2022-01-24T06:55:49.051 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 124/188 2022-01-24T06:55:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 125/188 2022-01-24T06:55:49.292 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:1.1.1k-5.el8_5.x86_64 145/188 2022-01-24T06:55:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 126/188 2022-01-24T06:55:49.511 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-user-2.32.1-28.el8.x86_64 146/188 2022-01-24T06:55:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 126/188 2022-01-24T06:55:49.674 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-5.0.0-9.el8.x86_64 147/188 2022-01-24T06:55:49.843 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_ 148/188 2022-01-24T06:55:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.5-12.el8.x86_64 127/188 2022-01-24T06:55:50.081 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.185-1.el8.x86_64 149/188 2022-01-24T06:55:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.1-7.el8.noarch 128/188 2022-01-24T06:55:50.579 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libs-0.185-1.el8.x86_64 150/188 2022-01-24T06:55:50.836 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : krb5-workstation-1.18.2-14.el8.x86_64 151/188 2022-01-24T06:55:51.101 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 152/188 2022-01-24T06:55:51.324 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 153/188 2022-01-24T06:55:51.957 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : python3-libselinux-2.9-5.el8.x86_64 154/188 2022-01-24T06:55:51.958 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : keyutils-1.5.10-9.el8.x86_64 155/188 2022-01-24T06:55:52.189 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:1.1.1k-5.el8_5.x86_64 156/188 2022-01-24T06:55:52.407 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 157/188 2022-01-24T06:55:52.483 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 129/188 2022-01-24T06:55:52.578 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.1-9.el8.x86_64 158/188 2022-01-24T06:55:52.698 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 158/188 2022-01-24T06:55:52.931 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 129/188 2022-01-24T06:55:52.936 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.0.4-10.el8.x86_64 159/188 2022-01-24T06:55:52.980 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 159/188 2022-01-24T06:55:53.163 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : krb5-workstation-1.18.2-8.el8.x86_64 160/188 2022-01-24T06:55:53.333 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libkadm5-1.18.2-8.el8.x86_64 161/188 2022-01-24T06:55:53.549 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : krb5-libs-1.18.2-8.el8.x86_64 162/188 2022-01-24T06:55:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.e 130/188 2022-01-24T06:55:53.780 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : e2fsprogs-1.45.6-1.el8.x86_64 163/188 2022-01-24T06:55:53.832 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc. 131/188 2022-01-24T06:55:53.969 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libs-0.180-1.el8.x86_64 164/188 2022-01-24T06:55:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 132/188 2022-01-24T06:55:54.197 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:1.1.1g-11.el8.x86_64 165/188 2022-01-24T06:55:54.352 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : keyutils-1.5.10-6.el8.x86_64 166/188 2022-01-24T06:55:54.352 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsprogs-5.0.0-4.el8.x86_64 167/188 2022-01-24T06:55:54.604 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: xfsprogs-5.0.0-4.el8.x86_64 167/188 2022-01-24T06:55:54.830 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libselinux-utils-2.9-3.el8.x86_64 168/188 2022-01-24T06:55:54.830 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 169/188 2022-01-24T06:55:54.936 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 132/188 2022-01-24T06:55:55.128 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 169/188 2022-01-24T06:55:55.128 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 170/188 2022-01-24T06:55:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 133/188 2022-01-24T06:55:55.406 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 170/188 2022-01-24T06:55:55.407 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : e2fsprogs-libs-1.45.6-1.el8.x86_64 171/188 2022-01-24T06:55:55.689 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-1.el8.x86_64 171/188 2022-01-24T06:55:55.690 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:55:55.906 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:55:56.104 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-user-2.32.1-24.el8.x86_64 173/188 2022-01-24T06:55:56.287 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 133/188 2022-01-24T06:55:56.296 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-2.32.1-24.el8.x86_64 174/188 2022-01-24T06:55:56.297 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libfdisk-2.32.1-24.el8.x86_64 175/188 2022-01-24T06:55:56.492 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 134/188 2022-01-24T06:55:56.556 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libfdisk-2.32.1-24.el8.x86_64 175/188 2022-01-24T06:55:56.556 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libmount-2.32.1-24.el8.x86_64 176/188 2022-01-24T06:55:56.568 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 134/188 2022-01-24T06:55:56.764 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libmount-2.32.1-24.el8.x86_64 176/188 2022-01-24T06:55:56.765 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libblkid-2.32.1-24.el8.x86_64 177/188 2022-01-24T06:55:56.970 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el 135/188 2022-01-24T06:55:57.031 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libblkid-2.32.1-24.el8.x86_64 177/188 2022-01-24T06:55:57.199 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : python3-libselinux-2.9-3.el8.x86_64 178/188 2022-01-24T06:55:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 136/188 2022-01-24T06:55:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 136/188 2022-01-24T06:55:57.363 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : chkconfig-1.13-2.el8.x86_64 179/188 2022-01-24T06:55:57.442 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 137/188 2022-01-24T06:55:57.453 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 137/188 2022-01-24T06:55:57.572 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libselinux-2.9-3.el8.x86_64 180/188 2022-01-24T06:55:57.573 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:1.1.1g-11.el8.x86_64 181/188 2022-01-24T06:55:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 138/188 2022-01-24T06:55:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-25.el8.x86_64 139/188 2022-01-24T06:55:58.092 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:1.1.1g-11.el8.x86_64 181/188 2022-01-24T06:55:58.246 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libelf-0.180-1.el8.x86_64 182/188 2022-01-24T06:55:58.455 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : zlib-1.2.11-16.el8_2.x86_64 183/188 2022-01-24T06:55:58.455 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libsepol-2.9-1.el8.x86_64 184/188 2022-01-24T06:55:58.706 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libsepol-2.9-1.el8.x86_64 184/188 2022-01-24T06:55:58.707 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libuuid-2.32.1-24.el8.x86_64 185/188 2022-01-24T06:55:58.981 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libuuid-2.32.1-24.el8.x86_64 185/188 2022-01-24T06:55:58.981 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libsmartcols-2.32.1-24.el8.x86_64 186/188 2022-01-24T06:55:59.206 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libsmartcols-2.32.1-24.el8.x86_64 186/188 2022-01-24T06:55:59.206 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libcom_err-1.45.6-1.el8.x86_64 187/188 2022-01-24T06:55:59.464 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcom_err-1.45.6-1.el8.x86_64 187/188 2022-01-24T06:55:59.587 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : keyutils-libs-1.5.10-6.el8.x86_64 188/188 2022-01-24T06:56:00.753 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: keyutils-libs-1.5.10-6.el8.x86_64 188/188 2022-01-24T06:56:00.753 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 1/188 2022-01-24T06:56:00.754 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 2/188 2022-01-24T06:56:00.754 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 3/188 2022-01-24T06:56:00.754 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 4/188 2022-01-24T06:56:00.754 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:15.2.15-156.g6d026 5/188 2022-01-24T06:56:00.755 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 6/188 2022-01-24T06:56:00.755 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 7/188 2022-01-24T06:56:00.755 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 8/188 2022-01-24T06:56:00.755 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 9/188 2022-01-24T06:56:00.756 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 10/188 2022-01-24T06:56:00.756 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 11/188 2022-01-24T06:56:00.756 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 12/188 2022-01-24T06:56:00.756 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_ 13/188 2022-01-24T06:56:00.756 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 14/188 2022-01-24T06:56:00.757 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_6 15/188 2022-01-24T06:56:00.757 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 16/188 2022-01-24T06:56:00.757 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:56:00.757 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el 18/188 2022-01-24T06:56:00.758 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:15.2.15-156.g6d0261fc.el8. 19/188 2022-01-24T06:56:00.758 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_6 20/188 2022-01-24T06:56:00.758 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 21/188 2022-01-24T06:56:00.758 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 22/188 2022-01-24T06:56:00.759 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 23/188 2022-01-24T06:56:00.759 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 24/188 2022-01-24T06:56:00.759 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 25/188 2022-01-24T06:56:00.759 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 26/188 2022-01-24T06:56:00.759 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc. 27/188 2022-01-24T06:56:00.776 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 28/188 2022-01-24T06:56:00.777 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 29/188 2022-01-24T06:56:00.777 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 30/188 2022-01-24T06:56:00.777 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el 31/188 2022-01-24T06:56:00.777 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 32/188 2022-01-24T06:56:00.777 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.e 33/188 2022-01-24T06:56:00.778 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 34/188 2022-01-24T06:56:00.778 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.1-7.el8.noarch 35/188 2022-01-24T06:56:00.778 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/188 2022-01-24T06:56:00.778 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/188 2022-01-24T06:56:00.779 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.5-12.el8.x86_64 38/188 2022-01-24T06:56:00.779 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/188 2022-01-24T06:56:00.779 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/188 2022-01-24T06:56:00.779 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/188 2022-01-24T06:56:00.779 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 42/188 2022-01-24T06:56:00.780 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 43/188 2022-01-24T06:56:00.780 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 44/188 2022-01-24T06:56:00.780 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 45/188 2022-01-24T06:56:00.780 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 46/188 2022-01-24T06:56:00.781 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 47/188 2022-01-24T06:56:00.781 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 48/188 2022-01-24T06:56:00.781 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 49/188 2022-01-24T06:56:00.781 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-lxml-4.2.3-3.el8.x86_64 50/188 2022-01-24T06:56:00.781 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 51/188 2022-01-24T06:56:00.782 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/188 2022-01-24T06:56:00.782 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:56:00.782 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/188 2022-01-24T06:56:00.782 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/188 2022-01-24T06:56:00.783 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/188 2022-01-24T06:56:00.783 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/188 2022-01-24T06:56:00.783 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/188 2022-01-24T06:56:00.783 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/188 2022-01-24T06:56:00.784 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/188 2022-01-24T06:56:00.784 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 61/188 2022-01-24T06:56:00.784 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/188 2022-01-24T06:56:00.784 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/188 2022-01-24T06:56:00.785 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.185-1.el8.x86_64 64/188 2022-01-24T06:56:00.785 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 65/188 2022-01-24T06:56:00.785 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/188 2022-01-24T06:56:00.785 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 67/188 2022-01-24T06:56:00.785 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/188 2022-01-24T06:56:00.786 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcom_err-devel-1.45.6-2.el8.x86_64 69/188 2022-01-24T06:56:00.786 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-8.5.0-4.el8_5.x86_64 70/188 2022-01-24T06:56:00.786 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-8.5.0-4.el8_5.x86_64 71/188 2022-01-24T06:56:00.786 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/188 2022-01-24T06:56:00.787 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/188 2022-01-24T06:56:00.787 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/188 2022-01-24T06:56:00.787 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.32.1-28.el8.x86_64 75/188 2022-01-24T06:56:00.787 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 76/188 2022-01-24T06:56:00.787 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 77/188 2022-01-24T06:56:00.788 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:1.1.1k-5.el8_5.x86_64 78/188 2022-01-24T06:56:00.788 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/188 2022-01-24T06:56:00.788 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/188 2022-01-24T06:56:00.788 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/188 2022-01-24T06:56:00.789 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 82/188 2022-01-24T06:56:00.789 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 83/188 2022-01-24T06:56:00.789 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/188 2022-01-24T06:56:00.789 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-idna-2.5-5.el8.noarch 85/188 2022-01-24T06:56:00.789 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/188 2022-01-24T06:56:00.790 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/188 2022-01-24T06:56:00.790 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/188 2022-01-24T06:56:00.790 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 89/188 2022-01-24T06:56:00.790 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 90/188 2022-01-24T06:56:00.791 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 91/188 2022-01-24T06:56:00.791 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 92/188 2022-01-24T06:56:00.791 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-5.0.0-9.el8.x86_64 93/188 2022-01-24T06:56:00.791 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 94/188 2022-01-24T06:56:00.791 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 95/188 2022-01-24T06:56:00.792 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/188 2022-01-24T06:56:00.792 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : leveldb-1.22-1.el8.x86_64 97/188 2022-01-24T06:56:00.792 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/188 2022-01-24T06:56:00.792 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/188 2022-01-24T06:56:00.793 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 100/188 2022-01-24T06:56:00.793 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/188 2022-01-24T06:56:00.793 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/188 2022-01-24T06:56:00.793 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/188 2022-01-24T06:56:00.793 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/188 2022-01-24T06:56:00.794 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/188 2022-01-24T06:56:00.794 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/188 2022-01-24T06:56:00.794 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 107/188 2022-01-24T06:56:00.794 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 108/188 2022-01-24T06:56:00.795 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 109/188 2022-01-24T06:56:00.795 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 110/188 2022-01-24T06:56:00.795 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 111/188 2022-01-24T06:56:00.795 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 112/188 2022-01-24T06:56:00.795 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 113/188 2022-01-24T06:56:00.796 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 114/188 2022-01-24T06:56:00.796 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 115/188 2022-01-24T06:56:00.796 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-2.6-1.el8.noarch 116/188 2022-01-24T06:56:00.796 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 117/188 2022-01-24T06:56:00.796 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 118/188 2022-01-24T06:56:00.797 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 119/188 2022-01-24T06:56:00.797 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 120/188 2022-01-24T06:56:00.797 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 121/188 2022-01-24T06:56:00.797 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 122/188 2022-01-24T06:56:00.798 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 123/188 2022-01-24T06:56:00.798 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 124/188 2022-01-24T06:56:00.798 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 125/188 2022-01-24T06:56:00.798 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 126/188 2022-01-24T06:56:00.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 127/188 2022-01-24T06:56:00.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 128/188 2022-01-24T06:56:00.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 129/188 2022-01-24T06:56:00.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 130/188 2022-01-24T06:56:00.799 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 131/188 2022-01-24T06:56:00.800 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/188 2022-01-24T06:56:00.800 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 133/188 2022-01-24T06:56:00.800 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/188 2022-01-24T06:56:00.800 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : chkconfig-1.19.1-1.el8.x86_64 135/188 2022-01-24T06:56:00.800 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : chkconfig-1.13-2.el8.x86_64 136/188 2022-01-24T06:56:00.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : e2fsprogs-1.45.6-2.el8.x86_64 137/188 2022-01-24T06:56:00.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : e2fsprogs-1.45.6-1.el8.x86_64 138/188 2022-01-24T06:56:00.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : e2fsprogs-libs-1.45.6-2.el8.x86_64 139/188 2022-01-24T06:56:00.801 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : e2fsprogs-libs-1.45.6-1.el8.x86_64 140/188 2022-01-24T06:56:00.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.185-1.el8.x86_64 141/188 2022-01-24T06:56:00.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.180-1.el8.x86_64 142/188 2022-01-24T06:56:00.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.185-1.el8.x86_64 143/188 2022-01-24T06:56:00.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.180-1.el8.x86_64 144/188 2022-01-24T06:56:00.802 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-1.5.10-9.el8.x86_64 145/188 2022-01-24T06:56:00.803 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-1.5.10-6.el8.x86_64 146/188 2022-01-24T06:56:00.803 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-libs-1.5.10-9.el8.x86_64 147/188 2022-01-24T06:56:00.803 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-libs-1.5.10-6.el8.x86_64 148/188 2022-01-24T06:56:00.803 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-libs-1.18.2-14.el8.x86_64 149/188 2022-01-24T06:56:00.804 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-libs-1.18.2-8.el8.x86_64 150/188 2022-01-24T06:56:00.804 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-workstation-1.18.2-14.el8.x86_64 151/188 2022-01-24T06:56:00.804 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-workstation-1.18.2-8.el8.x86_64 152/188 2022-01-24T06:56:00.804 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.32.1-28.el8.x86_64 153/188 2022-01-24T06:56:00.804 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.32.1-24.el8.x86_64 154/188 2022-01-24T06:56:00.805 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcom_err-1.45.6-2.el8.x86_64 155/188 2022-01-24T06:56:00.805 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcom_err-1.45.6-1.el8.x86_64 156/188 2022-01-24T06:56:00.805 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.32.1-28.el8.x86_64 157/188 2022-01-24T06:56:00.805 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.32.1-24.el8.x86_64 158/188 2022-01-24T06:56:00.806 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libkadm5-1.18.2-14.el8.x86_64 159/188 2022-01-24T06:56:00.806 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libkadm5-1.18.2-8.el8.x86_64 160/188 2022-01-24T06:56:00.806 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.32.1-28.el8.x86_64 161/188 2022-01-24T06:56:00.806 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.32.1-24.el8.x86_64 162/188 2022-01-24T06:56:00.806 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-2.9-5.el8.x86_64 163/188 2022-01-24T06:56:00.807 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-2.9-3.el8.x86_64 164/188 2022-01-24T06:56:00.807 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-utils-2.9-5.el8.x86_64 165/188 2022-01-24T06:56:00.807 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-utils-2.9-3.el8.x86_64 166/188 2022-01-24T06:56:00.807 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsepol-2.9-3.el8.x86_64 167/188 2022-01-24T06:56:00.808 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsepol-2.9-1.el8.x86_64 168/188 2022-01-24T06:56:00.808 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.32.1-28.el8.x86_64 169/188 2022-01-24T06:56:00.808 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.32.1-24.el8.x86_64 170/188 2022-01-24T06:56:00.808 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libss-1.45.6-2.el8.x86_64 171/188 2022-01-24T06:56:00.808 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:56:00.809 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.32.1-28.el8.x86_64 173/188 2022-01-24T06:56:00.809 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.32.1-24.el8.x86_64 174/188 2022-01-24T06:56:00.809 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:1.1.1k-5.el8_5.x86_64 175/188 2022-01-24T06:56:00.809 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:1.1.1g-11.el8.x86_64 176/188 2022-01-24T06:56:00.809 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:1.1.1k-5.el8_5.x86_64 177/188 2022-01-24T06:56:00.810 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:1.1.1g-11.el8.x86_64 178/188 2022-01-24T06:56:00.810 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-libselinux-2.9-5.el8.x86_64 179/188 2022-01-24T06:56:00.810 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-libselinux-2.9-3.el8.x86_64 180/188 2022-01-24T06:56:00.811 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.32.1-28.el8.x86_64 181/188 2022-01-24T06:56:00.811 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.32.1-24.el8.x86_64 182/188 2022-01-24T06:56:00.811 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.32.1-28.el8.x86_64 183/188 2022-01-24T06:56:00.812 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.32.1-24.el8.x86_64 184/188 2022-01-24T06:56:00.812 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-5.0.0-9.el8.x86_64 185/188 2022-01-24T06:56:00.812 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-5.0.0-4.el8.x86_64 186/188 2022-01-24T06:56:00.812 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-1.2.11-17.el8.x86_64 187/188 2022-01-24T06:56:01.525 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 139/188 2022-01-24T06:56:02.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 140/188 2022-01-24T06:56:02.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 141/188 2022-01-24T06:56:03.052 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 141/188 2022-01-24T06:56:03.200 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-1.2.11-16.el8_2.x86_64 188/188 2022-01-24T06:56:03.200 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:56:03.200 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2022-01-24T06:56:03.201 INFO:teuthology.orchestra.run.smithi164.stdout: chkconfig-1.19.1-1.el8.x86_64 2022-01-24T06:56:03.201 INFO:teuthology.orchestra.run.smithi164.stdout: e2fsprogs-1.45.6-2.el8.x86_64 2022-01-24T06:56:03.201 INFO:teuthology.orchestra.run.smithi164.stdout: e2fsprogs-libs-1.45.6-2.el8.x86_64 2022-01-24T06:56:03.201 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-0.185-1.el8.x86_64 2022-01-24T06:56:03.202 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs-0.185-1.el8.x86_64 2022-01-24T06:56:03.202 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-1.5.10-9.el8.x86_64 2022-01-24T06:56:03.202 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-1.5.10-9.el8.x86_64 2022-01-24T06:56:03.202 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-libs-1.18.2-14.el8.x86_64 2022-01-24T06:56:03.203 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-workstation-1.18.2-14.el8.x86_64 2022-01-24T06:56:03.203 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.203 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-1.45.6-2.el8.x86_64 2022-01-24T06:56:03.203 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: libkadm5-1.18.2-14.el8.x86_64 2022-01-24T06:56:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: libmount-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.204 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-2.9-5.el8.x86_64 2022-01-24T06:56:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-utils-2.9-5.el8.x86_64 2022-01-24T06:56:03.205 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-2.9-3.el8.x86_64 2022-01-24T06:56:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: libss-1.45.6-2.el8.x86_64 2022-01-24T06:56:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.206 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:56:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:56:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: python3-libselinux-2.9-5.el8.x86_64 2022-01-24T06:56:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.207 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-5.0.0-9.el8.x86_64 2022-01-24T06:56:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-1.2.11-17.el8.x86_64 2022-01-24T06:56:03.208 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:56:03.208 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2022-01-24T06:56:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.1-7.el8.noarch 2022-01-24T06:56:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.0.4-10.el8.x86_64 2022-01-24T06:56:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.209 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.210 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.211 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.212 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.213 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.185-1.el8.x86_64 2022-01-24T06:56:03.214 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.1-9.el8.x86_64 2022-01-24T06:56:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: fmt-6.2.1-1.el8.x86_64 2022-01-24T06:56:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.7-12.el8.x86_64 2022-01-24T06:56:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-01-24T06:56:03.215 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.5-12.el8.x86_64 2022-01-24T06:56:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-01-24T06:56:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-01-24T06:56:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: leveldb-1.22-1.el8.x86_64 2022-01-24T06:56:03.216 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-01-24T06:56:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel-1.45.6-2.el8.x86_64 2022-01-24T06:56:03.217 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-8.5.0-4.el8_5.x86_64 2022-01-24T06:56:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.2-3.el8.x86_64 2022-01-24T06:56:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-8.5.0-4.el8_5.x86_64 2022-01-24T06:56:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-01-24T06:56:03.218 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-01-24T06:56:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.219 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-01-24T06:56:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-01-24T06:56:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-25.el8.x86_64 2022-01-24T06:56:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.3.1-3.el8.x86_64 2022-01-24T06:56:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.32.1-28.el8.x86_64 2022-01-24T06:56:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-01-24T06:56:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: libxslt-1.1.32-6.el8.x86_64 2022-01-24T06:56:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-01-24T06:56:03.221 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-01-24T06:56:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.12-1.el8.x86_64 2022-01-24T06:56:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-01-24T06:56:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:56:03.222 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-01-24T06:56:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-01-24T06:56:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-01-24T06:56:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: python3-apipkg-1.5-6.el8.noarch 2022-01-24T06:56:03.223 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.5.1-7.el8.noarch 2022-01-24T06:56:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-01-24T06:56:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-01-24T06:56:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-01-24T06:56:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.224 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-01-24T06:56:03.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-01-24T06:56:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-chardet-3.0.4-7.el8.noarch 2022-01-24T06:56:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-01-24T06:56:03.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-01-24T06:56:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-01-24T06:56:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cssselect-0.9.2-10.el8.noarch 2022-01-24T06:56:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-01-24T06:56:03.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-01-24T06:56:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2022-01-24T06:56:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-idna-2.5-5.el8.noarch 2022-01-24T06:56:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-6.2-6.el8.noarch 2022-01-24T06:56:03.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-01-24T06:56:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-01-24T06:56:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-01-24T06:56:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-01-24T06:56:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-01-24T06:56:03.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-01-24T06:56:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-01-24T06:56:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-lxml-4.2.3-3.el8.x86_64 2022-01-24T06:56:03.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.0.6-13.el8.noarch 2022-01-24T06:56:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-01-24T06:56:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-01-24T06:56:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-01-24T06:56:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-01-24T06:56:03.231 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-01-24T06:56:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-01-24T06:56:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-2.6-1.el8.noarch 2022-01-24T06:56:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-01-24T06:56:03.232 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-01-24T06:56:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-01-24T06:56:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-01-24T06:56:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.14-14.el8.noarch 2022-01-24T06:56:03.233 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pysocks-1.6.8-3.el8.noarch 2022-01-24T06:56:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2017.2-9.el8.noarch 2022-01-24T06:56:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.234 INFO:teuthology.orchestra.run.smithi164.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-01-24T06:56:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-01-24T06:56:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2022-01-24T06:56:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-01-24T06:56:03.235 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.4.1-12.el8.noarch 2022-01-24T06:56:03.236 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.8-1.el8.noarch 2022-01-24T06:56:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-01-24T06:56:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-01-24T06:56:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-01-24T06:56:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-01-24T06:56:03.237 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-01-24T06:56:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.24.2-5.el8.noarch 2022-01-24T06:56:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-01-24T06:56:03.238 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webencodings-0.5.1-6.el8.noarch 2022-01-24T06:56:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-01-24T06:56:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-01-24T06:56:03.239 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-01-24T06:56:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-01-24T06:56:03.240 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-01-24T06:56:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.241 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-1.el8.x86_64 2022-01-24T06:56:03.242 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-5.0.0-9.el8.x86_64 2022-01-24T06:56:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-01-24T06:56:03.243 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-01-24T06:56:03.244 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:56:03.245 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2022-01-24T06:56:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:15.2.15-156.g6d026 142/188 2022-01-24T06:56:03.465 DEBUG:teuthology.parallel:result is None 2022-01-24T06:56:03.527 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.15-156.g6d026 142/188 2022-01-24T06:56:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 143/188 2022-01-24T06:56:03.807 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 143/188 2022-01-24T06:56:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 144/188 2022-01-24T06:56:04.922 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:1.1.1k-5.el8_5.x86_64 145/188 2022-01-24T06:56:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.32.1-28.el8.x86_64 146/188 2022-01-24T06:56:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-5.0.0-9.el8.x86_64 147/188 2022-01-24T06:56:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_ 148/188 2022-01-24T06:56:05.897 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.185-1.el8.x86_64 149/188 2022-01-24T06:56:06.352 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.185-1.el8.x86_64 150/188 2022-01-24T06:56:06.664 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : krb5-workstation-1.18.2-14.el8.x86_64 151/188 2022-01-24T06:56:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 152/188 2022-01-24T06:56:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 153/188 2022-01-24T06:56:07.383 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : python3-libselinux-2.9-5.el8.x86_64 154/188 2022-01-24T06:56:07.692 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : keyutils-1.5.10-9.el8.x86_64 155/188 2022-01-24T06:56:07.917 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:1.1.1k-5.el8_5.x86_64 156/188 2022-01-24T06:56:08.184 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 157/188 2022-01-24T06:56:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.1-9.el8.x86_64 158/188 2022-01-24T06:56:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 158/188 2022-01-24T06:56:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.0.4-10.el8.x86_64 159/188 2022-01-24T06:56:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 159/188 2022-01-24T06:56:08.951 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : krb5-workstation-1.18.2-8.el8.x86_64 160/188 2022-01-24T06:56:09.086 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libkadm5-1.18.2-8.el8.x86_64 161/188 2022-01-24T06:56:09.334 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : krb5-libs-1.18.2-8.el8.x86_64 162/188 2022-01-24T06:56:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : e2fsprogs-1.45.6-1.el8.x86_64 163/188 2022-01-24T06:56:09.720 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.180-1.el8.x86_64 164/188 2022-01-24T06:56:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:1.1.1g-11.el8.x86_64 165/188 2022-01-24T06:56:10.066 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : keyutils-1.5.10-6.el8.x86_64 166/188 2022-01-24T06:56:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.0.0-4.el8.x86_64 167/188 2022-01-24T06:56:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xfsprogs-5.0.0-4.el8.x86_64 167/188 2022-01-24T06:56:10.509 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libselinux-utils-2.9-3.el8.x86_64 168/188 2022-01-24T06:56:10.509 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 169/188 2022-01-24T06:56:10.769 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 169/188 2022-01-24T06:56:10.770 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 170/188 2022-01-24T06:56:10.993 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 170/188 2022-01-24T06:56:11.541 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : e2fsprogs-libs-1.45.6-1.el8.x86_64 171/188 2022-01-24T06:56:11.543 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-1.el8.x86_64 171/188 2022-01-24T06:56:11.543 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:56:11.543 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:56:11.613 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.32.1-24.el8.x86_64 173/188 2022-01-24T06:56:11.867 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.32.1-24.el8.x86_64 174/188 2022-01-24T06:56:11.867 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.32.1-24.el8.x86_64 175/188 2022-01-24T06:56:12.080 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libfdisk-2.32.1-24.el8.x86_64 175/188 2022-01-24T06:56:12.081 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.32.1-24.el8.x86_64 176/188 2022-01-24T06:56:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libmount-2.32.1-24.el8.x86_64 176/188 2022-01-24T06:56:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.32.1-24.el8.x86_64 177/188 2022-01-24T06:56:12.534 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.32.1-24.el8.x86_64 177/188 2022-01-24T06:56:12.728 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : python3-libselinux-2.9-3.el8.x86_64 178/188 2022-01-24T06:56:12.900 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : chkconfig-1.13-2.el8.x86_64 179/188 2022-01-24T06:56:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libselinux-2.9-3.el8.x86_64 180/188 2022-01-24T06:56:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:1.1.1g-11.el8.x86_64 181/188 2022-01-24T06:56:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:1.1.1g-11.el8.x86_64 181/188 2022-01-24T06:56:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.180-1.el8.x86_64 182/188 2022-01-24T06:56:13.733 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : zlib-1.2.11-16.el8_2.x86_64 183/188 2022-01-24T06:56:13.734 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsepol-2.9-1.el8.x86_64 184/188 2022-01-24T06:56:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsepol-2.9-1.el8.x86_64 184/188 2022-01-24T06:56:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.32.1-24.el8.x86_64 185/188 2022-01-24T06:56:14.201 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libuuid-2.32.1-24.el8.x86_64 185/188 2022-01-24T06:56:14.201 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.32.1-24.el8.x86_64 186/188 2022-01-24T06:56:14.401 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsmartcols-2.32.1-24.el8.x86_64 186/188 2022-01-24T06:56:14.401 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libcom_err-1.45.6-1.el8.x86_64 187/188 2022-01-24T06:56:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcom_err-1.45.6-1.el8.x86_64 187/188 2022-01-24T06:56:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : keyutils-libs-1.5.10-6.el8.x86_64 188/188 2022-01-24T06:56:15.392 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: keyutils-libs-1.5.10-6.el8.x86_64 188/188 2022-01-24T06:56:15.393 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 1/188 2022-01-24T06:56:15.393 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 2/188 2022-01-24T06:56:15.393 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 3/188 2022-01-24T06:56:15.394 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 4/188 2022-01-24T06:56:15.394 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:15.2.15-156.g6d026 5/188 2022-01-24T06:56:15.394 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 6/188 2022-01-24T06:56:15.394 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 7/188 2022-01-24T06:56:15.394 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 8/188 2022-01-24T06:56:15.395 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 9/188 2022-01-24T06:56:15.395 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 10/188 2022-01-24T06:56:15.395 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 11/188 2022-01-24T06:56:15.395 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 12/188 2022-01-24T06:56:15.396 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_ 13/188 2022-01-24T06:56:15.396 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 14/188 2022-01-24T06:56:15.396 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_6 15/188 2022-01-24T06:56:15.396 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 16/188 2022-01-24T06:56:15.396 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:56:15.397 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el 18/188 2022-01-24T06:56:15.397 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:15.2.15-156.g6d0261fc.el8. 19/188 2022-01-24T06:56:15.397 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_6 20/188 2022-01-24T06:56:15.397 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 21/188 2022-01-24T06:56:15.398 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 22/188 2022-01-24T06:56:15.398 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 23/188 2022-01-24T06:56:15.398 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 24/188 2022-01-24T06:56:15.398 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 25/188 2022-01-24T06:56:15.399 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 26/188 2022-01-24T06:56:15.399 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc. 27/188 2022-01-24T06:56:15.399 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 28/188 2022-01-24T06:56:15.399 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 29/188 2022-01-24T06:56:15.399 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 30/188 2022-01-24T06:56:15.400 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el 31/188 2022-01-24T06:56:15.400 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 32/188 2022-01-24T06:56:15.400 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.e 33/188 2022-01-24T06:56:15.400 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 34/188 2022-01-24T06:56:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.1-7.el8.noarch 35/188 2022-01-24T06:56:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/188 2022-01-24T06:56:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/188 2022-01-24T06:56:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.5-12.el8.x86_64 38/188 2022-01-24T06:56:15.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/188 2022-01-24T06:56:15.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/188 2022-01-24T06:56:15.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/188 2022-01-24T06:56:15.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 42/188 2022-01-24T06:56:15.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 43/188 2022-01-24T06:56:15.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 44/188 2022-01-24T06:56:15.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 45/188 2022-01-24T06:56:15.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 46/188 2022-01-24T06:56:15.403 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 47/188 2022-01-24T06:56:15.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 48/188 2022-01-24T06:56:15.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 49/188 2022-01-24T06:56:15.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-lxml-4.2.3-3.el8.x86_64 50/188 2022-01-24T06:56:15.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 51/188 2022-01-24T06:56:15.404 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/188 2022-01-24T06:56:15.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:56:15.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/188 2022-01-24T06:56:15.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/188 2022-01-24T06:56:15.405 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/188 2022-01-24T06:56:15.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/188 2022-01-24T06:56:15.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/188 2022-01-24T06:56:15.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/188 2022-01-24T06:56:15.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/188 2022-01-24T06:56:15.406 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 61/188 2022-01-24T06:56:15.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/188 2022-01-24T06:56:15.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/188 2022-01-24T06:56:15.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.185-1.el8.x86_64 64/188 2022-01-24T06:56:15.407 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 65/188 2022-01-24T06:56:15.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/188 2022-01-24T06:56:15.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 67/188 2022-01-24T06:56:15.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/188 2022-01-24T06:56:15.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcom_err-devel-1.45.6-2.el8.x86_64 69/188 2022-01-24T06:56:15.408 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-8.5.0-4.el8_5.x86_64 70/188 2022-01-24T06:56:15.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-8.5.0-4.el8_5.x86_64 71/188 2022-01-24T06:56:15.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/188 2022-01-24T06:56:15.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/188 2022-01-24T06:56:15.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/188 2022-01-24T06:56:15.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.32.1-28.el8.x86_64 75/188 2022-01-24T06:56:15.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 76/188 2022-01-24T06:56:15.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 77/188 2022-01-24T06:56:15.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:1.1.1k-5.el8_5.x86_64 78/188 2022-01-24T06:56:15.410 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/188 2022-01-24T06:56:15.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/188 2022-01-24T06:56:15.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/188 2022-01-24T06:56:15.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 82/188 2022-01-24T06:56:15.411 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 83/188 2022-01-24T06:56:15.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/188 2022-01-24T06:56:15.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-idna-2.5-5.el8.noarch 85/188 2022-01-24T06:56:15.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/188 2022-01-24T06:56:15.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/188 2022-01-24T06:56:15.412 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/188 2022-01-24T06:56:15.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 89/188 2022-01-24T06:56:15.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 90/188 2022-01-24T06:56:15.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 91/188 2022-01-24T06:56:15.413 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 92/188 2022-01-24T06:56:15.414 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-5.0.0-9.el8.x86_64 93/188 2022-01-24T06:56:15.414 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 94/188 2022-01-24T06:56:15.414 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 95/188 2022-01-24T06:56:15.414 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/188 2022-01-24T06:56:15.414 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : leveldb-1.22-1.el8.x86_64 97/188 2022-01-24T06:56:15.415 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/188 2022-01-24T06:56:15.415 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/188 2022-01-24T06:56:15.415 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 100/188 2022-01-24T06:56:15.415 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/188 2022-01-24T06:56:15.416 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/188 2022-01-24T06:56:15.416 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/188 2022-01-24T06:56:15.416 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/188 2022-01-24T06:56:15.416 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/188 2022-01-24T06:56:15.417 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/188 2022-01-24T06:56:15.417 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 107/188 2022-01-24T06:56:15.417 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 108/188 2022-01-24T06:56:15.417 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 109/188 2022-01-24T06:56:15.417 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 110/188 2022-01-24T06:56:15.418 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 111/188 2022-01-24T06:56:15.418 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 112/188 2022-01-24T06:56:15.418 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 113/188 2022-01-24T06:56:15.418 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 114/188 2022-01-24T06:56:15.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 115/188 2022-01-24T06:56:15.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-2.6-1.el8.noarch 116/188 2022-01-24T06:56:15.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 117/188 2022-01-24T06:56:15.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 118/188 2022-01-24T06:56:15.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 119/188 2022-01-24T06:56:15.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 120/188 2022-01-24T06:56:15.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 121/188 2022-01-24T06:56:15.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 122/188 2022-01-24T06:56:15.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 123/188 2022-01-24T06:56:15.421 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 124/188 2022-01-24T06:56:15.421 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 125/188 2022-01-24T06:56:15.421 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 126/188 2022-01-24T06:56:15.421 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 127/188 2022-01-24T06:56:15.422 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 128/188 2022-01-24T06:56:15.422 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 129/188 2022-01-24T06:56:15.422 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 130/188 2022-01-24T06:56:15.422 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 131/188 2022-01-24T06:56:15.422 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/188 2022-01-24T06:56:15.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 133/188 2022-01-24T06:56:15.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/188 2022-01-24T06:56:15.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : chkconfig-1.19.1-1.el8.x86_64 135/188 2022-01-24T06:56:15.423 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : chkconfig-1.13-2.el8.x86_64 136/188 2022-01-24T06:56:15.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : e2fsprogs-1.45.6-2.el8.x86_64 137/188 2022-01-24T06:56:15.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : e2fsprogs-1.45.6-1.el8.x86_64 138/188 2022-01-24T06:56:15.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : e2fsprogs-libs-1.45.6-2.el8.x86_64 139/188 2022-01-24T06:56:15.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : e2fsprogs-libs-1.45.6-1.el8.x86_64 140/188 2022-01-24T06:56:15.424 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.185-1.el8.x86_64 141/188 2022-01-24T06:56:15.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.180-1.el8.x86_64 142/188 2022-01-24T06:56:15.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.185-1.el8.x86_64 143/188 2022-01-24T06:56:15.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.180-1.el8.x86_64 144/188 2022-01-24T06:56:15.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-1.5.10-9.el8.x86_64 145/188 2022-01-24T06:56:15.426 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-1.5.10-6.el8.x86_64 146/188 2022-01-24T06:56:15.426 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-libs-1.5.10-9.el8.x86_64 147/188 2022-01-24T06:56:15.426 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-libs-1.5.10-6.el8.x86_64 148/188 2022-01-24T06:56:15.426 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-libs-1.18.2-14.el8.x86_64 149/188 2022-01-24T06:56:15.426 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-libs-1.18.2-8.el8.x86_64 150/188 2022-01-24T06:56:15.427 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-workstation-1.18.2-14.el8.x86_64 151/188 2022-01-24T06:56:15.427 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-workstation-1.18.2-8.el8.x86_64 152/188 2022-01-24T06:56:15.427 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.32.1-28.el8.x86_64 153/188 2022-01-24T06:56:15.427 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.32.1-24.el8.x86_64 154/188 2022-01-24T06:56:15.428 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcom_err-1.45.6-2.el8.x86_64 155/188 2022-01-24T06:56:15.428 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcom_err-1.45.6-1.el8.x86_64 156/188 2022-01-24T06:56:15.428 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.32.1-28.el8.x86_64 157/188 2022-01-24T06:56:15.428 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.32.1-24.el8.x86_64 158/188 2022-01-24T06:56:15.428 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libkadm5-1.18.2-14.el8.x86_64 159/188 2022-01-24T06:56:15.429 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libkadm5-1.18.2-8.el8.x86_64 160/188 2022-01-24T06:56:15.429 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.32.1-28.el8.x86_64 161/188 2022-01-24T06:56:15.429 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.32.1-24.el8.x86_64 162/188 2022-01-24T06:56:15.429 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-2.9-5.el8.x86_64 163/188 2022-01-24T06:56:15.430 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-2.9-3.el8.x86_64 164/188 2022-01-24T06:56:15.430 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-utils-2.9-5.el8.x86_64 165/188 2022-01-24T06:56:15.430 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-utils-2.9-3.el8.x86_64 166/188 2022-01-24T06:56:15.430 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsepol-2.9-3.el8.x86_64 167/188 2022-01-24T06:56:15.430 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsepol-2.9-1.el8.x86_64 168/188 2022-01-24T06:56:15.431 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.32.1-28.el8.x86_64 169/188 2022-01-24T06:56:15.431 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.32.1-24.el8.x86_64 170/188 2022-01-24T06:56:15.431 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libss-1.45.6-2.el8.x86_64 171/188 2022-01-24T06:56:15.431 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:56:15.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.32.1-28.el8.x86_64 173/188 2022-01-24T06:56:15.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.32.1-24.el8.x86_64 174/188 2022-01-24T06:56:15.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:1.1.1k-5.el8_5.x86_64 175/188 2022-01-24T06:56:15.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:1.1.1g-11.el8.x86_64 176/188 2022-01-24T06:56:15.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:1.1.1k-5.el8_5.x86_64 177/188 2022-01-24T06:56:15.433 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:1.1.1g-11.el8.x86_64 178/188 2022-01-24T06:56:15.433 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-libselinux-2.9-5.el8.x86_64 179/188 2022-01-24T06:56:15.433 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-libselinux-2.9-3.el8.x86_64 180/188 2022-01-24T06:56:15.433 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.32.1-28.el8.x86_64 181/188 2022-01-24T06:56:15.434 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.32.1-24.el8.x86_64 182/188 2022-01-24T06:56:15.434 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.32.1-28.el8.x86_64 183/188 2022-01-24T06:56:15.434 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.32.1-24.el8.x86_64 184/188 2022-01-24T06:56:15.434 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.0.0-9.el8.x86_64 185/188 2022-01-24T06:56:15.434 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.0.0-4.el8.x86_64 186/188 2022-01-24T06:56:15.435 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-1.2.11-17.el8.x86_64 187/188 2022-01-24T06:56:17.491 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-1.2.11-16.el8_2.x86_64 188/188 2022-01-24T06:56:17.491 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:56:17.491 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2022-01-24T06:56:17.491 INFO:teuthology.orchestra.run.smithi142.stdout: chkconfig-1.19.1-1.el8.x86_64 2022-01-24T06:56:17.492 INFO:teuthology.orchestra.run.smithi142.stdout: e2fsprogs-1.45.6-2.el8.x86_64 2022-01-24T06:56:17.492 INFO:teuthology.orchestra.run.smithi142.stdout: e2fsprogs-libs-1.45.6-2.el8.x86_64 2022-01-24T06:56:17.493 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.185-1.el8.x86_64 2022-01-24T06:56:17.493 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.185-1.el8.x86_64 2022-01-24T06:56:17.493 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-1.5.10-9.el8.x86_64 2022-01-24T06:56:17.494 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-1.5.10-9.el8.x86_64 2022-01-24T06:56:17.494 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-libs-1.18.2-14.el8.x86_64 2022-01-24T06:56:17.494 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-workstation-1.18.2-14.el8.x86_64 2022-01-24T06:56:17.494 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-1.45.6-2.el8.x86_64 2022-01-24T06:56:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: libkadm5-1.18.2-14.el8.x86_64 2022-01-24T06:56:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.496 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.496 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.496 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-2.9-5.el8.x86_64 2022-01-24T06:56:17.496 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-utils-2.9-5.el8.x86_64 2022-01-24T06:56:17.497 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-2.9-3.el8.x86_64 2022-01-24T06:56:17.497 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.497 INFO:teuthology.orchestra.run.smithi142.stdout: libss-1.45.6-2.el8.x86_64 2022-01-24T06:56:17.497 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.497 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:56:17.498 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:56:17.498 INFO:teuthology.orchestra.run.smithi142.stdout: python3-libselinux-2.9-5.el8.x86_64 2022-01-24T06:56:17.498 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.499 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.499 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-5.0.0-9.el8.x86_64 2022-01-24T06:56:17.499 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-1.2.11-17.el8.x86_64 2022-01-24T06:56:17.499 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:56:17.500 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-01-24T06:56:17.500 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.1-7.el8.noarch 2022-01-24T06:56:17.500 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.0.4-10.el8.x86_64 2022-01-24T06:56:17.501 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.501 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.501 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.502 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.502 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.502 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.507 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.507 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.507 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.507 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.508 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.508 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.508 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.509 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:56:17.509 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.185-1.el8.x86_64 2022-01-24T06:56:17.509 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.1-9.el8.x86_64 2022-01-24T06:56:17.509 INFO:teuthology.orchestra.run.smithi142.stdout: fmt-6.2.1-1.el8.x86_64 2022-01-24T06:56:17.510 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.7-12.el8.x86_64 2022-01-24T06:56:17.510 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-01-24T06:56:17.510 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.5-12.el8.x86_64 2022-01-24T06:56:17.510 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-01-24T06:56:17.511 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-01-24T06:56:17.511 INFO:teuthology.orchestra.run.smithi142.stdout: leveldb-1.22-1.el8.x86_64 2022-01-24T06:56:17.511 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-01-24T06:56:17.511 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.512 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.512 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel-1.45.6-2.el8.x86_64 2022-01-24T06:56:17.512 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-8.5.0-4.el8_5.x86_64 2022-01-24T06:56:17.512 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.2-3.el8.x86_64 2022-01-24T06:56:17.512 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-8.5.0-4.el8_5.x86_64 2022-01-24T06:56:17.513 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-01-24T06:56:17.513 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.513 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.513 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-01-24T06:56:17.514 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.514 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-01-24T06:56:17.514 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-01-24T06:56:17.514 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-25.el8.x86_64 2022-01-24T06:56:17.515 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.3.1-3.el8.x86_64 2022-01-24T06:56:17.515 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.32.1-28.el8.x86_64 2022-01-24T06:56:17.515 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-01-24T06:56:17.515 INFO:teuthology.orchestra.run.smithi142.stdout: libxslt-1.1.32-6.el8.x86_64 2022-01-24T06:56:17.515 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-01-24T06:56:17.516 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-01-24T06:56:17.516 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.12-1.el8.x86_64 2022-01-24T06:56:17.516 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-01-24T06:56:17.516 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:56:17.517 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-01-24T06:56:17.517 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-01-24T06:56:17.517 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-01-24T06:56:17.517 INFO:teuthology.orchestra.run.smithi142.stdout: python3-apipkg-1.5-6.el8.noarch 2022-01-24T06:56:17.517 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.5.1-7.el8.noarch 2022-01-24T06:56:17.518 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-01-24T06:56:17.518 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-01-24T06:56:17.518 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-01-24T06:56:17.518 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.519 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.519 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.519 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-01-24T06:56:17.519 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-01-24T06:56:17.519 INFO:teuthology.orchestra.run.smithi142.stdout: python3-chardet-3.0.4-7.el8.noarch 2022-01-24T06:56:17.520 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-01-24T06:56:17.520 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-01-24T06:56:17.520 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-01-24T06:56:17.520 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cssselect-0.9.2-10.el8.noarch 2022-01-24T06:56:17.521 INFO:teuthology.orchestra.run.smithi142.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-01-24T06:56:17.521 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-01-24T06:56:17.521 INFO:teuthology.orchestra.run.smithi142.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2022-01-24T06:56:17.521 INFO:teuthology.orchestra.run.smithi142.stdout: python3-idna-2.5-5.el8.noarch 2022-01-24T06:56:17.522 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-6.2-6.el8.noarch 2022-01-24T06:56:17.522 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-01-24T06:56:17.522 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-01-24T06:56:17.522 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-01-24T06:56:17.523 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-01-24T06:56:17.523 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-01-24T06:56:17.523 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-01-24T06:56:17.523 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-01-24T06:56:17.523 INFO:teuthology.orchestra.run.smithi142.stdout: python3-lxml-4.2.3-3.el8.x86_64 2022-01-24T06:56:17.524 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.0.6-13.el8.noarch 2022-01-24T06:56:17.524 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-01-24T06:56:17.524 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-01-24T06:56:17.524 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-01-24T06:56:17.525 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-01-24T06:56:17.525 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-01-24T06:56:17.525 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-01-24T06:56:17.525 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-2.6-1.el8.noarch 2022-01-24T06:56:17.525 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-01-24T06:56:17.526 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-01-24T06:56:17.526 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-01-24T06:56:17.526 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-01-24T06:56:17.526 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.14-14.el8.noarch 2022-01-24T06:56:17.527 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pysocks-1.6.8-3.el8.noarch 2022-01-24T06:56:17.527 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2017.2-9.el8.noarch 2022-01-24T06:56:17.527 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.527 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.528 INFO:teuthology.orchestra.run.smithi142.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-01-24T06:56:17.528 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-01-24T06:56:17.528 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2022-01-24T06:56:17.528 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-01-24T06:56:17.528 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.529 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.4.1-12.el8.noarch 2022-01-24T06:56:17.529 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.8-1.el8.noarch 2022-01-24T06:56:17.529 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-01-24T06:56:17.529 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-01-24T06:56:17.530 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-01-24T06:56:17.530 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-01-24T06:56:17.530 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-01-24T06:56:17.530 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.24.2-5.el8.noarch 2022-01-24T06:56:17.530 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-01-24T06:56:17.531 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webencodings-0.5.1-6.el8.noarch 2022-01-24T06:56:17.531 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-01-24T06:56:17.531 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-01-24T06:56:17.531 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-01-24T06:56:17.532 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-01-24T06:56:17.532 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-01-24T06:56:17.532 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.532 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.532 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:56:17.533 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-1.el8.x86_64 2022-01-24T06:56:17.533 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-5.0.0-9.el8.x86_64 2022-01-24T06:56:17.533 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-01-24T06:56:17.533 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-01-24T06:56:17.534 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:56:17.534 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-01-24T06:56:17.620 DEBUG:teuthology.parallel:result is None 2022-01-24T06:57:59.503 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Linux 8 - AppStream 15 kB/s | 8.4 MB 09:40 2022-01-24T06:58:01.824 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Linux 8 - BaseOS 4.7 MB/s | 4.6 MB 00:00 2022-01-24T06:58:03.432 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Linux 8 - Extras 11 kB/s | 10 kB 00:00 2022-01-24T06:58:03.637 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS-8 - PowerTools 16 MB/s | 2.3 MB 00:00 2022-01-24T06:58:06.451 INFO:teuthology.orchestra.run.smithi145.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-01-24T06:58:07.720 INFO:teuthology.orchestra.run.smithi145.stdout:Apache Arrow 153 kB/s | 184 kB 00:01 2022-01-24T06:58:08.700 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 13 MB/s | 11 MB 00:00 2022-01-24T06:58:11.094 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2022-01-24T06:58:13.128 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-01-24T06:58:13.129 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-01-24T06:58:13.134 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-01-24T06:58:13.135 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-01-24T06:58:13.137 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-01-24T06:58:13.138 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2022-01-24T06:58:13.410 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2022-01-24T06:58:13.425 INFO:teuthology.orchestra.run.smithi145.stdout:===================================================================================================== 2022-01-24T06:58:13.426 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2022-01-24T06:58:13.426 INFO:teuthology.orchestra.run.smithi145.stdout:===================================================================================================== 2022-01-24T06:58:13.426 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2022-01-24T06:58:13.427 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-01-24T06:58:13.427 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 6.4 k 2022-01-24T06:58:13.427 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 5.6 M 2022-01-24T06:58:13.427 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 574 k 2022-01-24T06:58:13.428 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 203 k 2022-01-24T06:58:13.428 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 1.4 M 2022-01-24T06:58:13.428 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 68 k 2022-01-24T06:58:13.428 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 3.6 M 2022-01-24T06:58:13.429 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 8.6 M 2022-01-24T06:58:13.429 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 27 k 2022-01-24T06:58:13.429 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 10 M 2022-01-24T06:58:13.429 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 42 M 2022-01-24T06:58:13.429 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 59 k 2022-01-24T06:58:13.430 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.185-1.el8 CentOS-Base 59 k 2022-01-24T06:58:13.430 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-01-24T06:58:13.430 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2022-01-24T06:58:13.431 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 22 k 2022-01-24T06:58:13.431 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 509 k 2022-01-24T06:58:13.431 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 141 k 2022-01-24T06:58:13.431 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-01-24T06:58:13.432 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.32.1-28.el8 CentOS-Base 97 k 2022-01-24T06:58:13.432 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:1.1.1k-5.el8_5 CentOS-Base 2.3 M 2022-01-24T06:58:13.432 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 164 k 2022-01-24T06:58:13.432 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 364 k 2022-01-24T06:58:13.433 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 349 k 2022-01-24T06:58:13.433 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 113 k 2022-01-24T06:58:13.433 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 72 k 2022-01-24T06:58:13.433 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 2.7 M 2022-01-24T06:58:13.433 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 140 k 2022-01-24T06:58:13.434 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 5.0.0-9.el8 CentOS-Base 70 k 2022-01-24T06:58:13.434 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2022-01-24T06:58:13.434 INFO:teuthology.orchestra.run.smithi145.stdout: chkconfig x86_64 1.19.1-1.el8 CentOS-Base 198 k 2022-01-24T06:58:13.435 INFO:teuthology.orchestra.run.smithi145.stdout: e2fsprogs x86_64 1.45.6-2.el8 CentOS-Base 1.0 M 2022-01-24T06:58:13.435 INFO:teuthology.orchestra.run.smithi145.stdout: e2fsprogs-libs x86_64 1.45.6-2.el8 CentOS-Base 233 k 2022-01-24T06:58:13.435 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf x86_64 0.185-1.el8 CentOS-Base 221 k 2022-01-24T06:58:13.435 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs x86_64 0.185-1.el8 CentOS-Base 292 k 2022-01-24T06:58:13.435 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils x86_64 1.5.10-9.el8 CentOS-Base 66 k 2022-01-24T06:58:13.436 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs x86_64 1.5.10-9.el8 CentOS-Base 34 k 2022-01-24T06:58:13.436 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-libs x86_64 1.18.2-14.el8 CentOS-Base 840 k 2022-01-24T06:58:13.436 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-workstation x86_64 1.18.2-14.el8 CentOS-Base 957 k 2022-01-24T06:58:13.436 INFO:teuthology.orchestra.run.smithi145.stdout: libblkid x86_64 2.32.1-28.el8 CentOS-Base 217 k 2022-01-24T06:58:13.437 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err x86_64 1.45.6-2.el8 CentOS-Base 49 k 2022-01-24T06:58:13.437 INFO:teuthology.orchestra.run.smithi145.stdout: libfdisk x86_64 2.32.1-28.el8 CentOS-Base 251 k 2022-01-24T06:58:13.437 INFO:teuthology.orchestra.run.smithi145.stdout: libkadm5 x86_64 1.18.2-14.el8 CentOS-Base 187 k 2022-01-24T06:58:13.437 INFO:teuthology.orchestra.run.smithi145.stdout: libmount x86_64 2.32.1-28.el8 CentOS-Base 234 k 2022-01-24T06:58:13.438 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 3.5 M 2022-01-24T06:58:13.438 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 1.9 M 2022-01-24T06:58:13.438 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux x86_64 2.9-5.el8 CentOS-Base 165 k 2022-01-24T06:58:13.438 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-utils x86_64 2.9-5.el8 CentOS-Base 243 k 2022-01-24T06:58:13.439 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol x86_64 2.9-3.el8 CentOS-Base 340 k 2022-01-24T06:58:13.439 INFO:teuthology.orchestra.run.smithi145.stdout: libsmartcols x86_64 2.32.1-28.el8 CentOS-Base 177 k 2022-01-24T06:58:13.439 INFO:teuthology.orchestra.run.smithi145.stdout: libss x86_64 1.45.6-2.el8 CentOS-Base 54 k 2022-01-24T06:58:13.439 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid x86_64 2.32.1-28.el8 CentOS-Base 96 k 2022-01-24T06:58:13.440 INFO:teuthology.orchestra.run.smithi145.stdout: openssl x86_64 1:1.1.1k-5.el8_5 CentOS-Base 709 k 2022-01-24T06:58:13.440 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs x86_64 1:1.1.1k-5.el8_5 CentOS-Base 1.5 M 2022-01-24T06:58:13.440 INFO:teuthology.orchestra.run.smithi145.stdout: python3-libselinux x86_64 2.9-5.el8 CentOS-Base 283 k 2022-01-24T06:58:13.440 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux x86_64 2.32.1-28.el8 CentOS-Base 2.5 M 2022-01-24T06:58:13.441 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux-user x86_64 2.32.1-28.el8 CentOS-Base 100 k 2022-01-24T06:58:13.441 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs x86_64 5.0.0-9.el8 CentOS-Base 1.1 M 2022-01-24T06:58:13.441 INFO:teuthology.orchestra.run.smithi145.stdout: zlib x86_64 1.2.11-17.el8 CentOS-Base 102 k 2022-01-24T06:58:13.441 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2022-01-24T06:58:13.442 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-01-24T06:58:13.442 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 21 M 2022-01-24T06:58:13.442 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 24 k 2022-01-24T06:58:13.442 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 2.0 M 2022-01-24T06:58:13.443 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 192 k 2022-01-24T06:58:13.443 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 4.4 M 2022-01-24T06:58:13.443 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 17 M 2022-01-24T06:58:13.443 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:15.2.15-156.g6d0261fc.el8 ceph-noarch 9.0 k 2022-01-24T06:58:13.444 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 26 k 2022-01-24T06:58:13.444 INFO:teuthology.orchestra.run.smithi145.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-01-24T06:58:13.444 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-01-24T06:58:13.444 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-01-24T06:58:13.445 INFO:teuthology.orchestra.run.smithi145.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2022-01-24T06:58:13.445 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-Base 48 k 2022-01-24T06:58:13.445 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-devel x86_64 1.18.2-14.el8 CentOS-Base 560 k 2022-01-24T06:58:13.445 INFO:teuthology.orchestra.run.smithi145.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-01-24T06:58:13.446 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err-devel x86_64 1.45.6-2.el8 CentOS-Base 38 k 2022-01-24T06:58:13.446 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 8.5.0-4.el8_5 CentOS-Base 643 k 2022-01-24T06:58:13.446 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-01-24T06:58:13.446 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 8.5.0-4.el8_5 CentOS-Base 170 k 2022-01-24T06:58:13.447 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-01-24T06:58:13.447 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 381 k 2022-01-24T06:58:13.447 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2022-01-24T06:58:13.447 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 3.2 M 2022-01-24T06:58:13.447 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-devel x86_64 2.9-5.el8 CentOS-Base 200 k 2022-01-24T06:58:13.448 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-Base 87 k 2022-01-24T06:58:13.448 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-01-24T06:58:13.448 INFO:teuthology.orchestra.run.smithi145.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2022-01-24T06:58:13.448 INFO:teuthology.orchestra.run.smithi145.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2022-01-24T06:58:13.449 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-01-24T06:58:13.449 INFO:teuthology.orchestra.run.smithi145.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-01-24T06:58:13.449 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2022-01-24T06:58:13.449 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2022-01-24T06:58:13.450 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2022-01-24T06:58:13.450 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2022-01-24T06:58:13.450 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2022-01-24T06:58:13.450 INFO:teuthology.orchestra.run.smithi145.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-01-24T06:58:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-01-24T06:58:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-01-24T06:58:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-01-24T06:58:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-01-24T06:58:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 40 k 2022-01-24T06:58:13.452 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:15.2.15-156.g6d0261fc.el8 ceph 77 k 2022-01-24T06:58:13.452 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-01-24T06:58:13.452 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-01-24T06:58:13.452 INFO:teuthology.orchestra.run.smithi145.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2022-01-24T06:58:13.453 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-01-24T06:58:13.453 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-01-24T06:58:13.453 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-01-24T06:58:13.453 INFO:teuthology.orchestra.run.smithi145.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-01-24T06:58:13.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-01-24T06:58:13.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2022-01-24T06:58:13.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-01-24T06:58:13.454 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-01-24T06:58:13.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-01-24T06:58:13.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-01-24T06:58:13.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-01-24T06:58:13.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-01-24T06:58:13.455 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-01-24T06:58:13.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-01-24T06:58:13.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-lxml x86_64 4.2.3-3.el8 CentOS-AppStream 1.5 M 2022-01-24T06:58:13.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-01-24T06:58:13.456 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-01-24T06:58:13.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-01-24T06:58:13.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-01-24T06:58:13.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-01-24T06:58:13.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-01-24T06:58:13.457 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-01-24T06:58:13.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-01-24T06:58:13.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-01-24T06:58:13.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-01-24T06:58:13.458 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-01-24T06:58:13.459 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-01-24T06:58:13.459 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-01-24T06:58:13.459 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2022-01-24T06:58:13.459 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-01-24T06:58:13.459 INFO:teuthology.orchestra.run.smithi145.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-01-24T06:58:13.460 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-01-24T06:58:13.460 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2022-01-24T06:58:13.460 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-01-24T06:58:13.460 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-01-24T06:58:13.461 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-01-24T06:58:13.461 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-01-24T06:58:13.461 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-01-24T06:58:13.461 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-01-24T06:58:13.461 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-01-24T06:58:13.462 INFO:teuthology.orchestra.run.smithi145.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-01-24T06:58:13.462 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2022-01-24T06:58:13.462 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-01-24T06:58:13.462 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2022-01-24T06:58:13.463 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-01-24T06:58:13.463 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-01-24T06:58:13.463 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-01-24T06:58:13.463 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-01-24T06:58:13.464 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-01-24T06:58:13.464 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-01-24T06:58:13.464 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-01-24T06:58:13.464 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-17.el8 CentOS-Base 58 k 2022-01-24T06:58:13.465 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2022-01-24T06:58:13.465 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2022-01-24T06:58:13.465 INFO:teuthology.orchestra.run.smithi145.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2022-01-24T06:58:13.465 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:58:13.466 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2022-01-24T06:58:13.466 INFO:teuthology.orchestra.run.smithi145.stdout:===================================================================================================== 2022-01-24T06:58:13.466 INFO:teuthology.orchestra.run.smithi145.stdout:Install 130 Packages 2022-01-24T06:58:13.466 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 29 Packages 2022-01-24T06:58:13.467 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:58:13.467 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 193 M 2022-01-24T06:58:13.468 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2022-01-24T06:58:13.616 INFO:teuthology.orchestra.run.smithi145.stdout:(1/159): ceph-15.2.15-156.g6d0261fc.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2022-01-24T06:58:13.946 INFO:teuthology.orchestra.run.smithi145.stdout:(2/159): ceph-fuse-15.2.15-156.g6d0261fc.el8.x8 1.7 MB/s | 574 kB 00:00 2022-01-24T06:58:14.046 INFO:teuthology.orchestra.run.smithi145.stdout:(3/159): ceph-immutable-object-cache-15.2.15-15 2.0 MB/s | 203 kB 00:00 2022-01-24T06:58:14.559 INFO:teuthology.orchestra.run.smithi145.stdout:(4/159): ceph-mds-15.2.15-156.g6d0261fc.el8.x86 4.0 MB/s | 2.0 MB 00:00 2022-01-24T06:58:14.819 INFO:teuthology.orchestra.run.smithi145.stdout:(5/159): ceph-mgr-15.2.15-156.g6d0261fc.el8.x86 5.5 MB/s | 1.4 MB 00:00 2022-01-24T06:58:15.083 INFO:teuthology.orchestra.run.smithi145.stdout:(6/159): ceph-base-15.2.15-156.g6d0261fc.el8.x8 3.4 MB/s | 5.6 MB 00:01 2022-01-24T06:58:15.465 INFO:teuthology.orchestra.run.smithi145.stdout:(7/159): ceph-common-15.2.15-156.g6d0261fc.el8. 10 MB/s | 21 MB 00:02 2022-01-24T06:58:15.481 INFO:teuthology.orchestra.run.smithi145.stdout:(8/159): ceph-mon-15.2.15-156.g6d0261fc.el8.x86 6.6 MB/s | 4.4 MB 00:00 2022-01-24T06:58:15.559 INFO:teuthology.orchestra.run.smithi145.stdout:(9/159): ceph-selinux-15.2.15-156.g6d0261fc.el8 330 kB/s | 26 kB 00:00 2022-01-24T06:58:16.100 INFO:teuthology.orchestra.run.smithi145.stdout:(10/159): ceph-radosgw-15.2.15-156.g6d0261fc.el 16 MB/s | 10 MB 00:00 2022-01-24T06:58:16.157 INFO:teuthology.orchestra.run.smithi145.stdout:(11/159): libcephfs-devel-15.2.15-156.g6d0261fc 382 kB/s | 22 kB 00:00 2022-01-24T06:58:16.223 INFO:teuthology.orchestra.run.smithi145.stdout:(12/159): libcephfs2-15.2.15-156.g6d0261fc.el8. 7.7 MB/s | 509 kB 00:00 2022-01-24T06:58:16.277 INFO:teuthology.orchestra.run.smithi145.stdout:(13/159): librados-devel-15.2.15-156.g6d0261fc. 2.5 MB/s | 141 kB 00:00 2022-01-24T06:58:16.339 INFO:teuthology.orchestra.run.smithi145.stdout:(14/159): libradosstriper1-15.2.15-156.g6d0261f 6.0 MB/s | 381 kB 00:00 2022-01-24T06:58:16.534 INFO:teuthology.orchestra.run.smithi145.stdout:(15/159): librgw2-15.2.15-156.g6d0261fc.el8.x86 16 MB/s | 3.2 MB 00:00 2022-01-24T06:58:16.584 INFO:teuthology.orchestra.run.smithi145.stdout:(16/159): python3-ceph-argparse-15.2.15-156.g6d 800 kB/s | 40 kB 00:00 2022-01-24T06:58:16.633 INFO:teuthology.orchestra.run.smithi145.stdout:(17/159): python3-ceph-common-15.2.15-156.g6d02 1.5 MB/s | 77 kB 00:00 2022-01-24T06:58:16.689 INFO:teuthology.orchestra.run.smithi145.stdout:(18/159): python3-cephfs-15.2.15-156.g6d0261fc. 2.9 MB/s | 164 kB 00:00 2022-01-24T06:58:16.741 INFO:teuthology.orchestra.run.smithi145.stdout:(19/159): python3-rados-15.2.15-156.g6d0261fc.e 6.8 MB/s | 364 kB 00:00 2022-01-24T06:58:16.797 INFO:teuthology.orchestra.run.smithi145.stdout:(20/159): python3-rbd-15.2.15-156.g6d0261fc.el8 6.1 MB/s | 349 kB 00:00 2022-01-24T06:58:16.850 INFO:teuthology.orchestra.run.smithi145.stdout:(21/159): python3-rgw-15.2.15-156.g6d0261fc.el8 2.1 MB/s | 113 kB 00:00 2022-01-24T06:58:16.903 INFO:teuthology.orchestra.run.smithi145.stdout:(22/159): rbd-fuse-15.2.15-156.g6d0261fc.el8.x8 1.3 MB/s | 72 kB 00:00 2022-01-24T06:58:17.123 INFO:teuthology.orchestra.run.smithi145.stdout:(23/159): rbd-mirror-15.2.15-156.g6d0261fc.el8. 12 MB/s | 2.7 MB 00:00 2022-01-24T06:58:17.172 INFO:teuthology.orchestra.run.smithi145.stdout:(24/159): rbd-nbd-15.2.15-156.g6d0261fc.el8.x86 2.8 MB/s | 140 kB 00:00 2022-01-24T06:58:17.220 INFO:teuthology.orchestra.run.smithi145.stdout:(25/159): ceph-grafana-dashboards-15.2.15-156.g 500 kB/s | 24 kB 00:00 2022-01-24T06:58:17.270 INFO:teuthology.orchestra.run.smithi145.stdout:(26/159): ceph-mgr-cephadm-15.2.15-156.g6d0261f 1.3 MB/s | 68 kB 00:00 2022-01-24T06:58:17.404 INFO:teuthology.orchestra.run.smithi145.stdout:(27/159): ceph-osd-15.2.15-156.g6d0261fc.el8.x8 7.2 MB/s | 17 MB 00:02 2022-01-24T06:58:17.509 INFO:teuthology.orchestra.run.smithi145.stdout:(28/159): ceph-mgr-dashboard-15.2.15-156.g6d026 15 MB/s | 3.6 MB 00:00 2022-01-24T06:58:17.556 INFO:teuthology.orchestra.run.smithi145.stdout:(29/159): ceph-mgr-modules-core-15.2.15-156.g6d 4.0 MB/s | 192 kB 00:00 2022-01-24T06:58:17.597 INFO:teuthology.orchestra.run.smithi145.stdout:(30/159): ceph-mgr-rook-15.2.15-156.g6d0261fc.e 651 kB/s | 27 kB 00:00 2022-01-24T06:58:17.644 INFO:teuthology.orchestra.run.smithi145.stdout:(31/159): ceph-prometheus-alerts-15.2.15-156.g6 194 kB/s | 9.0 kB 00:00 2022-01-24T06:58:17.695 INFO:teuthology.orchestra.run.smithi145.stdout:(32/159): cephadm-15.2.15-156.g6d0261fc.el8.noa 1.1 MB/s | 59 kB 00:00 2022-01-24T06:58:17.733 INFO:teuthology.orchestra.run.smithi145.stdout:(33/159): automake-1.16.1-7.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2022-01-24T06:58:17.741 INFO:teuthology.orchestra.run.smithi145.stdout:(34/159): bison-3.0.4-10.el8.x86_64.rpm 80 MB/s | 688 kB 00:00 2022-01-24T06:58:17.746 INFO:teuthology.orchestra.run.smithi145.stdout:(35/159): flex-2.6.1-9.el8.x86_64.rpm 70 MB/s | 320 kB 00:00 2022-01-24T06:58:17.748 INFO:teuthology.orchestra.run.smithi145.stdout:(36/159): jq-1.5-12.el8.x86_64.rpm 63 MB/s | 161 kB 00:00 2022-01-24T06:58:17.753 INFO:teuthology.orchestra.run.smithi145.stdout:(37/159): librdkafka-0.11.4-1.el8.x86_64.rpm 74 MB/s | 353 kB 00:00 2022-01-24T06:58:17.762 INFO:teuthology.orchestra.run.smithi145.stdout:(38/159): libtool-2.4.6-25.el8.x86_64.rpm 77 MB/s | 709 kB 00:00 2022-01-24T06:58:17.766 INFO:teuthology.orchestra.run.smithi145.stdout:(39/159): lttng-ust-2.8.1-11.el8.x86_64.rpm 69 MB/s | 259 kB 00:00 2022-01-24T06:58:17.769 INFO:teuthology.orchestra.run.smithi145.stdout:(40/159): oniguruma-6.8.2-2.el8.x86_64.rpm 57 MB/s | 187 kB 00:00 2022-01-24T06:58:17.824 INFO:teuthology.orchestra.run.smithi145.stdout:(41/159): openblas-0.3.12-1.el8.x86_64.rpm 85 MB/s | 4.6 MB 00:00 2022-01-24T06:58:17.880 INFO:teuthology.orchestra.run.smithi145.stdout:(42/159): openblas-threads-0.3.12-1.el8.x86_64. 84 MB/s | 4.7 MB 00:00 2022-01-24T06:58:17.937 INFO:teuthology.orchestra.run.smithi145.stdout:(43/159): python3-babel-2.5.1-7.el8.noarch.rpm 85 MB/s | 4.8 MB 00:00 2022-01-24T06:58:17.940 INFO:teuthology.orchestra.run.smithi145.stdout:(44/159): python3-html5lib-0.999999999-6.el8.no 65 MB/s | 214 kB 00:00 2022-01-24T06:58:17.947 INFO:teuthology.orchestra.run.smithi145.stdout:(45/159): python3-jinja2-2.10.1-3.el8.noarch.rp 78 MB/s | 538 kB 00:00 2022-01-24T06:58:17.948 INFO:teuthology.orchestra.run.smithi145.stdout:(46/159): python3-jsonpatch-1.21-2.el8.noarch.r 25 MB/s | 27 kB 00:00 2022-01-24T06:58:17.949 INFO:teuthology.orchestra.run.smithi145.stdout:(47/159): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2022-01-24T06:58:17.968 INFO:teuthology.orchestra.run.smithi145.stdout:(48/159): python3-lxml-4.2.3-3.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2022-01-24T06:58:17.971 INFO:teuthology.orchestra.run.smithi145.stdout:(49/159): python3-mako-1.0.6-13.el8.noarch.rpm 62 MB/s | 157 kB 00:00 2022-01-24T06:58:17.972 INFO:teuthology.orchestra.run.smithi145.stdout:(50/159): python3-markupsafe-0.23-19.el8.x86_64 31 MB/s | 39 kB 00:00 2022-01-24T06:58:18.016 INFO:teuthology.orchestra.run.smithi145.stdout:(51/159): python3-numpy-1.14.3-10.el8.x86_64.rp 85 MB/s | 3.7 MB 00:00 2022-01-24T06:58:18.019 INFO:teuthology.orchestra.run.smithi145.stdout:(52/159): python3-numpy-f2py-1.14.3-10.el8.x86_ 66 MB/s | 225 kB 00:00 2022-01-24T06:58:18.021 INFO:teuthology.orchestra.run.smithi145.stdout:(53/159): python3-prettytable-0.7.2-14.el8.noar 38 MB/s | 44 kB 00:00 2022-01-24T06:58:18.023 INFO:teuthology.orchestra.run.smithi145.stdout:(54/159): python3-pyOpenSSL-19.0.0-1.el8.noarch 50 MB/s | 103 kB 00:00 2022-01-24T06:58:18.025 INFO:teuthology.orchestra.run.smithi145.stdout:(55/159): python3-pyasn1-0.3.7-6.el8.noarch.rpm 56 MB/s | 126 kB 00:00 2022-01-24T06:58:18.027 INFO:teuthology.orchestra.run.smithi145.stdout:(56/159): python3-pyasn1-modules-0.3.7-6.el8.no 56 MB/s | 110 kB 00:00 2022-01-24T06:58:18.029 INFO:teuthology.orchestra.run.smithi145.stdout:(57/159): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2022-01-24T06:58:18.259 INFO:teuthology.orchestra.run.smithi145.stdout:(58/159): python3-scipy-1.0.0-21.module_el8.5.0 60 MB/s | 14 MB 00:00 2022-01-24T06:58:18.260 INFO:teuthology.orchestra.run.smithi145.stdout:(59/159): python3-webencodings-0.5.1-6.el8.noar 22 MB/s | 27 kB 00:00 2022-01-24T06:58:18.266 INFO:teuthology.orchestra.run.smithi145.stdout:(60/159): python3-werkzeug-0.12.2-4.el8.noarch. 69 MB/s | 457 kB 00:00 2022-01-24T06:58:18.271 INFO:teuthology.orchestra.run.smithi145.stdout:(61/159): socat-1.7.4.1-1.el8.x86_64.rpm 71 MB/s | 323 kB 00:00 2022-01-24T06:58:18.273 INFO:teuthology.orchestra.run.smithi145.stdout:(62/159): elfutils-libelf-devel-0.185-1.el8.x86 37 MB/s | 59 kB 00:00 2022-01-24T06:58:18.274 INFO:teuthology.orchestra.run.smithi145.stdout:(63/159): fuse-2.9.7-12.el8.x86_64.rpm 48 MB/s | 82 kB 00:00 2022-01-24T06:58:18.276 INFO:teuthology.orchestra.run.smithi145.stdout:(64/159): keyutils-libs-devel-1.5.10-9.el8.x86_ 38 MB/s | 48 kB 00:00 2022-01-24T06:58:18.283 INFO:teuthology.orchestra.run.smithi145.stdout:(65/159): krb5-devel-1.18.2-14.el8.x86_64.rpm 79 MB/s | 560 kB 00:00 2022-01-24T06:58:18.284 INFO:teuthology.orchestra.run.smithi145.stdout:(66/159): libaio-devel-0.3.112-1.el8.x86_64.rpm 18 MB/s | 19 kB 00:00 2022-01-24T06:58:18.285 INFO:teuthology.orchestra.run.smithi145.stdout:(67/159): libcom_err-devel-1.45.6-2.el8.x86_64. 32 MB/s | 38 kB 00:00 2022-01-24T06:58:18.293 INFO:teuthology.orchestra.run.smithi145.stdout:(68/159): libgfortran-8.5.0-4.el8_5.x86_64.rpm 79 MB/s | 643 kB 00:00 2022-01-24T06:58:18.296 INFO:teuthology.orchestra.run.smithi145.stdout:(69/159): libquadmath-8.5.0-4.el8_5.x86_64.rpm 63 MB/s | 170 kB 00:00 2022-01-24T06:58:18.298 INFO:teuthology.orchestra.run.smithi145.stdout:(70/159): librabbitmq-0.9.0-3.el8.x86_64.rpm 37 MB/s | 47 kB 00:00 2022-01-24T06:58:18.301 INFO:teuthology.orchestra.run.smithi145.stdout:(71/159): libselinux-devel-2.9-5.el8.x86_64.rpm 64 MB/s | 200 kB 00:00 2022-01-24T06:58:18.303 INFO:teuthology.orchestra.run.smithi145.stdout:(72/159): libsepol-devel-2.9-3.el8.x86_64.rpm 48 MB/s | 87 kB 00:00 2022-01-24T06:58:18.305 INFO:teuthology.orchestra.run.smithi145.stdout:(73/159): libuuid-devel-2.32.1-28.el8.x86_64.rp 48 MB/s | 97 kB 00:00 2022-01-24T06:58:18.306 INFO:teuthology.orchestra.run.smithi145.stdout:(74/159): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2022-01-24T06:58:18.310 INFO:teuthology.orchestra.run.smithi145.stdout:(75/159): libxslt-1.1.32-6.el8.x86_64.rpm 69 MB/s | 250 kB 00:00 2022-01-24T06:58:18.337 INFO:teuthology.orchestra.run.smithi145.stdout:(76/159): openssl-devel-1.1.1k-5.el8_5.x86_64.r 85 MB/s | 2.3 MB 00:00 2022-01-24T06:58:18.345 INFO:teuthology.orchestra.run.smithi145.stdout:(77/159): pcre2-devel-10.32-2.el8.x86_64.rpm 78 MB/s | 605 kB 00:00 2022-01-24T06:58:18.349 INFO:teuthology.orchestra.run.smithi145.stdout:(78/159): pcre2-utf16-10.32-2.el8.x86_64.rpm 67 MB/s | 229 kB 00:00 2022-01-24T06:58:18.352 INFO:teuthology.orchestra.run.smithi145.stdout:(79/159): pcre2-utf32-10.32-2.el8.x86_64.rpm 67 MB/s | 220 kB 00:00 2022-01-24T06:58:18.355 INFO:teuthology.orchestra.run.smithi145.stdout:(80/159): python3-cffi-1.11.5-5.el8.x86_64.rpm 68 MB/s | 237 kB 00:00 2022-01-24T06:58:18.359 INFO:teuthology.orchestra.run.smithi145.stdout:(81/159): python3-chardet-3.0.4-7.el8.noarch.rp 64 MB/s | 195 kB 00:00 2022-01-24T06:58:18.366 INFO:teuthology.orchestra.run.smithi145.stdout:(82/159): python3-cryptography-3.2.1-5.el8.x86_ 77 MB/s | 559 kB 00:00 2022-01-24T06:58:18.368 INFO:teuthology.orchestra.run.smithi145.stdout:(83/159): python3-idna-2.5-5.el8.noarch.rpm 50 MB/s | 97 kB 00:00 2022-01-24T06:58:18.369 INFO:teuthology.orchestra.run.smithi145.stdout:(84/159): python3-jwt-1.6.1-2.el8.noarch.rpm 35 MB/s | 43 kB 00:00 2022-01-24T06:58:18.372 INFO:teuthology.orchestra.run.smithi145.stdout:(85/159): python3-oauthlib-2.1.0-1.el8.noarch.r 60 MB/s | 155 kB 00:00 2022-01-24T06:58:18.374 INFO:teuthology.orchestra.run.smithi145.stdout:(86/159): python3-pycparser-2.14-14.el8.noarch. 53 MB/s | 109 kB 00:00 2022-01-24T06:58:18.375 INFO:teuthology.orchestra.run.smithi145.stdout:(87/159): python3-pysocks-1.6.8-3.el8.noarch.rp 33 MB/s | 34 kB 00:00 2022-01-24T06:58:18.377 INFO:teuthology.orchestra.run.smithi145.stdout:(88/159): python3-requests-2.20.0-2.1.el8_1.noa 59 MB/s | 123 kB 00:00 2022-01-24T06:58:18.379 INFO:teuthology.orchestra.run.smithi145.stdout:(89/159): python3-requests-oauthlib-1.0.0-1.el8 36 MB/s | 43 kB 00:00 2022-01-24T06:58:18.382 INFO:teuthology.orchestra.run.smithi145.stdout:(90/159): python3-urllib3-1.24.2-5.el8.noarch.r 63 MB/s | 177 kB 00:00 2022-01-24T06:58:18.383 INFO:teuthology.orchestra.run.smithi145.stdout:(91/159): xfsprogs-devel-5.0.0-9.el8.x86_64.rpm 46 MB/s | 70 kB 00:00 2022-01-24T06:58:18.385 INFO:teuthology.orchestra.run.smithi145.stdout:(92/159): zlib-devel-1.2.11-17.el8.x86_64.rpm 42 MB/s | 58 kB 00:00 2022-01-24T06:58:18.557 INFO:teuthology.orchestra.run.smithi145.stdout:(93/159): ceph-mgr-diskprediction-local-15.2.15 7.5 MB/s | 8.6 MB 00:01 2022-01-24T06:58:18.584 INFO:teuthology.orchestra.run.smithi145.stdout:(94/159): fmt-6.2.1-1.el8.x86_64.rpm 585 kB/s | 116 kB 00:00 2022-01-24T06:58:18.642 INFO:teuthology.orchestra.run.smithi145.stdout:(95/159): leveldb-1.22-1.el8.x86_64.rpm 3.1 MB/s | 181 kB 00:00 2022-01-24T06:58:18.671 INFO:teuthology.orchestra.run.smithi145.stdout:(96/159): liboath-2.6.2-3.el8.x86_64.rpm 2.0 MB/s | 59 kB 00:00 2022-01-24T06:58:18.701 INFO:teuthology.orchestra.run.smithi145.stdout:(97/159): libunwind-1.3.1-3.el8.x86_64.rpm 2.5 MB/s | 75 kB 00:00 2022-01-24T06:58:18.725 INFO:teuthology.orchestra.run.smithi145.stdout:(98/159): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2022-01-24T06:58:18.729 INFO:teuthology.orchestra.run.smithi145.stdout:(99/159): python3-apipkg-1.5-6.el8.noarch.rpm 740 kB/s | 21 kB 00:00 2022-01-24T06:58:18.753 INFO:teuthology.orchestra.run.smithi145.stdout:(100/159): python3-bcrypt-3.1.6-2.el8.1.x86_64. 1.5 MB/s | 44 kB 00:00 2022-01-24T06:58:18.760 INFO:teuthology.orchestra.run.smithi145.stdout:(101/159): python3-beautifulsoup4-4.6.3-2.el8.1 5.8 MB/s | 185 kB 00:00 2022-01-24T06:58:18.781 INFO:teuthology.orchestra.run.smithi145.stdout:(102/159): python3-cachetools-3.1.1-4.el8.noarc 1.2 MB/s | 33 kB 00:00 2022-01-24T06:58:18.789 INFO:teuthology.orchestra.run.smithi145.stdout:(103/159): python3-certifi-2018.10.15-7.el8.noa 572 kB/s | 16 kB 00:00 2022-01-24T06:58:18.811 INFO:teuthology.orchestra.run.smithi145.stdout:(104/159): python3-cheroot-8.5.2-1.el8.noarch.r 5.7 MB/s | 173 kB 00:00 2022-01-24T06:58:18.839 INFO:teuthology.orchestra.run.smithi145.stdout:(105/159): python3-cssselect-0.9.2-10.el8.noarc 1.4 MB/s | 40 kB 00:00 2022-01-24T06:58:18.848 INFO:teuthology.orchestra.run.smithi145.stdout:(106/159): python3-cherrypy-18.4.0-1.el8.noarch 6.5 MB/s | 384 kB 00:00 2022-01-24T06:58:18.877 INFO:teuthology.orchestra.run.smithi145.stdout:(107/159): python3-google-auth-1.1.1-10.el8.noa 2.6 MB/s | 81 kB 00:00 2022-01-24T06:58:18.895 INFO:teuthology.orchestra.run.smithi145.stdout:(108/159): python3-execnet-1.7.1-1.el8.noarch.r 6.2 MB/s | 355 kB 00:00 2022-01-24T06:58:18.906 INFO:teuthology.orchestra.run.smithi145.stdout:(109/159): python3-jaraco-6.2-6.el8.noarch.rpm 387 kB/s | 11 kB 00:00 2022-01-24T06:58:18.923 INFO:teuthology.orchestra.run.smithi145.stdout:(110/159): python3-jaraco-functools-2.0-4.el8.n 630 kB/s | 18 kB 00:00 2022-01-24T06:58:18.951 INFO:teuthology.orchestra.run.smithi145.stdout:(111/159): python3-logutils-0.3.5-11.el8.noarch 1.7 MB/s | 49 kB 00:00 2022-01-24T06:58:18.979 INFO:teuthology.orchestra.run.smithi145.stdout:(112/159): python3-more-itertools-7.2.0-3.el8.n 2.0 MB/s | 59 kB 00:00 2022-01-24T06:58:19.010 INFO:teuthology.orchestra.run.smithi145.stdout:(113/159): python3-pecan-1.3.2-9.el8.noarch.rpm 9.1 MB/s | 283 kB 00:00 2022-01-24T06:58:19.026 INFO:teuthology.orchestra.run.smithi145.stdout:(114/159): python3-kubernetes-11.0.0-6.el8.noar 9.8 MB/s | 1.2 MB 00:00 2022-01-24T06:58:19.037 INFO:teuthology.orchestra.run.smithi145.stdout:(115/159): python3-portend-2.6-1.el8.noarch.rpm 565 kB/s | 16 kB 00:00 2022-01-24T06:58:19.055 INFO:teuthology.orchestra.run.smithi145.stdout:(116/159): python3-remoto-1.2.1-1.el8.noarch.rp 1.7 MB/s | 49 kB 00:00 2022-01-24T06:58:19.066 INFO:teuthology.orchestra.run.smithi145.stdout:(117/159): python3-repoze-lru-0.7-6.el8.noarch. 1.2 MB/s | 34 kB 00:00 2022-01-24T06:58:19.086 INFO:teuthology.orchestra.run.smithi145.stdout:(118/159): python3-routes-2.4.1-12.el8.noarch.r 6.3 MB/s | 196 kB 00:00 2022-01-24T06:58:19.094 INFO:teuthology.orchestra.run.smithi145.stdout:(119/159): python3-rsa-4.8-1.el8.noarch.rpm 2.1 MB/s | 61 kB 00:00 2022-01-24T06:58:19.114 INFO:teuthology.orchestra.run.smithi145.stdout:(120/159): python3-simplegeneric-0.8.1-17.el8.n 656 kB/s | 19 kB 00:00 2022-01-24T06:58:19.122 INFO:teuthology.orchestra.run.smithi145.stdout:(121/159): python3-singledispatch-3.4.0.3-18.el 860 kB/s | 24 kB 00:00 2022-01-24T06:58:19.143 INFO:teuthology.orchestra.run.smithi145.stdout:(122/159): python3-tempora-1.14.1-5.el8.noarch. 1.0 MB/s | 29 kB 00:00 2022-01-24T06:58:19.150 INFO:teuthology.orchestra.run.smithi145.stdout:(123/159): python3-trustme-0.6.0-4.el8.noarch.r 994 kB/s | 27 kB 00:00 2022-01-24T06:58:19.175 INFO:teuthology.orchestra.run.smithi145.stdout:(124/159): python3-waitress-1.2.1-2.el8.1.noarc 7.5 MB/s | 241 kB 00:00 2022-01-24T06:58:19.180 INFO:teuthology.orchestra.run.smithi145.stdout:(125/159): python3-webob-1.8.5-1.el8.1.noarch.r 8.1 MB/s | 251 kB 00:00 2022-01-24T06:58:19.204 INFO:teuthology.orchestra.run.smithi145.stdout:(126/159): python3-websocket-client-0.56.0-5.el 2.1 MB/s | 61 kB 00:00 2022-01-24T06:58:19.208 INFO:teuthology.orchestra.run.smithi145.stdout:(127/159): python3-webtest-2.0.33-1.el8.noarch. 2.9 MB/s | 85 kB 00:00 2022-01-24T06:58:19.232 INFO:teuthology.orchestra.run.smithi145.stdout:(128/159): python3-zc-lockfile-2.0-2.el8.noarch 803 kB/s | 23 kB 00:00 2022-01-24T06:58:19.237 INFO:teuthology.orchestra.run.smithi145.stdout:(129/159): xmlstarlet-1.6.1-11.el8.x86_64.rpm 2.4 MB/s | 69 kB 00:00 2022-01-24T06:58:19.557 INFO:teuthology.orchestra.run.smithi145.stdout:(130/159): librbd1-15.2.15-156.g6d0261fc.el8.x8 6.0 MB/s | 1.9 MB 00:00 2022-01-24T06:58:19.560 INFO:teuthology.orchestra.run.smithi145.stdout:(131/159): chkconfig-1.19.1-1.el8.x86_64.rpm 62 MB/s | 198 kB 00:00 2022-01-24T06:58:19.573 INFO:teuthology.orchestra.run.smithi145.stdout:(132/159): e2fsprogs-1.45.6-2.el8.x86_64.rpm 78 MB/s | 1.0 MB 00:00 2022-01-24T06:58:19.577 INFO:teuthology.orchestra.run.smithi145.stdout:(133/159): e2fsprogs-libs-1.45.6-2.el8.x86_64.r 68 MB/s | 233 kB 00:00 2022-01-24T06:58:19.580 INFO:teuthology.orchestra.run.smithi145.stdout:(134/159): elfutils-libelf-0.185-1.el8.x86_64.r 67 MB/s | 221 kB 00:00 2022-01-24T06:58:19.585 INFO:teuthology.orchestra.run.smithi145.stdout:(135/159): elfutils-libs-0.185-1.el8.x86_64.rpm 66 MB/s | 292 kB 00:00 2022-01-24T06:58:19.587 INFO:teuthology.orchestra.run.smithi145.stdout:(136/159): keyutils-1.5.10-9.el8.x86_64.rpm 44 MB/s | 66 kB 00:00 2022-01-24T06:58:19.588 INFO:teuthology.orchestra.run.smithi145.stdout:(137/159): keyutils-libs-1.5.10-9.el8.x86_64.rp 31 MB/s | 34 kB 00:00 2022-01-24T06:58:19.598 INFO:teuthology.orchestra.run.smithi145.stdout:(138/159): krb5-libs-1.18.2-14.el8.x86_64.rpm 81 MB/s | 840 kB 00:00 2022-01-24T06:58:19.610 INFO:teuthology.orchestra.run.smithi145.stdout:(139/159): krb5-workstation-1.18.2-14.el8.x86_6 79 MB/s | 957 kB 00:00 2022-01-24T06:58:19.614 INFO:teuthology.orchestra.run.smithi145.stdout:(140/159): libblkid-2.32.1-28.el8.x86_64.rpm 64 MB/s | 217 kB 00:00 2022-01-24T06:58:19.615 INFO:teuthology.orchestra.run.smithi145.stdout:(141/159): libcom_err-1.45.6-2.el8.x86_64.rpm 29 MB/s | 49 kB 00:00 2022-01-24T06:58:19.620 INFO:teuthology.orchestra.run.smithi145.stdout:(142/159): libfdisk-2.32.1-28.el8.x86_64.rpm 56 MB/s | 251 kB 00:00 2022-01-24T06:58:19.625 INFO:teuthology.orchestra.run.smithi145.stdout:(143/159): libkadm5-1.18.2-14.el8.x86_64.rpm 37 MB/s | 187 kB 00:00 2022-01-24T06:58:19.629 INFO:teuthology.orchestra.run.smithi145.stdout:(144/159): libmount-2.32.1-28.el8.x86_64.rpm 67 MB/s | 234 kB 00:00 2022-01-24T06:58:19.631 INFO:teuthology.orchestra.run.smithi145.stdout:(145/159): libselinux-2.9-5.el8.x86_64.rpm 65 MB/s | 165 kB 00:00 2022-01-24T06:58:19.635 INFO:teuthology.orchestra.run.smithi145.stdout:(146/159): libselinux-utils-2.9-5.el8.x86_64.rp 67 MB/s | 243 kB 00:00 2022-01-24T06:58:19.640 INFO:teuthology.orchestra.run.smithi145.stdout:(147/159): libsepol-2.9-3.el8.x86_64.rpm 73 MB/s | 340 kB 00:00 2022-01-24T06:58:19.644 INFO:teuthology.orchestra.run.smithi145.stdout:(148/159): libsmartcols-2.32.1-28.el8.x86_64.rp 64 MB/s | 177 kB 00:00 2022-01-24T06:58:19.644 INFO:teuthology.orchestra.run.smithi145.stdout:(149/159): libss-1.45.6-2.el8.x86_64.rpm 42 MB/s | 54 kB 00:00 2022-01-24T06:58:19.646 INFO:teuthology.orchestra.run.smithi145.stdout:(150/159): libuuid-2.32.1-28.el8.x86_64.rpm 54 MB/s | 96 kB 00:00 2022-01-24T06:58:19.655 INFO:teuthology.orchestra.run.smithi145.stdout:(151/159): openssl-1.1.1k-5.el8_5.x86_64.rpm 80 MB/s | 709 kB 00:00 2022-01-24T06:58:19.673 INFO:teuthology.orchestra.run.smithi145.stdout:(152/159): openssl-libs-1.1.1k-5.el8_5.x86_64.r 81 MB/s | 1.5 MB 00:00 2022-01-24T06:58:19.677 INFO:teuthology.orchestra.run.smithi145.stdout:(153/159): python3-libselinux-2.9-5.el8.x86_64. 70 MB/s | 283 kB 00:00 2022-01-24T06:58:19.694 INFO:teuthology.orchestra.run.smithi145.stdout:(154/159): librados2-15.2.15-156.g6d0261fc.el8. 7.6 MB/s | 3.5 MB 00:00 2022-01-24T06:58:19.980 INFO:teuthology.orchestra.run.smithi145.stdout:(155/159): ceph-test-15.2.15-156.g6d0261fc.el8. 9.5 MB/s | 42 MB 00:04 2022-01-24T06:58:20.000 INFO:teuthology.orchestra.run.smithi145.stdout:(156/159): util-linux-2.32.1-28.el8.x86_64.rpm 7.6 MB/s | 2.5 MB 00:00 2022-01-24T06:58:20.003 INFO:teuthology.orchestra.run.smithi145.stdout:(157/159): zlib-1.2.11-17.el8.x86_64.rpm 47 MB/s | 102 kB 00:00 2022-01-24T06:58:20.010 INFO:teuthology.orchestra.run.smithi145.stdout:(158/159): util-linux-user-2.32.1-28.el8.x86_64 317 kB/s | 100 kB 00:00 2022-01-24T06:58:20.026 INFO:teuthology.orchestra.run.smithi145.stdout:(159/159): xfsprogs-5.0.0-9.el8.x86_64.rpm 26 MB/s | 1.1 MB 00:00 2022-01-24T06:58:20.031 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2022-01-24T06:58:20.032 INFO:teuthology.orchestra.run.smithi145.stdout:Total 29 MB/s | 193 MB 00:06 2022-01-24T06:58:20.180 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2022-01-24T06:58:20.569 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2022-01-24T06:58:20.569 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2022-01-24T06:58:21.927 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2022-01-24T06:58:21.931 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2022-01-24T06:58:28.044 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2022-01-24T06:58:28.100 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: zlib-1.2.11-17.el8.x86_64 1/1 2022-01-24T06:58:28.381 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : zlib-1.2.11-17.el8.x86_64 1/188 2022-01-24T06:58:28.540 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-libs-1:1.1.1k-5.el8_5.x86_64 2/188 2022-01-24T06:58:28.620 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:1.1.1k-5.el8_5.x86_64 2/188 2022-01-24T06:58:28.776 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fmt-6.2.1-1.el8.x86_64 3/188 2022-01-24T06:58:28.896 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libcom_err-1.45.6-2.el8.x86_64 4/188 2022-01-24T06:58:28.957 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcom_err-1.45.6-2.el8.x86_64 4/188 2022-01-24T06:58:29.092 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : keyutils-libs-1.5.10-9.el8.x86_64 5/188 2022-01-24T06:58:29.271 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libuuid-2.32.1-28.el8.x86_64 6/188 2022-01-24T06:58:29.339 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libuuid-2.32.1-28.el8.x86_64 6/188 2022-01-24T06:58:29.521 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libblkid-2.32.1-28.el8.x86_64 7/188 2022-01-24T06:58:29.576 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libblkid-2.32.1-28.el8.x86_64 7/188 2022-01-24T06:58:29.706 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.2-3.el8.x86_64 8/188 2022-01-24T06:58:29.871 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/188 2022-01-24T06:58:29.996 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/188 2022-01-24T06:58:30.068 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/188 2022-01-24T06:58:30.232 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 11/188 2022-01-24T06:58:30.438 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libsepol-2.9-3.el8.x86_64 12/188 2022-01-24T06:58:30.507 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libsepol-2.9-3.el8.x86_64 12/188 2022-01-24T06:58:30.648 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libselinux-2.9-5.el8.x86_64 13/188 2022-01-24T06:58:30.725 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libselinux-2.9-5.el8.x86_64 13/188 2022-01-24T06:58:30.872 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 14/188 2022-01-24T06:58:31.226 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 14/188 2022-01-24T06:58:31.389 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 15/188 2022-01-24T06:58:31.598 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 15/188 2022-01-24T06:58:31.804 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 16/188 2022-01-24T06:58:31.910 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 16/188 2022-01-24T06:58:32.054 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:58:32.179 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:58:32.571 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 18/188 2022-01-24T06:58:32.754 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 19/188 2022-01-24T06:58:32.917 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 19/188 2022-01-24T06:58:33.126 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : krb5-libs-1.18.2-14.el8.x86_64 20/188 2022-01-24T06:58:33.371 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 21/188 2022-01-24T06:58:33.530 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 22/188 2022-01-24T06:58:33.736 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libkadm5-1.18.2-14.el8.x86_64 23/188 2022-01-24T06:58:33.929 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 24/188 2022-01-24T06:58:34.121 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 24/188 2022-01-24T06:58:34.362 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : xfsprogs-5.0.0-9.el8.x86_64 25/188 2022-01-24T06:58:34.467 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: xfsprogs-5.0.0-9.el8.x86_64 25/188 2022-01-24T06:58:34.620 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libss-1.45.6-2.el8.x86_64 26/188 2022-01-24T06:58:34.688 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libss-1.45.6-2.el8.x86_64 26/188 2022-01-24T06:58:34.829 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 27/188 2022-01-24T06:58:35.120 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libelf-0.185-1.el8.x86_64 28/188 2022-01-24T06:58:35.309 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 29/188 2022-01-24T06:58:35.482 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-idna-2.5-5.el8.noarch 30/188 2022-01-24T06:58:35.708 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 31/188 2022-01-24T06:58:35.845 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-8.5.0-4.el8_5.x86_64 32/188 2022-01-24T06:58:35.984 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libquadmath-8.5.0-4.el8_5.x86_64 32/188 2022-01-24T06:58:36.282 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-8.5.0-4.el8_5.x86_64 33/188 2022-01-24T06:58:36.820 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libgfortran-8.5.0-4.el8_5.x86_64 33/188 2022-01-24T06:58:36.953 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.12-1.el8.x86_64 34/188 2022-01-24T06:58:37.497 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 34/188 2022-01-24T06:58:37.636 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 35/188 2022-01-24T06:58:38.346 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 35/188 2022-01-24T06:58:38.669 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 36/188 2022-01-24T06:58:38.860 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 37/188 2022-01-24T06:58:39.058 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 38/188 2022-01-24T06:58:39.231 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 39/188 2022-01-24T06:58:39.416 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:15.2.15-156.g6d0261fc.el8. 40/188 2022-01-24T06:58:39.563 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el 41/188 2022-01-24T06:58:39.802 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_6 42/188 2022-01-24T06:58:40.811 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 43/188 2022-01-24T06:58:41.151 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 44/188 2022-01-24T06:58:41.670 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 45/188 2022-01-24T06:58:41.827 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 46/188 2022-01-24T06:58:42.065 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 47/188 2022-01-24T06:58:42.240 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.8-1.el8.noarch 48/188 2022-01-24T06:58:42.428 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 49/188 2022-01-24T06:58:42.617 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 50/188 2022-01-24T06:58:42.866 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_6 51/188 2022-01-24T06:58:43.219 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : chkconfig-1.19.1-1.el8.x86_64 52/188 2022-01-24T06:58:43.402 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:58:45.257 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:58:45.561 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 54/188 2022-01-24T06:58:45.743 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libmount-2.32.1-28.el8.x86_64 55/188 2022-01-24T06:58:45.853 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libmount-2.32.1-28.el8.x86_64 55/188 2022-01-24T06:58:46.100 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libselinux-utils-2.9-5.el8.x86_64 56/188 2022-01-24T06:58:46.269 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/188 2022-01-24T06:58:46.427 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libfdisk-2.32.1-28.el8.x86_64 58/188 2022-01-24T06:58:46.526 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libfdisk-2.32.1-28.el8.x86_64 58/188 2022-01-24T06:58:46.656 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.32.1-28.el8.x86_64 59/188 2022-01-24T06:58:46.814 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/188 2022-01-24T06:58:46.987 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcom_err-devel-1.45.6-2.el8.x86_64 61/188 2022-01-24T06:58:47.193 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : e2fsprogs-libs-1.45.6-2.el8.x86_64 62/188 2022-01-24T06:58:47.388 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-2.el8.x86_64 62/188 2022-01-24T06:58:47.725 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : e2fsprogs-1.45.6-2.el8.x86_64 63/188 2022-01-24T06:58:47.870 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 64/188 2022-01-24T06:58:48.025 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libsmartcols-2.32.1-28.el8.x86_64 65/188 2022-01-24T06:58:48.525 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libsmartcols-2.32.1-28.el8.x86_64 65/188 2022-01-24T06:58:48.835 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : util-linux-2.32.1-28.el8.x86_64 66/188 2022-01-24T06:58:48.862 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: util-linux-2.32.1-28.el8.x86_64 66/188 2022-01-24T06:58:49.007 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 67/188 2022-01-24T06:58:49.238 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 68/188 2022-01-24T06:58:49.433 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 69/188 2022-01-24T06:58:49.555 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 70/188 2022-01-24T06:58:49.695 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 71/188 2022-01-24T06:58:49.868 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 72/188 2022-01-24T06:58:50.062 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 73/188 2022-01-24T06:58:50.212 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 74/188 2022-01-24T06:58:50.357 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 75/188 2022-01-24T06:58:50.505 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 76/188 2022-01-24T06:58:50.690 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/188 2022-01-24T06:58:50.848 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/188 2022-01-24T06:58:51.018 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 79/188 2022-01-24T06:58:51.194 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/188 2022-01-24T06:58:51.389 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/188 2022-01-24T06:58:51.567 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/188 2022-01-24T06:58:51.827 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/188 2022-01-24T06:58:52.043 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/188 2022-01-24T06:58:52.326 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/188 2022-01-24T06:58:52.526 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/188 2022-01-24T06:58:52.709 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/188 2022-01-24T06:58:52.975 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 88/188 2022-01-24T06:58:53.226 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 89/188 2022-01-24T06:58:53.433 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 90/188 2022-01-24T06:58:53.817 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 91/188 2022-01-24T06:58:54.122 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 92/188 2022-01-24T06:58:54.320 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/188 2022-01-24T06:58:54.594 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 94/188 2022-01-24T06:58:54.784 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 95/188 2022-01-24T06:58:54.987 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 96/188 2022-01-24T06:58:55.272 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 97/188 2022-01-24T06:58:55.468 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 98/188 2022-01-24T06:58:55.745 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 99/188 2022-01-24T06:58:55.940 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 100/188 2022-01-24T06:58:56.132 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 101/188 2022-01-24T06:58:57.271 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/188 2022-01-24T06:58:57.808 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 103/188 2022-01-24T06:58:58.077 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 104/188 2022-01-24T06:58:58.403 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 105/188 2022-01-24T06:58:58.742 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 106/188 2022-01-24T06:58:58.951 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 107/188 2022-01-24T06:58:59.141 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 108/188 2022-01-24T06:58:59.401 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 109/188 2022-01-24T06:58:59.594 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.7-12.el8.x86_64 110/188 2022-01-24T06:58:59.865 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 111/188 2022-01-24T06:59:00.148 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 112/188 2022-01-24T06:59:00.534 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 113/188 2022-01-24T06:59:00.844 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-lxml-4.2.3-3.el8.x86_64 114/188 2022-01-24T06:59:01.176 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 115/188 2022-01-24T06:59:01.449 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 116/188 2022-01-24T06:59:01.624 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 117/188 2022-01-24T06:59:05.804 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:59:05.990 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:59:06.662 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 118/188 2022-01-24T06:59:06.942 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 119/188 2022-01-24T06:59:07.037 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 119/188 2022-01-24T06:59:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 120/188 2022-01-24T06:59:22.549 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 120/188 2022-01-24T06:59:22.549 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2022-01-24T06:59:22.550 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2022-01-24T06:59:22.550 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /dev 2022-01-24T06:59:22.550 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /run 2022-01-24T06:59:22.550 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2022-01-24T06:59:22.550 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2022-01-24T06:59:22.551 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2022-01-24T06:59:22.551 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2022-01-24T06:59:22.551 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /dev 2022-01-24T06:59:22.551 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:22.962 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 121/188 2022-01-24T06:59:23.333 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 121/188 2022-01-24T06:59:23.570 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 122/188 2022-01-24T06:59:24.923 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 122/188 2022-01-24T06:59:25.161 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 123/188 2022-01-24T06:59:25.190 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 123/188 2022-01-24T06:59:25.531 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 124/188 2022-01-24T06:59:25.848 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 125/188 2022-01-24T06:59:26.027 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 126/188 2022-01-24T06:59:26.087 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 126/188 2022-01-24T06:59:26.414 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : jq-1.5-12.el8.x86_64 127/188 2022-01-24T06:59:26.636 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.1-7.el8.noarch 128/188 2022-01-24T06:59:28.898 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 129/188 2022-01-24T06:59:29.165 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 129/188 2022-01-24T06:59:29.334 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.e 130/188 2022-01-24T06:59:29.537 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc. 131/188 2022-01-24T06:59:29.769 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 132/188 2022-01-24T06:59:30.720 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 132/188 2022-01-24T06:59:31.296 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 133/188 2022-01-24T06:59:32.340 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 133/188 2022-01-24T06:59:32.551 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 134/188 2022-01-24T06:59:32.628 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 134/188 2022-01-24T06:59:33.006 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el 135/188 2022-01-24T06:59:33.273 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 136/188 2022-01-24T06:59:33.297 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 136/188 2022-01-24T06:59:33.493 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 137/188 2022-01-24T06:59:33.504 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 137/188 2022-01-24T06:59:33.730 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 138/188 2022-01-24T06:59:33.909 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-25.el8.x86_64 139/188 2022-01-24T06:59:37.539 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 139/188 2022-01-24T06:59:38.801 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 140/188 2022-01-24T06:59:39.061 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 141/188 2022-01-24T06:59:39.156 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 141/188 2022-01-24T06:59:39.350 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:15.2.15-156.g6d026 142/188 2022-01-24T06:59:39.602 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.15-156.g6d026 142/188 2022-01-24T06:59:39.800 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 143/188 2022-01-24T06:59:39.866 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 143/188 2022-01-24T06:59:40.785 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 144/188 2022-01-24T06:59:41.064 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:1.1.1k-5.el8_5.x86_64 145/188 2022-01-24T06:59:41.303 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : util-linux-user-2.32.1-28.el8.x86_64 146/188 2022-01-24T06:59:41.452 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-5.0.0-9.el8.x86_64 147/188 2022-01-24T06:59:41.621 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_ 148/188 2022-01-24T06:59:41.873 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.185-1.el8.x86_64 149/188 2022-01-24T06:59:42.277 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libs-0.185-1.el8.x86_64 150/188 2022-01-24T06:59:42.573 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : krb5-workstation-1.18.2-14.el8.x86_64 151/188 2022-01-24T06:59:42.778 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 152/188 2022-01-24T06:59:43.021 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 153/188 2022-01-24T06:59:43.271 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : python3-libselinux-2.9-5.el8.x86_64 154/188 2022-01-24T06:59:43.572 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : keyutils-1.5.10-9.el8.x86_64 155/188 2022-01-24T06:59:43.792 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-1:1.1.1k-5.el8_5.x86_64 156/188 2022-01-24T06:59:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 157/188 2022-01-24T06:59:44.224 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.1-9.el8.x86_64 158/188 2022-01-24T06:59:44.302 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 158/188 2022-01-24T06:59:44.474 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.0.4-10.el8.x86_64 159/188 2022-01-24T06:59:44.489 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 159/188 2022-01-24T06:59:44.726 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : krb5-workstation-1.18.2-8.el8.x86_64 160/188 2022-01-24T06:59:44.853 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libkadm5-1.18.2-8.el8.x86_64 161/188 2022-01-24T06:59:45.047 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : krb5-libs-1.18.2-8.el8.x86_64 162/188 2022-01-24T06:59:45.233 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : e2fsprogs-1.45.6-1.el8.x86_64 163/188 2022-01-24T06:59:45.438 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libs-0.180-1.el8.x86_64 164/188 2022-01-24T06:59:45.601 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-1:1.1.1g-11.el8.x86_64 165/188 2022-01-24T06:59:45.745 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : keyutils-1.5.10-6.el8.x86_64 166/188 2022-01-24T06:59:45.745 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : xfsprogs-5.0.0-4.el8.x86_64 167/188 2022-01-24T06:59:46.018 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: xfsprogs-5.0.0-4.el8.x86_64 167/188 2022-01-24T06:59:46.192 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libselinux-utils-2.9-3.el8.x86_64 168/188 2022-01-24T06:59:46.193 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 169/188 2022-01-24T06:59:46.445 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 169/188 2022-01-24T06:59:46.445 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 170/188 2022-01-24T06:59:46.660 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 170/188 2022-01-24T06:59:46.660 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : e2fsprogs-libs-1.45.6-1.el8.x86_64 171/188 2022-01-24T06:59:46.868 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-1.el8.x86_64 171/188 2022-01-24T06:59:46.868 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:59:47.069 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:59:47.204 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : util-linux-user-2.32.1-24.el8.x86_64 173/188 2022-01-24T06:59:47.417 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : util-linux-2.32.1-24.el8.x86_64 174/188 2022-01-24T06:59:47.418 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libfdisk-2.32.1-24.el8.x86_64 175/188 2022-01-24T06:59:47.618 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libfdisk-2.32.1-24.el8.x86_64 175/188 2022-01-24T06:59:47.618 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libmount-2.32.1-24.el8.x86_64 176/188 2022-01-24T06:59:47.801 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libmount-2.32.1-24.el8.x86_64 176/188 2022-01-24T06:59:47.801 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libblkid-2.32.1-24.el8.x86_64 177/188 2022-01-24T06:59:47.968 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libblkid-2.32.1-24.el8.x86_64 177/188 2022-01-24T06:59:48.203 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : python3-libselinux-2.9-3.el8.x86_64 178/188 2022-01-24T06:59:48.359 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : chkconfig-1.13-2.el8.x86_64 179/188 2022-01-24T06:59:48.526 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libselinux-2.9-3.el8.x86_64 180/188 2022-01-24T06:59:48.527 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-libs-1:1.1.1g-11.el8.x86_64 181/188 2022-01-24T06:59:48.820 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:1.1.1g-11.el8.x86_64 181/188 2022-01-24T06:59:48.983 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libelf-0.180-1.el8.x86_64 182/188 2022-01-24T06:59:49.117 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : zlib-1.2.11-16.el8_2.x86_64 183/188 2022-01-24T06:59:49.117 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libsepol-2.9-1.el8.x86_64 184/188 2022-01-24T06:59:49.351 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libsepol-2.9-1.el8.x86_64 184/188 2022-01-24T06:59:49.352 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libuuid-2.32.1-24.el8.x86_64 185/188 2022-01-24T06:59:49.543 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libuuid-2.32.1-24.el8.x86_64 185/188 2022-01-24T06:59:49.543 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libsmartcols-2.32.1-24.el8.x86_64 186/188 2022-01-24T06:59:49.717 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libsmartcols-2.32.1-24.el8.x86_64 186/188 2022-01-24T06:59:49.718 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libcom_err-1.45.6-1.el8.x86_64 187/188 2022-01-24T06:59:49.942 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcom_err-1.45.6-1.el8.x86_64 187/188 2022-01-24T06:59:50.073 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : keyutils-libs-1.5.10-6.el8.x86_64 188/188 2022-01-24T06:59:50.635 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: keyutils-libs-1.5.10-6.el8.x86_64 188/188 2022-01-24T06:59:50.635 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 1/188 2022-01-24T06:59:50.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 2/188 2022-01-24T06:59:50.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 3/188 2022-01-24T06:59:50.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 4/188 2022-01-24T06:59:50.636 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:15.2.15-156.g6d026 5/188 2022-01-24T06:59:50.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 6/188 2022-01-24T06:59:50.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 7/188 2022-01-24T06:59:50.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 8/188 2022-01-24T06:59:50.637 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 9/188 2022-01-24T06:59:50.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 10/188 2022-01-24T06:59:50.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 11/188 2022-01-24T06:59:50.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 12/188 2022-01-24T06:59:50.638 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_ 13/188 2022-01-24T06:59:50.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 14/188 2022-01-24T06:59:50.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_6 15/188 2022-01-24T06:59:50.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86 16/188 2022-01-24T06:59:50.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 17/188 2022-01-24T06:59:50.639 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el 18/188 2022-01-24T06:59:50.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:15.2.15-156.g6d0261fc.el8. 19/188 2022-01-24T06:59:50.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_6 20/188 2022-01-24T06:59:50.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 21/188 2022-01-24T06:59:50.640 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 22/188 2022-01-24T06:59:50.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 23/188 2022-01-24T06:59:50.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 24/188 2022-01-24T06:59:50.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 25/188 2022-01-24T06:59:50.641 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 26/188 2022-01-24T06:59:50.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc. 27/188 2022-01-24T06:59:50.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noa 28/188 2022-01-24T06:59:50.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.n 29/188 2022-01-24T06:59:50.642 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0 30/188 2022-01-24T06:59:50.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el 31/188 2022-01-24T06:59:50.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 32/188 2022-01-24T06:59:50.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.e 33/188 2022-01-24T06:59:50.643 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 34/188 2022-01-24T06:59:50.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.1-7.el8.noarch 35/188 2022-01-24T06:59:50.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/188 2022-01-24T06:59:50.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/188 2022-01-24T06:59:50.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : jq-1.5-12.el8.x86_64 38/188 2022-01-24T06:59:50.644 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/188 2022-01-24T06:59:50.645 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/188 2022-01-24T06:59:50.645 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/188 2022-01-24T06:59:50.645 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 42/188 2022-01-24T06:59:50.645 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 43/188 2022-01-24T06:59:50.646 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 44/188 2022-01-24T06:59:50.646 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 45/188 2022-01-24T06:59:50.646 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 46/188 2022-01-24T06:59:50.646 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 47/188 2022-01-24T06:59:50.646 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 48/188 2022-01-24T06:59:50.647 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 49/188 2022-01-24T06:59:50.647 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-lxml-4.2.3-3.el8.x86_64 50/188 2022-01-24T06:59:50.647 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 51/188 2022-01-24T06:59:50.647 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/188 2022-01-24T06:59:50.648 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/188 2022-01-24T06:59:50.648 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/188 2022-01-24T06:59:50.648 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/188 2022-01-24T06:59:50.648 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/188 2022-01-24T06:59:50.648 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/188 2022-01-24T06:59:50.649 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/188 2022-01-24T06:59:50.649 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 59/188 2022-01-24T06:59:50.649 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 60/188 2022-01-24T06:59:50.649 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 61/188 2022-01-24T06:59:50.650 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/188 2022-01-24T06:59:50.650 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/188 2022-01-24T06:59:50.650 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.185-1.el8.x86_64 64/188 2022-01-24T06:59:50.650 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 65/188 2022-01-24T06:59:50.650 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/188 2022-01-24T06:59:50.651 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 67/188 2022-01-24T06:59:50.651 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/188 2022-01-24T06:59:50.651 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcom_err-devel-1.45.6-2.el8.x86_64 69/188 2022-01-24T06:59:50.651 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-8.5.0-4.el8_5.x86_64 70/188 2022-01-24T06:59:50.652 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-8.5.0-4.el8_5.x86_64 71/188 2022-01-24T06:59:50.652 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/188 2022-01-24T06:59:50.652 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/188 2022-01-24T06:59:50.652 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/188 2022-01-24T06:59:50.653 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.32.1-28.el8.x86_64 75/188 2022-01-24T06:59:50.653 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 76/188 2022-01-24T06:59:50.653 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 77/188 2022-01-24T06:59:50.653 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:1.1.1k-5.el8_5.x86_64 78/188 2022-01-24T06:59:50.653 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/188 2022-01-24T06:59:50.654 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/188 2022-01-24T06:59:50.654 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/188 2022-01-24T06:59:50.654 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 82/188 2022-01-24T06:59:50.654 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 83/188 2022-01-24T06:59:50.655 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/188 2022-01-24T06:59:50.655 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-idna-2.5-5.el8.noarch 85/188 2022-01-24T06:59:50.655 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/188 2022-01-24T06:59:50.655 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/188 2022-01-24T06:59:50.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/188 2022-01-24T06:59:50.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 89/188 2022-01-24T06:59:50.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 90/188 2022-01-24T06:59:50.656 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 91/188 2022-01-24T06:59:50.657 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 92/188 2022-01-24T06:59:50.657 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-5.0.0-9.el8.x86_64 93/188 2022-01-24T06:59:50.657 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 94/188 2022-01-24T06:59:50.657 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 95/188 2022-01-24T06:59:50.657 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/188 2022-01-24T06:59:50.658 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : leveldb-1.22-1.el8.x86_64 97/188 2022-01-24T06:59:50.658 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/188 2022-01-24T06:59:50.658 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/188 2022-01-24T06:59:50.658 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 100/188 2022-01-24T06:59:50.659 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/188 2022-01-24T06:59:50.659 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/188 2022-01-24T06:59:50.659 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/188 2022-01-24T06:59:50.659 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/188 2022-01-24T06:59:50.660 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/188 2022-01-24T06:59:50.660 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/188 2022-01-24T06:59:50.660 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 107/188 2022-01-24T06:59:50.660 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 108/188 2022-01-24T06:59:50.660 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 109/188 2022-01-24T06:59:50.661 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 110/188 2022-01-24T06:59:50.661 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 111/188 2022-01-24T06:59:50.661 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 112/188 2022-01-24T06:59:50.661 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 113/188 2022-01-24T06:59:50.662 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 114/188 2022-01-24T06:59:50.662 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 115/188 2022-01-24T06:59:50.662 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-2.6-1.el8.noarch 116/188 2022-01-24T06:59:50.662 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 117/188 2022-01-24T06:59:50.663 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 118/188 2022-01-24T06:59:50.663 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 119/188 2022-01-24T06:59:50.663 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 120/188 2022-01-24T06:59:50.663 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 121/188 2022-01-24T06:59:50.663 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 122/188 2022-01-24T06:59:50.664 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 123/188 2022-01-24T06:59:50.664 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 124/188 2022-01-24T06:59:50.664 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 125/188 2022-01-24T06:59:50.664 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 126/188 2022-01-24T06:59:50.665 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 127/188 2022-01-24T06:59:50.665 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 128/188 2022-01-24T06:59:50.665 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 129/188 2022-01-24T06:59:50.665 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 130/188 2022-01-24T06:59:50.666 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 131/188 2022-01-24T06:59:50.666 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/188 2022-01-24T06:59:50.666 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 133/188 2022-01-24T06:59:50.666 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/188 2022-01-24T06:59:50.666 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : chkconfig-1.19.1-1.el8.x86_64 135/188 2022-01-24T06:59:50.667 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : chkconfig-1.13-2.el8.x86_64 136/188 2022-01-24T06:59:50.667 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : e2fsprogs-1.45.6-2.el8.x86_64 137/188 2022-01-24T06:59:50.667 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : e2fsprogs-1.45.6-1.el8.x86_64 138/188 2022-01-24T06:59:50.667 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : e2fsprogs-libs-1.45.6-2.el8.x86_64 139/188 2022-01-24T06:59:50.668 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : e2fsprogs-libs-1.45.6-1.el8.x86_64 140/188 2022-01-24T06:59:50.668 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.185-1.el8.x86_64 141/188 2022-01-24T06:59:50.668 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.180-1.el8.x86_64 142/188 2022-01-24T06:59:50.668 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.185-1.el8.x86_64 143/188 2022-01-24T06:59:50.668 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.180-1.el8.x86_64 144/188 2022-01-24T06:59:50.669 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : keyutils-1.5.10-9.el8.x86_64 145/188 2022-01-24T06:59:50.669 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : keyutils-1.5.10-6.el8.x86_64 146/188 2022-01-24T06:59:50.669 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : keyutils-libs-1.5.10-9.el8.x86_64 147/188 2022-01-24T06:59:50.669 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : keyutils-libs-1.5.10-6.el8.x86_64 148/188 2022-01-24T06:59:50.670 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : krb5-libs-1.18.2-14.el8.x86_64 149/188 2022-01-24T06:59:50.670 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : krb5-libs-1.18.2-8.el8.x86_64 150/188 2022-01-24T06:59:50.670 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : krb5-workstation-1.18.2-14.el8.x86_64 151/188 2022-01-24T06:59:50.670 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : krb5-workstation-1.18.2-8.el8.x86_64 152/188 2022-01-24T06:59:50.670 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libblkid-2.32.1-28.el8.x86_64 153/188 2022-01-24T06:59:50.671 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libblkid-2.32.1-24.el8.x86_64 154/188 2022-01-24T06:59:50.671 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcom_err-1.45.6-2.el8.x86_64 155/188 2022-01-24T06:59:50.671 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcom_err-1.45.6-1.el8.x86_64 156/188 2022-01-24T06:59:50.671 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libfdisk-2.32.1-28.el8.x86_64 157/188 2022-01-24T06:59:50.672 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libfdisk-2.32.1-24.el8.x86_64 158/188 2022-01-24T06:59:50.672 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libkadm5-1.18.2-14.el8.x86_64 159/188 2022-01-24T06:59:50.672 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libkadm5-1.18.2-8.el8.x86_64 160/188 2022-01-24T06:59:50.672 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libmount-2.32.1-28.el8.x86_64 161/188 2022-01-24T06:59:50.672 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libmount-2.32.1-24.el8.x86_64 162/188 2022-01-24T06:59:50.673 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libselinux-2.9-5.el8.x86_64 163/188 2022-01-24T06:59:50.673 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libselinux-2.9-3.el8.x86_64 164/188 2022-01-24T06:59:50.673 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libselinux-utils-2.9-5.el8.x86_64 165/188 2022-01-24T06:59:50.673 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libselinux-utils-2.9-3.el8.x86_64 166/188 2022-01-24T06:59:50.674 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsepol-2.9-3.el8.x86_64 167/188 2022-01-24T06:59:50.674 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsepol-2.9-1.el8.x86_64 168/188 2022-01-24T06:59:50.674 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsmartcols-2.32.1-28.el8.x86_64 169/188 2022-01-24T06:59:50.674 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsmartcols-2.32.1-24.el8.x86_64 170/188 2022-01-24T06:59:50.674 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libss-1.45.6-2.el8.x86_64 171/188 2022-01-24T06:59:50.675 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libss-1.45.6-1.el8.x86_64 172/188 2022-01-24T06:59:50.675 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-2.32.1-28.el8.x86_64 173/188 2022-01-24T06:59:50.675 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-2.32.1-24.el8.x86_64 174/188 2022-01-24T06:59:50.675 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:1.1.1k-5.el8_5.x86_64 175/188 2022-01-24T06:59:50.676 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:1.1.1g-11.el8.x86_64 176/188 2022-01-24T06:59:50.676 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:1.1.1k-5.el8_5.x86_64 177/188 2022-01-24T06:59:50.676 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:1.1.1g-11.el8.x86_64 178/188 2022-01-24T06:59:50.676 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-libselinux-2.9-5.el8.x86_64 179/188 2022-01-24T06:59:50.676 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-libselinux-2.9-3.el8.x86_64 180/188 2022-01-24T06:59:50.677 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-2.32.1-28.el8.x86_64 181/188 2022-01-24T06:59:50.677 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-2.32.1-24.el8.x86_64 182/188 2022-01-24T06:59:50.677 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-user-2.32.1-28.el8.x86_64 183/188 2022-01-24T06:59:50.677 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-user-2.32.1-24.el8.x86_64 184/188 2022-01-24T06:59:50.678 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-5.0.0-9.el8.x86_64 185/188 2022-01-24T06:59:50.678 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-5.0.0-4.el8.x86_64 186/188 2022-01-24T06:59:50.678 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-1.2.11-17.el8.x86_64 187/188 2022-01-24T06:59:52.717 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-1.2.11-16.el8_2.x86_64 188/188 2022-01-24T06:59:52.718 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:52.718 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2022-01-24T06:59:52.718 INFO:teuthology.orchestra.run.smithi145.stdout: chkconfig-1.19.1-1.el8.x86_64 2022-01-24T06:59:52.719 INFO:teuthology.orchestra.run.smithi145.stdout: e2fsprogs-1.45.6-2.el8.x86_64 2022-01-24T06:59:52.719 INFO:teuthology.orchestra.run.smithi145.stdout: e2fsprogs-libs-1.45.6-2.el8.x86_64 2022-01-24T06:59:52.719 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-0.185-1.el8.x86_64 2022-01-24T06:59:52.719 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs-0.185-1.el8.x86_64 2022-01-24T06:59:52.719 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-1.5.10-9.el8.x86_64 2022-01-24T06:59:52.720 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs-1.5.10-9.el8.x86_64 2022-01-24T06:59:52.720 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-libs-1.18.2-14.el8.x86_64 2022-01-24T06:59:52.720 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-workstation-1.18.2-14.el8.x86_64 2022-01-24T06:59:52.720 INFO:teuthology.orchestra.run.smithi145.stdout: libblkid-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.721 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err-1.45.6-2.el8.x86_64 2022-01-24T06:59:52.721 INFO:teuthology.orchestra.run.smithi145.stdout: libfdisk-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.721 INFO:teuthology.orchestra.run.smithi145.stdout: libkadm5-1.18.2-14.el8.x86_64 2022-01-24T06:59:52.721 INFO:teuthology.orchestra.run.smithi145.stdout: libmount-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.722 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.722 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.722 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-2.9-5.el8.x86_64 2022-01-24T06:59:52.722 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-utils-2.9-5.el8.x86_64 2022-01-24T06:59:52.723 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol-2.9-3.el8.x86_64 2022-01-24T06:59:52.723 INFO:teuthology.orchestra.run.smithi145.stdout: libsmartcols-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.723 INFO:teuthology.orchestra.run.smithi145.stdout: libss-1.45.6-2.el8.x86_64 2022-01-24T06:59:52.723 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.723 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:59:52.724 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:59:52.724 INFO:teuthology.orchestra.run.smithi145.stdout: python3-libselinux-2.9-5.el8.x86_64 2022-01-24T06:59:52.724 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.724 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux-user-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.725 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-5.0.0-9.el8.x86_64 2022-01-24T06:59:52.725 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-1.2.11-17.el8.x86_64 2022-01-24T06:59:52.725 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:52.725 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2022-01-24T06:59:52.725 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.1-7.el8.noarch 2022-01-24T06:59:52.726 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.0.4-10.el8.x86_64 2022-01-24T06:59:52.726 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.726 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.726 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.727 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.727 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.727 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.727 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.728 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.728 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.728 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.728 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.728 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.729 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.729 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.729 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.729 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.729 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.730 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.730 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.730 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:15.2.15-156.g6d0261fc.el8.noarch 2022-01-24T06:59:52.730 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.185-1.el8.x86_64 2022-01-24T06:59:52.731 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.1-9.el8.x86_64 2022-01-24T06:59:52.731 INFO:teuthology.orchestra.run.smithi145.stdout: fmt-6.2.1-1.el8.x86_64 2022-01-24T06:59:52.731 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.7-12.el8.x86_64 2022-01-24T06:59:52.731 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-01-24T06:59:52.731 INFO:teuthology.orchestra.run.smithi145.stdout: jq-1.5-12.el8.x86_64 2022-01-24T06:59:52.732 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-01-24T06:59:52.732 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-01-24T06:59:52.732 INFO:teuthology.orchestra.run.smithi145.stdout: leveldb-1.22-1.el8.x86_64 2022-01-24T06:59:52.732 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-01-24T06:59:52.732 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.733 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.733 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err-devel-1.45.6-2.el8.x86_64 2022-01-24T06:59:52.733 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-8.5.0-4.el8_5.x86_64 2022-01-24T06:59:52.733 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.2-3.el8.x86_64 2022-01-24T06:59:52.734 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-8.5.0-4.el8_5.x86_64 2022-01-24T06:59:52.734 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-01-24T06:59:52.734 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.734 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.734 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-0.11.4-1.el8.x86_64 2022-01-24T06:59:52.735 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.735 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-01-24T06:59:52.735 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-01-24T06:59:52.735 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-25.el8.x86_64 2022-01-24T06:59:52.735 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.3.1-3.el8.x86_64 2022-01-24T06:59:52.736 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.32.1-28.el8.x86_64 2022-01-24T06:59:52.736 INFO:teuthology.orchestra.run.smithi145.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-01-24T06:59:52.736 INFO:teuthology.orchestra.run.smithi145.stdout: libxslt-1.1.32-6.el8.x86_64 2022-01-24T06:59:52.736 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-01-24T06:59:52.737 INFO:teuthology.orchestra.run.smithi145.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-01-24T06:59:52.737 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.12-1.el8.x86_64 2022-01-24T06:59:52.737 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-threads-0.3.12-1.el8.x86_64 2022-01-24T06:59:52.737 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:1.1.1k-5.el8_5.x86_64 2022-01-24T06:59:52.738 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-01-24T06:59:52.738 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-01-24T06:59:52.738 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-01-24T06:59:52.738 INFO:teuthology.orchestra.run.smithi145.stdout: python3-apipkg-1.5-6.el8.noarch 2022-01-24T06:59:52.738 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.5.1-7.el8.noarch 2022-01-24T06:59:52.739 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-01-24T06:59:52.739 INFO:teuthology.orchestra.run.smithi145.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-01-24T06:59:52.739 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-01-24T06:59:52.739 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.739 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.740 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.740 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-01-24T06:59:52.740 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-01-24T06:59:52.740 INFO:teuthology.orchestra.run.smithi145.stdout: python3-chardet-3.0.4-7.el8.noarch 2022-01-24T06:59:52.741 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-01-24T06:59:52.741 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-01-24T06:59:52.741 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-01-24T06:59:52.741 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cssselect-0.9.2-10.el8.noarch 2022-01-24T06:59:52.741 INFO:teuthology.orchestra.run.smithi145.stdout: python3-execnet-1.7.1-1.el8.noarch 2022-01-24T06:59:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-01-24T06:59:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2022-01-24T06:59:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: python3-idna-2.5-5.el8.noarch 2022-01-24T06:59:52.742 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-6.2-6.el8.noarch 2022-01-24T06:59:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-01-24T06:59:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-01-24T06:59:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-01-24T06:59:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-01-24T06:59:52.743 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-01-24T06:59:52.744 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-01-24T06:59:52.744 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-01-24T06:59:52.744 INFO:teuthology.orchestra.run.smithi145.stdout: python3-lxml-4.2.3-3.el8.x86_64 2022-01-24T06:59:52.744 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.0.6-13.el8.noarch 2022-01-24T06:59:52.744 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-01-24T06:59:52.745 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-01-24T06:59:52.745 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-01-24T06:59:52.745 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-01-24T06:59:52.745 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-01-24T06:59:52.745 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-01-24T06:59:52.746 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-2.6-1.el8.noarch 2022-01-24T06:59:52.746 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-01-24T06:59:52.746 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-01-24T06:59:52.746 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-01-24T06:59:52.747 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-01-24T06:59:52.747 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.14-14.el8.noarch 2022-01-24T06:59:52.747 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pysocks-1.6.8-3.el8.noarch 2022-01-24T06:59:52.747 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2017.2-9.el8.noarch 2022-01-24T06:59:52.748 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.748 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.748 INFO:teuthology.orchestra.run.smithi145.stdout: python3-remoto-1.2.1-1.el8.noarch 2022-01-24T06:59:52.748 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-01-24T06:59:52.748 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2022-01-24T06:59:52.749 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-01-24T06:59:52.749 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.749 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.4.1-12.el8.noarch 2022-01-24T06:59:52.749 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.8-1.el8.noarch 2022-01-24T06:59:52.749 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-01-24T06:59:52.750 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-01-24T06:59:52.750 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-01-24T06:59:52.750 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-01-24T06:59:52.750 INFO:teuthology.orchestra.run.smithi145.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-01-24T06:59:52.750 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.24.2-5.el8.noarch 2022-01-24T06:59:52.751 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-01-24T06:59:52.751 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webencodings-0.5.1-6.el8.noarch 2022-01-24T06:59:52.751 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-01-24T06:59:52.751 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-01-24T06:59:52.752 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-01-24T06:59:52.752 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-01-24T06:59:52.752 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-01-24T06:59:52.752 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.752 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.753 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:15.2.15-156.g6d0261fc.el8.x86_64 2022-01-24T06:59:52.753 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-1.el8.x86_64 2022-01-24T06:59:52.753 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-5.0.0-9.el8.x86_64 2022-01-24T06:59:52.753 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-01-24T06:59:52.754 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-01-24T06:59:52.754 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:52.754 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2022-01-24T06:59:52.848 DEBUG:teuthology.parallel:result is None 2022-01-24T06:59:52.849 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2022-01-24T06:59:52.903 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS 2022-01-24T06:59:52.905 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:59:52.906 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6d0261fcb9458c90b6f509c036c9df47e35eb281 2022-01-24T06:59:53.118 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-01-24T06:59:53.142 INFO:teuthology.orchestra.run.smithi142.stdout:15.2.15-156.g6d0261fc.el8 2022-01-24T06:59:53.143 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-156.g6d0261fc.el8 2022-01-24T06:59:53.143 INFO:teuthology.task.install:The correct ceph version 15.2.15-156.g6d0261fc is installed. 2022-01-24T06:59:53.143 DEBUG:teuthology.orchestra.run.smithi145:> sudo lsb_release -is 2022-01-24T06:59:53.191 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS 2022-01-24T06:59:53.192 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:59:53.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6d0261fcb9458c90b6f509c036c9df47e35eb281 2022-01-24T06:59:53.401 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-01-24T06:59:53.421 INFO:teuthology.orchestra.run.smithi145.stdout:15.2.15-156.g6d0261fc.el8 2022-01-24T06:59:53.422 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-156.g6d0261fc.el8 2022-01-24T06:59:53.422 INFO:teuthology.task.install:The correct ceph version 15.2.15-156.g6d0261fc is installed. 2022-01-24T06:59:53.423 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-01-24T06:59:53.551 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS 2022-01-24T06:59:53.555 DEBUG:teuthology.misc:System to be installed: CentOS 2022-01-24T06:59:53.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6d0261fcb9458c90b6f509c036c9df47e35eb281 2022-01-24T06:59:53.765 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-01-24T06:59:53.821 INFO:teuthology.orchestra.run.smithi164.stdout:15.2.15-156.g6d0261fc.el8 2022-01-24T06:59:53.821 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-156.g6d0261fc.el8 2022-01-24T06:59:53.822 INFO:teuthology.task.install:The correct ceph version 15.2.15-156.g6d0261fc is installed. 2022-01-24T06:59:53.822 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-01-24T06:59:53.823 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:59:53.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-01-24T06:59:53.852 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:59:53.852 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-01-24T06:59:53.876 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:59:53.876 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-01-24T06:59:53.947 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-01-24T06:59:53.948 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:59:53.948 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2022-01-24T06:59:53.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-01-24T06:59:54.043 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:59:54.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2022-01-24T06:59:54.067 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-01-24T06:59:54.131 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:59:54.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2022-01-24T06:59:54.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-01-24T06:59:54.310 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-01-24T06:59:54.311 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:59:54.311 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2022-01-24T06:59:54.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-01-24T06:59:54.407 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:59:54.408 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2022-01-24T06:59:54.431 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-01-24T06:59:54.494 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:59:54.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2022-01-24T06:59:54.565 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-01-24T06:59:54.675 INFO:teuthology.run_tasks:Running task ceph... 2022-01-24T06:59:54.735 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-01-24T06:59:54.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2022-01-24T06:59:54.739 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2022-01-24T06:59:54.742 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2022-01-24T06:59:54.811 INFO:tasks.ceph:Disabling ceph logrotate... 2022-01-24T06:59:54.812 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2022-01-24T06:59:54.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2022-01-24T06:59:54.817 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2022-01-24T06:59:54.886 INFO:tasks.ceph:Creating extra log directories... 2022-01-24T06:59:54.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-01-24T06:59:54.890 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-01-24T06:59:54.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-01-24T06:59:54.962 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-01-24T06:59:54.963 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-01-24T06:59:54.963 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-01-24T06:59:54.964 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:59:54.964 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-01-24T06:59:54.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-01-24T06:59:55.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-01-24T06:59:55.116 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:59:55.116 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-01-24T06:59:55.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-01-24T06:59:55.236 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-01-24T06:59:55.277 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:59:55.278 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-01-24T06:59:55.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-01-24T06:59:55.489 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-01-24T06:59:55.559 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-01-24T06:59:55.560 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'fuse default permissions': False, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-01-24T06:59:55.560 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi/6634138', 'branch': 'octopus', 'description': 'multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6634138', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2022-01-22_13:15:03-multimds-octopus-distro-default-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'cephfs': {'max_mds': 9, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'fuse default permissions': False, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': '4d29e4caec1870b870492d17110d34996b9335e6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mgr.x', 'mds.e', 'mds.f', 'mds.g', 'mds.h', 'mds.i', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0', 'client.1']], 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281', 'sleep_before_teardown': 0, 'suite': 'multimds', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_4d29e4caec1870b870492d17110d34996b9335e6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '4d29e4caec1870b870492d17110d34996b9335e6', 'targets': {'smithi142.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBel4Hmyrc8BsbN1n/kivbcZ/cklLTPttFIUArdc5sw1mx+Szd1A1KiSLtBTICmt4pkn9XY1e1sXzYQ63lgxVE8VnmUOH5C0Id8wDvd5AcC1Vab3i4ODuv+2Yn8wi9ppelLzf8WjjHTUIYm+WUVDKoxPfkmpsH5GpOaz3TdorXtWEdcQ9mTs9lbHyNA+aHvAU8MVIzirMDYRB/FJq0by0JgSlRTIbkXJNZJx4lwQyjLrR/zlAd5U4UekR90g5RWCi11x9UTS7CCYKCbuRK9wRgzqFdTr93A27T9XgE7e2VmEAXuQpJXLdgZCquJdEbMuxyaGX6RSvZ043ysuKH27+o5Gt5LPFb7TNOS2LHoLfNVoqrn0201bvrKhL/gJf6/U2SGDyE11yIqkPzg8C81yGWija7WRVK7wq0I9MTihOjqL0a9CkmthRtNkkT5BiIuuX5FyhRYDdwa6rhK4A8NyEdMftqH7kOKGEEafMAuCGtwm71zPjCjufrBBRa9M1Zz20=', 'smithi145.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC76Sm3BQswAARBmilOyzcKK4wQM+QRlO3wngZ9buhzuGYiQVNxaI6m5dDjEBYHZDT4Q7q2o+k5ZSin3+E79biMmeoMQCMA+mHgHo7XDcFo9t9SlG/sCdPSI/gCEjbgvbJh2fComoJ9ow+wfl9X128+GNYK9Qqe0McG5ZOv0QtWhB6BUWH8gMsAhnWaWXHibcclgibe7yoD93f1+fQhK9r8OAol8d36gnN+SRV1m3sF+c7Run2YUYzwcE1pPlfHmQtje62CByGJl8+L4otRiIDs0goRsBab2dZ61WuhQRjboVRWHo4wWfAC/GVps8xMJjkSPbLiVvyBJ8BWpaU+/FM7SBVGECSO4xccGKnn2s15oJohLtYNfMn9HF+atIag67j3NM7gj88C7HGqV4tU8FLl03JUD7+TYsDhOytKYjhRI8dDwZyaKrLQzkvqwLkMNk/Kv2n6xTvKt4hH3vf9A0FPqB7mIxUQvJGGc7t9L1lQhNNlfMRJP3oCDyzuM3FeF7k=', 'smithi164.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4GK/1ykojrxfSiA6YTCcuU5/FafDndeSjXb290fDEime1NR9rijx2s97RYArFdpK0mVhyG6DUtVrlJl/AQjNluMTpn4prEYmky1rT8CwkZNhIL1p0Kkim5dYiuCOiAw7O+C89OPmUF6KjFdQqmcdUO+1rU9Yq3lISqLUVn8gRIL7k8r9krB3juaKBnEBJEKg0hg1ZJrXhvt5IuhkvzlX5jtRwoLH6+Qfz3+BLNYmxyLP/cewCgqZFC23zKIOQhps81qqMNPvPO+EIq4YViHTGz2c8ndkWKf+P2W1m+yQIkaewPCAsc9dlb4tv/A6GuieTuaaChPY5cv00LdYjUJOenbrSEHAyMo0+tBzdRiNoVxz/l4TpGPVKxw7VsmqBwKK9gJ9RfON1usn78V0QUNzFDIE/Rey0EcJpg8Uq46fuuLRrbwyKXmw26hsBreGYZG4QXBuNHKxAPIjfv3l+wbupIVe/qt/HQSd6KtjdQkKP+nKxeVzJVTes4VpEYvfJdxM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '6d0261fcb9458c90b6f509c036c9df47e35eb281'}}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it']}}, {'kclient': None}, {'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '75f1bcd237a8b6022305cd53ba87e106d45aa665', 'timestamp': '2022-01-22_13:15:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.20261'} 2022-01-24T06:59:55.561 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-01-24T06:59:55.564 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-01-24T06:59:55.566 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-01-24T06:59:55.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2022-01-24T06:59:55.619 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2022-01-24T06:59:55.621 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2022-01-24T06:59:55.720 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:59:55.721 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2022-01-24T06:59:55.736 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-01-24T06:59:55.737 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-01-24T06:59:55.791 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-01-24T06:59:55.791 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:55.791 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 143089 Links: 1 2022-01-24T06:59:55.791 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:55.792 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:55.792 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-01-24 06:56:14.949708092 +0000 2022-01-24T06:59:55.792 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-01-24 06:47:23.155684288 +0000 2022-01-24T06:59:55.792 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-01-24 06:47:23.155684288 +0000 2022-01-24T06:59:55.793 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-01-24T06:59:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-01-24T06:59:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-01-24T06:59:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000242379 s, 2.1 MB/s 2022-01-24T06:59:55.804 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-01-24T06:59:55.860 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-01-24T06:59:55.860 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:55.860 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 147020 Links: 1 2022-01-24T06:59:55.861 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:55.861 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:55.861 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-01-24 06:56:14.949708092 +0000 2022-01-24T06:59:55.861 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-01-24 06:47:23.486677936 +0000 2022-01-24T06:59:55.861 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-01-24 06:47:23.486677936 +0000 2022-01-24T06:59:55.862 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-01-24T06:59:55.869 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-01-24T06:59:55.870 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-01-24T06:59:55.870 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000215476 s, 2.4 MB/s 2022-01-24T06:59:55.872 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-01-24T06:59:55.927 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-01-24T06:59:55.928 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:55.928 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 148722 Links: 1 2022-01-24T06:59:55.928 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:55.928 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:55.929 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-01-24 06:56:14.950708073 +0000 2022-01-24T06:59:55.929 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-01-24 06:47:23.830671335 +0000 2022-01-24T06:59:55.929 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-01-24 06:47:23.830671335 +0000 2022-01-24T06:59:55.929 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-01-24T06:59:55.937 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-01-24T06:59:55.937 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-01-24T06:59:55.938 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000213347 s, 2.4 MB/s 2022-01-24T06:59:55.940 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-01-24T06:59:55.994 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-01-24T06:59:55.994 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:55.995 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 147142 Links: 1 2022-01-24T06:59:55.995 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:55.995 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:55.995 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-01-24 06:56:14.950708073 +0000 2022-01-24T06:59:55.995 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-01-24 06:47:24.183664561 +0000 2022-01-24T06:59:55.996 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-01-24 06:47:24.183664561 +0000 2022-01-24T06:59:55.996 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-01-24T06:59:56.003 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-01-24T06:59:56.004 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-01-24T06:59:56.004 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000200306 s, 2.6 MB/s 2022-01-24T06:59:56.006 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-24T06:59:56.007 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:59:56.007 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2022-01-24T06:59:56.023 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-01-24T06:59:56.023 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-01-24T06:59:56.078 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-01-24T06:59:56.078 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:56.079 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 146747 Links: 1 2022-01-24T06:59:56.079 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:56.079 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:56.079 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2022-01-24 06:59:50.261093684 +0000 2022-01-24T06:59:56.080 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2022-01-24 06:43:52.075792696 +0000 2022-01-24T06:59:56.080 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2022-01-24 06:43:52.075792696 +0000 2022-01-24T06:59:56.080 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2022-01-24T06:59:56.089 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2022-01-24T06:59:56.089 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2022-01-24T06:59:56.089 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000252256 s, 2.0 MB/s 2022-01-24T06:59:56.092 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-01-24T06:59:56.147 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-01-24T06:59:56.148 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:56.148 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 147689 Links: 1 2022-01-24T06:59:56.148 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:56.148 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:56.149 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2022-01-24 06:59:50.261093684 +0000 2022-01-24T06:59:56.149 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2022-01-24 06:43:52.405785309 +0000 2022-01-24T06:59:56.149 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2022-01-24 06:43:52.405785309 +0000 2022-01-24T06:59:56.149 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2022-01-24T06:59:56.157 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2022-01-24T06:59:56.157 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2022-01-24T06:59:56.158 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000221517 s, 2.3 MB/s 2022-01-24T06:59:56.160 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-01-24T06:59:56.215 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-01-24T06:59:56.215 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:56.215 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 149657 Links: 1 2022-01-24T06:59:56.216 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:56.216 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:56.216 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2022-01-24 06:59:50.261093684 +0000 2022-01-24T06:59:56.216 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2022-01-24 06:43:52.730778034 +0000 2022-01-24T06:59:56.217 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2022-01-24 06:43:52.730778034 +0000 2022-01-24T06:59:56.217 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2022-01-24T06:59:56.224 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2022-01-24T06:59:56.225 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2022-01-24T06:59:56.225 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.00019249 s, 2.7 MB/s 2022-01-24T06:59:56.228 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-01-24T06:59:56.283 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-01-24T06:59:56.284 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-24T06:59:56.284 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 148908 Links: 1 2022-01-24T06:59:56.285 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T06:59:56.285 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2022-01-24T06:59:56.286 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2022-01-24 06:59:50.261093684 +0000 2022-01-24T06:59:56.286 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2022-01-24 06:43:53.073770357 +0000 2022-01-24T06:59:56.287 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2022-01-24 06:43:53.073770357 +0000 2022-01-24T06:59:56.287 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2022-01-24T06:59:56.293 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2022-01-24T06:59:56.294 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2022-01-24T06:59:56.294 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000202338 s, 2.5 MB/s 2022-01-24T06:59:56.296 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-24T06:59:56.297 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-01-24T06:59:56.298 INFO:tasks.ceph:Generating config... 2022-01-24T06:59:56.301 INFO:tasks.ceph:[client] client mount timeout = 600 2022-01-24T06:59:56.302 INFO:tasks.ceph:[client] debug client = 20 2022-01-24T06:59:56.302 INFO:tasks.ceph:[client] debug ms = 1 2022-01-24T06:59:56.303 INFO:tasks.ceph:[client] fuse default permissions = False 2022-01-24T06:59:56.304 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2022-01-24T06:59:56.304 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2022-01-24T06:59:56.305 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-01-24T06:59:56.306 INFO:tasks.ceph:[mds] debug mds = 20 2022-01-24T06:59:56.306 INFO:tasks.ceph:[mds] debug ms = 1 2022-01-24T06:59:56.307 INFO:tasks.ceph:[mds] mds bal frag = True 2022-01-24T06:59:56.307 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2022-01-24T06:59:56.308 INFO:tasks.ceph:[mds] mds bal merge size = 5 2022-01-24T06:59:56.309 INFO:tasks.ceph:[mds] mds bal split bits = 3 2022-01-24T06:59:56.309 INFO:tasks.ceph:[mds] mds bal split size = 100 2022-01-24T06:59:56.310 INFO:tasks.ceph:[mds] mds debug frag = True 2022-01-24T06:59:56.311 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-01-24T06:59:56.311 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-01-24T06:59:56.312 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-01-24T06:59:56.313 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-01-24T06:59:56.313 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2022-01-24T06:59:56.314 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2022-01-24T06:59:56.315 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-01-24T06:59:56.315 INFO:tasks.ceph:[mgr] debug ms = 1 2022-01-24T06:59:56.316 INFO:tasks.ceph:[mon] debug mon = 20 2022-01-24T06:59:56.317 INFO:tasks.ceph:[mon] debug ms = 1 2022-01-24T06:59:56.317 INFO:tasks.ceph:[mon] debug paxos = 20 2022-01-24T06:59:56.318 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-01-24T06:59:56.318 INFO:tasks.ceph:[osd] bdev async discard = True 2022-01-24T06:59:56.319 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-01-24T06:59:56.320 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-01-24T06:59:56.320 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-01-24T06:59:56.321 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-01-24T06:59:56.322 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-01-24T06:59:56.322 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-01-24T06:59:56.323 INFO:tasks.ceph:[osd] debug ms = 1 2022-01-24T06:59:56.324 INFO:tasks.ceph:[osd] debug osd = 20 2022-01-24T06:59:56.324 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-01-24T06:59:56.325 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-01-24T06:59:56.326 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-01-24T06:59:56.326 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-01-24T06:59:56.327 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-01-24T06:59:56.328 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-01-24T06:59:56.328 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-01-24T06:59:56.329 INFO:tasks.ceph:Setting up mon.a... 2022-01-24T06:59:56.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-01-24T06:59:56.445 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.keyring 2022-01-24T06:59:56.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-01-24T06:59:56.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-24T06:59:56.550 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'), ('mon.b', '172.21.15.145')] 2022-01-24T06:59:56.551 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --add b 172.21.15.145 --print /home/ubuntu/cephtest/ceph.monmap 2022-01-24T06:59:56.627 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-01-24T06:59:56.627 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: generated fsid 5daa98c7-3c1a-4e96-84f4-135ece391de4 2022-01-24T06:59:56.627 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 0 2022-01-24T06:59:56.628 INFO:teuthology.orchestra.run.smithi142.stdout:fsid 5daa98c7-3c1a-4e96-84f4-135ece391de4 2022-01-24T06:59:56.628 INFO:teuthology.orchestra.run.smithi142.stdout:last_changed 2022-01-24T06:59:56.628131+0000 2022-01-24T06:59:56.628 INFO:teuthology.orchestra.run.smithi142.stdout:created 2022-01-24T06:59:56.628131+0000 2022-01-24T06:59:56.628 INFO:teuthology.orchestra.run.smithi142.stdout:min_mon_release 0 (unknown) 2022-01-24T06:59:56.629 INFO:teuthology.orchestra.run.smithi142.stdout:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2022-01-24T06:59:56.629 INFO:teuthology.orchestra.run.smithi142.stdout:1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2022-01-24T06:59:56.629 INFO:teuthology.orchestra.run.smithi142.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2022-01-24T06:59:56.629 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-01-24T06:59:56.631 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5daa98c7-3c1a-4e96-84f4-135ece391de4... 2022-01-24T06:59:56.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-24T06:59:56.673 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-24T06:59:56.675 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-24T06:59:56.711 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2022-01-24T06:59:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2022-01-24T06:59:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-24T06:59:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2022-01-24T06:59:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2022-01-24T06:59:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2022-01-24T06:59:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2022-01-24T06:59:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2022-01-24T06:59:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2022-01-24T06:59:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2022-01-24T06:59:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-24T06:59:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2022-01-24T06:59:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2022-01-24T06:59:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-24T06:59:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2022-01-24T06:59:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2022-01-24T06:59:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2022-01-24T06:59:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2022-01-24T06:59:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2022-01-24T06:59:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2022-01-24T06:59:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2022-01-24T06:59:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2022-01-24T06:59:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-24T06:59:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-24T06:59:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-24T06:59:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2022-01-24T06:59:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2022-01-24T06:59:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2022-01-24T06:59:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2022-01-24T06:59:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2022-01-24T06:59:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.145" 2022-01-24T06:59:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2022-01-24T06:59:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 5daa98c7-3c1a-4e96-84f4-135ece391de4 2022-01-24T06:59:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.721 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2022-01-24T06:59:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2022-01-24T06:59:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2022-01-24T06:59:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2022-01-24T06:59:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2022-01-24T06:59:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2022-01-24T06:59:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2022-01-24T06:59:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2022-01-24T06:59:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2022-01-24T06:59:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2022-01-24T06:59:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2022-01-24T06:59:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2022-01-24T06:59:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2022-01-24T06:59:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2022-01-24T06:59:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2022-01-24T06:59:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2022-01-24T06:59:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2022-01-24T06:59:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2022-01-24T06:59:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2022-01-24T06:59:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2022-01-24T06:59:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2022-01-24T06:59:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2022-01-24T06:59:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2022-01-24T06:59:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2022-01-24T06:59:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2022-01-24T06:59:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-01-24T06:59:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2022-01-24T06:59:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2022-01-24T06:59:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2022-01-24T06:59:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2022-01-24T06:59:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2022-01-24T06:59:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2022-01-24T06:59:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2022-01-24T06:59:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2022-01-24T06:59:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.731 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2022-01-24T06:59:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-01-24T06:59:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2022-01-24T06:59:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2022-01-24T06:59:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2022-01-24T06:59:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2022-01-24T06:59:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2022-01-24T06:59:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2022-01-24T06:59:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.733 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2022-01-24T06:59:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-01-24T06:59:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2022-01-24T06:59:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2022-01-24T06:59:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2022-01-24T06:59:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2022-01-24T06:59:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2022-01-24T06:59:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2022-01-24T06:59:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2022-01-24T06:59:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2022-01-24T06:59:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2022-01-24T06:59:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-24T06:59:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2022-01-24T06:59:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2022-01-24T06:59:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2022-01-24T06:59:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-24T06:59:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-24T06:59:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2022-01-24T06:59:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T06:59:56.738 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2022-01-24T06:59:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2022-01-24T06:59:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2022-01-24T06:59:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2022-01-24T06:59:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-24T06:59:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-24T06:59:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2022-01-24T06:59:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2022-01-24T06:59:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-01-24T06:59:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: fuse default permissions = False 2022-01-24T06:59:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 15m 2022-01-24T06:59:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 15m 2022-01-24T06:59:56.740 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2022-01-24T06:59:56.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2022-01-24T06:59:56.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2022-01-24T06:59:56.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2022-01-24T06:59:56.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2022-01-24T06:59:56.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2022-01-24T06:59:56.742 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2022-01-24T06:59:56.742 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.e] 2022-01-24T06:59:56.742 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.f] 2022-01-24T06:59:56.742 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.g] 2022-01-24T06:59:56.743 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.h] 2022-01-24T06:59:56.743 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.i] 2022-01-24T06:59:56.743 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2022-01-24T06:59:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2022-01-24T06:59:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-01-24T06:59:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal frag = True 2022-01-24T06:59:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal fragment size max = 10000 2022-01-24T06:59:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal merge size = 5 2022-01-24T06:59:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal split bits = 3 2022-01-24T06:59:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: mds bal split size = 100 2022-01-24T06:59:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2022-01-24T06:59:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2022-01-24T06:59:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2022-01-24T06:59:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2022-01-24T06:59:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2022-01-24T06:59:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 15m 2022-01-24T06:59:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 15m 2022-01-24T06:59:56.748 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2022-01-24T06:59:56.748 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2022-01-24T06:59:56.748 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-24T06:59:56.748 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2022-01-24T06:59:56.749 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.749 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2022-01-24T06:59:56.749 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.749 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2022-01-24T06:59:56.750 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.750 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2022-01-24T06:59:56.750 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2022-01-24T06:59:56.750 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.751 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2022-01-24T06:59:56.751 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2022-01-24T06:59:56.751 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.751 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-24T06:59:56.751 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2022-01-24T06:59:56.752 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.752 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2022-01-24T06:59:56.752 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-24T06:59:56.752 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.752 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2022-01-24T06:59:56.753 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.753 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2022-01-24T06:59:56.753 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2022-01-24T06:59:56.753 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2022-01-24T06:59:56.754 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2022-01-24T06:59:56.754 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2022-01-24T06:59:56.754 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2022-01-24T06:59:56.754 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2022-01-24T06:59:56.754 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-24T06:59:56.755 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-24T06:59:56.755 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.755 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-24T06:59:56.755 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.756 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2022-01-24T06:59:56.756 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.756 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2022-01-24T06:59:56.756 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.756 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2022-01-24T06:59:56.757 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2022-01-24T06:59:56.757 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2022-01-24T06:59:56.757 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.145" 2022-01-24T06:59:56.757 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on skipped message = False 2022-01-24T06:59:56.758 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 5daa98c7-3c1a-4e96-84f4-135ece391de4 2022-01-24T06:59:56.758 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.758 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2022-01-24T06:59:56.758 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2022-01-24T06:59:56.758 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.759 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2022-01-24T06:59:56.759 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2022-01-24T06:59:56.759 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.759 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2022-01-24T06:59:56.759 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2022-01-24T06:59:56.760 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.760 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2022-01-24T06:59:56.760 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2022-01-24T06:59:56.760 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2022-01-24T06:59:56.760 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.761 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2022-01-24T06:59:56.761 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2022-01-24T06:59:56.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.761 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2022-01-24T06:59:56.762 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.762 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2022-01-24T06:59:56.762 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.762 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2022-01-24T06:59:56.762 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.763 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2022-01-24T06:59:56.763 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2022-01-24T06:59:56.763 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.763 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2022-01-24T06:59:56.764 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2022-01-24T06:59:56.764 INFO:teuthology.orchestra.run.smithi145.stdout: bdev async discard = True 2022-01-24T06:59:56.764 INFO:teuthology.orchestra.run.smithi145.stdout: bdev enable discard = True 2022-01-24T06:59:56.764 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore allocator = bitmap 2022-01-24T06:59:56.764 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2022-01-24T06:59:56.765 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2022-01-24T06:59:56.765 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 20 2022-01-24T06:59:56.765 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 20 2022-01-24T06:59:56.765 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2022-01-24T06:59:56.766 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2022-01-24T06:59:56.766 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 10 2022-01-24T06:59:56.766 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2022-01-24T06:59:56.766 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2022-01-24T06:59:56.766 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2022-01-24T06:59:56.767 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2022-01-24T06:59:56.767 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2022-01-24T06:59:56.767 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2022-01-24T06:59:56.767 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.767 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2022-01-24T06:59:56.768 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2022-01-24T06:59:56.768 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2022-01-24T06:59:56.768 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2022-01-24T06:59:56.768 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2022-01-24T06:59:56.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2022-01-24T06:59:56.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2022-01-24T06:59:56.769 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2022-01-24T06:59:56.769 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.769 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2022-01-24T06:59:56.770 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2022-01-24T06:59:56.770 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2022-01-24T06:59:56.770 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2022-01-24T06:59:56.770 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2022-01-24T06:59:56.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2022-01-24T06:59:56.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2022-01-24T06:59:56.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2022-01-24T06:59:56.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2022-01-24T06:59:56.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2022-01-24T06:59:56.772 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2022-01-24T06:59:56.772 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.772 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-24T06:59:56.772 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2022-01-24T06:59:56.772 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2022-01-24T06:59:56.773 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.773 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2022-01-24T06:59:56.773 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-24T06:59:56.773 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-24T06:59:56.773 INFO:teuthology.orchestra.run.smithi145.stdout: mon op complaint time = 120 2022-01-24T06:59:56.774 INFO:teuthology.orchestra.run.smithi145.stdout: 2022-01-24T06:59:56.774 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2022-01-24T06:59:56.774 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2022-01-24T06:59:56.774 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2022-01-24T06:59:56.775 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2022-01-24T06:59:56.775 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-24T06:59:56.775 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-24T06:59:56.775 INFO:teuthology.orchestra.run.smithi145.stdout: client mount timeout = 600 2022-01-24T06:59:56.775 INFO:teuthology.orchestra.run.smithi145.stdout: debug client = 20 2022-01-24T06:59:56.776 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2022-01-24T06:59:56.776 INFO:teuthology.orchestra.run.smithi145.stdout: fuse default permissions = False 2022-01-24T06:59:56.776 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 15m 2022-01-24T06:59:56.776 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 15m 2022-01-24T06:59:56.777 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2022-01-24T06:59:56.777 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.c] 2022-01-24T06:59:56.777 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.b] 2022-01-24T06:59:56.777 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2022-01-24T06:59:56.777 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2022-01-24T06:59:56.778 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2022-01-24T06:59:56.778 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2022-01-24T06:59:56.778 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.e] 2022-01-24T06:59:56.778 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.f] 2022-01-24T06:59:56.778 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.g] 2022-01-24T06:59:56.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.h] 2022-01-24T06:59:56.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.i] 2022-01-24T06:59:56.779 INFO:teuthology.orchestra.run.smithi145.stdout:[mds] 2022-01-24T06:59:56.779 INFO:teuthology.orchestra.run.smithi145.stdout: debug mds = 20 2022-01-24T06:59:56.780 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2022-01-24T06:59:56.780 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal frag = True 2022-01-24T06:59:56.780 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal fragment size max = 10000 2022-01-24T06:59:56.780 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal merge size = 5 2022-01-24T06:59:56.780 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal split bits = 3 2022-01-24T06:59:56.781 INFO:teuthology.orchestra.run.smithi145.stdout: mds bal split size = 100 2022-01-24T06:59:56.781 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug frag = True 2022-01-24T06:59:56.781 INFO:teuthology.orchestra.run.smithi145.stdout: mds debug scatterstat = True 2022-01-24T06:59:56.781 INFO:teuthology.orchestra.run.smithi145.stdout: mds op complaint time = 180 2022-01-24T06:59:56.781 INFO:teuthology.orchestra.run.smithi145.stdout: mds verify scatter = True 2022-01-24T06:59:56.782 INFO:teuthology.orchestra.run.smithi145.stdout: osd op complaint time = 180 2022-01-24T06:59:56.782 INFO:teuthology.orchestra.run.smithi145.stdout: rados mon op timeout = 15m 2022-01-24T06:59:56.782 INFO:teuthology.orchestra.run.smithi145.stdout: rados osd op timeout = 15m 2022-01-24T06:59:56.804 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2022-01-24T06:59:56.805 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2022-01-24T06:59:56.805 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-24T06:59:56.805 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2022-01-24T06:59:56.805 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.805 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2022-01-24T06:59:56.806 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.806 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2022-01-24T06:59:56.806 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.806 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2022-01-24T06:59:56.807 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2022-01-24T06:59:56.807 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.807 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2022-01-24T06:59:56.807 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2022-01-24T06:59:56.807 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.808 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-24T06:59:56.808 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2022-01-24T06:59:56.808 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.808 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2022-01-24T06:59:56.808 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-24T06:59:56.809 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.809 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2022-01-24T06:59:56.809 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.809 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2022-01-24T06:59:56.810 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2022-01-24T06:59:56.810 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2022-01-24T06:59:56.810 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2022-01-24T06:59:56.810 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2022-01-24T06:59:56.810 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2022-01-24T06:59:56.811 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2022-01-24T06:59:56.811 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-24T06:59:56.811 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-24T06:59:56.811 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.812 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-24T06:59:56.812 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.812 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2022-01-24T06:59:56.812 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.812 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2022-01-24T06:59:56.813 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.813 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2022-01-24T06:59:56.813 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2022-01-24T06:59:56.813 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2022-01-24T06:59:56.814 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.145" 2022-01-24T06:59:56.814 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2022-01-24T06:59:56.814 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5daa98c7-3c1a-4e96-84f4-135ece391de4 2022-01-24T06:59:56.814 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.815 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2022-01-24T06:59:56.815 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2022-01-24T06:59:56.815 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.815 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2022-01-24T06:59:56.815 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2022-01-24T06:59:56.816 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.816 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2022-01-24T06:59:56.816 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2022-01-24T06:59:56.816 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.817 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2022-01-24T06:59:56.817 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2022-01-24T06:59:56.817 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2022-01-24T06:59:56.817 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.817 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2022-01-24T06:59:56.818 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2022-01-24T06:59:56.818 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.818 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2022-01-24T06:59:56.818 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.819 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2022-01-24T06:59:56.819 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.819 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2022-01-24T06:59:56.819 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.819 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2022-01-24T06:59:56.820 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2022-01-24T06:59:56.820 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.820 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2022-01-24T06:59:56.820 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2022-01-24T06:59:56.820 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2022-01-24T06:59:56.821 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2022-01-24T06:59:56.821 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2022-01-24T06:59:56.821 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2022-01-24T06:59:56.821 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2022-01-24T06:59:56.822 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2022-01-24T06:59:56.822 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2022-01-24T06:59:56.822 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-01-24T06:59:56.822 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2022-01-24T06:59:56.822 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2022-01-24T06:59:56.823 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2022-01-24T06:59:56.823 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2022-01-24T06:59:56.823 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2022-01-24T06:59:56.823 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2022-01-24T06:59:56.824 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2022-01-24T06:59:56.824 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2022-01-24T06:59:56.824 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.824 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2022-01-24T06:59:56.824 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-01-24T06:59:56.825 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2022-01-24T06:59:56.825 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2022-01-24T06:59:56.825 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2022-01-24T06:59:56.825 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2022-01-24T06:59:56.825 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2022-01-24T06:59:56.826 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2022-01-24T06:59:56.826 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.826 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2022-01-24T06:59:56.826 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-01-24T06:59:56.826 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2022-01-24T06:59:56.827 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2022-01-24T06:59:56.827 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2022-01-24T06:59:56.827 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2022-01-24T06:59:56.827 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2022-01-24T06:59:56.828 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2022-01-24T06:59:56.828 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2022-01-24T06:59:56.828 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2022-01-24T06:59:56.828 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2022-01-24T06:59:56.828 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.829 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-24T06:59:56.829 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2022-01-24T06:59:56.829 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2022-01-24T06:59:56.829 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.829 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2022-01-24T06:59:56.830 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-24T06:59:56.830 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-24T06:59:56.830 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2022-01-24T06:59:56.830 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-01-24T06:59:56.831 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2022-01-24T06:59:56.831 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2022-01-24T06:59:56.831 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2022-01-24T06:59:56.831 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2022-01-24T06:59:56.831 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-24T06:59:56.832 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-24T06:59:56.832 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2022-01-24T06:59:56.832 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2022-01-24T06:59:56.832 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-01-24T06:59:56.832 INFO:teuthology.orchestra.run.smithi164.stdout: fuse default permissions = False 2022-01-24T06:59:56.833 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 15m 2022-01-24T06:59:56.833 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 15m 2022-01-24T06:59:56.833 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2022-01-24T06:59:56.833 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2022-01-24T06:59:56.834 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2022-01-24T06:59:56.834 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2022-01-24T06:59:56.834 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2022-01-24T06:59:56.834 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2022-01-24T06:59:56.834 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2022-01-24T06:59:56.835 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.e] 2022-01-24T06:59:56.835 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.f] 2022-01-24T06:59:56.835 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.g] 2022-01-24T06:59:56.835 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.h] 2022-01-24T06:59:56.835 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.i] 2022-01-24T06:59:56.836 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2022-01-24T06:59:56.836 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2022-01-24T06:59:56.836 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-01-24T06:59:56.836 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal frag = True 2022-01-24T06:59:56.836 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal fragment size max = 10000 2022-01-24T06:59:56.837 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal merge size = 5 2022-01-24T06:59:56.837 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal split bits = 3 2022-01-24T06:59:56.837 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal split size = 100 2022-01-24T06:59:56.837 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2022-01-24T06:59:56.837 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2022-01-24T06:59:56.838 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2022-01-24T06:59:56.838 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2022-01-24T06:59:56.838 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2022-01-24T06:59:56.838 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 15m 2022-01-24T06:59:56.838 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 15m 2022-01-24T06:59:56.839 INFO:tasks.ceph:Creating admin key on mon.a... 2022-01-24T06:59:56.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-01-24T06:59:56.887 INFO:tasks.ceph:Copying monmap to all nodes... 2022-01-24T06:59:56.904 DEBUG:teuthology.orchestra.remote:smithi142:/etc/ceph/ceph.keyring is 206B 2022-01-24T06:59:56.998 DEBUG:teuthology.orchestra.remote:smithi142:/home/ubuntu/cephtest/ceph.monmap is 379B 2022-01-24T06:59:57.045 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2022-01-24T06:59:57.045 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:59:57.045 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2022-01-24T06:59:57.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-24T06:59:57.078 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-01-24T06:59:57.078 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-01-24T06:59:57.132 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2022-01-24T06:59:57.132 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:59:57.133 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2022-01-24T06:59:57.133 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-24T06:59:57.168 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2022-01-24T06:59:57.168 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-01-24T06:59:57.223 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2022-01-24T06:59:57.224 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:59:57.224 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2022-01-24T06:59:57.224 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-24T06:59:57.322 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-01-24T06:59:57.323 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-01-24T06:59:57.406 INFO:tasks.ceph:Setting up mon nodes... 2022-01-24T06:59:57.407 INFO:tasks.ceph:Setting up mgr nodes... 2022-01-24T06:59:57.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-01-24T06:59:57.453 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-01-24T06:59:57.455 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-01-24T06:59:57.535 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-01-24T06:59:57.537 INFO:tasks.ceph:Setting up mds nodes... 2022-01-24T06:59:57.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-01-24T06:59:57.583 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-01-24T06:59:57.585 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-01-24T06:59:57.608 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-01-24T06:59:57.694 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-01-24T06:59:57.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-01-24T06:59:57.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-01-24T06:59:57.804 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-01-24T06:59:57.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-01-24T06:59:57.830 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-01-24T06:59:57.915 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-01-24T06:59:57.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-01-24T06:59:57.941 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2022-01-24T06:59:57.994 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2022-01-24T06:59:57.997 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2022-01-24T06:59:58.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2022-01-24T06:59:58.110 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2022-01-24T06:59:58.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2022-01-24T06:59:58.136 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-g && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.g /var/lib/ceph/mds/ceph-g/keyring 2022-01-24T06:59:58.221 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-g/keyring 2022-01-24T06:59:58.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-g 2022-01-24T06:59:58.247 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-h && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.h /var/lib/ceph/mds/ceph-h/keyring 2022-01-24T06:59:58.332 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-h/keyring 2022-01-24T06:59:58.334 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-h 2022-01-24T06:59:58.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mds/ceph-i && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.i /var/lib/ceph/mds/ceph-i/keyring 2022-01-24T06:59:58.443 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mds/ceph-i/keyring 2022-01-24T06:59:58.445 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-i 2022-01-24T06:59:58.468 INFO:tasks.ceph_client:Setting up client nodes... 2022-01-24T06:59:58.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-01-24T06:59:58.606 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-01-24T06:59:58.643 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-01-24T06:59:58.735 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-01-24T06:59:58.771 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-01-24T06:59:58.772 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-01-24T06:59:58.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-01-24T06:59:58.800 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-24T06:59:58.800 INFO:tasks.ceph:role: osd.0 2022-01-24T06:59:58.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2022-01-24T06:59:58.801 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-01-24T06:59:58.874 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T06:59:58.875 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T06:59:58.875 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T06:59:58.875 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2022-01-24T06:59:58.875 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T06:59:58.876 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-01-24T06:59:58.876 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T06:59:58.876 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T06:59:58.876 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T06:59:58.876 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T06:59:59.237 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-01-24T06:59:59.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-01-24T06:59:59.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-01-24T06:59:59.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-01-24T06:59:59.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-01-24T06:59:59.497 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-24T06:59:59.497 INFO:tasks.ceph:role: osd.1 2022-01-24T06:59:59.498 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2022-01-24T06:59:59.498 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-01-24T06:59:59.569 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T06:59:59.569 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T06:59:59.569 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T06:59:59.569 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2022-01-24T06:59:59.570 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T06:59:59.570 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-01-24T06:59:59.570 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T06:59:59.570 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T06:59:59.570 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T06:59:59.571 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T06:59:59.925 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-01-24T06:59:59.926 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-01-24T06:59:59.927 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-01-24T07:00:00.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-01-24T07:00:00.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-01-24T07:00:00.150 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-24T07:00:00.150 INFO:tasks.ceph:role: osd.2 2022-01-24T07:00:00.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2022-01-24T07:00:00.151 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-01-24T07:00:00.220 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T07:00:00.221 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T07:00:00.221 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T07:00:00.221 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2022-01-24T07:00:00.222 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T07:00:00.222 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-01-24T07:00:00.222 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T07:00:00.222 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T07:00:00.223 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T07:00:00.223 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T07:00:00.591 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-01-24T07:00:00.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-01-24T07:00:00.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-01-24T07:00:00.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-01-24T07:00:00.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-01-24T07:00:00.805 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-24T07:00:00.805 INFO:tasks.ceph:role: osd.3 2022-01-24T07:00:00.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2022-01-24T07:00:00.806 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-01-24T07:00:00.877 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T07:00:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T07:00:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T07:00:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 2022-01-24T07:00:00.878 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T07:00:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-01-24T07:00:00.879 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T07:00:00.879 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T07:00:00.879 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T07:00:00.879 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T07:00:01.249 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-01-24T07:00:01.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-01-24T07:00:01.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-01-24T07:00:01.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-01-24T07:00:01.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:01.485 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:01.486+0000 7ff2c3248f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-01-24T07:00:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:01.487+0000 7ff2c3248f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-01-24T07:00:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:01.487+0000 7ff2c3248f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-01-24T07:00:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:01.487+0000 7ff2c3248f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-01-24T07:00:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:01.487+0000 7ff2c3248f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-01-24T07:00:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:01.494+0000 7ff2c3248f00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-01-24T07:00:01.518 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:01.518+0000 7ff2c3248f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:03.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-01-24T07:00:03.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:03.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:03.990+0000 7f75481d7f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-01-24T07:00:03.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:03.990+0000 7f75481d7f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-01-24T07:00:03.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:03.990+0000 7f75481d7f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-01-24T07:00:03.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:03.990+0000 7f75481d7f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-01-24T07:00:03.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:03.990+0000 7f75481d7f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-01-24T07:00:03.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:03.990+0000 7f75481d7f00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-01-24T07:00:04.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:04.001+0000 7f75481d7f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:06.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-01-24T07:00:06.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:06.452 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:06.451+0000 7f2e96609f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-01-24T07:00:06.452 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:06.451+0000 7f2e96609f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-01-24T07:00:06.452 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:06.451+0000 7f2e96609f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-01-24T07:00:06.453 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:06.451+0000 7f2e96609f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-01-24T07:00:06.453 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:06.451+0000 7f2e96609f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-01-24T07:00:06.453 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:06.452+0000 7f2e96609f00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-01-24T07:00:06.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:06.459+0000 7f2e96609f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:08.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-01-24T07:00:08.879 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:08.972 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:08.972+0000 7fb08ecf3f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-01-24T07:00:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:08.972+0000 7fb08ecf3f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-01-24T07:00:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:08.972+0000 7fb08ecf3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-01-24T07:00:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:08.972+0000 7fb08ecf3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-01-24T07:00:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:08.972+0000 7fb08ecf3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-01-24T07:00:08.974 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:08.974+0000 7fb08ecf3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-01-24T07:00:08.979 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:08.979+0000 7fb08ecf3f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:11.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-01-24T07:00:11.383 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-01-24T07:00:11.413 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-24T07:00:11.414 INFO:tasks.ceph:role: osd.4 2022-01-24T07:00:11.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2022-01-24T07:00:11.415 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-01-24T07:00:11.489 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T07:00:11.489 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T07:00:11.489 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T07:00:11.490 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2022-01-24T07:00:11.490 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T07:00:11.490 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2022-01-24T07:00:11.491 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T07:00:11.491 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T07:00:11.491 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T07:00:11.492 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T07:00:11.851 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2022-01-24T07:00:11.853 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2022-01-24T07:00:11.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-01-24T07:00:11.993 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-01-24T07:00:12.024 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-01-24T07:00:12.091 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-24T07:00:12.091 INFO:tasks.ceph:role: osd.5 2022-01-24T07:00:12.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2022-01-24T07:00:12.092 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-01-24T07:00:12.163 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T07:00:12.164 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T07:00:12.164 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T07:00:12.164 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2022-01-24T07:00:12.164 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T07:00:12.165 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2022-01-24T07:00:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T07:00:12.165 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T07:00:12.165 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T07:00:12.166 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T07:00:12.522 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2022-01-24T07:00:12.524 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2022-01-24T07:00:12.524 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-01-24T07:00:12.619 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-01-24T07:00:12.652 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-01-24T07:00:12.718 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-24T07:00:12.718 INFO:tasks.ceph:role: osd.6 2022-01-24T07:00:12.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2022-01-24T07:00:12.719 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-01-24T07:00:12.790 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T07:00:12.791 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T07:00:12.791 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T07:00:12.791 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2022-01-24T07:00:12.792 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T07:00:12.792 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2022-01-24T07:00:12.792 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T07:00:12.792 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T07:00:12.793 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T07:00:12.793 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T07:00:13.154 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2022-01-24T07:00:13.156 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2022-01-24T07:00:13.156 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-01-24T07:00:13.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-01-24T07:00:13.289 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-01-24T07:00:13.353 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-24T07:00:13.354 INFO:tasks.ceph:role: osd.7 2022-01-24T07:00:13.354 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com 2022-01-24T07:00:13.355 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-01-24T07:00:13.426 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-01-24T07:00:13.426 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-24T07:00:13.427 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-24T07:00:13.427 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 2022-01-24T07:00:13.427 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-24T07:00:13.428 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2022-01-24T07:00:13.428 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-24T07:00:13.428 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-24T07:00:13.428 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-24T07:00:13.429 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-24T07:00:13.798 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2022-01-24T07:00:13.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2022-01-24T07:00:13.800 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-01-24T07:00:13.909 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-01-24T07:00:13.937 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:14.016 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:14.017+0000 7ff9b2ff8f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-01-24T07:00:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:14.022+0000 7ff9b2ff8f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-01-24T07:00:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:14.022+0000 7ff9b2ff8f00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-01-24T07:00:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:14.022+0000 7ff9b2ff8f00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-01-24T07:00:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:14.022+0000 7ff9b2ff8f00 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-01-24T07:00:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:14.022+0000 7ff9b2ff8f00 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-01-24T07:00:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:14.046+0000 7ff9b2ff8f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:16.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-01-24T07:00:16.435 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:16.519 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:16.519+0000 7efdbc868f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-01-24T07:00:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:16.519+0000 7efdbc868f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-01-24T07:00:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:16.520+0000 7efdbc868f00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-01-24T07:00:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:16.520+0000 7efdbc868f00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-01-24T07:00:16.520 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:16.520+0000 7efdbc868f00 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-01-24T07:00:16.521 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:16.520+0000 7efdbc868f00 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-01-24T07:00:16.528 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:16.528+0000 7efdbc868f00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:18.861 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-01-24T07:00:18.930 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:19.015 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:19.015+0000 7fbbf4e8df00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-01-24T07:00:19.015 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:19.015+0000 7fbbf4e8df00 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-01-24T07:00:19.015 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:19.015+0000 7fbbf4e8df00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-01-24T07:00:19.016 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:19.015+0000 7fbbf4e8df00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-01-24T07:00:19.016 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:19.015+0000 7fbbf4e8df00 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-01-24T07:00:19.016 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:19.015+0000 7fbbf4e8df00 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-01-24T07:00:19.025 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:19.026+0000 7fbbf4e8df00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:21.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-01-24T07:00:21.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:21.483+0000 7f66df6fbf00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-01-24T07:00:21.484 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:21.483+0000 7f66df6fbf00 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-01-24T07:00:21.484 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:21.483+0000 7f66df6fbf00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-01-24T07:00:21.484 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:21.483+0000 7f66df6fbf00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-01-24T07:00:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:21.483+0000 7f66df6fbf00 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-01-24T07:00:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:21.484+0000 7f66df6fbf00 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-01-24T07:00:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:21.494+0000 7f66df6fbf00 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-24T07:00:23.820 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-01-24T07:00:23.888 INFO:tasks.ceph:Reading keys from all nodes... 2022-01-24T07:00:23.889 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:23.907 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.CqP0Vy3n9U 2022-01-24T07:00:23.907 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.CqP0Vy3n9U 2022-01-24T07:00:23.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.CqP0Vy3n9U 2022-01-24T07:00:24.099 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.CqP0Vy3n9U is 56B 2022-01-24T07:00:24.147 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.CqP0Vy3n9U 2022-01-24T07:00:24.162 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:24.215 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.waNbGog6Km 2022-01-24T07:00:24.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.waNbGog6Km 2022-01-24T07:00:24.279 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.waNbGog6Km 2022-01-24T07:00:24.403 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.waNbGog6Km is 56B 2022-01-24T07:00:24.451 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.waNbGog6Km 2022-01-24T07:00:24.465 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:24.519 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.p30QOSZrMg 2022-01-24T07:00:24.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.p30QOSZrMg 2022-01-24T07:00:24.582 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.p30QOSZrMg 2022-01-24T07:00:24.701 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.p30QOSZrMg is 56B 2022-01-24T07:00:24.750 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.p30QOSZrMg 2022-01-24T07:00:24.764 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:24.816 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.lHtuzR1v51 2022-01-24T07:00:24.817 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.lHtuzR1v51 2022-01-24T07:00:24.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.lHtuzR1v51 2022-01-24T07:00:24.999 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.lHtuzR1v51 is 56B 2022-01-24T07:00:25.047 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.lHtuzR1v51 2022-01-24T07:00:25.061 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:25.114 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.Ihtpk4gHcv 2022-01-24T07:00:25.115 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mds/ceph-d/keyring /tmp/tmp.Ihtpk4gHcv 2022-01-24T07:00:25.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.Ihtpk4gHcv 2022-01-24T07:00:25.298 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.Ihtpk4gHcv is 56B 2022-01-24T07:00:25.346 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.Ihtpk4gHcv 2022-01-24T07:00:25.360 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:25.412 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.AVk8QHYGNG 2022-01-24T07:00:25.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.AVk8QHYGNG 2022-01-24T07:00:25.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.AVk8QHYGNG 2022-01-24T07:00:25.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:00:25.582 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:00:25.585 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:00:25.637 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.AVk8QHYGNG is 56B 2022-01-24T07:00:25.725 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.AVk8QHYGNG 2022-01-24T07:00:25.739 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:25.793 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.v3LstlOxtn 2022-01-24T07:00:25.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.v3LstlOxtn 2022-01-24T07:00:25.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.v3LstlOxtn 2022-01-24T07:00:25.977 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.v3LstlOxtn is 56B 2022-01-24T07:00:26.025 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.v3LstlOxtn 2022-01-24T07:00:26.040 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:26.092 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.Sdg5edNvOy 2022-01-24T07:00:26.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.Sdg5edNvOy 2022-01-24T07:00:26.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.Sdg5edNvOy 2022-01-24T07:00:26.276 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.Sdg5edNvOy is 56B 2022-01-24T07:00:26.325 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.Sdg5edNvOy 2022-01-24T07:00:26.338 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:26.391 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.JtpAgBZEbH 2022-01-24T07:00:26.392 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.JtpAgBZEbH 2022-01-24T07:00:26.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.JtpAgBZEbH 2022-01-24T07:00:26.574 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.JtpAgBZEbH is 56B 2022-01-24T07:00:26.623 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.JtpAgBZEbH 2022-01-24T07:00:26.637 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:26.654 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.SHh6MHZL5l 2022-01-24T07:00:26.655 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.SHh6MHZL5l 2022-01-24T07:00:26.722 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.SHh6MHZL5l 2022-01-24T07:00:26.847 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.SHh6MHZL5l is 56B 2022-01-24T07:00:26.895 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.SHh6MHZL5l 2022-01-24T07:00:26.911 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:26.965 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.JMoLM7EZWR 2022-01-24T07:00:26.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/mds/ceph-e/keyring /tmp/tmp.JMoLM7EZWR 2022-01-24T07:00:27.030 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.JMoLM7EZWR 2022-01-24T07:00:27.152 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.JMoLM7EZWR is 56B 2022-01-24T07:00:27.200 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.JMoLM7EZWR 2022-01-24T07:00:27.215 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:27.268 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.AYVUkZDJtH 2022-01-24T07:00:27.269 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/mds/ceph-f/keyring /tmp/tmp.AYVUkZDJtH 2022-01-24T07:00:27.332 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.AYVUkZDJtH 2022-01-24T07:00:27.452 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.AYVUkZDJtH is 56B 2022-01-24T07:00:27.501 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.AYVUkZDJtH 2022-01-24T07:00:27.515 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:27.568 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.MBaPft0vu2 2022-01-24T07:00:27.568 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/mds/ceph-g/keyring /tmp/tmp.MBaPft0vu2 2022-01-24T07:00:27.632 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.MBaPft0vu2 2022-01-24T07:00:27.752 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.MBaPft0vu2 is 56B 2022-01-24T07:00:27.801 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.MBaPft0vu2 2022-01-24T07:00:27.815 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:27.868 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.wqZHlJM9nd 2022-01-24T07:00:27.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/mds/ceph-h/keyring /tmp/tmp.wqZHlJM9nd 2022-01-24T07:00:27.931 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.wqZHlJM9nd 2022-01-24T07:00:28.051 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.wqZHlJM9nd is 56B 2022-01-24T07:00:28.099 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.wqZHlJM9nd 2022-01-24T07:00:28.113 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:28.166 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.XLFLUS6QPV 2022-01-24T07:00:28.167 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/mds/ceph-i/keyring /tmp/tmp.XLFLUS6QPV 2022-01-24T07:00:28.229 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.XLFLUS6QPV 2022-01-24T07:00:28.349 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.XLFLUS6QPV is 56B 2022-01-24T07:00:28.398 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.XLFLUS6QPV 2022-01-24T07:00:28.412 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:28.466 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.acD7y8roaY 2022-01-24T07:00:28.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.acD7y8roaY 2022-01-24T07:00:28.530 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.acD7y8roaY 2022-01-24T07:00:28.650 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.acD7y8roaY is 56B 2022-01-24T07:00:28.697 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.acD7y8roaY 2022-01-24T07:00:28.711 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:28.764 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.ZvJ8HLS47e 2022-01-24T07:00:28.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.ZvJ8HLS47e 2022-01-24T07:00:28.828 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.ZvJ8HLS47e 2022-01-24T07:00:28.948 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.ZvJ8HLS47e is 56B 2022-01-24T07:00:28.996 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.ZvJ8HLS47e 2022-01-24T07:00:29.009 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:29.063 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.TPfFr98YyI 2022-01-24T07:00:29.063 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.TPfFr98YyI 2022-01-24T07:00:29.126 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.TPfFr98YyI 2022-01-24T07:00:29.246 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.TPfFr98YyI is 56B 2022-01-24T07:00:29.294 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.TPfFr98YyI 2022-01-24T07:00:29.308 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:29.361 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.ccbJZS1usS 2022-01-24T07:00:29.361 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.ccbJZS1usS 2022-01-24T07:00:29.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.ccbJZS1usS 2022-01-24T07:00:29.545 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.ccbJZS1usS is 56B 2022-01-24T07:00:29.594 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.ccbJZS1usS 2022-01-24T07:00:29.659 DEBUG:teuthology.orchestra.remote:smithi164:/etc/ceph/ceph.client.0.keyring is 59B 2022-01-24T07:00:29.759 DEBUG:teuthology.orchestra.remote:smithi164:/etc/ceph/ceph.client.1.keyring is 59B 2022-01-24T07:00:29.809 INFO:tasks.ceph:Adding keys to all mons... 2022-01-24T07:00:29.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2022-01-24T07:00:29.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2022-01-24T07:00:29.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.y] 2022-01-24T07:00:29.835 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBtTu5hYtgXGxAA0XzG9M7xV0kPYWsoztju/Q== 2022-01-24T07:00:29.835 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.a] 2022-01-24T07:00:29.835 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBtTu5hQbvYIhAApdY6EUK6ZKM+iBDgZR7VPg== 2022-01-24T07:00:29.836 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.b] 2022-01-24T07:00:29.836 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBtTu5hqLx3KRAA3D3e7yrgKD5p6aM0kLFZJA== 2022-01-24T07:00:29.836 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.c] 2022-01-24T07:00:29.836 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBtTu5h8vgJMBAAjog1JOdfMWJefHsUjuNtpw== 2022-01-24T07:00:29.837 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.d] 2022-01-24T07:00:29.837 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBtTu5htRKfNhAADhVxNiPZiBaCAYPTCdoIiA== 2022-01-24T07:00:29.837 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2022-01-24T07:00:29.837 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBxTu5hjycLHRAACy2+VUV2JGiajuZn6l4I6w== 2022-01-24T07:00:29.838 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2022-01-24T07:00:29.838 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBzTu5h0/wYOxAAcvFMVb2/uSzon2duIch1zQ== 2022-01-24T07:00:29.838 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2022-01-24T07:00:29.838 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQB2Tu5hb0T7GhAAuWWZz5Ph+RywvRSFs5lqgA== 2022-01-24T07:00:29.839 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2022-01-24T07:00:29.839 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQB4Tu5hTtEFOhAAggP7B5lREHj9XBbpzgiZ6Q== 2022-01-24T07:00:29.839 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2022-01-24T07:00:29.840 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBtTu5hFd34HxAAlQw/Z+NuBdke5SDpMP8Mbg== 2022-01-24T07:00:29.840 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.e] 2022-01-24T07:00:29.840 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBtTu5hfSpcOxAAX8KnEe63bfEJKlGoyAT64w== 2022-01-24T07:00:29.840 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.f] 2022-01-24T07:00:29.840 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBuTu5haX6oBhAAw+uf07Olq9y9yn1658gODw== 2022-01-24T07:00:29.841 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.g] 2022-01-24T07:00:29.841 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBuTu5hthhODRAAVWpCCmHS16MActBn7mUpRg== 2022-01-24T07:00:29.841 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.h] 2022-01-24T07:00:29.841 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBuTu5hvQbhExAAMKsVVZsG62UMyfH/kFqFsQ== 2022-01-24T07:00:29.842 INFO:teuthology.orchestra.run.smithi145.stdout:[mds.i] 2022-01-24T07:00:29.842 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBuTu5hndt8GhAAXs6Jbpektuk7dSR8fAcXcQ== 2022-01-24T07:00:29.842 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.4] 2022-01-24T07:00:29.842 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQB+Tu5hc14UARAAkbRN2dUXiu/rDpCeIf9tqA== 2022-01-24T07:00:29.843 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.5] 2022-01-24T07:00:29.843 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCATu5hXYYFHxAA0buNQMZlsZMrqm9IL0sfgg== 2022-01-24T07:00:29.843 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.6] 2022-01-24T07:00:29.843 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCDTu5hciLyABAAPS/NXswXljYv6oM/TJ0/Xw== 2022-01-24T07:00:29.844 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.7] 2022-01-24T07:00:29.844 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQCFTu5hzLDZHBAAnpWBnE7qEPmNwCu07/kXzg== 2022-01-24T07:00:29.844 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2022-01-24T07:00:29.844 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBuTu5hOVpAJBAA2QLydrq4x6FIWfrO/kjDHw== 2022-01-24T07:00:29.845 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2022-01-24T07:00:29.845 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBuTu5htUTrKxAAXAbMmmbHz3yBPXnm58oxrQ== 2022-01-24T07:00:29.847 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2022-01-24T07:00:29.847 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtTu5hYtgXGxAA0XzG9M7xV0kPYWsoztju/Q== 2022-01-24T07:00:29.847 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2022-01-24T07:00:29.847 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtTu5hQbvYIhAApdY6EUK6ZKM+iBDgZR7VPg== 2022-01-24T07:00:29.848 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2022-01-24T07:00:29.848 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtTu5hqLx3KRAA3D3e7yrgKD5p6aM0kLFZJA== 2022-01-24T07:00:29.848 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2022-01-24T07:00:29.848 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtTu5h8vgJMBAAjog1JOdfMWJefHsUjuNtpw== 2022-01-24T07:00:29.849 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2022-01-24T07:00:29.849 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtTu5htRKfNhAADhVxNiPZiBaCAYPTCdoIiA== 2022-01-24T07:00:29.849 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2022-01-24T07:00:29.849 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBxTu5hjycLHRAACy2+VUV2JGiajuZn6l4I6w== 2022-01-24T07:00:29.850 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2022-01-24T07:00:29.850 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBzTu5h0/wYOxAAcvFMVb2/uSzon2duIch1zQ== 2022-01-24T07:00:29.850 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2022-01-24T07:00:29.850 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB2Tu5hb0T7GhAAuWWZz5Ph+RywvRSFs5lqgA== 2022-01-24T07:00:29.851 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2022-01-24T07:00:29.851 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB4Tu5hTtEFOhAAggP7B5lREHj9XBbpzgiZ6Q== 2022-01-24T07:00:29.851 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2022-01-24T07:00:29.851 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtTu5hFd34HxAAlQw/Z+NuBdke5SDpMP8Mbg== 2022-01-24T07:00:29.852 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.e] 2022-01-24T07:00:29.852 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtTu5hfSpcOxAAX8KnEe63bfEJKlGoyAT64w== 2022-01-24T07:00:29.852 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.f] 2022-01-24T07:00:29.852 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBuTu5haX6oBhAAw+uf07Olq9y9yn1658gODw== 2022-01-24T07:00:29.853 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.g] 2022-01-24T07:00:29.853 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBuTu5hthhODRAAVWpCCmHS16MActBn7mUpRg== 2022-01-24T07:00:29.853 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.h] 2022-01-24T07:00:29.853 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBuTu5hvQbhExAAMKsVVZsG62UMyfH/kFqFsQ== 2022-01-24T07:00:29.853 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.i] 2022-01-24T07:00:29.854 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBuTu5hndt8GhAAXs6Jbpektuk7dSR8fAcXcQ== 2022-01-24T07:00:29.854 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2022-01-24T07:00:29.854 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+Tu5hc14UARAAkbRN2dUXiu/rDpCeIf9tqA== 2022-01-24T07:00:29.854 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2022-01-24T07:00:29.855 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCATu5hXYYFHxAA0buNQMZlsZMrqm9IL0sfgg== 2022-01-24T07:00:29.855 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2022-01-24T07:00:29.855 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCDTu5hciLyABAAPS/NXswXljYv6oM/TJ0/Xw== 2022-01-24T07:00:29.855 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2022-01-24T07:00:29.856 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCFTu5hzLDZHBAAnpWBnE7qEPmNwCu07/kXzg== 2022-01-24T07:00:29.856 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2022-01-24T07:00:29.856 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBuTu5hOVpAJBAA2QLydrq4x6FIWfrO/kjDHw== 2022-01-24T07:00:29.856 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2022-01-24T07:00:29.857 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBuTu5htUTrKxAAXAbMmmbHz3yBPXnm58oxrQ== 2022-01-24T07:00:29.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-24T07:00:29.889 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-24T07:00:29.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:29.938 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:29.986 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:29.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.038 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.085 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.134 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.137 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.181 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.306 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.390 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.435 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-24T07:00:30.474 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-24T07:00:30.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.572 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.622 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.671 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.720 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-24T07:00:30.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.769 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.899 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.938 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:30.983 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:31.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-24T07:00:31.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-24T07:00:31.071 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-24T07:00:31.118 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-24T07:00:31.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-24T07:00:31.168 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-01-24T07:00:31.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-01-24T07:00:31.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-01-24T07:00:31.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-01-24T07:00:31.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-01-24T07:00:31.368 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-01-24T07:00:31.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-01-24T07:00:31.482 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-01-24T07:00:31.506 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-01-24T07:00:31.596 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-01-24T07:00:31.620 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:31.623 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-01-24T07:00:31.674 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-01-24T07:00:31.675 INFO:tasks.ceph.mon.a:Restarting daemon 2022-01-24T07:00:31.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-01-24T07:00:31.678 INFO:tasks.ceph.mon.a:Started 2022-01-24T07:00:31.678 INFO:tasks.ceph.mon.c:Restarting daemon 2022-01-24T07:00:31.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-01-24T07:00:31.681 INFO:tasks.ceph.mon.c:Started 2022-01-24T07:00:31.681 INFO:tasks.ceph.mon.b:Restarting daemon 2022-01-24T07:00:31.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-01-24T07:00:31.716 INFO:tasks.ceph.mon.b:Started 2022-01-24T07:00:31.717 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-01-24T07:00:31.717 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-01-24T07:00:31.717 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-01-24T07:00:31.719 INFO:tasks.ceph.mgr.y:Started 2022-01-24T07:00:31.720 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-01-24T07:00:31.720 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-01-24T07:00:31.722 INFO:tasks.ceph.mgr.x:Started 2022-01-24T07:00:31.723 INFO:tasks.ceph:Setting crush tunables to default 2022-01-24T07:00:31.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd crush tunables default 2022-01-24T07:00:31.827 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.826+0000 7f7239cf3700 1 Processor -- start 2022-01-24T07:00:31.827 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.826+0000 7f7239cf3700 1 -- start start 2022-01-24T07:00:31.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7239cf3700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:31.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7239cf3700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:31.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7239cf3700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72340634b0 con 0x7f72340cec50 2022-01-24T07:00:31.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7239cf3700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7234067b90 con 0x7f7234062fe0 2022-01-24T07:00:31.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7239cf3700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7234063750 con 0x7f72340d0b70 2022-01-24T07:00:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7232ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7232ffd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49838/0 (socket says 172.21.15.142:49838) 2022-01-24T07:00:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.827+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 learned_addr learned my addr 172.21.15.142:0/2416537294 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:31.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:31.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-24T07:00:31.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:31.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-24T07:00:31.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:31.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:31.834 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:31.828+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-24T07:00:32.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:32.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-24T07:00:32.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:32.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:32.031 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-01-24T07:00:32.031 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:32.031 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:32.031 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:32.032 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:32.032 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.029+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-01-24T07:00:32.431 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:32.431 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-24T07:00:32.431 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:32.432 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:32.432 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:32.432 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-01-24T07:00:32.432 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:32.433 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:32.433 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:32.433 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:32.430+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-01-24T07:00:33.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:33.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-24T07:00:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:33.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:33.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-01-24T07:00:33.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:33.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:33.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:33.231+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-01-24T07:00:34.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 msgr2=0x7f7234064670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-24T07:00:34.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.145:3300/0 conn(0x7f72340d0b70 0x7f7234064670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:34.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 -- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 msgr2=0x7f72340ce760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-24T07:00:34.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 --2- 172.21.15.142:0/2416537294 >> v2:172.21.15.142:3300/0 conn(0x7f7234062fe0 0x7f72340ce760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:34.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 -- 172.21.15.142:0/2416537294 >> v1:172.21.15.145:6789/0 conn(0x7f72340cec50 legacy=0x7f723413f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:34.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:34.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 -- 172.21.15.142:0/2416537294 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72340639f0 con 0x7f72140033c0 2022-01-24T07:00:34.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f72317fa700 1 -- 172.21.15.142:0/2416537294 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7234067b90 con 0x7f7214006fd0 2022-01-24T07:00:34.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:34.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:34.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:34.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:34.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:34.828+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-24T07:00:35.029 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.029+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:35.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.029+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:35.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.029+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.029+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:35.031 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.029+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-01-24T07:00:35.430 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.430+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:35.431 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.430+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:35.431 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.430+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:35.431 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.430+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:35.432 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:35.430+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-01-24T07:00:36.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:36.231+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:36.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:36.231+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-24T07:00:36.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:36.231+0000 7f7232ffd700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-24T07:00:36.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:36.231+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-24T07:00:36.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:36.231+0000 7f7232ffd700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-01-24T07:00:37.005 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.005+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462642153 0 0) 0x7f72340639f0 con 0x7f72140033c0 2022-01-24T07:00:37.006 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.005+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7220003260 con 0x7f72140033c0 2022-01-24T07:00:37.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3025981537 0 0) 0x7f7220003260 con 0x7f72140033c0 2022-01-24T07:00:37.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7214009470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-24T07:00:37.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7214009470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721400aca0 con 0x7f72140033c0 2022-01-24T07:00:37.010 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2378315007 0 0) 0x7f722400d1c0 con 0x7f72140033c0 2022-01-24T07:00:37.010 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 >> v1:172.21.15.142:6789/0 conn(0x7f72140033c0 legacy=0x7f7214005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:37.010 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f7233fff700 1 -- 172.21.15.142:0/2416537294 reap_dead start 2022-01-24T07:00:37.010 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7220003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:37.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7220003d10 0x7f7220004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:37.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72200049f0 0x7f7220004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:37.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7220003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:37.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7234067b90 con 0x7f72200049f0 2022-01-24T07:00:37.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722000b860 con 0x7f7220003d10 2022-01-24T07:00:37.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722000ba20 con 0x7f7214006fd0 2022-01-24T07:00:37.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f7233fff700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72200049f0 0x7f7220004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:37.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7220003d10 msgr2=0x7f7220004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:37.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7220003d10 0x7f7220004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-01-24T07:00:37.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72200049f0 msgr2=0x7f7220004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:37.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72200049f0 0x7f7220004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f72337fe700 1 -- 172.21.15.142:0/2416537294 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220003260 con 0x7f7214006fd0 2022-01-24T07:00:37.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.008+0000 7f7233fff700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72200049f0 0x7f7220004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:37.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.009+0000 7f72337fe700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7220003750 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7224000b60 tx=0x7f7224008040).ready entity=mon.2 client_cookie=63559f160729ec7f server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:37.019 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.010+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7224013b50 con 0x7f7214006fd0 2022-01-24T07:00:37.019 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.010+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224013cb0 con 0x7f7214006fd0 2022-01-24T07:00:37.020 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.010+0000 7f72327fc700 1 -- 172.21.15.142:0/2416537294 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7224016650 con 0x7f7214006fd0 2022-01-24T07:00:37.020 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 -- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7220003750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:37.020 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7220003750 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7224000b60 tx=0x7f7224008040).stop 2022-01-24T07:00:37.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 -- 172.21.15.142:0/2416537294 shutdown_connections 2022-01-24T07:00:37.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7220003d10 0x7f7220004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-01-24T07:00:37.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72200049f0 0x7f7220004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 --2- 172.21.15.142:0/2416537294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7220003750 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 -- 172.21.15.142:0/2416537294 >> 172.21.15.142:0/2416537294 conn(0x7f7234061ea0 msgr2=0x7f72340622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:37.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 -- 172.21.15.142:0/2416537294 shutdown_connections 2022-01-24T07:00:37.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.011+0000 7f7239cf3700 1 -- 172.21.15.142:0/2416537294 wait complete. 2022-01-24T07:00:37.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.012+0000 7f7239cf3700 1 Processor -- start 2022-01-24T07:00:37.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.013+0000 7f7239cf3700 1 -- start start 2022-01-24T07:00:37.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7239cf3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7234135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:37.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7239cf3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7220003d10 0x7f723416fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:37.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7239cf3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72200049f0 0x7f7234066ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:37.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7239cf3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7234170400 con 0x7f7220003d10 2022-01-24T07:00:37.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7239cf3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72341706a0 con 0x7f72200049f0 2022-01-24T07:00:37.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7239cf3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7234170940 con 0x7f7214006fd0 2022-01-24T07:00:37.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7234135690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:37.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7234135690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:52668/0 (socket says 172.21.15.142:52668) 2022-01-24T07:00:37.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 -- 172.21.15.142:0/681880157 learned_addr learned my addr 172.21.15.142:0/681880157 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:37.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7232ffd700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7220003d10 0x7f723416fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:37.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7233fff700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72200049f0 0x7f7234066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:37.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 -- 172.21.15.142:0/681880157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72200049f0 msgr2=0x7f7234066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:37.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72200049f0 0x7f7234066ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 -- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7220003d10 msgr2=0x7f723416fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:37.028 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7220003d10 0x7f723416fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.028 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 -- 172.21.15.142:0/681880157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7234170be0 con 0x7f7214006fd0 2022-01-24T07:00:37.028 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f72337fe700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7234135690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7224000b60 tx=0x7f7224008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:37.028 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.014+0000 7f7230ff9700 1 -- 172.21.15.142:0/681880157 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7224006940 con 0x7f7214006fd0 2022-01-24T07:00:37.029 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.015+0000 7f7230ff9700 1 -- 172.21.15.142:0/681880157 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722400d940 con 0x7f7214006fd0 2022-01-24T07:00:37.029 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.015+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723413d470 con 0x7f7214006fd0 2022-01-24T07:00:37.029 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.015+0000 7f7230ff9700 1 -- 172.21.15.142:0/681880157 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f722401f450 con 0x7f7214006fd0 2022-01-24T07:00:37.029 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.015+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72340d4af0 con 0x7f7214006fd0 2022-01-24T07:00:37.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.015+0000 7f7230ff9700 1 -- 172.21.15.142:0/681880157 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f7224031070 con 0x7f7214006fd0 2022-01-24T07:00:37.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.015+0000 7f7230ff9700 1 -- 172.21.15.142:0/681880157 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f7224000e40 con 0x7f7214006fd0 2022-01-24T07:00:37.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.016+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7234063c90 con 0x7f7214006fd0 2022-01-24T07:00:37.030 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.018+0000 7f7230ff9700 1 -- 172.21.15.142:0/681880157 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f722402f060 con 0x7f7214006fd0 2022-01-24T07:00:37.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.089+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7234057950 con 0x7f7214006fd0 2022-01-24T07:00:37.093 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.093+0000 7f7230ff9700 1 -- 172.21.15.142:0/681880157 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f722401a020 con 0x7f7214006fd0 2022-01-24T07:00:37.094 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 msgr2=0x7f7234135690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7234135690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7224000b60 tx=0x7f7224008040).stop 2022-01-24T07:00:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 shutdown_connections 2022-01-24T07:00:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f72200049f0 0x7f7234066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7214006fd0 0x7f7234135690 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.095 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 --2- 172.21.15.142:0/681880157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7220003d10 0x7f723416fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 >> 172.21.15.142:0/681880157 conn(0x7f7234061ea0 msgr2=0x7f723415e940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 shutdown_connections 2022-01-24T07:00:37.096 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:37.094+0000 7f7239cf3700 1 -- 172.21.15.142:0/681880157 wait complete. 2022-01-24T07:00:37.097 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2022-01-24T07:00:37.105 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-01-24T07:00:37.105 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:37.120 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.bOUiWldIRH 2022-01-24T07:00:37.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.bOUiWldIRH 2022-01-24T07:00:37.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.bOUiWldIRH 2022-01-24T07:00:37.303 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.bOUiWldIRH is 37B 2022-01-24T07:00:37.351 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.bOUiWldIRH 2022-01-24T07:00:37.365 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:37.420 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.PTeLKkz40n 2022-01-24T07:00:37.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.PTeLKkz40n 2022-01-24T07:00:37.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.PTeLKkz40n 2022-01-24T07:00:37.606 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.PTeLKkz40n is 37B 2022-01-24T07:00:37.654 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.PTeLKkz40n 2022-01-24T07:00:37.669 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:37.722 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.gsoVf9UZS1 2022-01-24T07:00:37.722 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.gsoVf9UZS1 2022-01-24T07:00:37.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.gsoVf9UZS1 2022-01-24T07:00:37.907 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.gsoVf9UZS1 is 37B 2022-01-24T07:00:37.955 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.gsoVf9UZS1 2022-01-24T07:00:37.969 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-01-24T07:00:38.024 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.knDRHXDnnX 2022-01-24T07:00:38.025 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.knDRHXDnnX 2022-01-24T07:00:38.101 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.knDRHXDnnX 2022-01-24T07:00:38.226 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.knDRHXDnnX is 37B 2022-01-24T07:00:38.273 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.knDRHXDnnX 2022-01-24T07:00:38.288 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:38.302 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.4KqQY1a5Uf 2022-01-24T07:00:38.303 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.4KqQY1a5Uf 2022-01-24T07:00:38.368 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.4KqQY1a5Uf 2022-01-24T07:00:38.489 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.4KqQY1a5Uf is 37B 2022-01-24T07:00:38.537 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.4KqQY1a5Uf 2022-01-24T07:00:38.552 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:38.605 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.1uiUkV8Dek 2022-01-24T07:00:38.606 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.1uiUkV8Dek 2022-01-24T07:00:38.669 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.1uiUkV8Dek 2022-01-24T07:00:38.790 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.1uiUkV8Dek is 37B 2022-01-24T07:00:38.838 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.1uiUkV8Dek 2022-01-24T07:00:38.852 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:38.907 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.BGwU4sXxRR 2022-01-24T07:00:38.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.BGwU4sXxRR 2022-01-24T07:00:38.971 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.BGwU4sXxRR 2022-01-24T07:00:39.092 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.BGwU4sXxRR is 37B 2022-01-24T07:00:39.139 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.BGwU4sXxRR 2022-01-24T07:00:39.154 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2022-01-24T07:00:39.207 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.dnTHlgWSza 2022-01-24T07:00:39.208 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.dnTHlgWSza 2022-01-24T07:00:39.272 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.dnTHlgWSza 2022-01-24T07:00:39.393 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.dnTHlgWSza is 37B 2022-01-24T07:00:39.441 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.dnTHlgWSza 2022-01-24T07:00:39.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new e16b2f5c-9c86-4748-8627-15c008bbfed8 0 2022-01-24T07:00:39.596 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.595+0000 7f77ae638700 1 Processor -- start 2022-01-24T07:00:39.596 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.595+0000 7f77ae638700 1 -- start start 2022-01-24T07:00:39.598 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77ae638700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77a80b86d0 0x7f77a8160c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.598 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77ae638700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f77a80ccb60 0x7f77a805b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.598 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77ae638700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a8160220 con 0x7f77a80cc700 2022-01-24T07:00:39.599 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77ae638700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a80cb950 con 0x7f77a80b86d0 2022-01-24T07:00:39.599 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77ae638700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a81604c0 con 0x7f77a80ccb60 2022-01-24T07:00:39.599 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77acbd5700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f77a80ccb60 0x7f77a805b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.599 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77a77fe700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f77a80cc700 0x7f77a815f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:58274/0 (socket says 172.21.15.145:58274) 2022-01-24T07:00:39.600 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77a77fe700 1 -- 172.21.15.145:0/3897666268 learned_addr learned my addr 172.21.15.145:0/3897666268 (peer_addr_for_me v1:172.21.15.145:0/0) 2022-01-24T07:00:39.604 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77a7fff700 1 --2- 172.21.15.145:0/3897666268 >> v2:172.21.15.142:3300/0 conn(0x7f77a80b86d0 0x7f77a8160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77acbd5700 1 -- 172.21.15.145:0/3897666268 >> v2:172.21.15.142:3300/0 conn(0x7f77a80b86d0 msgr2=0x7f77a8160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:39.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77acbd5700 1 --2- 172.21.15.145:0/3897666268 >> v2:172.21.15.142:3300/0 conn(0x7f77a80b86d0 0x7f77a8160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77acbd5700 1 -- 172.21.15.145:0/3897666268 >> v1:172.21.15.145:6789/0 conn(0x7f77a80cc700 legacy=0x7f77a815f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77a6ffd700 1 -- 172.21.15.145:0/3897666268 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028226207 0 0) 0x7f77a8160220 con 0x7f77a80cc700 2022-01-24T07:00:39.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.596+0000 7f77acbd5700 1 -- 172.21.15.145:0/3897666268 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80cbd20 con 0x7f77a80ccb60 2022-01-24T07:00:39.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77acbd5700 1 --2- 172.21.15.145:0/3897666268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80ccb60 0x7f77a805b330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f77a00032f0 tx=0x7f77a00091d0).ready entity=mon.1 client_cookie=abaf7fd06f256111 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:39.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77a6ffd700 1 -- 172.21.15.145:0/3897666268 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a000b680 con 0x7f77a80ccb60 2022-01-24T07:00:39.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77a6ffd700 1 -- 172.21.15.145:0/3897666268 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a000b7e0 con 0x7f77a80ccb60 2022-01-24T07:00:39.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77a6ffd700 1 -- 172.21.15.145:0/3897666268 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a000b950 con 0x7f77a80ccb60 2022-01-24T07:00:39.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 -- 172.21.15.145:0/3897666268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80ccb60 msgr2=0x7f77a805b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 --2- 172.21.15.145:0/3897666268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80ccb60 0x7f77a805b330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f77a00032f0 tx=0x7f77a00091d0).stop 2022-01-24T07:00:39.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 -- 172.21.15.145:0/3897666268 shutdown_connections 2022-01-24T07:00:39.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 --2- 172.21.15.145:0/3897666268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80ccb60 0x7f77a805b330 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 --2- 172.21.15.145:0/3897666268 >> v2:172.21.15.142:3300/0 conn(0x7f77a80b86d0 0x7f77a8160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 -- 172.21.15.145:0/3897666268 >> 172.21.15.145:0/3897666268 conn(0x7f77a80d5ff0 msgr2=0x7f77a80d6400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:39.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 -- 172.21.15.145:0/3897666268 shutdown_connections 2022-01-24T07:00:39.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.597+0000 7f77ae638700 1 -- 172.21.15.145:0/3897666268 wait complete. 2022-01-24T07:00:39.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.599+0000 7f77ae638700 1 Processor -- start 2022-01-24T07:00:39.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.599+0000 7f77ae638700 1 -- start start 2022-01-24T07:00:39.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77ae638700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80b86d0 0x7f77a816fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77ae638700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77a80cc700 0x7f77a8172d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77ae638700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77a80ccb60 0x7f77a8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77ae638700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8170370 con 0x7f77a80cc700 2022-01-24T07:00:39.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77ae638700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a815c290 con 0x7f77a80b86d0 2022-01-24T07:00:39.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77ae638700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a816d4c0 con 0x7f77a80ccb60 2022-01-24T07:00:39.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80b86d0 0x7f77a816fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80b86d0 0x7f77a816fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:34966/0 (socket says 172.21.15.145:34966) 2022-01-24T07:00:39.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 -- 172.21.15.145:0/1995429322 learned_addr learned my addr 172.21.15.145:0/1995429322 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:39.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77acbd5700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77a80ccb60 0x7f77a8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a77fe700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77a80cc700 0x7f77a8172d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 -- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77a80ccb60 msgr2=0x7f77a8158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77a80ccb60 0x7f77a8158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 -- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77a80cc700 msgr2=0x7f77a8172d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77a80cc700 0x7f77a8172d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 -- 172.21.15.145:0/1995429322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0009470 con 0x7f77a80b86d0 2022-01-24T07:00:39.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a7fff700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80b86d0 0x7f77a816fe80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f779c00c000 tx=0x7f779c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:39.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a57fa700 1 -- 172.21.15.145:0/1995429322 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f779c010780 con 0x7f77a80b86d0 2022-01-24T07:00:39.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a57fa700 1 -- 172.21.15.145:0/1995429322 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c0108e0 con 0x7f77a80b86d0 2022-01-24T07:00:39.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a816d760 con 0x7f77a80b86d0 2022-01-24T07:00:39.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.601+0000 7f77a57fa700 1 -- 172.21.15.145:0/1995429322 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f779c010c40 con 0x7f77a80b86d0 2022-01-24T07:00:39.615 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.602+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a816dca0 con 0x7f77a80b86d0 2022-01-24T07:00:39.615 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.602+0000 7f77a57fa700 1 -- 172.21.15.145:0/1995429322 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f779c01c460 con 0x7f77a80b86d0 2022-01-24T07:00:39.615 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.602+0000 7f77a57fa700 1 -- 172.21.15.145:0/1995429322 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f779c0123f0 con 0x7f77a80b86d0 2022-01-24T07:00:39.616 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.602+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a80cbfc0 con 0x7f77a80b86d0 2022-01-24T07:00:39.616 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.604+0000 7f77a57fa700 1 -- 172.21.15.145:0/1995429322 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f779c0125b0 con 0x7f77a80b86d0 2022-01-24T07:00:39.680 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.680+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e16b2f5c-9c86-4748-8627-15c008bbfed8", "id": 0} v 0) v1 -- 0x7f77a8057950 con 0x7f77a80b86d0 2022-01-24T07:00:39.685 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.684+0000 7f77a57fa700 1 -- 172.21.15.145:0/1995429322 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e16b2f5c-9c86-4748-8627-15c008bbfed8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f779c012750 con 0x7f77a80b86d0 2022-01-24T07:00:39.685 INFO:teuthology.orchestra.run.smithi145.stdout:0 2022-01-24T07:00:39.686 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80b86d0 msgr2=0x7f77a816fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.687 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80b86d0 0x7f77a816fe80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f779c00c000 tx=0x7f779c006df0).stop 2022-01-24T07:00:39.687 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 shutdown_connections 2022-01-24T07:00:39.687 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a80b86d0 0x7f77a816fe80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.687 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77a80ccb60 0x7f77a8158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.688 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 --2- 172.21.15.145:0/1995429322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77a80cc700 0x7f77a8172d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.688 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 >> 172.21.15.145:0/1995429322 conn(0x7f77a80d5ff0 msgr2=0x7f77a815da60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:39.688 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 shutdown_connections 2022-01-24T07:00:39.688 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.685+0000 7f77ae638700 1 -- 172.21.15.145:0/1995429322 wait complete. 2022-01-24T07:00:39.697 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 6fcbaa78-aa8b-475e-b2ae-b63e7641d31b 1 2022-01-24T07:00:39.802 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.801+0000 7f54db232700 1 Processor -- start 2022-01-24T07:00:39.803 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.801+0000 7f54db232700 1 -- start start 2022-01-24T07:00:39.809 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.802+0000 7f54db232700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d4148a30 0x7f54d40ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.809 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.802+0000 7f54db232700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f54d4148e10 0x7f54d405bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.809 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.802+0000 7f54db232700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d40c7450 con 0x7f54d40cd2e0 2022-01-24T07:00:39.810 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.802+0000 7f54db232700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d40cd830 con 0x7f54d4148e10 2022-01-24T07:00:39.810 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.802+0000 7f54db232700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40cdad0 con 0x7f54d4148a30 2022-01-24T07:00:39.810 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d3fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f54d4148e10 0x7f54d405bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.810 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d97cf700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f54d40cd2e0 0x7f54d405c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:58288/0 (socket says 172.21.15.145:58288) 2022-01-24T07:00:39.811 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d97cf700 1 -- 172.21.15.145:0/1117418062 learned_addr learned my addr 172.21.15.145:0/1117418062 (peer_addr_for_me v1:172.21.15.145:0/0) 2022-01-24T07:00:39.811 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d8fce700 1 --2- 172.21.15.145:0/1117418062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d4148a30 0x7f54d40ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.811 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d3fff700 1 -- 172.21.15.145:0/1117418062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d4148a30 msgr2=0x7f54d40ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:39.811 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d3fff700 1 --2- 172.21.15.145:0/1117418062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d4148a30 0x7f54d40ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.812 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d3fff700 1 -- 172.21.15.145:0/1117418062 >> v1:172.21.15.145:6789/0 conn(0x7f54d40cd2e0 legacy=0x7f54d405c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.812 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d3fff700 1 -- 172.21.15.145:0/1117418062 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40cdd70 con 0x7f54d4148e10 2022-01-24T07:00:39.812 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d3fff700 1 --2- 172.21.15.145:0/1117418062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d405bed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f54c0002f70 tx=0x7f54c0006df0).ready entity=mon.1 client_cookie=6db1fae848d8f7d3 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:39.812 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d37fe700 1 -- 172.21.15.145:0/1117418062 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c000d570 con 0x7f54d4148e10 2022-01-24T07:00:39.813 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d37fe700 1 -- 172.21.15.145:0/1117418062 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c0000e90 con 0x7f54d4148e10 2022-01-24T07:00:39.813 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.803+0000 7f54d37fe700 1 -- 172.21.15.145:0/1117418062 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c000d8c0 con 0x7f54d4148e10 2022-01-24T07:00:39.813 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 -- 172.21.15.145:0/1117418062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 msgr2=0x7f54d405bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.813 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 --2- 172.21.15.145:0/1117418062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d405bed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f54c0002f70 tx=0x7f54c0006df0).stop 2022-01-24T07:00:39.814 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 -- 172.21.15.145:0/1117418062 shutdown_connections 2022-01-24T07:00:39.814 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 --2- 172.21.15.145:0/1117418062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d4148a30 0x7f54d40ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.814 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 --2- 172.21.15.145:0/1117418062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d405bed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.814 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 -- 172.21.15.145:0/1117418062 >> 172.21.15.145:0/1117418062 conn(0x7f54d40d2f20 msgr2=0x7f54d40ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:39.815 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 -- 172.21.15.145:0/1117418062 shutdown_connections 2022-01-24T07:00:39.815 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.804+0000 7f54db232700 1 -- 172.21.15.145:0/1117418062 wait complete. 2022-01-24T07:00:39.815 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.805+0000 7f54db232700 1 Processor -- start 2022-01-24T07:00:39.815 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.805+0000 7f54db232700 1 -- start start 2022-01-24T07:00:39.816 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54db232700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d40cd2e0 0x7f54d4067a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.816 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54db232700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54d4148a30 0x7f54d41721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.816 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54db232700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d4172690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:39.816 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54db232700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d416ebd0 con 0x7f54d4148a30 2022-01-24T07:00:39.817 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54db232700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d41730e0 con 0x7f54d4148e10 2022-01-24T07:00:39.817 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54db232700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4067f30 con 0x7f54d40cd2e0 2022-01-24T07:00:39.817 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d4172690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.817 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d8fce700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d40cd2e0 0x7f54d4067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.817 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d4172690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:34980/0 (socket says 172.21.15.145:34980) 2022-01-24T07:00:39.818 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 -- 172.21.15.145:0/2546024634 learned_addr learned my addr 172.21.15.145:0/2546024634 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:39.818 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d3fff700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54d4148a30 0x7f54d41721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:39.818 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 -- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d40cd2e0 msgr2=0x7f54d4067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.818 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d40cd2e0 0x7f54d4067a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.819 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 -- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54d4148a30 msgr2=0x7f54d41721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.819 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54d4148a30 0x7f54d41721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.819 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 -- 172.21.15.145:0/2546024634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c000b180 con 0x7f54d4148e10 2022-01-24T07:00:39.819 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d8fce700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d40cd2e0 0x7f54d4067a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:39.820 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d97cf700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d4172690 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f54d40643b0 tx=0x7f54cc007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:39.820 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.806+0000 7f54d1ffb700 1 -- 172.21.15.145:0/2546024634 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc005c70 con 0x7f54d4148e10 2022-01-24T07:00:39.820 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.807+0000 7f54d1ffb700 1 -- 172.21.15.145:0/2546024634 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc005dd0 con 0x7f54d4148e10 2022-01-24T07:00:39.820 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.807+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d416edc0 con 0x7f54d4148e10 2022-01-24T07:00:39.821 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.807+0000 7f54d1ffb700 1 -- 172.21.15.145:0/2546024634 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc0072c0 con 0x7f54d4148e10 2022-01-24T07:00:39.821 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.807+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d416f020 con 0x7f54d4148e10 2022-01-24T07:00:39.821 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.807+0000 7f54d1ffb700 1 -- 172.21.15.145:0/2546024634 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f54cc010070 con 0x7f54d4148e10 2022-01-24T07:00:39.821 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.807+0000 7f54d1ffb700 1 -- 172.21.15.145:0/2546024634 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f54cc013490 con 0x7f54d4148e10 2022-01-24T07:00:39.822 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.807+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d416f720 con 0x7f54d4148e10 2022-01-24T07:00:39.822 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.809+0000 7f54d1ffb700 1 -- 172.21.15.145:0/2546024634 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f54cc01d3f0 con 0x7f54d4148e10 2022-01-24T07:00:39.884 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.883+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6fcbaa78-aa8b-475e-b2ae-b63e7641d31b", "id": 1} v 0) v1 -- 0x7f54d40ce010 con 0x7f54d4148e10 2022-01-24T07:00:39.889 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.888+0000 7f54d1ffb700 1 -- 172.21.15.145:0/2546024634 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fcbaa78-aa8b-475e-b2ae-b63e7641d31b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54cc013720 con 0x7f54d4148e10 2022-01-24T07:00:39.889 INFO:teuthology.orchestra.run.smithi145.stdout:1 2022-01-24T07:00:39.891 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 msgr2=0x7f54d4172690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:39.891 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d4172690 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f54d40643b0 tx=0x7f54cc007f40).stop 2022-01-24T07:00:39.891 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 shutdown_connections 2022-01-24T07:00:39.891 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f54d4148e10 0x7f54d4172690 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.892 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54d40cd2e0 0x7f54d4067a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.892 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 --2- 172.21.15.145:0/2546024634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54d4148a30 0x7f54d41721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:39.892 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 >> 172.21.15.145:0/2546024634 conn(0x7f54d40d2f20 msgr2=0x7f54d40cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:39.892 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 shutdown_connections 2022-01-24T07:00:39.893 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:39.889+0000 7f54db232700 1 -- 172.21.15.145:0/2546024634 wait complete. 2022-01-24T07:00:39.904 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 3fd2b441-dae7-4882-bcba-00ca52360135 2 2022-01-24T07:00:40.004 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.004+0000 7ff7d2474700 1 Processor -- start 2022-01-24T07:00:40.004 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.004+0000 7ff7d2474700 1 -- start start 2022-01-24T07:00:40.008 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d2474700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7cc061230 0x7ff7cc05b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.008 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d2474700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff7cc0b81a0 0x7ff7cc148110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.008 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d2474700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc05bc90 con 0x7ff7cc061610 2022-01-24T07:00:40.009 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d2474700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0b7160 con 0x7ff7cc061230 2022-01-24T07:00:40.009 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d2474700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc05bf30 con 0x7ff7cc0b81a0 2022-01-24T07:00:40.009 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d1c73700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff7cc0b81a0 0x7ff7cc148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.009 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d0c71700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7ff7cc061610 0x7ff7cc0b7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:58296/0 (socket says 172.21.15.145:58296) 2022-01-24T07:00:40.010 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d0c71700 1 -- 172.21.15.145:0/2043996436 learned_addr learned my addr 172.21.15.145:0/2043996436 (peer_addr_for_me v1:172.21.15.145:0/0) 2022-01-24T07:00:40.010 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d1472700 1 --2- 172.21.15.145:0/2043996436 >> v2:172.21.15.142:3300/0 conn(0x7ff7cc061230 0x7ff7cc05b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.010 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d1c73700 1 -- 172.21.15.145:0/2043996436 >> v2:172.21.15.142:3300/0 conn(0x7ff7cc061230 msgr2=0x7ff7cc05b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:40.010 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d1c73700 1 --2- 172.21.15.145:0/2043996436 >> v2:172.21.15.142:3300/0 conn(0x7ff7cc061230 0x7ff7cc05b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.011 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d1c73700 1 -- 172.21.15.145:0/2043996436 >> v1:172.21.15.145:6789/0 conn(0x7ff7cc061610 legacy=0x7ff7cc0b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.011 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7bbfff700 1 -- 172.21.15.145:0/2043996436 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890869510 0 0) 0x7ff7cc05bc90 con 0x7ff7cc061610 2022-01-24T07:00:40.011 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d1c73700 1 -- 172.21.15.145:0/2043996436 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc05c1d0 con 0x7ff7cc0b81a0 2022-01-24T07:00:40.011 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7d1c73700 1 --2- 172.21.15.145:0/2043996436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc0b81a0 0x7ff7cc148110 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff7c40032f0 tx=0x7ff7c40091d0).ready entity=mon.1 client_cookie=c43e68f2a9c1c762 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.012 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7bbfff700 1 -- 172.21.15.145:0/2043996436 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c400b680 con 0x7ff7cc0b81a0 2022-01-24T07:00:40.012 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7bbfff700 1 -- 172.21.15.145:0/2043996436 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400b7e0 con 0x7ff7cc0b81a0 2022-01-24T07:00:40.012 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.005+0000 7ff7bbfff700 1 -- 172.21.15.145:0/2043996436 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c400b950 con 0x7ff7cc0b81a0 2022-01-24T07:00:40.012 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 -- 172.21.15.145:0/2043996436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc0b81a0 msgr2=0x7ff7cc148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.013 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 --2- 172.21.15.145:0/2043996436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc0b81a0 0x7ff7cc148110 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff7c40032f0 tx=0x7ff7c40091d0).stop 2022-01-24T07:00:40.013 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 -- 172.21.15.145:0/2043996436 shutdown_connections 2022-01-24T07:00:40.013 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 --2- 172.21.15.145:0/2043996436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc0b81a0 0x7ff7cc148110 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.013 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 --2- 172.21.15.145:0/2043996436 >> v2:172.21.15.142:3300/0 conn(0x7ff7cc061230 0x7ff7cc05b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.014 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 -- 172.21.15.145:0/2043996436 >> 172.21.15.145:0/2043996436 conn(0x7ff7cc06bcf0 msgr2=0x7ff7cc06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.014 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 -- 172.21.15.145:0/2043996436 shutdown_connections 2022-01-24T07:00:40.014 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.006+0000 7ff7d2474700 1 -- 172.21.15.145:0/2043996436 wait complete. 2022-01-24T07:00:40.014 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.007+0000 7ff7d2474700 1 Processor -- start 2022-01-24T07:00:40.015 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.007+0000 7ff7d2474700 1 -- start start 2022-01-24T07:00:40.018 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d2474700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc061230 0x7ff7cc1720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.018 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d2474700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7cc061610 0x7ff7cc15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.019 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d2474700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7cc0b81a0 0x7ff7cc0d5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.019 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d2474700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc143ef0 con 0x7ff7cc061610 2022-01-24T07:00:40.019 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d2474700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1726d0 con 0x7ff7cc061230 2022-01-24T07:00:40.019 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d2474700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc172970 con 0x7ff7cc0b81a0 2022-01-24T07:00:40.020 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc061230 0x7ff7cc1720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.020 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc061230 0x7ff7cc1720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:34988/0 (socket says 172.21.15.145:34988) 2022-01-24T07:00:40.020 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 -- 172.21.15.145:0/2695521012 learned_addr learned my addr 172.21.15.145:0/2695521012 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.020 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d0c71700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7cc061610 0x7ff7cc15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.021 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1c73700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7cc0b81a0 0x7ff7cc0d5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.021 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 -- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7cc0b81a0 msgr2=0x7ff7cc0d5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.021 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7cc0b81a0 0x7ff7cc0d5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.021 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 -- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7cc061610 msgr2=0x7ff7cc15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.022 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7cc061610 0x7ff7cc15a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.022 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.008+0000 7ff7d1472700 1 -- 172.21.15.145:0/2695521012 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4009470 con 0x7ff7cc061230 2022-01-24T07:00:40.022 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7d1472700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc061230 0x7ff7cc1720f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff7c800c000 tx=0x7ff7c8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.022 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7ba7fc700 1 -- 172.21.15.145:0/2695521012 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c8010780 con 0x7ff7cc061230 2022-01-24T07:00:40.023 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7ba7fc700 1 -- 172.21.15.145:0/2695521012 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c80108e0 con 0x7ff7cc061230 2022-01-24T07:00:40.023 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc172c10 con 0x7ff7cc061230 2022-01-24T07:00:40.023 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7ba7fc700 1 -- 172.21.15.145:0/2695521012 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7c8010c40 con 0x7ff7cc061230 2022-01-24T07:00:40.023 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7ba7fc700 1 -- 172.21.15.145:0/2695521012 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ff7c801c460 con 0x7ff7cc061230 2022-01-24T07:00:40.024 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc144150 con 0x7ff7cc061230 2022-01-24T07:00:40.024 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.009+0000 7ff7ba7fc700 1 -- 172.21.15.145:0/2695521012 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7ff7c80123f0 con 0x7ff7cc061230 2022-01-24T07:00:40.024 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.010+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc144310 con 0x7ff7cc061230 2022-01-24T07:00:40.024 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.012+0000 7ff7ba7fc700 1 -- 172.21.15.145:0/2695521012 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff7c801cba0 con 0x7ff7cc061230 2022-01-24T07:00:40.096 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.095+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3fd2b441-dae7-4882-bcba-00ca52360135", "id": 2} v 0) v1 -- 0x7ff7cc0b7350 con 0x7ff7cc061230 2022-01-24T07:00:40.100 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.099+0000 7ff7ba7fc700 1 -- 172.21.15.145:0/2695521012 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3fd2b441-dae7-4882-bcba-00ca52360135", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff7c80125b0 con 0x7ff7cc061230 2022-01-24T07:00:40.100 INFO:teuthology.orchestra.run.smithi145.stdout:2 2022-01-24T07:00:40.102 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc061230 msgr2=0x7ff7cc1720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.102 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc061230 0x7ff7cc1720f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff7c800c000 tx=0x7ff7c8006df0).stop 2022-01-24T07:00:40.102 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 shutdown_connections 2022-01-24T07:00:40.102 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7cc061230 0x7ff7cc1720f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7cc0b81a0 0x7ff7cc0d5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 --2- 172.21.15.145:0/2695521012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7cc061610 0x7ff7cc15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 >> 172.21.15.145:0/2695521012 conn(0x7ff7cc06bcf0 msgr2=0x7ff7cc146940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.103 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 shutdown_connections 2022-01-24T07:00:40.104 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.100+0000 7ff7d2474700 1 -- 172.21.15.145:0/2695521012 wait complete. 2022-01-24T07:00:40.111 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new deacbe82-2885-48a4-9b0d-29bd8ecf91f3 3 2022-01-24T07:00:40.212 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.211+0000 7ff6dd1e3700 1 Processor -- start 2022-01-24T07:00:40.212 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.211+0000 7ff6dd1e3700 1 -- start start 2022-01-24T07:00:40.215 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.212+0000 7ff6dd1e3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80d07f0 0x7ff6d80d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.216 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.212+0000 7ff6dd1e3700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80c9a60 con 0x7ff6d80c95e0 2022-01-24T07:00:40.216 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.212+0000 7ff6dd1e3700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d8067b90 con 0x7ff6d8142120 2022-01-24T07:00:40.216 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.212+0000 7ff6dd1e3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80632b0 con 0x7ff6d80d07f0 2022-01-24T07:00:40.216 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.212+0000 7ff6d6d9d700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7ff6d8142120 0x7ff6d8064470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:58308/0 (socket says 172.21.15.145:58308) 2022-01-24T07:00:40.217 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.212+0000 7ff6d6d9d700 1 -- 172.21.15.145:0/481648599 learned_addr learned my addr 172.21.15.145:0/481648599 (peer_addr_for_me v1:172.21.15.145:0/0) 2022-01-24T07:00:40.217 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d759e700 1 --2- 172.21.15.145:0/481648599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80d07f0 0x7ff6d80d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.217 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d5d9b700 1 -- 172.21.15.145:0/481648599 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071440986 0 0) 0x7ff6d8067b90 con 0x7ff6d8142120 2022-01-24T07:00:40.218 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d5d9b700 1 -- 172.21.15.145:0/481648599 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b8003260 con 0x7ff6d8142120 2022-01-24T07:00:40.218 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d5d9b700 1 -- 172.21.15.145:0/481648599 <== mon.1 v1:172.21.15.145:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2325203824 0 0) 0x7ff6b8003260 con 0x7ff6d8142120 2022-01-24T07:00:40.218 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d759e700 1 -- 172.21.15.145:0/481648599 >> v1:172.21.15.145:6789/0 conn(0x7ff6d8142120 legacy=0x7ff6d8064470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.218 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d759e700 1 -- 172.21.15.145:0/481648599 >> v1:172.21.15.142:6789/0 conn(0x7ff6d80c95e0 legacy=0x7ff6d80ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.219 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d759e700 1 -- 172.21.15.145:0/481648599 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8063550 con 0x7ff6d80d07f0 2022-01-24T07:00:40.219 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d759e700 1 --2- 172.21.15.145:0/481648599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80d07f0 0x7ff6d80d0ca0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff6c00012a0 tx=0x7ff6d0006df0).ready entity=mon.2 client_cookie=c518d4942df88971 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.219 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d5d9b700 1 -- 172.21.15.145:0/481648599 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6c8001a20 con 0x7ff6d80d07f0 2022-01-24T07:00:40.219 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d5d9b700 1 -- 172.21.15.145:0/481648599 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0000e90 con 0x7ff6d80d07f0 2022-01-24T07:00:40.220 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.213+0000 7ff6d5d9b700 1 -- 172.21.15.145:0/481648599 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d000d4a0 con 0x7ff6d80d07f0 2022-01-24T07:00:40.220 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.214+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/481648599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80d07f0 msgr2=0x7ff6d80d0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.220 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.214+0000 7ff6dd1e3700 1 --2- 172.21.15.145:0/481648599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80d07f0 0x7ff6d80d0ca0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff6c00012a0 tx=0x7ff6d0006df0).stop 2022-01-24T07:00:40.220 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.214+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/481648599 shutdown_connections 2022-01-24T07:00:40.220 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.214+0000 7ff6dd1e3700 1 --2- 172.21.15.145:0/481648599 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80d07f0 0x7ff6d80d0ca0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.221 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.214+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/481648599 >> 172.21.15.145:0/481648599 conn(0x7ff6d8061ea0 msgr2=0x7ff6d80622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.221 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.214+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/481648599 shutdown_connections 2022-01-24T07:00:40.221 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.214+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/481648599 wait complete. 2022-01-24T07:00:40.221 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.215+0000 7ff6dd1e3700 1 Processor -- start 2022-01-24T07:00:40.222 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.215+0000 7ff6dd1e3700 1 -- start start 2022-01-24T07:00:40.225 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80c95e0 0x7ff6d816ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.225 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6d80d07f0 0x7ff6d80d4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.225 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8142120 0x7ff6d80cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.226 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80ccea0 con 0x7ff6d8142120 2022-01-24T07:00:40.226 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d816f5b0 con 0x7ff6d80d07f0 2022-01-24T07:00:40.226 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d816f850 con 0x7ff6d80c95e0 2022-01-24T07:00:40.226 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6d80d07f0 0x7ff6d80d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.227 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6d80d07f0 0x7ff6d80d4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35002/0 (socket says 172.21.15.145:35002) 2022-01-24T07:00:40.227 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 -- 172.21.15.145:0/3265297894 learned_addr learned my addr 172.21.15.145:0/3265297894 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.227 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d6d9d700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80c95e0 0x7ff6d816ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.227 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d759e700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8142120 0x7ff6d80cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.228 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 -- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80c95e0 msgr2=0x7ff6d816ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.228 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80c95e0 0x7ff6d816ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.228 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 -- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8142120 msgr2=0x7ff6d80cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.228 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8142120 0x7ff6d80cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.229 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 -- 172.21.15.145:0/3265297894 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d000b180 con 0x7ff6d80d07f0 2022-01-24T07:00:40.229 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6d659c700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6d80d07f0 0x7ff6d80d4120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff6d816fdc0 tx=0x7ff6c0007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.229 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6cffff700 1 -- 172.21.15.145:0/3265297894 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6c0007240 con 0x7ff6d80d07f0 2022-01-24T07:00:40.229 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6cffff700 1 -- 172.21.15.145:0/3265297894 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00073a0 con 0x7ff6d80d07f0 2022-01-24T07:00:40.230 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d816faf0 con 0x7ff6d80d07f0 2022-01-24T07:00:40.230 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6cffff700 1 -- 172.21.15.145:0/3265297894 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6c0006700 con 0x7ff6d80d07f0 2022-01-24T07:00:40.230 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.216+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d80cd370 con 0x7ff6d80d07f0 2022-01-24T07:00:40.230 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.217+0000 7ff6cffff700 1 -- 172.21.15.145:0/3265297894 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 2) v1 ==== 32233+0+0 (secure 0 0 0) 0x7ff6c0010030 con 0x7ff6d80d07f0 2022-01-24T07:00:40.231 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.217+0000 7ff6cffff700 1 -- 172.21.15.145:0/3265297894 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7ff6c00396e0 con 0x7ff6d80d07f0 2022-01-24T07:00:40.231 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.217+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d80c9a60 con 0x7ff6d80d07f0 2022-01-24T07:00:40.231 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.219+0000 7ff6cffff700 1 -- 172.21.15.145:0/3265297894 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff6d80c9a60 con 0x7ff6d80d07f0 2022-01-24T07:00:40.291 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.290+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "deacbe82-2885-48a4-9b0d-29bd8ecf91f3", "id": 3} v 0) v1 -- 0x7ff6d80c9a60 con 0x7ff6d80d07f0 2022-01-24T07:00:40.296 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.296+0000 7ff6cffff700 1 -- 172.21.15.145:0/3265297894 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "deacbe82-2885-48a4-9b0d-29bd8ecf91f3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6d80c9a60 con 0x7ff6d80d07f0 2022-01-24T07:00:40.297 INFO:teuthology.orchestra.run.smithi145.stdout:3 2022-01-24T07:00:40.298 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6d80d07f0 msgr2=0x7ff6d80d4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.298 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6d80d07f0 0x7ff6d80d4120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff6d816fdc0 tx=0x7ff6c0007bd0).stop 2022-01-24T07:00:40.299 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 shutdown_connections 2022-01-24T07:00:40.299 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6d8142120 0x7ff6d80cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.299 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6d80c95e0 0x7ff6d816ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.299 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 --2- 172.21.15.145:0/3265297894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6d80d07f0 0x7ff6d80d4120 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.300 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 >> 172.21.15.145:0/3265297894 conn(0x7ff6d8061ea0 msgr2=0x7ff6d813d460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.300 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 shutdown_connections 2022-01-24T07:00:40.300 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.297+0000 7ff6dd1e3700 1 -- 172.21.15.145:0/3265297894 wait complete. 2022-01-24T07:00:40.307 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new e048cf98-4a69-4dcc-8c4b-78671d4a6d9c 4 2022-01-24T07:00:40.404 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.404+0000 7fefbd450700 1 Processor -- start 2022-01-24T07:00:40.405 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.404+0000 7fefbd450700 1 -- start start 2022-01-24T07:00:40.411 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefbd450700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142040 0x7fefb805b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.411 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefbd450700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fefb8142420 0x7fefb805b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.411 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefbd450700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb805bf00 con 0x7fefb80cd6b0 2022-01-24T07:00:40.411 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefbd450700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb805bd10 con 0x7fefb8142420 2022-01-24T07:00:40.412 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefbd450700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb805c1a0 con 0x7fefb8142040 2022-01-24T07:00:40.412 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fefb8142420 0x7fefb805b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.412 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fefb8142420 0x7fefb805b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35006/0 (socket says 172.21.15.145:35006) 2022-01-24T07:00:40.413 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 -- 172.21.15.145:0/4112076494 learned_addr learned my addr 172.21.15.145:0/4112076494 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.413 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefbcc4f700 1 --1- 172.21.15.145:0/4112076494 >> v1:172.21.15.145:6789/0 conn(0x7fefb80cd6b0 0x7fefb80cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:58324/0 (socket says 172.21.15.145:58324) 2022-01-24T07:00:40.413 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb7fff700 1 --2- 172.21.15.145:0/4112076494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142040 0x7fefb805b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.413 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 -- 172.21.15.145:0/4112076494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142040 msgr2=0x7fefb805b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:40.414 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 --2- 172.21.15.145:0/4112076494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142040 0x7fefb805b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.414 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 -- 172.21.15.145:0/4112076494 >> v1:172.21.15.145:6789/0 conn(0x7fefb80cd6b0 legacy=0x7fefb80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.414 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 -- 172.21.15.145:0/4112076494 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb805c440 con 0x7fefb8142420 2022-01-24T07:00:40.414 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb77fe700 1 --2- 172.21.15.145:0/4112076494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142420 0x7fefb805b820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fefac002f70 tx=0x7fefac006eb0).ready entity=mon.1 client_cookie=589346c7f7cc2f44 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.415 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb6ffd700 1 -- 172.21.15.145:0/4112076494 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac00d570 con 0x7fefb8142420 2022-01-24T07:00:40.415 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb6ffd700 1 -- 172.21.15.145:0/4112076494 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac000e90 con 0x7fefb8142420 2022-01-24T07:00:40.415 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.405+0000 7fefb6ffd700 1 -- 172.21.15.145:0/4112076494 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac00d900 con 0x7fefb8142420 2022-01-24T07:00:40.415 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 -- 172.21.15.145:0/4112076494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142420 msgr2=0x7fefb805b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.416 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 --2- 172.21.15.145:0/4112076494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142420 0x7fefb805b820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fefac002f70 tx=0x7fefac006eb0).stop 2022-01-24T07:00:40.416 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 -- 172.21.15.145:0/4112076494 shutdown_connections 2022-01-24T07:00:40.416 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 --2- 172.21.15.145:0/4112076494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142040 0x7fefb805b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.416 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 --2- 172.21.15.145:0/4112076494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142420 0x7fefb805b820 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.417 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 -- 172.21.15.145:0/4112076494 >> 172.21.15.145:0/4112076494 conn(0x7fefb80d2d90 msgr2=0x7fefb80ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.417 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 -- 172.21.15.145:0/4112076494 shutdown_connections 2022-01-24T07:00:40.417 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.406+0000 7fefbd450700 1 -- 172.21.15.145:0/4112076494 wait complete. 2022-01-24T07:00:40.417 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.407+0000 7fefbd450700 1 Processor -- start 2022-01-24T07:00:40.418 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.407+0000 7fefbd450700 1 -- start start 2022-01-24T07:00:40.418 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefbd450700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefb80cd6b0 0x7fefb80c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.418 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefbd450700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142040 0x7fefb81409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.418 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefbd450700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142420 0x7fefb8140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.419 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefbd450700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8171c40 con 0x7fefb80cd6b0 2022-01-24T07:00:40.419 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefbd450700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb816cb90 con 0x7fefb8142040 2022-01-24T07:00:40.419 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefbd450700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb816ce30 con 0x7fefb8142420 2022-01-24T07:00:40.419 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142040 0x7fefb81409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.420 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142040 0x7fefb81409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35014/0 (socket says 172.21.15.145:35014) 2022-01-24T07:00:40.420 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 -- 172.21.15.145:0/1777760149 learned_addr learned my addr 172.21.15.145:0/1777760149 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.420 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb7fff700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefb80cd6b0 0x7fefb80c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.420 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefbcc4f700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142420 0x7fefb8140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.420 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 -- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142420 msgr2=0x7fefb8140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.421 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142420 0x7fefb8140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.421 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 -- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefb80cd6b0 msgr2=0x7fefb80c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.421 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefb80cd6b0 0x7fefb80c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.421 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 -- 172.21.15.145:0/1777760149 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac00b1e0 con 0x7fefb8142040 2022-01-24T07:00:40.422 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb77fe700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142040 0x7fefb81409a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fefac002f70 tx=0x7fefac015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.422 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.408+0000 7fefb57fa700 1 -- 172.21.15.145:0/1777760149 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac0117e0 con 0x7fefb8142040 2022-01-24T07:00:40.422 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.409+0000 7fefb57fa700 1 -- 172.21.15.145:0/1777760149 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac011940 con 0x7fefb8142040 2022-01-24T07:00:40.422 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.409+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb816d0d0 con 0x7fefb8142040 2022-01-24T07:00:40.423 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.409+0000 7fefb57fa700 1 -- 172.21.15.145:0/1777760149 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac011ca0 con 0x7fefb8142040 2022-01-24T07:00:40.423 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.409+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb8141380 con 0x7fefb8142040 2022-01-24T07:00:40.423 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.409+0000 7fefb57fa700 1 -- 172.21.15.145:0/1777760149 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 2) v1 ==== 32233+0+0 (secure 0 0 0) 0x7fefac025030 con 0x7fefb8142040 2022-01-24T07:00:40.423 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.409+0000 7fefb57fa700 1 -- 172.21.15.145:0/1777760149 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1590+0+0 (secure 0 0 0) 0x7fefac03ad50 con 0x7fefb8142040 2022-01-24T07:00:40.424 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.410+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb805c6e0 con 0x7fefb8142040 2022-01-24T07:00:40.424 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.411+0000 7fefb57fa700 1 -- 172.21.15.145:0/1777760149 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fefac023020 con 0x7fefb8142040 2022-01-24T07:00:40.484 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.483+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e048cf98-4a69-4dcc-8c4b-78671d4a6d9c", "id": 4} v 0) v1 -- 0x7fefb805f5e0 con 0x7fefb8142040 2022-01-24T07:00:40.490 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.489+0000 7fefb57fa700 1 -- 172.21.15.145:0/1777760149 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e048cf98-4a69-4dcc-8c4b-78671d4a6d9c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefac023020 con 0x7fefb8142040 2022-01-24T07:00:40.490 INFO:teuthology.orchestra.run.smithi145.stdout:4 2022-01-24T07:00:40.491 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142040 msgr2=0x7fefb81409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.491 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142040 0x7fefb81409a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fefac002f70 tx=0x7fefac015000).stop 2022-01-24T07:00:40.492 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 shutdown_connections 2022-01-24T07:00:40.492 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fefb8142420 0x7fefb8140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.492 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fefb80cd6b0 0x7fefb80c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.493 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 --2- 172.21.15.145:0/1777760149 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fefb8142040 0x7fefb81409a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.493 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 >> 172.21.15.145:0/1777760149 conn(0x7fefb80d2d90 msgr2=0x7fefb8159110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.493 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 shutdown_connections 2022-01-24T07:00:40.493 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.490+0000 7fefbd450700 1 -- 172.21.15.145:0/1777760149 wait complete. 2022-01-24T07:00:40.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new b38df368-4f6b-4a11-9138-ac98ba45681d 5 2022-01-24T07:00:40.598 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.597+0000 7faf3d040700 1 Processor -- start 2022-01-24T07:00:40.598 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.597+0000 7faf3d040700 1 -- start start 2022-01-24T07:00:40.604 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3d040700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf3813f2d0 0x7faf3805c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3d040700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf38061cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3d040700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3805c9f0 con 0x7faf3813eef0 2022-01-24T07:00:40.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3d040700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3815d490 con 0x7faf3813f2d0 2022-01-24T07:00:40.605 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3d040700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3805cc90 con 0x7faf380603a0 2022-01-24T07:00:40.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3659c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf3813f2d0 0x7faf3805c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3659c700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7faf3813f2d0 0x7faf3805c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35020/0 (socket says 172.21.15.145:35020) 2022-01-24T07:00:40.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3659c700 1 -- 172.21.15.145:0/3690055882 learned_addr learned my addr 172.21.15.145:0/3690055882 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.598+0000 7faf3759e700 1 --2- 172.21.15.145:0/3690055882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf38061cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.606 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3659c700 1 -- 172.21.15.145:0/3690055882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 msgr2=0x7faf38061cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:40.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3659c700 1 --2- 172.21.15.145:0/3690055882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf38061cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3659c700 1 -- 172.21.15.145:0/3690055882 >> v1:172.21.15.145:6789/0 conn(0x7faf3813eef0 legacy=0x7faf3805fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3659c700 1 -- 172.21.15.145:0/3690055882 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3805cf30 con 0x7faf3813f2d0 2022-01-24T07:00:40.607 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3659c700 1 --2- 172.21.15.145:0/3690055882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813f2d0 0x7faf3805c440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faf380c8d90 tx=0x7faf2c006eb0).ready entity=mon.1 client_cookie=6c635b36ac66f8ad server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf35d9b700 1 -- 172.21.15.145:0/3690055882 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c00d5c0 con 0x7faf3813f2d0 2022-01-24T07:00:40.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf35d9b700 1 -- 172.21.15.145:0/3690055882 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c000e90 con 0x7faf3813f2d0 2022-01-24T07:00:40.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf35d9b700 1 -- 172.21.15.145:0/3690055882 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c00d950 con 0x7faf3813f2d0 2022-01-24T07:00:40.608 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 -- 172.21.15.145:0/3690055882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813f2d0 msgr2=0x7faf3805c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 --2- 172.21.15.145:0/3690055882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813f2d0 0x7faf3805c440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faf380c8d90 tx=0x7faf2c006eb0).stop 2022-01-24T07:00:40.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 -- 172.21.15.145:0/3690055882 shutdown_connections 2022-01-24T07:00:40.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 --2- 172.21.15.145:0/3690055882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf38061cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 --2- 172.21.15.145:0/3690055882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813f2d0 0x7faf3805c440 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.609 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 -- 172.21.15.145:0/3690055882 >> 172.21.15.145:0/3690055882 conn(0x7faf380d2d20 msgr2=0x7faf380d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 -- 172.21.15.145:0/3690055882 shutdown_connections 2022-01-24T07:00:40.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.599+0000 7faf3d040700 1 -- 172.21.15.145:0/3690055882 wait complete. 2022-01-24T07:00:40.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.600+0000 7faf3d040700 1 Processor -- start 2022-01-24T07:00:40.610 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3d040700 1 -- start start 2022-01-24T07:00:40.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3d040700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf3805baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3d040700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813eef0 0x7faf380b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3d040700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3816d040 0x7faf380b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.611 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3d040700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3816d4d0 con 0x7faf3816d040 2022-01-24T07:00:40.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3d040700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3816d770 con 0x7faf3813eef0 2022-01-24T07:00:40.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3d040700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3816da10 con 0x7faf380603a0 2022-01-24T07:00:40.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3659c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813eef0 0x7faf380b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.612 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3659c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813eef0 0x7faf380b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35026/0 (socket says 172.21.15.145:35026) 2022-01-24T07:00:40.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3659c700 1 -- 172.21.15.145:0/220451181 learned_addr learned my addr 172.21.15.145:0/220451181 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf36d9d700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf3805baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.601+0000 7faf3759e700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3816d040 0x7faf380b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.613 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3659c700 1 -- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 msgr2=0x7faf3805baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3659c700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf3805baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3659c700 1 -- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3816d040 msgr2=0x7faf380b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3659c700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3816d040 0x7faf380b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.614 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3659c700 1 -- 172.21.15.145:0/220451181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c00b1e0 con 0x7faf3813eef0 2022-01-24T07:00:40.615 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3659c700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813eef0 0x7faf380b1ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7faf380c8d90 tx=0x7faf2c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.615 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf27fff700 1 -- 172.21.15.145:0/220451181 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c0117e0 con 0x7faf3813eef0 2022-01-24T07:00:40.615 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf27fff700 1 -- 172.21.15.145:0/220451181 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c011940 con 0x7faf3813eef0 2022-01-24T07:00:40.616 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3816dcb0 con 0x7faf3813eef0 2022-01-24T07:00:40.616 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf27fff700 1 -- 172.21.15.145:0/220451181 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c011ca0 con 0x7faf3813eef0 2022-01-24T07:00:40.616 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf380af810 con 0x7faf3813eef0 2022-01-24T07:00:40.616 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.602+0000 7faf27fff700 1 -- 172.21.15.145:0/220451181 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 2) v1 ==== 32233+0+0 (secure 0 0 0) 0x7faf2c00f070 con 0x7faf3813eef0 2022-01-24T07:00:40.616 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.603+0000 7faf27fff700 1 -- 172.21.15.145:0/220451181 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1729+0+0 (secure 0 0 0) 0x7faf2c03b450 con 0x7faf3813eef0 2022-01-24T07:00:40.617 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.603+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3805d1d0 con 0x7faf3813eef0 2022-01-24T07:00:40.617 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.605+0000 7faf27fff700 1 -- 172.21.15.145:0/220451181 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7faf2c011e00 con 0x7faf3813eef0 2022-01-24T07:00:40.677 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.676+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b38df368-4f6b-4a11-9138-ac98ba45681d", "id": 5} v 0) v1 -- 0x7faf38057950 con 0x7faf3813eef0 2022-01-24T07:00:40.681 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.680+0000 7faf27fff700 1 -- 172.21.15.145:0/220451181 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b38df368-4f6b-4a11-9138-ac98ba45681d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faf2c0360b0 con 0x7faf3813eef0 2022-01-24T07:00:40.681 INFO:teuthology.orchestra.run.smithi145.stdout:5 2022-01-24T07:00:40.683 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813eef0 msgr2=0x7faf380b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.683 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813eef0 0x7faf380b1ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7faf380c8d90 tx=0x7faf2c015000).stop 2022-01-24T07:00:40.683 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 shutdown_connections 2022-01-24T07:00:40.683 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf3816d040 0x7faf380b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.684 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf380603a0 0x7faf3805baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.684 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 --2- 172.21.15.145:0/220451181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf3813eef0 0x7faf380b1ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.684 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 >> 172.21.15.145:0/220451181 conn(0x7faf380d2d20 msgr2=0x7faf3805fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.684 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 shutdown_connections 2022-01-24T07:00:40.685 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.681+0000 7faf3d040700 1 -- 172.21.15.145:0/220451181 wait complete. 2022-01-24T07:00:40.692 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 77268ca3-fb1a-4265-b96f-d348f8ad8048 6 2022-01-24T07:00:40.790 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.789+0000 7f8cc63b7700 1 Processor -- start 2022-01-24T07:00:40.790 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.789+0000 7f8cc63b7700 1 -- start start 2022-01-24T07:00:40.793 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cc63b7700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8cc005fc90 0x7f8cc00600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.794 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cc63b7700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8cc00620b0 0x7f8cc0062500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.794 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cc63b7700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc005cef0 con 0x7f8cc0141fb0 2022-01-24T07:00:40.794 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cc63b7700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc0061cc0 con 0x7f8cc00620b0 2022-01-24T07:00:40.794 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cc63b7700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc005d190 con 0x7f8cc005fc90 2022-01-24T07:00:40.795 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cbf7fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8cc005fc90 0x7f8cc00600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.795 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cbf7fe700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8cc005fc90 0x7f8cc00600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35032/0 (socket says 172.21.15.145:35032) 2022-01-24T07:00:40.795 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cbf7fe700 1 -- 172.21.15.145:0/1188387361 learned_addr learned my addr 172.21.15.145:0/1188387361 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.795 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.790+0000 7f8cc4954700 1 --2- 172.21.15.145:0/1188387361 >> v2:172.21.15.142:3300/0 conn(0x7f8cc00620b0 0x7f8cc0062500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.795 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbf7fe700 1 -- 172.21.15.145:0/1188387361 >> v2:172.21.15.142:3300/0 conn(0x7f8cc00620b0 msgr2=0x7f8cc0062500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:40.796 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbf7fe700 1 --2- 172.21.15.145:0/1188387361 >> v2:172.21.15.142:3300/0 conn(0x7f8cc00620b0 0x7f8cc0062500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.796 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbf7fe700 1 -- 172.21.15.145:0/1188387361 >> v1:172.21.15.142:6789/0 conn(0x7f8cc0141fb0 legacy=0x7f8cc005c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:40.796 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbf7fe700 1 -- 172.21.15.145:0/1188387361 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc005d430 con 0x7f8cc005fc90 2022-01-24T07:00:40.796 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbf7fe700 1 --2- 172.21.15.145:0/1188387361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc00600f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8cc00cd4f0 tx=0x7f8cb4006eb0).ready entity=mon.1 client_cookie=710fb2e3b715dc7a server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.797 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbeffd700 1 -- 172.21.15.145:0/1188387361 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb400d5c0 con 0x7f8cc005fc90 2022-01-24T07:00:40.797 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbeffd700 1 -- 172.21.15.145:0/1188387361 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4000e90 con 0x7f8cc005fc90 2022-01-24T07:00:40.797 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cbeffd700 1 -- 172.21.15.145:0/1188387361 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb400d910 con 0x7f8cc005fc90 2022-01-24T07:00:40.797 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 -- 172.21.15.145:0/1188387361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 msgr2=0x7f8cc00600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.798 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 --2- 172.21.15.145:0/1188387361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc00600f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8cc00cd4f0 tx=0x7f8cb4006eb0).stop 2022-01-24T07:00:40.798 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 -- 172.21.15.145:0/1188387361 shutdown_connections 2022-01-24T07:00:40.798 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 --2- 172.21.15.145:0/1188387361 >> v2:172.21.15.142:3300/0 conn(0x7f8cc00620b0 0x7f8cc0062500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.798 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 --2- 172.21.15.145:0/1188387361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc00600f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.799 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 -- 172.21.15.145:0/1188387361 >> 172.21.15.145:0/1188387361 conn(0x7f8cc00d2ce0 msgr2=0x7f8cc00d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.799 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 -- 172.21.15.145:0/1188387361 shutdown_connections 2022-01-24T07:00:40.799 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.791+0000 7f8cc63b7700 1 -- 172.21.15.145:0/1188387361 wait complete. 2022-01-24T07:00:40.799 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.792+0000 7f8cc63b7700 1 Processor -- start 2022-01-24T07:00:40.800 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.792+0000 7f8cc63b7700 1 -- start start 2022-01-24T07:00:40.803 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.793+0000 7f8cc63b7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc0139f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.803 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.793+0000 7f8cc63b7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cc00620b0 0x7f8cc013bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.803 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.793+0000 7f8cc63b7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cc0141fb0 0x7f8cc00cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.803 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.793+0000 7f8cc63b7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc013b810 con 0x7f8cc0141fb0 2022-01-24T07:00:40.804 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.793+0000 7f8cc63b7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc013b570 con 0x7f8cc005fc90 2022-01-24T07:00:40.804 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.793+0000 7f8cc63b7700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00cb5a0 con 0x7f8cc00620b0 2022-01-24T07:00:40.804 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.793+0000 7f8cbffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc0139f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.804 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc0139f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35036/0 (socket says 172.21.15.145:35036) 2022-01-24T07:00:40.804 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 -- 172.21.15.145:0/525826496 learned_addr learned my addr 172.21.15.145:0/525826496 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.805 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbf7fe700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cc00620b0 0x7f8cc013bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.805 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cc4954700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cc0141fb0 0x7f8cc00cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.805 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 -- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cc00620b0 msgr2=0x7f8cc013bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.805 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cc00620b0 0x7f8cc013bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.806 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 -- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cc0141fb0 msgr2=0x7f8cc00cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.806 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cc0141fb0 0x7f8cc00cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.806 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 -- 172.21.15.145:0/525826496 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb400b1e0 con 0x7f8cc005fc90 2022-01-24T07:00:40.806 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbffff700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc0139f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8cb0002f30 tx=0x7f8cb0006e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.806 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbd7fa700 1 -- 172.21.15.145:0/525826496 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb0015070 con 0x7f8cc005fc90 2022-01-24T07:00:40.807 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbd7fa700 1 -- 172.21.15.145:0/525826496 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb000f970 con 0x7f8cc005fc90 2022-01-24T07:00:40.807 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc00cb840 con 0x7f8cc005fc90 2022-01-24T07:00:40.807 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cbd7fa700 1 -- 172.21.15.145:0/525826496 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb000fcd0 con 0x7f8cc005fc90 2022-01-24T07:00:40.807 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.794+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc00cbd80 con 0x7f8cc005fc90 2022-01-24T07:00:40.808 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.795+0000 7f8cbd7fa700 1 -- 172.21.15.145:0/525826496 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 2) v1 ==== 32233+0+0 (secure 0 0 0) 0x7f8cb0010470 con 0x7f8cc005fc90 2022-01-24T07:00:40.808 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.795+0000 7f8cbd7fa700 1 -- 172.21.15.145:0/525826496 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f8cb003c110 con 0x7f8cc005fc90 2022-01-24T07:00:40.808 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.795+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc005d6d0 con 0x7f8cc005fc90 2022-01-24T07:00:40.808 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.797+0000 7f8cbd7fa700 1 -- 172.21.15.145:0/525826496 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f8cb00178b0 con 0x7f8cc005fc90 2022-01-24T07:00:40.870 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.870+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "77268ca3-fb1a-4265-b96f-d348f8ad8048", "id": 6} v 0) v1 -- 0x7f8cc0057950 con 0x7f8cc005fc90 2022-01-24T07:00:40.874 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.874+0000 7f8cbd7fa700 1 -- 172.21.15.145:0/525826496 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77268ca3-fb1a-4265-b96f-d348f8ad8048", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8cb00290b0 con 0x7f8cc005fc90 2022-01-24T07:00:40.875 INFO:teuthology.orchestra.run.smithi145.stdout:6 2022-01-24T07:00:40.877 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 msgr2=0x7f8cc0139f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.877 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc0139f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8cb0002f30 tx=0x7f8cb0006e00).stop 2022-01-24T07:00:40.877 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 shutdown_connections 2022-01-24T07:00:40.877 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cc005fc90 0x7f8cc0139f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.878 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cc0141fb0 0x7f8cc00cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.878 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 --2- 172.21.15.145:0/525826496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cc00620b0 0x7f8cc013bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.878 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 >> 172.21.15.145:0/525826496 conn(0x7f8cc00d2ce0 msgr2=0x7f8cc00d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.878 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 shutdown_connections 2022-01-24T07:00:40.879 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.875+0000 7f8cc63b7700 1 -- 172.21.15.145:0/525826496 wait complete. 2022-01-24T07:00:40.885 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 5281ba5d-beaa-4023-b892-b2e460eacb5c 7 2022-01-24T07:00:40.982 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.981+0000 7f6674354700 1 Processor -- start 2022-01-24T07:00:40.983 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.982+0000 7f6674354700 1 -- start start 2022-01-24T07:00:40.986 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f6674354700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c0d0b70 0x7f666c064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.986 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f6674354700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f666c062fe0 0x7f666c0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.986 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f6674354700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666c0634b0 con 0x7f666c0cec50 2022-01-24T07:00:40.987 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f6674354700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c067b90 con 0x7f666c062fe0 2022-01-24T07:00:40.987 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f6674354700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c063750 con 0x7f666c0d0b70 2022-01-24T07:00:40.987 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66728f1700 1 --1- >> v1:172.21.15.145:6789/0 conn(0x7f666c0cec50 0x7f666c13f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.145:6789/0 says I am v1:172.21.15.145:58358/0 (socket says 172.21.15.145:58358) 2022-01-24T07:00:40.987 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66728f1700 1 -- 172.21.15.145:0/2756051972 learned_addr learned my addr 172.21.15.145:0/2756051972 (peer_addr_for_me v1:172.21.15.145:0/0) 2022-01-24T07:00:40.987 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66720f0700 1 --2- 172.21.15.145:0/2756051972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c0d0b70 0x7f666c064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.988 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66718ef700 1 --2- 172.21.15.145:0/2756051972 >> v2:172.21.15.142:3300/0 conn(0x7f666c062fe0 0x7f666c0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.988 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66710ee700 1 -- 172.21.15.145:0/2756051972 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533237462 0 0) 0x7f666c0634b0 con 0x7f666c0cec50 2022-01-24T07:00:40.988 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66710ee700 1 -- 172.21.15.145:0/2756051972 --> v1:172.21.15.145:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6654003260 con 0x7f666c0cec50 2022-01-24T07:00:40.988 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66720f0700 1 -- 172.21.15.145:0/2756051972 >> v2:172.21.15.142:3300/0 conn(0x7f666c062fe0 msgr2=0x7f666c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:40.989 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66720f0700 1 --2- 172.21.15.145:0/2756051972 >> v2:172.21.15.142:3300/0 conn(0x7f666c062fe0 0x7f666c0ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.989 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66720f0700 1 -- 172.21.15.145:0/2756051972 >> v1:172.21.15.145:6789/0 conn(0x7f666c0cec50 legacy=0x7f666c13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.989 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66720f0700 1 -- 172.21.15.145:0/2756051972 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0639f0 con 0x7f666c0d0b70 2022-01-24T07:00:40.989 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66720f0700 1 --2- 172.21.15.145:0/2756051972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c0d0b70 0x7f666c064670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6668002f70 tx=0x7f6668006df0).ready entity=mon.2 client_cookie=a7476e29e8080eeb server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.989 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66710ee700 1 -- 172.21.15.145:0/2756051972 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666800d4a0 con 0x7f666c0d0b70 2022-01-24T07:00:40.990 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66710ee700 1 -- 172.21.15.145:0/2756051972 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668000e90 con 0x7f666c0d0b70 2022-01-24T07:00:40.990 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.983+0000 7f66710ee700 1 -- 172.21.15.145:0/2756051972 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f666800d7f0 con 0x7f666c0d0b70 2022-01-24T07:00:40.990 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 -- 172.21.15.145:0/2756051972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c0d0b70 msgr2=0x7f666c064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.990 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 --2- 172.21.15.145:0/2756051972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c0d0b70 0x7f666c064670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6668002f70 tx=0x7f6668006df0).stop 2022-01-24T07:00:40.991 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 -- 172.21.15.145:0/2756051972 shutdown_connections 2022-01-24T07:00:40.991 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 --2- 172.21.15.145:0/2756051972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c0d0b70 0x7f666c064670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.991 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 --2- 172.21.15.145:0/2756051972 >> v2:172.21.15.142:3300/0 conn(0x7f666c062fe0 0x7f666c0ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.991 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 -- 172.21.15.145:0/2756051972 >> 172.21.15.145:0/2756051972 conn(0x7f666c061ea0 msgr2=0x7f666c0622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:40.991 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 -- 172.21.15.145:0/2756051972 shutdown_connections 2022-01-24T07:00:40.992 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.984+0000 7f6674354700 1 -- 172.21.15.145:0/2756051972 wait complete. 2022-01-24T07:00:40.992 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.985+0000 7f6674354700 1 Processor -- start 2022-01-24T07:00:40.992 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.985+0000 7f6674354700 1 -- start start 2022-01-24T07:00:40.995 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f6674354700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c062fe0 0x7f666c0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.995 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f6674354700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f666c0cec50 0x7f666c16c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.996 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f6674354700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f666c0d0b70 0x7f666c172dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:40.996 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f6674354700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c134860 con 0x7f666c0d0b70 2022-01-24T07:00:40.996 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f6674354700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0b62b0 con 0x7f666c0cec50 2022-01-24T07:00:40.996 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f6674354700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0b6550 con 0x7f666c062fe0 2022-01-24T07:00:40.996 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f666c0cec50 0x7f666c16c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.997 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f666c0cec50 0x7f666c16c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35048/0 (socket says 172.21.15.145:35048) 2022-01-24T07:00:40.997 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 -- 172.21.15.145:0/573153522 learned_addr learned my addr 172.21.15.145:0/573153522 (peer_addr_for_me v2:172.21.15.145:0/0) 2022-01-24T07:00:40.997 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66720f0700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c062fe0 0x7f666c0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.997 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66728f1700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f666c0d0b70 0x7f666c172dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:40.998 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 -- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c062fe0 msgr2=0x7f666c0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.998 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c062fe0 0x7f666c0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.998 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 -- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f666c0d0b70 msgr2=0x7f666c172dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:40.998 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f666c0d0b70 0x7f666c172dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:40.999 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 -- 172.21.15.145:0/573153522 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666800b180 con 0x7f666c0cec50 2022-01-24T07:00:40.999 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.986+0000 7f66718ef700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f666c0cec50 0x7f666c16c770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f665c00c000 tx=0x7f665c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:40.999 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.987+0000 7f665b7fe700 1 -- 172.21.15.145:0/573153522 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f665c010780 con 0x7f666c0cec50 2022-01-24T07:00:40.999 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.987+0000 7f665b7fe700 1 -- 172.21.15.145:0/573153522 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c00b3b0 con 0x7f666c0cec50 2022-01-24T07:00:40.999 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.987+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c0b67f0 con 0x7f666c0cec50 2022-01-24T07:00:41.000 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.987+0000 7f665b7fe700 1 -- 172.21.15.145:0/573153522 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f665c010ad0 con 0x7f666c0cec50 2022-01-24T07:00:41.000 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.987+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c172680 con 0x7f666c0cec50 2022-01-24T07:00:41.000 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.987+0000 7f665b7fe700 1 -- 172.21.15.145:0/573153522 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 2) v1 ==== 32233+0+0 (secure 0 0 0) 0x7f665c010c30 con 0x7f666c0cec50 2022-01-24T07:00:41.000 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.987+0000 7f665b7fe700 1 -- 172.21.15.145:0/573153522 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f665c03a090 con 0x7f666c0cec50 2022-01-24T07:00:41.001 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.988+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c172ae0 con 0x7f666c0cec50 2022-01-24T07:00:41.001 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:40.990+0000 7f665b7fe700 1 -- 172.21.15.145:0/573153522 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f665c0123f0 con 0x7f666c0cec50 2022-01-24T07:00:41.061 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.060+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5281ba5d-beaa-4023-b892-b2e460eacb5c", "id": 7} v 0) v1 -- 0x7f666c063c90 con 0x7f666c0cec50 2022-01-24T07:00:41.067 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.066+0000 7f665b7fe700 1 -- 172.21.15.145:0/573153522 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5281ba5d-beaa-4023-b892-b2e460eacb5c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f665c019310 con 0x7f666c0cec50 2022-01-24T07:00:41.067 INFO:teuthology.orchestra.run.smithi145.stdout:7 2022-01-24T07:00:41.068 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f666c0cec50 msgr2=0x7f666c16c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:41.069 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f666c0cec50 0x7f666c16c770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f665c00c000 tx=0x7f665c006df0).stop 2022-01-24T07:00:41.069 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 shutdown_connections 2022-01-24T07:00:41.069 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f666c0d0b70 0x7f666c172dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:41.069 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f666c062fe0 0x7f666c0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:41.070 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 --2- 172.21.15.145:0/573153522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f666c0cec50 0x7f666c16c770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:41.070 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 >> 172.21.15.145:0/573153522 conn(0x7f666c061ea0 msgr2=0x7f666c137460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:41.070 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 shutdown_connections 2022-01-24T07:00:41.070 INFO:teuthology.orchestra.run.smithi145.stderr:2022-01-24T07:00:41.067+0000 7f6674354700 1 -- 172.21.15.145:0/573153522 wait complete. 2022-01-24T07:00:41.078 INFO:tasks.ceph.osd.0:Restarting daemon 2022-01-24T07:00:41.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-01-24T07:00:41.081 INFO:tasks.ceph.osd.0:Started 2022-01-24T07:00:41.082 INFO:tasks.ceph.osd.1:Restarting daemon 2022-01-24T07:00:41.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-01-24T07:00:41.084 INFO:tasks.ceph.osd.1:Started 2022-01-24T07:00:41.085 INFO:tasks.ceph.osd.2:Restarting daemon 2022-01-24T07:00:41.085 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-01-24T07:00:41.087 INFO:tasks.ceph.osd.2:Started 2022-01-24T07:00:41.087 INFO:tasks.ceph.osd.3:Restarting daemon 2022-01-24T07:00:41.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-01-24T07:00:41.091 INFO:tasks.ceph.osd.3:Started 2022-01-24T07:00:41.091 INFO:tasks.ceph.osd.4:Restarting daemon 2022-01-24T07:00:41.092 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-01-24T07:00:41.095 INFO:tasks.ceph.osd.4:Started 2022-01-24T07:00:41.095 INFO:tasks.ceph.osd.5:Restarting daemon 2022-01-24T07:00:41.096 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-01-24T07:00:41.098 INFO:tasks.ceph.osd.5:Started 2022-01-24T07:00:41.099 INFO:tasks.ceph.osd.6:Restarting daemon 2022-01-24T07:00:41.100 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-01-24T07:00:41.102 INFO:tasks.ceph.osd.6:Started 2022-01-24T07:00:41.102 INFO:tasks.ceph.osd.7:Restarting daemon 2022-01-24T07:00:41.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-01-24T07:00:41.105 INFO:tasks.ceph.osd.7:Started 2022-01-24T07:00:41.105 INFO:tasks.ceph:Waiting for OSDs to come up 2022-01-24T07:00:41.679 INFO:tasks.ceph.osd.0.smithi142.stderr:2022-01-24T07:00:41.678+0000 7f412f380f00 -1 Falling back to public interface 2022-01-24T07:00:41.681 INFO:tasks.ceph.osd.1.smithi142.stderr:2022-01-24T07:00:41.681+0000 7f532739bf00 -1 Falling back to public interface 2022-01-24T07:00:41.685 INFO:tasks.ceph.osd.2.smithi142.stderr:2022-01-24T07:00:41.685+0000 7efe53754f00 -1 Falling back to public interface 2022-01-24T07:00:41.686 INFO:tasks.ceph.osd.3.smithi142.stderr:2022-01-24T07:00:41.686+0000 7f6914392f00 -1 Falling back to public interface 2022-01-24T07:00:41.690 INFO:tasks.ceph.osd.4.smithi145.stderr:2022-01-24T07:00:41.689+0000 7f364817bf00 -1 Falling back to public interface 2022-01-24T07:00:41.699 INFO:tasks.ceph.osd.5.smithi145.stderr:2022-01-24T07:00:41.698+0000 7f1fc1584f00 -1 Falling back to public interface 2022-01-24T07:00:41.700 INFO:tasks.ceph.osd.6.smithi145.stderr:2022-01-24T07:00:41.700+0000 7f79f83e3f00 -1 Falling back to public interface 2022-01-24T07:00:41.701 INFO:tasks.ceph.osd.7.smithi145.stderr:2022-01-24T07:00:41.700+0000 7f315e830f00 -1 Falling back to public interface 2022-01-24T07:00:41.701 INFO:tasks.ceph.osd.6.smithi145.stderr:2022-01-24T07:00:41.700+0000 7f79f2b63700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6817/0: (98) Address already in use 2022-01-24T07:00:41.913 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:42.037 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.037+0000 7fcbd101f700 1 Processor -- start 2022-01-24T07:00:42.038 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.037+0000 7fcbd101f700 1 -- start start 2022-01-24T07:00:42.040 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbd101f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbcc142330 0x7fcbcc05cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:42.041 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbd101f700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fcbcc061cd0 0x7fcbcc0d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:42.041 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbd101f700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc0d0d60 con 0x7fcbcc141f50 2022-01-24T07:00:42.041 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbd101f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc062da0 con 0x7fcbcc142330 2022-01-24T07:00:42.041 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbd101f700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc0620b0 con 0x7fcbcc061cd0 2022-01-24T07:00:42.042 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbca59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbcc142330 0x7fcbcc05cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:42.042 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbca59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcbcc142330 0x7fcbcc05cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49992/0 (socket says 172.21.15.142:49992) 2022-01-24T07:00:42.042 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.038+0000 7fcbca59c700 1 -- 172.21.15.142:0/4090211904 learned_addr learned my addr 172.21.15.142:0/4090211904 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:42.042 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbcb59e700 1 --2- 172.21.15.142:0/4090211904 >> v2:172.21.15.145:3300/0 conn(0x7fcbcc061cd0 0x7fcbcc0d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:42.042 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbca59c700 1 -- 172.21.15.142:0/4090211904 >> v2:172.21.15.145:3300/0 conn(0x7fcbcc061cd0 msgr2=0x7fcbcc0d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:42.043 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbca59c700 1 --2- 172.21.15.142:0/4090211904 >> v2:172.21.15.145:3300/0 conn(0x7fcbcc061cd0 0x7fcbcc0d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:42.043 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbca59c700 1 -- 172.21.15.142:0/4090211904 >> v1:172.21.15.145:6789/0 conn(0x7fcbcc141f50 legacy=0x7fcbcc05c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:42.043 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbca59c700 1 -- 172.21.15.142:0/4090211904 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc062320 con 0x7fcbcc142330 2022-01-24T07:00:42.043 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbca59c700 1 --2- 172.21.15.142:0/4090211904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc05cb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcbc0002f70 tx=0x7fcbc0006eb0).ready entity=mon.0 client_cookie=a9c5ae113b3b493 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:42.044 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbc9d9b700 1 -- 172.21.15.142:0/4090211904 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc000d5c0 con 0x7fcbcc142330 2022-01-24T07:00:42.044 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbc9d9b700 1 -- 172.21.15.142:0/4090211904 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0000e90 con 0x7fcbcc142330 2022-01-24T07:00:42.044 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.039+0000 7fcbc9d9b700 1 -- 172.21.15.142:0/4090211904 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc000d950 con 0x7fcbcc142330 2022-01-24T07:00:42.045 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 -- 172.21.15.142:0/4090211904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 msgr2=0x7fcbcc05cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:42.045 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 --2- 172.21.15.142:0/4090211904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc05cb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcbc0002f70 tx=0x7fcbc0006eb0).stop 2022-01-24T07:00:42.045 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 -- 172.21.15.142:0/4090211904 shutdown_connections 2022-01-24T07:00:42.045 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 --2- 172.21.15.142:0/4090211904 >> v2:172.21.15.145:3300/0 conn(0x7fcbcc061cd0 0x7fcbcc0d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:42.045 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 --2- 172.21.15.142:0/4090211904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc05cb50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:42.046 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 -- 172.21.15.142:0/4090211904 >> 172.21.15.142:0/4090211904 conn(0x7fcbcc0d2d50 msgr2=0x7fcbcc0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:42.046 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 -- 172.21.15.142:0/4090211904 shutdown_connections 2022-01-24T07:00:42.046 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.040+0000 7fcbd101f700 1 -- 172.21.15.142:0/4090211904 wait complete. 2022-01-24T07:00:42.049 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.041+0000 7fcbd101f700 1 Processor -- start 2022-01-24T07:00:42.049 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.041+0000 7fcbd101f700 1 -- start start 2022-01-24T07:00:42.049 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbcc061cd0 0x7fcbcc170b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:42.050 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbcc141f50 0x7fcbcc0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:42.050 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:42.050 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0d0460 con 0x7fcbcc142330 2022-01-24T07:00:42.051 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0cfce0 con 0x7fcbcc141f50 2022-01-24T07:00:42.051 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0b8c90 con 0x7fcbcc061cd0 2022-01-24T07:00:42.051 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:42.051 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50000/0 (socket says 172.21.15.142:50000) 2022-01-24T07:00:42.051 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 -- 172.21.15.142:0/25398500 learned_addr learned my addr 172.21.15.142:0/25398500 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:42.052 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbca59c700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbcc141f50 0x7fcbcc0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:42.052 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 -- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbcc061cd0 msgr2=0x7fcbcc170b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:42.052 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbcc061cd0 0x7fcbcc170b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-24T07:00:42.052 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 -- 172.21.15.142:0/25398500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbcc141f50 msgr2=0x7fcbcc0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:42.053 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbcc141f50 0x7fcbcc0cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:42.053 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 -- 172.21.15.142:0/25398500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc000b1e0 con 0x7fcbcc142330 2022-01-24T07:00:42.053 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbcb59e700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc160270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcbc4006e00 tx=0x7fcbc40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:42.053 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbbbfff700 1 -- 172.21.15.142:0/25398500 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc400c610 con 0x7fcbcc142330 2022-01-24T07:00:42.054 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbbbfff700 1 -- 172.21.15.142:0/25398500 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400c770 con 0x7fcbcc142330 2022-01-24T07:00:42.054 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc0cff20 con 0x7fcbcc142330 2022-01-24T07:00:42.054 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc170130 con 0x7fcbcc142330 2022-01-24T07:00:42.054 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.042+0000 7fcbbbfff700 1 -- 172.21.15.142:0/25398500 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc400cad0 con 0x7fcbcc142330 2022-01-24T07:00:42.055 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.043+0000 7fcbbbfff700 1 -- 172.21.15.142:0/25398500 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 3) v1 ==== 64570+0+0 (secure 0 0 0) 0x7fcbc400cc30 con 0x7fcbcc142330 2022-01-24T07:00:42.055 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.043+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac003410 con 0x7fcbcc142330 2022-01-24T07:00:42.055 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.044+0000 7fcbbbfff700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fcba8052aa0 0x7fcba8054f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:42.055 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.044+0000 7fcbbbfff700 1 -- 172.21.15.142:0/25398500 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2074+0+0 (secure 0 0 0) 0x7fcbc4069b90 con 0x7fcbcc142330 2022-01-24T07:00:42.056 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.044+0000 7fcbcad9d700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fcba8052aa0 0x7fcba8054f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:42.056 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.044+0000 7fcbcad9d700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fcba8052aa0 0x7fcba8054f60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fcbcc0cd5e0 tx=0x7fcbbc007810).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:42.056 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.048+0000 7fcbbbfff700 1 -- 172.21.15.142:0/25398500 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fcbc40422d0 con 0x7fcbcc142330 2022-01-24T07:00:42.180 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.180+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbac0036c0 con 0x7fcbcc142330 2022-01-24T07:00:42.181 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.181+0000 7fcbbbfff700 1 -- 172.21.15.142:0/25398500 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+8274 (secure 0 0 0) 0x7fcbc40458f0 con 0x7fcbcc142330 2022-01-24T07:00:42.182 INFO:teuthology.misc.health.smithi142.stdout: 2022-01-24T07:00:42.182 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":10,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:41.062963+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"7","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:42.184 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fcba8052aa0 msgr2=0x7fcba8054f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:42.184 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fcba8052aa0 0x7fcba8054f60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fcbcc0cd5e0 tx=0x7fcbbc007810).stop 2022-01-24T07:00:42.184 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 msgr2=0x7fcbcc160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:42.184 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc160270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcbc4006e00 tx=0x7fcbc40091d0).stop 2022-01-24T07:00:42.185 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 shutdown_connections 2022-01-24T07:00:42.185 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fcba8052aa0 0x7fcba8054f60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:42.185 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbcc142330 0x7fcbcc160270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:42.186 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbcc061cd0 0x7fcbcc170b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-24T07:00:42.186 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 --2- 172.21.15.142:0/25398500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbcc141f50 0x7fcbcc0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:42.186 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 >> 172.21.15.142:0/25398500 conn(0x7fcbcc0d2d50 msgr2=0x7fcbcc0d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:42.186 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 shutdown_connections 2022-01-24T07:00:42.187 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:42.182+0000 7fcbd101f700 1 -- 172.21.15.142:0/25398500 wait complete. 2022-01-24T07:00:42.192 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-01-24T07:00:42.743 INFO:tasks.ceph.osd.0.smithi142.stderr:2022-01-24T07:00:42.743+0000 7f412f380f00 -1 osd.0 0 log_to_monitors {default=true} 2022-01-24T07:00:42.754 INFO:tasks.ceph.osd.4.smithi145.stderr:2022-01-24T07:00:42.754+0000 7f364817bf00 -1 osd.4 0 log_to_monitors {default=true} 2022-01-24T07:00:42.771 INFO:tasks.ceph.osd.1.smithi142.stderr:2022-01-24T07:00:42.771+0000 7f532739bf00 -1 osd.1 0 log_to_monitors {default=true} 2022-01-24T07:00:42.778 INFO:tasks.ceph.osd.3.smithi142.stderr:2022-01-24T07:00:42.778+0000 7f6914392f00 -1 osd.3 0 log_to_monitors {default=true} 2022-01-24T07:00:42.782 INFO:tasks.ceph.osd.5.smithi145.stderr:2022-01-24T07:00:42.781+0000 7f1fc1584f00 -1 osd.5 0 log_to_monitors {default=true} 2022-01-24T07:00:42.782 INFO:tasks.ceph.osd.2.smithi142.stderr:2022-01-24T07:00:42.782+0000 7efe53754f00 -1 osd.2 0 log_to_monitors {default=true} 2022-01-24T07:00:42.791 INFO:tasks.ceph.osd.6.smithi145.stderr:2022-01-24T07:00:42.791+0000 7f79f83e3f00 -1 osd.6 0 log_to_monitors {default=true} 2022-01-24T07:00:42.799 INFO:tasks.ceph.osd.7.smithi145.stderr:2022-01-24T07:00:42.798+0000 7f315e830f00 -1 osd.7 0 log_to_monitors {default=true} 2022-01-24T07:00:43.774 INFO:tasks.ceph.osd.4.smithi145.stderr:2022-01-24T07:00:43.773+0000 7f3630660700 -1 osd.4 0 waiting for initial osdmap 2022-01-24T07:00:43.776 INFO:tasks.ceph.osd.0.smithi142.stderr:2022-01-24T07:00:43.776+0000 7f4117865700 -1 osd.0 0 waiting for initial osdmap 2022-01-24T07:00:43.778 INFO:tasks.ceph.osd.4.smithi145.stderr:2022-01-24T07:00:43.778+0000 7f363c07d700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:43.782 INFO:tasks.ceph.osd.0.smithi142.stderr:2022-01-24T07:00:43.782+0000 7f4123282700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:44.789 INFO:tasks.ceph.osd.5.smithi145.stderr:2022-01-24T07:00:44.788+0000 7f1fa9a69700 -1 osd.5 0 waiting for initial osdmap 2022-01-24T07:00:44.789 INFO:tasks.ceph.osd.6.smithi145.stderr:2022-01-24T07:00:44.788+0000 7f79e08c8700 -1 osd.6 0 waiting for initial osdmap 2022-01-24T07:00:44.790 INFO:tasks.ceph.osd.2.smithi142.stderr:2022-01-24T07:00:44.788+0000 7efe3bc39700 -1 osd.2 0 waiting for initial osdmap 2022-01-24T07:00:44.793 INFO:tasks.ceph.osd.7.smithi145.stderr:2022-01-24T07:00:44.793+0000 7f3146d15700 -1 osd.7 0 waiting for initial osdmap 2022-01-24T07:00:44.794 INFO:tasks.ceph.osd.3.smithi142.stderr:2022-01-24T07:00:44.794+0000 7f68fc877700 -1 osd.3 0 waiting for initial osdmap 2022-01-24T07:00:44.794 INFO:tasks.ceph.osd.1.smithi142.stderr:2022-01-24T07:00:44.794+0000 7f530f880700 -1 osd.1 0 waiting for initial osdmap 2022-01-24T07:00:44.796 INFO:tasks.ceph.osd.6.smithi145.stderr:2022-01-24T07:00:44.795+0000 7f79ec2e5700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:44.796 INFO:tasks.ceph.osd.2.smithi142.stderr:2022-01-24T07:00:44.796+0000 7efe47656700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:44.799 INFO:tasks.ceph.osd.5.smithi145.stderr:2022-01-24T07:00:44.799+0000 7f1fb5486700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:44.800 INFO:tasks.ceph.osd.7.smithi145.stderr:2022-01-24T07:00:44.800+0000 7f3152732700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:44.802 INFO:tasks.ceph.osd.3.smithi142.stderr:2022-01-24T07:00:44.801+0000 7f6908294700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:44.802 INFO:tasks.ceph.osd.1.smithi142.stderr:2022-01-24T07:00:44.802+0000 7f531b29d700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-24T07:00:49.000 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:49.102 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.101+0000 7f50144f4700 1 Processor -- start 2022-01-24T07:00:49.102 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.101+0000 7f50144f4700 1 -- start start 2022-01-24T07:00:49.115 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.102+0000 7f50144f4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f500c0d0e20 0x7f500c05b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.116 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.102+0000 7f50144f4700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f500c05be90 0x7f500c05c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.116 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.102+0000 7f50144f4700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c062420 con 0x7f500c066ab0 2022-01-24T07:00:49.117 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.102+0000 7f50144f4700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0626c0 con 0x7f500c0d0e20 2022-01-24T07:00:49.117 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.102+0000 7f50144f4700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c062960 con 0x7f500c05be90 2022-01-24T07:00:49.118 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.102+0000 7f5012290700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f500c0d0e20 0x7f500c05b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.118 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012290700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f500c0d0e20 0x7f500c05b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50214/0 (socket says 172.21.15.142:50214) 2022-01-24T07:00:49.119 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012290700 1 -- 172.21.15.142:0/699590531 learned_addr learned my addr 172.21.15.142:0/699590531 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:49.119 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012290700 1 -- 172.21.15.142:0/699590531 >> v2:172.21.15.145:3300/0 conn(0x7f500c05be90 msgr2=0x7f500c05c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:49.119 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012a91700 1 --2- 172.21.15.142:0/699590531 >> v2:172.21.15.145:3300/0 conn(0x7f500c05be90 0x7f500c05c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.120 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012290700 1 --2- 172.21.15.142:0/699590531 >> v2:172.21.15.145:3300/0 conn(0x7f500c05be90 0x7f500c05c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.120 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012290700 1 -- 172.21.15.142:0/699590531 >> v1:172.21.15.145:6789/0 conn(0x7f500c066ab0 legacy=0x7f500c066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:49.121 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012290700 1 -- 172.21.15.142:0/699590531 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c062c00 con 0x7f500c0d0e20 2022-01-24T07:00:49.121 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f5012290700 1 --2- 172.21.15.142:0/699590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c05b5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f500c0634c0 tx=0x7f5008006eb0).ready entity=mon.0 client_cookie=cff5522425f59035 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.122 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f501128e700 1 -- 172.21.15.142:0/699590531 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500800d5c0 con 0x7f500c0d0e20 2022-01-24T07:00:49.122 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f501128e700 1 -- 172.21.15.142:0/699590531 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008000e90 con 0x7f500c0d0e20 2022-01-24T07:00:49.123 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.103+0000 7f501128e700 1 -- 172.21.15.142:0/699590531 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500800d910 con 0x7f500c0d0e20 2022-01-24T07:00:49.123 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 -- 172.21.15.142:0/699590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 msgr2=0x7f500c05b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.124 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 --2- 172.21.15.142:0/699590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c05b5d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f500c0634c0 tx=0x7f5008006eb0).stop 2022-01-24T07:00:49.124 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 -- 172.21.15.142:0/699590531 shutdown_connections 2022-01-24T07:00:49.125 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 --2- 172.21.15.142:0/699590531 >> v2:172.21.15.145:3300/0 conn(0x7f500c05be90 0x7f500c05c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.125 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 --2- 172.21.15.142:0/699590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c05b5d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.126 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 -- 172.21.15.142:0/699590531 >> 172.21.15.142:0/699590531 conn(0x7f500c065db0 msgr2=0x7f500c0661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:49.126 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 -- 172.21.15.142:0/699590531 shutdown_connections 2022-01-24T07:00:49.127 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.104+0000 7f50144f4700 1 -- 172.21.15.142:0/699590531 wait complete. 2022-01-24T07:00:49.127 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.105+0000 7f50144f4700 1 Processor -- start 2022-01-24T07:00:49.128 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.105+0000 7f50144f4700 1 -- start start 2022-01-24T07:00:49.128 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c05be90 0x7f500c1730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.128 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c066ab0 0x7f500c160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.129 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c170490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.129 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c15e7a0 con 0x7f500c0d0e20 2022-01-24T07:00:49.130 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c15e260 con 0x7f500c05be90 2022-01-24T07:00:49.130 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c15e500 con 0x7f500c066ab0 2022-01-24T07:00:49.131 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c170490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.131 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5011a8f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c066ab0 0x7f500c160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.132 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c170490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50224/0 (socket says 172.21.15.142:50224) 2022-01-24T07:00:49.132 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 -- 172.21.15.142:0/149548061 learned_addr learned my addr 172.21.15.142:0/149548061 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:49.133 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012290700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c05be90 0x7f500c1730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.133 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 -- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c066ab0 msgr2=0x7f500c160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.134 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c066ab0 0x7f500c160210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.134 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 -- 172.21.15.142:0/149548061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c05be90 msgr2=0x7f500c1730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.135 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c05be90 0x7f500c1730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.135 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 -- 172.21.15.142:0/149548061 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500800b1e0 con 0x7f500c0d0e20 2022-01-24T07:00:49.136 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5011a8f700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c066ab0 0x7f500c160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:49.136 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f5012a91700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c170490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5004007000 tx=0x7f5004008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.137 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f4ffb7fe700 1 -- 172.21.15.142:0/149548061 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50040105e0 con 0x7f500c0d0e20 2022-01-24T07:00:49.137 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f4ffb7fe700 1 -- 172.21.15.142:0/149548061 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5004010740 con 0x7f500c0d0e20 2022-01-24T07:00:49.137 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c172710 con 0x7f500c0d0e20 2022-01-24T07:00:49.138 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f4ffb7fe700 1 -- 172.21.15.142:0/149548061 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50040108b0 con 0x7f500c0d0e20 2022-01-24T07:00:49.138 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.106+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c172c50 con 0x7f500c0d0e20 2022-01-24T07:00:49.139 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.108+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c172e10 con 0x7f500c0d0e20 2022-01-24T07:00:49.139 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.108+0000 7f4ffb7fe700 1 -- 172.21.15.142:0/149548061 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f5004010a10 con 0x7f500c0d0e20 2022-01-24T07:00:49.140 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.108+0000 7f4ffb7fe700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4fec052ab0 0x7f4fec054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.140 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.108+0000 7f4ffb7fe700 1 -- 172.21.15.142:0/149548061 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f500406a590 con 0x7f500c0d0e20 2022-01-24T07:00:49.141 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.108+0000 7f5012290700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4fec052ab0 0x7f4fec054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.141 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.108+0000 7f5012290700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4fec052ab0 0x7f4fec054f70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f500801c000 tx=0x7f5008015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.142 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.112+0000 7f4ffb7fe700 1 -- 172.21.15.142:0/149548061 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f5004042140 con 0x7f500c0d0e20 2022-01-24T07:00:49.241 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.241+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f500c062ea0 con 0x7f500c0d0e20 2022-01-24T07:00:49.243 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.242+0000 7f4ffb7fe700 1 -- 172.21.15.142:0/149548061 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11902 (secure 0 0 0) 0x7f5004045760 con 0x7f500c0d0e20 2022-01-24T07:00:49.244 INFO:teuthology.misc.health.smithi142.stdout: 2022-01-24T07:00:49.244 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":16,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:47.796132+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:49.247 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4fec052ab0 msgr2=0x7f4fec054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.248 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4fec052ab0 0x7f4fec054f70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f500801c000 tx=0x7f5008015000).stop 2022-01-24T07:00:49.248 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 msgr2=0x7f500c170490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.249 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c170490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5004007000 tx=0x7f5004008040).stop 2022-01-24T07:00:49.249 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 shutdown_connections 2022-01-24T07:00:49.249 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c05be90 0x7f500c1730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.250 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4fec052ab0 0x7f4fec054f70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.250 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c0d0e20 0x7f500c170490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.251 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 --2- 172.21.15.142:0/149548061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c066ab0 0x7f500c160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.251 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 >> 172.21.15.142:0/149548061 conn(0x7f500c065db0 msgr2=0x7f500c05c300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:49.252 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 shutdown_connections 2022-01-24T07:00:49.252 INFO:teuthology.misc.health.smithi142.stderr:2022-01-24T07:00:49.244+0000 7f50144f4700 1 -- 172.21.15.142:0/149548061 wait complete. 2022-01-24T07:00:49.255 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-01-24T07:00:49.256 INFO:tasks.ceph:Creating RBD pool 2022-01-24T07:00:49.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool create rbd 8 2022-01-24T07:00:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.355+0000 7fa9eb4f6700 1 Processor -- start 2022-01-24T07:00:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.355+0000 7fa9eb4f6700 1 -- start start 2022-01-24T07:00:49.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9eb4f6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa9e4145240 0x7fa9e4061cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9eb4f6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9e4145620 0x7fa9e40603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9eb4f6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e40cdc00 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9eb4f6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e40cdea0 con 0x7fa9e4145620 2022-01-24T07:00:49.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9eb4f6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e40ce140 con 0x7fa9e4145240 2022-01-24T07:00:49.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e9a93700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9e4145620 0x7fa9e40603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e8a91700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa9e40cd6c0 0x7fa9e405fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47596/0 (socket says 172.21.15.142:47596) 2022-01-24T07:00:49.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e8a91700 1 -- 172.21.15.142:0/2770031854 learned_addr learned my addr 172.21.15.142:0/2770031854 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e9292700 1 --2- 172.21.15.142:0/2770031854 >> v2:172.21.15.145:3300/0 conn(0x7fa9e4145240 0x7fa9e4061cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e9a93700 1 -- 172.21.15.142:0/2770031854 >> v2:172.21.15.145:3300/0 conn(0x7fa9e4145240 msgr2=0x7fa9e4061cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e9a93700 1 --2- 172.21.15.142:0/2770031854 >> v2:172.21.15.145:3300/0 conn(0x7fa9e4145240 0x7fa9e4061cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e9a93700 1 -- 172.21.15.142:0/2770031854 >> v1:172.21.15.142:6789/0 conn(0x7fa9e40cd6c0 legacy=0x7fa9e405fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e9a93700 1 -- 172.21.15.142:0/2770031854 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e40ce3e0 con 0x7fa9e4145620 2022-01-24T07:00:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9d3fff700 1 -- 172.21.15.142:0/2770031854 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972804731 0 0) 0x7fa9e40cdc00 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.356+0000 7fa9e9292700 1 --2- 172.21.15.142:0/2770031854 >> v2:172.21.15.145:3300/0 conn(0x7fa9e4145240 0x7fa9e4061cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9e9a93700 1 --2- 172.21.15.142:0/2770031854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40603a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa9dc0032f0 tx=0x7fa9dc0091d0).ready entity=mon.0 client_cookie=8c8085536162a04d server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.363 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9d3fff700 1 -- 172.21.15.142:0/2770031854 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9dc009ea0 con 0x7fa9e4145620 2022-01-24T07:00:49.363 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9d3fff700 1 -- 172.21.15.142:0/2770031854 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00b870 con 0x7fa9e4145620 2022-01-24T07:00:49.363 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9d3fff700 1 -- 172.21.15.142:0/2770031854 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9dc00b9e0 con 0x7fa9e4145620 2022-01-24T07:00:49.363 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/2770031854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 msgr2=0x7fa9e40603a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.364 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/2770031854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40603a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa9dc0032f0 tx=0x7fa9dc0091d0).stop 2022-01-24T07:00:49.364 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/2770031854 shutdown_connections 2022-01-24T07:00:49.364 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/2770031854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40603a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.364 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/2770031854 >> v2:172.21.15.145:3300/0 conn(0x7fa9e4145240 0x7fa9e4061cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/2770031854 >> 172.21.15.142:0/2770031854 conn(0x7fa9e40d2d20 msgr2=0x7fa9e40d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/2770031854 shutdown_connections 2022-01-24T07:00:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.357+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/2770031854 wait complete. 2022-01-24T07:00:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.358+0000 7fa9eb4f6700 1 Processor -- start 2022-01-24T07:00:49.366 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.358+0000 7fa9eb4f6700 1 -- start start 2022-01-24T07:00:49.369 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9eb4f6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9e40cd6c0 0x7fa9e40d3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.369 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9eb4f6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9e4145240 0x7fa9e4062fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9eb4f6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9eb4f6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e41723c0 con 0x7fa9e4145620 2022-01-24T07:00:49.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9eb4f6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4172660 con 0x7fa9e4145240 2022-01-24T07:00:49.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9eb4f6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4172900 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9e9292700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9e40cd6c0 0x7fa9e40d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9e9a93700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9e9292700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9e40cd6c0 0x7fa9e40d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:52996/0 (socket says 172.21.15.142:52996) 2022-01-24T07:00:49.372 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9e9a93700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50238/0 (socket says 172.21.15.142:50238) 2022-01-24T07:00:49.372 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9e9292700 1 -- 172.21.15.142:0/998389582 learned_addr learned my addr 172.21.15.142:0/998389582 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:49.372 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.359+0000 7fa9e8a91700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9e4145240 0x7fa9e4062fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.372 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9e9292700 1 -- 172.21.15.142:0/998389582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9e4145240 msgr2=0x7fa9e4062fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.372 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9e9292700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9e4145240 0x7fa9e4062fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.373 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9e9292700 1 -- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 msgr2=0x7fa9e40634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.373 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9e9292700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.373 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9e9292700 1 -- 172.21.15.142:0/998389582 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc009470 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.373 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9e9a93700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:49.374 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9e9292700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9e40cd6c0 0x7fa9e40d3480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa9e0006940 tx=0x7fa9e0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.374 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9d27fc700 1 -- 172.21.15.142:0/998389582 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e0011850 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.374 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9d27fc700 1 -- 172.21.15.142:0/998389582 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e00119b0 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.374 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e4172ba0 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9d27fc700 1 -- 172.21.15.142:0/998389582 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e0011d10 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.360+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e40d3970 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.361+0000 7fa9d27fc700 1 -- 172.21.15.142:0/998389582 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fa9e001c460 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.375 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.361+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e4173000 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.361+0000 7fa9d27fc700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa9c4052b70 0x7fa9c4055030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.361+0000 7fa9d27fc700 1 -- 172.21.15.142:0/998389582 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fa9e006ab50 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.361+0000 7fa9e8a91700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa9c4052b70 0x7fa9c4055030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.376 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.362+0000 7fa9e8a91700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa9c4052b70 0x7fa9c4055030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa9d400b000 tx=0x7fa9d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.377 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.365+0000 7fa9d27fc700 1 -- 172.21.15.142:0/998389582 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fa9e00426a0 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.494 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.494+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fa9e40ce680 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.813 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.813+0000 7fa9d27fc700 1 -- 172.21.15.142:0/998389582 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fa9e0045cc0 con 0x7fa9e40cd6c0 2022-01-24T07:00:49.815 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa9c4052b70 msgr2=0x7fa9c4055030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.815 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa9c4052b70 0x7fa9c4055030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa9d400b000 tx=0x7fa9d4009040).stop 2022-01-24T07:00:49.816 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9e40cd6c0 msgr2=0x7fa9e40d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.816 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9e40cd6c0 0x7fa9e40d3480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa9e0006940 tx=0x7fa9e0008040).stop 2022-01-24T07:00:49.817 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 shutdown_connections 2022-01-24T07:00:49.817 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa9c4052b70 0x7fa9c4055030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.818 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9e4145620 0x7fa9e40634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.818 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9e40cd6c0 0x7fa9e40d3480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.818 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 --2- 172.21.15.142:0/998389582 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa9e4145240 0x7fa9e4062fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.818 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.815+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 >> 172.21.15.142:0/998389582 conn(0x7fa9e40d2d20 msgr2=0x7fa9e41617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.816+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 shutdown_connections 2022-01-24T07:00:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.816+0000 7fa9eb4f6700 1 -- 172.21.15.142:0/998389582 wait complete. 2022-01-24T07:00:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'rbd' created 2022-01-24T07:00:49.828 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-01-24T07:00:49.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.930+0000 7f86231b0700 1 Processor -- start 2022-01-24T07:00:49.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.930+0000 7f86231b0700 1 -- start start 2022-01-24T07:00:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f86231b0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c148db0 0x7f861c160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f86231b0700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f861c061560 0x7f861c15f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f86231b0700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f861c15fd50 0x7f861c0662b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f86231b0700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c1601e0 con 0x7f861c15fd50 2022-01-24T07:00:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f86231b0700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c149190 con 0x7f861c061560 2022-01-24T07:00:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f86231b0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c160430 con 0x7f861c148db0 2022-01-24T07:00:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c148db0 0x7f861c160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f862174d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f861c15fd50 0x7f861c0662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f862174d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f861c15fd50 0x7f861c0662b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50242/0 (socket says 172.21.15.142:50242) 2022-01-24T07:00:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c148db0 0x7f861c160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53008/0 (socket says 172.21.15.142:53008) 2022-01-24T07:00:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f862174d700 1 -- 172.21.15.142:0/3193961037 learned_addr learned my addr 172.21.15.142:0/3193961037 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f861bfff700 1 --2- 172.21.15.142:0/3193961037 >> v2:172.21.15.145:3300/0 conn(0x7f861c061560 0x7f861c15f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 -- 172.21.15.142:0/3193961037 >> v2:172.21.15.145:3300/0 conn(0x7f861c061560 msgr2=0x7f861c15f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 --2- 172.21.15.142:0/3193961037 >> v2:172.21.15.145:3300/0 conn(0x7f861c061560 0x7f861c15f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 -- 172.21.15.142:0/3193961037 >> v2:172.21.15.142:3300/0 conn(0x7f861c15fd50 msgr2=0x7f861c0662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 --2- 172.21.15.142:0/3193961037 >> v2:172.21.15.142:3300/0 conn(0x7f861c15fd50 0x7f861c0662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 -- 172.21.15.142:0/3193961037 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c1606d0 con 0x7f861c148db0 2022-01-24T07:00:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f862174d700 1 --2- 172.21.15.142:0/3193961037 >> v2:172.21.15.142:3300/0 conn(0x7f861c15fd50 0x7f861c0662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f8620f4c700 1 --2- 172.21.15.142:0/3193961037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c148db0 0x7f861c160cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f860c002f70 tx=0x7f860c006df0).ready entity=mon.2 client_cookie=ea285b1cd64dae0f server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f861b7fe700 1 -- 172.21.15.142:0/3193961037 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f860c00d570 con 0x7f861c148db0 2022-01-24T07:00:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f861b7fe700 1 -- 172.21.15.142:0/3193961037 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c000e90 con 0x7f861c148db0 2022-01-24T07:00:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.931+0000 7f861b7fe700 1 -- 172.21.15.142:0/3193961037 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f860c00d8c0 con 0x7f861c148db0 2022-01-24T07:00:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 -- 172.21.15.142:0/3193961037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c148db0 msgr2=0x7f861c160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 --2- 172.21.15.142:0/3193961037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c148db0 0x7f861c160cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f860c002f70 tx=0x7f860c006df0).stop 2022-01-24T07:00:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 -- 172.21.15.142:0/3193961037 shutdown_connections 2022-01-24T07:00:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 --2- 172.21.15.142:0/3193961037 >> v2:172.21.15.142:3300/0 conn(0x7f861c15fd50 0x7f861c0662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 --2- 172.21.15.142:0/3193961037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c148db0 0x7f861c160cd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 --2- 172.21.15.142:0/3193961037 >> v2:172.21.15.145:3300/0 conn(0x7f861c061560 0x7f861c15f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 -- 172.21.15.142:0/3193961037 >> 172.21.15.142:0/3193961037 conn(0x7f861c06bcf0 msgr2=0x7f861c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 -- 172.21.15.142:0/3193961037 shutdown_connections 2022-01-24T07:00:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.932+0000 7f86231b0700 1 -- 172.21.15.142:0/3193961037 wait complete. 2022-01-24T07:00:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.933+0000 7f86231b0700 1 Processor -- start 2022-01-24T07:00:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.933+0000 7f86231b0700 1 -- start start 2022-01-24T07:00:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f86231b0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f861c061560 0x7f861c15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f86231b0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f861c148db0 0x7f861c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f86231b0700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c15fd50 0x7f861c0d6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f86231b0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c1444c0 con 0x7f861c148db0 2022-01-24T07:00:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f86231b0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c15eb80 con 0x7f861c061560 2022-01-24T07:00:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f86231b0700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0ca2c0 con 0x7f861c15fd50 2022-01-24T07:00:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f861c148db0 0x7f861c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f861c148db0 0x7f861c0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50248/0 (socket says 172.21.15.142:50248) 2022-01-24T07:00:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 -- 172.21.15.142:0/4143691673 learned_addr learned my addr 172.21.15.142:0/4143691673 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:49.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f862174d700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c15fd50 0x7f861c0d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f8620f4c700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f861c061560 0x7f861c15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 -- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c15fd50 msgr2=0x7f861c0d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c15fd50 0x7f861c0d6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 -- 172.21.15.142:0/4143691673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f861c061560 msgr2=0x7f861c15e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:49.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f861c061560 0x7f861c15e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:49.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 -- 172.21.15.142:0/4143691673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614009530 con 0x7f861c148db0 2022-01-24T07:00:49.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.934+0000 7f861bfff700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f861c148db0 0x7f861c0c9dd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f861c0bb7f0 tx=0x7f8604008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.935+0000 7f8619ffb700 1 -- 172.21.15.142:0/4143691673 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8604011780 con 0x7f861c148db0 2022-01-24T07:00:49.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.935+0000 7f8619ffb700 1 -- 172.21.15.142:0/4143691673 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86040118e0 con 0x7f861c148db0 2022-01-24T07:00:49.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.935+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c00b180 con 0x7f861c148db0 2022-01-24T07:00:49.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.935+0000 7f8619ffb700 1 -- 172.21.15.142:0/4143691673 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8604011c40 con 0x7f861c148db0 2022-01-24T07:00:49.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.935+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c15edc0 con 0x7f861c148db0 2022-01-24T07:00:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.936+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c15f4c0 con 0x7f861c148db0 2022-01-24T07:00:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.936+0000 7f8619ffb700 1 -- 172.21.15.142:0/4143691673 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f8604012420 con 0x7f861c148db0 2022-01-24T07:00:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.936+0000 7f8619ffb700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8600052ab0 0x7f8600054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.936+0000 7f8619ffb700 1 -- 172.21.15.142:0/4143691673 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f860406a590 con 0x7f861c148db0 2022-01-24T07:00:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.936+0000 7f8620f4c700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8600052ab0 0x7f8600054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.937+0000 7f8620f4c700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8600052ab0 0x7f8600054f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f860c01a000 tx=0x7f860c014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:49.952 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:49.940+0000 7f8619ffb700 1 -- 172.21.15.142:0/4143691673 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f8604041ef0 con 0x7f861c148db0 2022-01-24T07:00:50.070 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.070+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f861c060b80 con 0x7f861c148db0 2022-01-24T07:00:50.819 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.818+0000 7f8619ffb700 1 -- 172.21.15.142:0/4143691673 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f860400dea0 con 0x7f861c148db0 2022-01-24T07:00:50.821 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8600052ab0 msgr2=0x7f8600054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:50.822 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8600052ab0 0x7f8600054f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f860c01a000 tx=0x7f860c014000).stop 2022-01-24T07:00:50.822 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f861c148db0 msgr2=0x7f861c0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:50.822 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f861c148db0 0x7f861c0c9dd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f861c0bb7f0 tx=0x7f8604008040).stop 2022-01-24T07:00:50.823 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 shutdown_connections 2022-01-24T07:00:50.823 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f861c061560 0x7f861c15e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.823 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8600052ab0 0x7f8600054f70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.823 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f861c15fd50 0x7f861c0d6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.824 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 --2- 172.21.15.142:0/4143691673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f861c148db0 0x7f861c0c9dd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.824 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.821+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 >> 172.21.15.142:0/4143691673 conn(0x7f861c06bcf0 msgr2=0x7f861c0d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:50.825 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.822+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 shutdown_connections 2022-01-24T07:00:50.825 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.822+0000 7f86231b0700 1 -- 172.21.15.142:0/4143691673 wait complete. 2022-01-24T07:00:50.825 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rbd' on pool 'rbd' 2022-01-24T07:00:50.835 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-01-24T07:00:50.836 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-24T07:00:50.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-24T07:00:50.839 INFO:tasks.ceph.mds.a:Started 2022-01-24T07:00:50.839 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-24T07:00:50.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-24T07:00:50.842 INFO:tasks.ceph.mds.b:Started 2022-01-24T07:00:50.842 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-24T07:00:50.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-24T07:00:50.845 INFO:tasks.ceph.mds.c:Started 2022-01-24T07:00:50.845 INFO:tasks.ceph.mds.d:Restarting daemon 2022-01-24T07:00:50.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-01-24T07:00:50.848 INFO:tasks.ceph.mds.d:Started 2022-01-24T07:00:50.848 INFO:tasks.ceph.mds.e:Restarting daemon 2022-01-24T07:00:50.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2022-01-24T07:00:50.852 INFO:tasks.ceph.mds.e:Started 2022-01-24T07:00:50.852 INFO:tasks.ceph.mds.f:Restarting daemon 2022-01-24T07:00:50.852 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2022-01-24T07:00:50.855 INFO:tasks.ceph.mds.f:Started 2022-01-24T07:00:50.855 INFO:tasks.ceph.mds.g:Restarting daemon 2022-01-24T07:00:50.856 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i g 2022-01-24T07:00:50.858 INFO:tasks.ceph.mds.g:Started 2022-01-24T07:00:50.858 INFO:tasks.ceph.mds.h:Restarting daemon 2022-01-24T07:00:50.859 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i h 2022-01-24T07:00:50.861 INFO:tasks.ceph.mds.h:Started 2022-01-24T07:00:50.861 INFO:tasks.ceph.mds.i:Restarting daemon 2022-01-24T07:00:50.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i i 2022-01-24T07:00:50.865 INFO:tasks.ceph.mds.i:Started 2022-01-24T07:00:50.865 INFO:tasks.ceph:Setting up CephFS filesystem... 2022-01-24T07:00:50.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:50.918 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2022-01-24T07:00:50.919 INFO:tasks.ceph.mds.a.smithi142.stdout:starting mds.a at 2022-01-24T07:00:50.942 INFO:tasks.ceph.mds.c.smithi142.stdout:starting mds.c at 2022-01-24T07:00:50.945 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2022-01-24T07:00:50.950 INFO:tasks.ceph.mds.h.smithi145.stdout:starting mds.h at 2022-01-24T07:00:50.953 INFO:tasks.ceph.mds.g.smithi145.stdout:starting mds.g at 2022-01-24T07:00:50.953 INFO:tasks.ceph.mds.f.smithi145.stdout:starting mds.f at 2022-01-24T07:00:50.955 INFO:tasks.ceph.mds.e.smithi145.stdout:starting mds.e at 2022-01-24T07:00:50.965 INFO:tasks.ceph.mds.i.smithi145.stdout:starting mds.i at 2022-01-24T07:00:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.982+0000 7fe48eb90700 1 Processor -- start 2022-01-24T07:00:50.982 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.982+0000 7fe48eb90700 1 -- start start 2022-01-24T07:00:50.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48eb90700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fe48815caf0 0x7fe4880cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48eb90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815ced0 0x7fe4880cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48eb90700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe488162cb0 0x7fe488163100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48eb90700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880cd6a0 con 0x7fe488162cb0 2022-01-24T07:00:50.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48eb90700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880cd8c0 con 0x7fe48815caf0 2022-01-24T07:00:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48eb90700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880cdb60 con 0x7fe48815ced0 2022-01-24T07:00:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48e38f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe488162cb0 0x7fe488163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:50.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815ced0 0x7fe4880cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48e38f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe488162cb0 0x7fe488163100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50310/0 (socket says 172.21.15.142:50310) 2022-01-24T07:00:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815ced0 0x7fe4880cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53070/0 (socket says 172.21.15.142:53070) 2022-01-24T07:00:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48e38f700 1 -- 172.21.15.142:0/1844493967 learned_addr learned my addr 172.21.15.142:0/1844493967 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48db8e700 1 --2- 172.21.15.142:0/1844493967 >> v2:172.21.15.145:3300/0 conn(0x7fe48815caf0 0x7fe4880cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:50.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 -- 172.21.15.142:0/1844493967 >> v2:172.21.15.145:3300/0 conn(0x7fe48815caf0 msgr2=0x7fe4880cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 --2- 172.21.15.142:0/1844493967 >> v2:172.21.15.145:3300/0 conn(0x7fe48815caf0 0x7fe4880cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 -- 172.21.15.142:0/1844493967 >> v2:172.21.15.142:3300/0 conn(0x7fe488162cb0 msgr2=0x7fe488163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 --2- 172.21.15.142:0/1844493967 >> v2:172.21.15.142:3300/0 conn(0x7fe488162cb0 0x7fe488163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 -- 172.21.15.142:0/1844493967 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880cde00 con 0x7fe48815ced0 2022-01-24T07:00:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48e38f700 1 --2- 172.21.15.142:0/1844493967 >> v2:172.21.15.142:3300/0 conn(0x7fe488162cb0 0x7fe488163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48d38d700 1 --2- 172.21.15.142:0/1844493967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815ced0 0x7fe4880cd1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe484002f70 tx=0x7fe484006df0).ready entity=mon.2 client_cookie=8fba5c27690938e4 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.983+0000 7fe48cb8c700 1 -- 172.21.15.142:0/1844493967 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48400d4a0 con 0x7fe48815ced0 2022-01-24T07:00:50.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48cb8c700 1 -- 172.21.15.142:0/1844493967 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484000e90 con 0x7fe48815ced0 2022-01-24T07:00:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48cb8c700 1 -- 172.21.15.142:0/1844493967 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48400d7f0 con 0x7fe48815ced0 2022-01-24T07:00:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 -- 172.21.15.142:0/1844493967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815ced0 msgr2=0x7fe4880cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 --2- 172.21.15.142:0/1844493967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815ced0 0x7fe4880cd1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe484002f70 tx=0x7fe484006df0).stop 2022-01-24T07:00:50.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 -- 172.21.15.142:0/1844493967 shutdown_connections 2022-01-24T07:00:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 --2- 172.21.15.142:0/1844493967 >> v2:172.21.15.142:3300/0 conn(0x7fe488162cb0 0x7fe488163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 --2- 172.21.15.142:0/1844493967 >> v2:172.21.15.145:3300/0 conn(0x7fe48815caf0 0x7fe4880cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 --2- 172.21.15.142:0/1844493967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815ced0 0x7fe4880cd1b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:50.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 -- 172.21.15.142:0/1844493967 >> 172.21.15.142:0/1844493967 conn(0x7fe4880cedc0 msgr2=0x7fe4880cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 -- 172.21.15.142:0/1844493967 shutdown_connections 2022-01-24T07:00:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.984+0000 7fe48eb90700 1 -- 172.21.15.142:0/1844493967 wait complete. 2022-01-24T07:00:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.985+0000 7fe48eb90700 1 Processor -- start 2022-01-24T07:00:50.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.985+0000 7fe48eb90700 1 -- start start 2022-01-24T07:00:50.996 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48eb90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815caf0 0x7fe4880b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48eb90700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe48815ced0 0x7fe488066020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48eb90700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488162cb0 0x7fe48815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48eb90700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880b8260 con 0x7fe48815ced0 2022-01-24T07:00:50.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48eb90700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880b6e50 con 0x7fe488162cb0 2022-01-24T07:00:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48eb90700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880b70f0 con 0x7fe48815caf0 2022-01-24T07:00:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48db8e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815caf0 0x7fe4880b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe48815ced0 0x7fe488066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:50.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48db8e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815caf0 0x7fe4880b7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53074/0 (socket says 172.21.15.142:53074) 2022-01-24T07:00:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe48815ced0 0x7fe488066020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50312/0 (socket says 172.21.15.142:50312) 2022-01-24T07:00:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48db8e700 1 -- 172.21.15.142:0/4150211298 learned_addr learned my addr 172.21.15.142:0/4150211298 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:50.999 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48e38f700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488162cb0 0x7fe48815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 -- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815caf0 msgr2=0x7fe4880b7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815caf0 0x7fe4880b7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 -- 172.21.15.142:0/4150211298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488162cb0 msgr2=0x7fe48815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488162cb0 0x7fe48815b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 -- 172.21.15.142:0/4150211298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009530 con 0x7fe48815ced0 2022-01-24T07:00:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48db8e700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815caf0 0x7fe4880b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.986+0000 7fe48d38d700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe48815ced0 0x7fe488066020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe484002f70 tx=0x7fe484014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.987+0000 7fe476ffd700 1 -- 172.21.15.142:0/4150211298 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe484013bf0 con 0x7fe48815ced0 2022-01-24T07:00:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.987+0000 7fe476ffd700 1 -- 172.21.15.142:0/4150211298 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484013d50 con 0x7fe48815ced0 2022-01-24T07:00:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.987+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48400b180 con 0x7fe48815ced0 2022-01-24T07:00:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.987+0000 7fe476ffd700 1 -- 172.21.15.142:0/4150211298 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48401e5f0 con 0x7fe48815ced0 2022-01-24T07:00:51.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.987+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4880b7630 con 0x7fe48815ced0 2022-01-24T07:00:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.988+0000 7fe476ffd700 1 -- 172.21.15.142:0/4150211298 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fe484025030 con 0x7fe48815ced0 2022-01-24T07:00:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.988+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4880b7a90 con 0x7fe48815ced0 2022-01-24T07:00:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.988+0000 7fe476ffd700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fe468052c60 0x7fe468055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.988+0000 7fe476ffd700 1 -- 172.21.15.142:0/4150211298 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe48406b280 con 0x7fe48815ced0 2022-01-24T07:00:51.003 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.988+0000 7fe48db8e700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fe468052c60 0x7fe468055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.988+0000 7fe48db8e700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fe468052c60 0x7fe468055120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe47800b000 tx=0x7fe478006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.004 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:50.991+0000 7fe476ffd700 1 -- 172.21.15.142:0/4150211298 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fe484042cd0 con 0x7fe48815ced0 2022-01-24T07:00:51.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.122+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe488057950 con 0x7fe48815ced0 2022-01-24T07:00:51.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.123+0000 7fe476ffd700 1 -- 172.21.15.142:0/4150211298 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13288 (secure 0 0 0) 0x7fe484023020 con 0x7fe48815ced0 2022-01-24T07:00:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:51.124 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":18,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:50.812098+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:51.125 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fe468052c60 msgr2=0x7fe468055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.126 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fe468052c60 0x7fe468055120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe47800b000 tx=0x7fe478006df0).stop 2022-01-24T07:00:51.126 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe48815ced0 msgr2=0x7fe488066020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.126 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe48815ced0 0x7fe488066020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe484002f70 tx=0x7fe484014000).stop 2022-01-24T07:00:51.126 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 shutdown_connections 2022-01-24T07:00:51.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe488162cb0 0x7fe48815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fe468052c60 0x7fe468055120 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe48815caf0 0x7fe4880b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 --2- 172.21.15.142:0/4150211298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe48815ced0 0x7fe488066020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 >> 172.21.15.142:0/4150211298 conn(0x7fe4880cedc0 msgr2=0x7fe4880629d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:51.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 shutdown_connections 2022-01-24T07:00:51.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.124+0000 7fe48eb90700 1 -- 172.21.15.142:0/4150211298 wait complete. 2022-01-24T07:00:51.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-24T07:00:40.161690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-24T07:00:49.517379+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-24T07:00:51.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-24T07:00:51.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.237+0000 7f11072ad700 1 Processor -- start 2022-01-24T07:00:51.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.237+0000 7f11072ad700 1 -- start start 2022-01-24T07:00:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.238+0000 7f11072ad700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f11001600b0 0x7f1100160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.238+0000 7f11072ad700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f110015d5d0 0x7f11001623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f11072ad700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1100161220 con 0x7f11000b07e0 2022-01-24T07:00:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f11072ad700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1100161020 con 0x7f110015d5d0 2022-01-24T07:00:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f11072ad700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11001614c0 con 0x7f11001600b0 2022-01-24T07:00:51.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f110015d5d0 0x7f11001623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f110015d5d0 0x7f11001623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50322/0 (socket says 172.21.15.142:50322) 2022-01-24T07:00:51.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1106aac700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f11000b07e0 0x7f11000b0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47686/0 (socket says 172.21.15.142:47686) 2022-01-24T07:00:51.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 -- 172.21.15.142:0/4250581121 learned_addr learned my addr 172.21.15.142:0/4250581121 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:51.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f11062ab700 1 --2- 172.21.15.142:0/4250581121 >> v2:172.21.15.145:3300/0 conn(0x7f11001600b0 0x7f1100160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 -- 172.21.15.142:0/4250581121 >> v2:172.21.15.145:3300/0 conn(0x7f11001600b0 msgr2=0x7f1100160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:51.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 --2- 172.21.15.142:0/4250581121 >> v2:172.21.15.145:3300/0 conn(0x7f11001600b0 0x7f1100160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 -- 172.21.15.142:0/4250581121 >> v1:172.21.15.142:6789/0 conn(0x7f11000b07e0 legacy=0x7f11000b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 -- 172.21.15.142:0/4250581121 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100161760 con 0x7f110015d5d0 2022-01-24T07:00:51.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f1105aaa700 1 --2- 172.21.15.142:0/4250581121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f110015d5d0 0x7f11001623e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f10f0002f70 tx=0x7f10f0006eb0).ready entity=mon.0 client_cookie=20323b5302e14351 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f11052a9700 1 -- 172.21.15.142:0/4250581121 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f000d610 con 0x7f110015d5d0 2022-01-24T07:00:51.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f11052a9700 1 -- 172.21.15.142:0/4250581121 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0000e90 con 0x7f110015d5d0 2022-01-24T07:00:51.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.239+0000 7f11052a9700 1 -- 172.21.15.142:0/4250581121 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f000d9a0 con 0x7f110015d5d0 2022-01-24T07:00:51.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 -- 172.21.15.142:0/4250581121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f110015d5d0 msgr2=0x7f11001623e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 --2- 172.21.15.142:0/4250581121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f110015d5d0 0x7f11001623e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f10f0002f70 tx=0x7f10f0006eb0).stop 2022-01-24T07:00:51.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 -- 172.21.15.142:0/4250581121 shutdown_connections 2022-01-24T07:00:51.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 --2- 172.21.15.142:0/4250581121 >> v2:172.21.15.145:3300/0 conn(0x7f11001600b0 0x7f1100160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 --2- 172.21.15.142:0/4250581121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f110015d5d0 0x7f11001623e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 -- 172.21.15.142:0/4250581121 >> 172.21.15.142:0/4250581121 conn(0x7f11000d2b70 msgr2=0x7f11000d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:51.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 -- 172.21.15.142:0/4250581121 shutdown_connections 2022-01-24T07:00:51.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.240+0000 7f11072ad700 1 -- 172.21.15.142:0/4250581121 wait complete. 2022-01-24T07:00:51.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.241+0000 7f11072ad700 1 Processor -- start 2022-01-24T07:00:51.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.241+0000 7f11072ad700 1 -- start start 2022-01-24T07:00:51.252 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11000b07e0 0x7f1100065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.252 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f110015d5d0 0x7f11000d2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.252 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11001600b0 0x7f1100067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.252 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000cf000 con 0x7f11001600b0 2022-01-24T07:00:51.253 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1100066010 con 0x7f11000b07e0 2022-01-24T07:00:51.253 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11000662b0 con 0x7f110015d5d0 2022-01-24T07:00:51.253 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1106aac700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11001600b0 0x7f1100067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.253 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f110015d5d0 0x7f11000d2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.254 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f110015d5d0 0x7f11000d2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53088/0 (socket says 172.21.15.142:53088) 2022-01-24T07:00:51.254 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1106aac700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11001600b0 0x7f1100067c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50328/0 (socket says 172.21.15.142:50328) 2022-01-24T07:00:51.254 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 -- 172.21.15.142:0/916780590 learned_addr learned my addr 172.21.15.142:0/916780590 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:51.254 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11062ab700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11000b07e0 0x7f1100065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.255 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 -- 172.21.15.142:0/916780590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11000b07e0 msgr2=0x7f1100065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.255 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11000b07e0 0x7f1100065950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.255 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 -- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11001600b0 msgr2=0x7f1100067c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.255 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11001600b0 0x7f1100067c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.256 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 -- 172.21.15.142:0/916780590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f000b1e0 con 0x7f110015d5d0 2022-01-24T07:00:51.256 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1106aac700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11001600b0 0x7f1100067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:51.256 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f1105aaa700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f110015d5d0 0x7f11000d2370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f10f0002f70 tx=0x7f10f0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.256 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f10ef7fe700 1 -- 172.21.15.142:0/916780590 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f0011860 con 0x7f110015d5d0 2022-01-24T07:00:51.257 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f10ef7fe700 1 -- 172.21.15.142:0/916780590 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f00119c0 con 0x7f110015d5d0 2022-01-24T07:00:51.257 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1100066550 con 0x7f110015d5d0 2022-01-24T07:00:51.257 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f10ef7fe700 1 -- 172.21.15.142:0/916780590 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10f0011d20 con 0x7f110015d5d0 2022-01-24T07:00:51.257 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.242+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11001523f0 con 0x7f110015d5d0 2022-01-24T07:00:51.258 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.244+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1100161a00 con 0x7f110015d5d0 2022-01-24T07:00:51.258 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.244+0000 7f10ef7fe700 1 -- 172.21.15.142:0/916780590 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f10f0025030 con 0x7f110015d5d0 2022-01-24T07:00:51.258 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.244+0000 7f10ef7fe700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f10e0052ab0 0x7f10e0054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.258 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.244+0000 7f10ef7fe700 1 -- 172.21.15.142:0/916780590 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f10f006b8d0 con 0x7f110015d5d0 2022-01-24T07:00:51.259 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.244+0000 7f11062ab700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f10e0052ab0 0x7f10e0054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.259 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.244+0000 7f11062ab700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f10e0052ab0 0x7f10e0054f70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f10fc00c000 tx=0x7f10fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.259 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.248+0000 7f10ef7fe700 1 -- 172.21.15.142:0/916780590 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f10f0043320 con 0x7f110015d5d0 2022-01-24T07:00:51.379 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.378+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1100057950 con 0x7f110015d5d0 2022-01-24T07:00:51.379 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.379+0000 7f10ef7fe700 1 -- 172.21.15.142:0/916780590 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f10f0023070 con 0x7f110015d5d0 2022-01-24T07:00:51.380 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2022-01-24T07:00:51.381 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f10e0052ab0 msgr2=0x7f10e0054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.381 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f10e0052ab0 0x7f10e0054f70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f10fc00c000 tx=0x7f10fc008040).stop 2022-01-24T07:00:51.381 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f110015d5d0 msgr2=0x7f11000d2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.382 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f110015d5d0 0x7f11000d2370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f10f0002f70 tx=0x7f10f0015000).stop 2022-01-24T07:00:51.382 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 shutdown_connections 2022-01-24T07:00:51.382 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11000b07e0 0x7f1100065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f10e0052ab0 0x7f10e0054f70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11001600b0 0x7f1100067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 --2- 172.21.15.142:0/916780590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f110015d5d0 0x7f11000d2370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.380+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 >> 172.21.15.142:0/916780590 conn(0x7f11000d2b70 msgr2=0x7f11000d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:51.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.381+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 shutdown_connections 2022-01-24T07:00:51.384 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.381+0000 7f11072ad700 1 -- 172.21.15.142:0/916780590 wait complete. 2022-01-24T07:00:51.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-24T07:00:51.493 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.493+0000 7fd2d46fb700 1 Processor -- start 2022-01-24T07:00:51.493 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.493+0000 7fd2d46fb700 1 -- start start 2022-01-24T07:00:51.496 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d46fb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc0600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d46fb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2cc0620b0 0x7fd2cc062520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d46fb700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc05cef0 con 0x7fd2cc141fb0 2022-01-24T07:00:51.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d46fb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc061cc0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d46fb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc05d190 con 0x7fd2cc05fc90 2022-01-24T07:00:51.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc0600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d2c98700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2cc0620b0 0x7fd2cc062520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc0600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53096/0 (socket says 172.21.15.142:53096) 2022-01-24T07:00:51.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d2c98700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2cc0620b0 0x7fd2cc062520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50336/0 (socket says 172.21.15.142:50336) 2022-01-24T07:00:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 -- 172.21.15.142:0/2400886207 learned_addr learned my addr 172.21.15.142:0/2400886207 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 -- 172.21.15.142:0/2400886207 >> v2:172.21.15.142:3300/0 conn(0x7fd2cc0620b0 msgr2=0x7fd2cc062520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 --2- 172.21.15.142:0/2400886207 >> v2:172.21.15.142:3300/0 conn(0x7fd2cc0620b0 0x7fd2cc062520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 -- 172.21.15.142:0/2400886207 >> v1:172.21.15.145:6789/0 conn(0x7fd2cc141fb0 legacy=0x7fd2cc05c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 -- 172.21.15.142:0/2400886207 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc05d430 con 0x7fd2cc05fc90 2022-01-24T07:00:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1c96700 1 --2- 172.21.15.142:0/2400886207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc0600f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd2c0002f70 tx=0x7fd2c0006eb0).ready entity=mon.2 client_cookie=d39ca3c2d31788eb server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1495700 1 -- 172.21.15.142:0/2400886207 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c000d570 con 0x7fd2cc05fc90 2022-01-24T07:00:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1495700 1 -- 172.21.15.142:0/2400886207 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c0000e90 con 0x7fd2cc05fc90 2022-01-24T07:00:51.501 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.494+0000 7fd2d1495700 1 -- 172.21.15.142:0/2400886207 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c000d900 con 0x7fd2cc05fc90 2022-01-24T07:00:51.501 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 -- 172.21.15.142:0/2400886207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 msgr2=0x7fd2cc0600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.501 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/2400886207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc0600f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd2c0002f70 tx=0x7fd2c0006eb0).stop 2022-01-24T07:00:51.501 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 -- 172.21.15.142:0/2400886207 shutdown_connections 2022-01-24T07:00:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/2400886207 >> v2:172.21.15.142:3300/0 conn(0x7fd2cc0620b0 0x7fd2cc062520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/2400886207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc0600f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 -- 172.21.15.142:0/2400886207 >> 172.21.15.142:0/2400886207 conn(0x7fd2cc0d2ce0 msgr2=0x7fd2cc0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 -- 172.21.15.142:0/2400886207 shutdown_connections 2022-01-24T07:00:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.495+0000 7fd2d46fb700 1 -- 172.21.15.142:0/2400886207 wait complete. 2022-01-24T07:00:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.496+0000 7fd2d46fb700 1 Processor -- start 2022-01-24T07:00:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.496+0000 7fd2d46fb700 1 -- start start 2022-01-24T07:00:51.506 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc1702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2cc0620b0 0x7fd2cc0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2cc141fb0 0x7fd2cc131e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0cd8a0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0cdb40 con 0x7fd2cc141fb0 2022-01-24T07:00:51.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0cdde0 con 0x7fd2cc05fc90 2022-01-24T07:00:51.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2cc0620b0 0x7fd2cc0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d2497700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc1702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2cc0620b0 0x7fd2cc0cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50340/0 (socket says 172.21.15.142:50340) 2022-01-24T07:00:51.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 -- 172.21.15.142:0/3183935706 learned_addr learned my addr 172.21.15.142:0/3183935706 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:51.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d2c98700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2cc141fb0 0x7fd2cc131e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 -- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 msgr2=0x7fd2cc1702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc1702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 -- 172.21.15.142:0/3183935706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2cc141fb0 msgr2=0x7fd2cc131e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2cc141fb0 0x7fd2cc131e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 -- 172.21.15.142:0/3183935706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c000b1e0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d2497700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc1702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d1c96700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2cc0620b0 0x7fd2cc0cea60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd2c0002f70 tx=0x7fd2c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2cb7fe700 1 -- 172.21.15.142:0/3183935706 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c00117e0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2cb7fe700 1 -- 172.21.15.142:0/3183935706 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c0011940 con 0x7fd2cc0620b0 2022-01-24T07:00:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc0ce080 con 0x7fd2cc0620b0 2022-01-24T07:00:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2cb7fe700 1 -- 172.21.15.142:0/3183935706 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2c0011ca0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.497+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc0ce5c0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.498+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc05d6d0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.499+0000 7fd2cb7fe700 1 -- 172.21.15.142:0/3183935706 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fd2c0025030 con 0x7fd2cc0620b0 2022-01-24T07:00:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.499+0000 7fd2cb7fe700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd2ac052c00 0x7fd2ac0550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.499+0000 7fd2cb7fe700 1 -- 172.21.15.142:0/3183935706 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd2c006b970 con 0x7fd2cc0620b0 2022-01-24T07:00:51.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.499+0000 7fd2d2497700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd2ac052c00 0x7fd2ac0550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.499+0000 7fd2d2497700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd2ac052c00 0x7fd2ac0550c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd2bc00d000 tx=0x7fd2bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.502+0000 7fd2cb7fe700 1 -- 172.21.15.142:0/3183935706 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fd2c00433c0 con 0x7fd2cc0620b0 2022-01-24T07:00:51.635 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.635+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2cc057950 con 0x7fd2cc0620b0 2022-01-24T07:00:51.635 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.635+0000 7fd2cb7fe700 1 -- 172.21.15.142:0/3183935706 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2c0023020 con 0x7fd2cc0620b0 2022-01-24T07:00:51.636 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:00:51.637 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.636+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd2ac052c00 msgr2=0x7fd2ac0550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.637 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.636+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd2ac052c00 0x7fd2ac0550c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd2bc00d000 tx=0x7fd2bc009040).stop 2022-01-24T07:00:51.638 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.636+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2cc0620b0 msgr2=0x7fd2cc0cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.638 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.636+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2cc0620b0 0x7fd2cc0cea60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd2c0002f70 tx=0x7fd2c0015000).stop 2022-01-24T07:00:51.638 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 shutdown_connections 2022-01-24T07:00:51.638 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2cc141fb0 0x7fd2cc131e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.639 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd2ac052c00 0x7fd2ac0550c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.639 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2cc05fc90 0x7fd2cc1702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.639 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 --2- 172.21.15.142:0/3183935706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2cc0620b0 0x7fd2cc0cea60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.639 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 >> 172.21.15.142:0/3183935706 conn(0x7fd2cc0d2ce0 msgr2=0x7fd2cc0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:51.640 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 shutdown_connections 2022-01-24T07:00:51.640 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.637+0000 7fd2d46fb700 1 -- 172.21.15.142:0/3183935706 wait complete. 2022-01-24T07:00:51.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-24T07:00:51.747 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.746+0000 7fed961a5700 1 Processor -- start 2022-01-24T07:00:51.747 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.746+0000 7fed961a5700 1 -- start start 2022-01-24T07:00:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed961a5700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fed900ceea0 0x7fed90061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed961a5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed9005c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed961a5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900d0cb0 con 0x7fed900621a0 2022-01-24T07:00:51.751 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed961a5700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900c9e20 con 0x7fed900ceea0 2022-01-24T07:00:51.751 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed961a5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed90062df0 con 0x7fed900d1d60 2022-01-24T07:00:51.751 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed8ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed9005c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.751 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed8effd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fed900621a0 0x7fed900d1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47712/0 (socket says 172.21.15.142:47712) 2022-01-24T07:00:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed8effd700 1 -- 172.21.15.142:0/2699108825 learned_addr learned my addr 172.21.15.142:0/2699108825 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed8ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed9005c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53112/0 (socket says 172.21.15.142:53112) 2022-01-24T07:00:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed8f7fe700 1 --2- 172.21.15.142:0/2699108825 >> v2:172.21.15.145:3300/0 conn(0x7fed900ceea0 0x7fed90061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.747+0000 7fed8e7fc700 1 -- 172.21.15.142:0/2699108825 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666598476 0 0) 0x7fed900d0cb0 con 0x7fed900621a0 2022-01-24T07:00:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8e7fc700 1 -- 172.21.15.142:0/2699108825 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed7c003260 con 0x7fed900621a0 2022-01-24T07:00:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8ffff700 1 -- 172.21.15.142:0/2699108825 >> v2:172.21.15.145:3300/0 conn(0x7fed900ceea0 msgr2=0x7fed90061cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8ffff700 1 --2- 172.21.15.142:0/2699108825 >> v2:172.21.15.145:3300/0 conn(0x7fed900ceea0 0x7fed90061cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8ffff700 1 -- 172.21.15.142:0/2699108825 >> v1:172.21.15.142:6789/0 conn(0x7fed900621a0 legacy=0x7fed900d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.754 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8ffff700 1 -- 172.21.15.142:0/2699108825 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900628b0 con 0x7fed900d1d60 2022-01-24T07:00:51.754 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8ffff700 1 --2- 172.21.15.142:0/2699108825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed9005c440 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fed880032f0 tx=0x7fed880091d0).ready entity=mon.2 client_cookie=278067e7a04a2b3c server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.754 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8e7fc700 1 -- 172.21.15.142:0/2699108825 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800b680 con 0x7fed900d1d60 2022-01-24T07:00:51.754 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8e7fc700 1 -- 172.21.15.142:0/2699108825 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8800b7e0 con 0x7fed900d1d60 2022-01-24T07:00:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed8e7fc700 1 -- 172.21.15.142:0/2699108825 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800b990 con 0x7fed900d1d60 2022-01-24T07:00:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 -- 172.21.15.142:0/2699108825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 msgr2=0x7fed9005c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 --2- 172.21.15.142:0/2699108825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed9005c440 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fed880032f0 tx=0x7fed880091d0).stop 2022-01-24T07:00:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 -- 172.21.15.142:0/2699108825 shutdown_connections 2022-01-24T07:00:51.756 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 --2- 172.21.15.142:0/2699108825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed9005c440 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.756 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 --2- 172.21.15.142:0/2699108825 >> v2:172.21.15.145:3300/0 conn(0x7fed900ceea0 0x7fed90061cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.756 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 -- 172.21.15.142:0/2699108825 >> 172.21.15.142:0/2699108825 conn(0x7fed900d2ca0 msgr2=0x7fed900d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:51.756 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 -- 172.21.15.142:0/2699108825 shutdown_connections 2022-01-24T07:00:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.748+0000 7fed961a5700 1 -- 172.21.15.142:0/2699108825 wait complete. 2022-01-24T07:00:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.749+0000 7fed961a5700 1 Processor -- start 2022-01-24T07:00:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed961a5700 1 -- start start 2022-01-24T07:00:51.760 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed961a5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed900621a0 0x7fed901503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.760 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed961a5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed900ceea0 0x7fed900cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed961a5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed900cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed961a5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900d0100 con 0x7fed900ceea0 2022-01-24T07:00:51.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed961a5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90172d80 con 0x7fed900621a0 2022-01-24T07:00:51.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed961a5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9016ea90 con 0x7fed900d1d60 2022-01-24T07:00:51.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed8ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed900cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed8effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed900ceea0 0x7fed900cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed8ffff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed900cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53118/0 (socket says 172.21.15.142:53118) 2022-01-24T07:00:51.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.750+0000 7fed8ffff700 1 -- 172.21.15.142:0/3093848434 learned_addr learned my addr 172.21.15.142:0/3093848434 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8f7fe700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed900621a0 0x7fed901503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8ffff700 1 -- 172.21.15.142:0/3093848434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed900621a0 msgr2=0x7fed901503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8ffff700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed900621a0 0x7fed901503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8ffff700 1 -- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed900ceea0 msgr2=0x7fed900cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.764 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8ffff700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed900ceea0 0x7fed900cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.764 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8ffff700 1 -- 172.21.15.142:0/3093848434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009470 con 0x7fed900d1d60 2022-01-24T07:00:51.764 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8ffff700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed900cfc10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fed880032f0 tx=0x7fed88016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.764 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8cff9700 1 -- 172.21.15.142:0/3093848434 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed88011de0 con 0x7fed900d1d60 2022-01-24T07:00:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8cff9700 1 -- 172.21.15.142:0/3093848434 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88021440 con 0x7fed900d1d60 2022-01-24T07:00:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9016ed30 con 0x7fed900d1d60 2022-01-24T07:00:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed8cff9700 1 -- 172.21.15.142:0/3093848434 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed880217a0 con 0x7fed900d1d60 2022-01-24T07:00:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.751+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9016f270 con 0x7fed900d1d60 2022-01-24T07:00:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.752+0000 7fed8cff9700 1 -- 172.21.15.142:0/3093848434 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fed88027020 con 0x7fed900d1d60 2022-01-24T07:00:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.752+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9016f6d0 con 0x7fed900d1d60 2022-01-24T07:00:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.752+0000 7fed8cff9700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fed70052c60 0x7fed70055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.752+0000 7fed8cff9700 1 -- 172.21.15.142:0/3093848434 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fed8806bc30 con 0x7fed900d1d60 2022-01-24T07:00:51.767 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.752+0000 7fed8f7fe700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fed70052c60 0x7fed70055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:51.767 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.753+0000 7fed8f7fe700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fed70052c60 0x7fed70055120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fed8000c000 tx=0x7fed80008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:51.767 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.756+0000 7fed8cff9700 1 -- 172.21.15.142:0/3093848434 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fed88043570 con 0x7fed900d1d60 2022-01-24T07:00:51.892 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.892+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fed90150a80 con 0x7fed900d1d60 2022-01-24T07:00:51.893 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.893+0000 7fed8cff9700 1 -- 172.21.15.142:0/3093848434 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+143 (secure 0 0 0) 0x7fed88015020 con 0x7fed900d1d60 2022-01-24T07:00:51.894 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2022-01-24T07:00:51.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2022-01-24T07:00:51.894 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2022-01-24T07:00:51.895 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "device_health_metrics" 2022-01-24T07:00:51.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:00:51.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2022-01-24T07:00:51.895 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 2, 2022-01-24T07:00:51.896 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": "rbd" 2022-01-24T07:00:51.896 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:00:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:] 2022-01-24T07:00:51.897 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fed70052c60 msgr2=0x7fed70055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.897 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fed70052c60 0x7fed70055120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fed8000c000 tx=0x7fed80008040).stop 2022-01-24T07:00:51.898 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 msgr2=0x7fed900cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:51.898 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed900cfc10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fed880032f0 tx=0x7fed88016000).stop 2022-01-24T07:00:51.898 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 shutdown_connections 2022-01-24T07:00:51.898 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed900621a0 0x7fed901503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.899 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fed70052c60 0x7fed70055120 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.899 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed900d1d60 0x7fed900cfc10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.899 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 --2- 172.21.15.142:0/3093848434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed900ceea0 0x7fed900cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:51.899 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.894+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 >> 172.21.15.142:0/3093848434 conn(0x7fed900d2ca0 msgr2=0x7fed900c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:51.900 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.895+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 shutdown_connections 2022-01-24T07:00:51.900 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:51.895+0000 7fed961a5700 1 -- 172.21.15.142:0/3093848434 wait complete. 2022-01-24T07:00:51.905 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-24T07:00:51.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-24T07:00:52.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.008+0000 7ff028278700 1 Processor -- start 2022-01-24T07:00:52.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.008+0000 7ff028278700 1 -- start start 2022-01-24T07:00:52.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff028278700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff020064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:52.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff028278700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0200d0f50 0x7ff02013f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:52.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff028278700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0200634b0 con 0x7ff020062fe0 2022-01-24T07:00:52.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff028278700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff020067b90 con 0x7ff0200d0f50 2022-01-24T07:00:52.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff028278700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff020063750 con 0x7ff0200d0b70 2022-01-24T07:00:52.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0200d0f50 0x7ff02013f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:52.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026014700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff020064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:52.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0200d0f50 0x7ff02013f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50368/0 (socket says 172.21.15.142:50368) 2022-01-24T07:00:52.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026014700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff020064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53126/0 (socket says 172.21.15.142:53126) 2022-01-24T07:00:52.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 -- 172.21.15.142:0/1667959790 learned_addr learned my addr 172.21.15.142:0/1667959790 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:52.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 -- 172.21.15.142:0/1667959790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 msgr2=0x7ff020064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:52.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 --2- 172.21.15.142:0/1667959790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff020064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 -- 172.21.15.142:0/1667959790 >> v1:172.21.15.145:6789/0 conn(0x7ff020062fe0 legacy=0x7ff0200ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:52.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 -- 172.21.15.142:0/1667959790 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0200639f0 con 0x7ff0200d0f50 2022-01-24T07:00:52.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff026815700 1 --2- 172.21.15.142:0/1667959790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff02013f920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff0180032f0 tx=0x7ff018009290).ready entity=mon.0 client_cookie=bdf42c815b5df1f8 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:52.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff025012700 1 -- 172.21.15.142:0/1667959790 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01800b8a0 con 0x7ff0200d0f50 2022-01-24T07:00:52.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff025012700 1 -- 172.21.15.142:0/1667959790 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01800ba00 con 0x7ff0200d0f50 2022-01-24T07:00:52.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.009+0000 7ff025012700 1 -- 172.21.15.142:0/1667959790 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01800bb70 con 0x7ff0200d0f50 2022-01-24T07:00:52.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 -- 172.21.15.142:0/1667959790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 msgr2=0x7ff02013f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:52.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 --2- 172.21.15.142:0/1667959790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff02013f920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff0180032f0 tx=0x7ff018009290).stop 2022-01-24T07:00:52.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 -- 172.21.15.142:0/1667959790 shutdown_connections 2022-01-24T07:00:52.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 --2- 172.21.15.142:0/1667959790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff02013f920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 --2- 172.21.15.142:0/1667959790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff020064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 -- 172.21.15.142:0/1667959790 >> 172.21.15.142:0/1667959790 conn(0x7ff020061ea0 msgr2=0x7ff0200622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:52.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 -- 172.21.15.142:0/1667959790 shutdown_connections 2022-01-24T07:00:52.017 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.010+0000 7ff028278700 1 -- 172.21.15.142:0/1667959790 wait complete. 2022-01-24T07:00:52.020 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.011+0000 7ff028278700 1 Processor -- start 2022-01-24T07:00:52.020 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.011+0000 7ff028278700 1 -- start start 2022-01-24T07:00:52.020 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff028278700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff020062fe0 0x7ff020136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:52.020 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff028278700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff02015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:52.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff028278700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff0200c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:52.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff028278700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02016d9a0 con 0x7ff0200d0f50 2022-01-24T07:00:52.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff028278700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0201700d0 con 0x7ff020062fe0 2022-01-24T07:00:52.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff028278700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff020170370 con 0x7ff0200d0b70 2022-01-24T07:00:52.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff0200c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:52.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff025813700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff02015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:52.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff0200c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50374/0 (socket says 172.21.15.142:50374) 2022-01-24T07:00:52.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff025813700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff02015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53134/0 (socket says 172.21.15.142:53134) 2022-01-24T07:00:52.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 -- 172.21.15.142:0/519847186 learned_addr learned my addr 172.21.15.142:0/519847186 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:52.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026014700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff020062fe0 0x7ff020136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:52.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 -- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 msgr2=0x7ff02015ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:52.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff02015ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 -- 172.21.15.142:0/519847186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff020062fe0 msgr2=0x7ff020136ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:52.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff020062fe0 0x7ff020136ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.012+0000 7ff026815700 1 -- 172.21.15.142:0/519847186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018009530 con 0x7ff0200d0f50 2022-01-24T07:00:52.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.013+0000 7ff026815700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff0200c8d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff0180032f0 tx=0x7ff018016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:52.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.013+0000 7ff00f7fe700 1 -- 172.21.15.142:0/519847186 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01800b8a0 con 0x7ff0200d0f50 2022-01-24T07:00:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.013+0000 7ff00f7fe700 1 -- 172.21.15.142:0/519847186 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff018021480 con 0x7ff0200d0f50 2022-01-24T07:00:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.013+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff020170610 con 0x7ff0200d0f50 2022-01-24T07:00:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.013+0000 7ff00f7fe700 1 -- 172.21.15.142:0/519847186 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0180217e0 con 0x7ff0200d0f50 2022-01-24T07:00:52.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.013+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff020170b50 con 0x7ff0200d0f50 2022-01-24T07:00:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.014+0000 7ff00f7fe700 1 -- 172.21.15.142:0/519847186 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7ff018028070 con 0x7ff0200d0f50 2022-01-24T07:00:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.014+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff020170fb0 con 0x7ff0200d0f50 2022-01-24T07:00:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.014+0000 7ff00f7fe700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff000052ab0 0x7ff000054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:52.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.014+0000 7ff00f7fe700 1 -- 172.21.15.142:0/519847186 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff01806b720 con 0x7ff0200d0f50 2022-01-24T07:00:52.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.014+0000 7ff026014700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff000052ab0 0x7ff000054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:52.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.014+0000 7ff026014700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff000052ab0 0x7ff000054f70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff01c00b000 tx=0x7ff01c006df0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:52.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.018+0000 7ff00f7fe700 1 -- 172.21.15.142:0/519847186 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7ff018043170 con 0x7ff0200d0f50 2022-01-24T07:00:52.149 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.149+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff020137550 con 0x7ff0200d0f50 2022-01-24T07:00:52.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.940+0000 7ff00f7fe700 1 -- 172.21.15.142:0/519847186 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v20) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff018015030 con 0x7ff0200d0f50 2022-01-24T07:00:52.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff000052ab0 msgr2=0x7ff000054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:52.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff000052ab0 0x7ff000054f70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff01c00b000 tx=0x7ff01c006df0).stop 2022-01-24T07:00:52.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 msgr2=0x7ff0200c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:52.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff0200c8d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff0180032f0 tx=0x7ff018016000).stop 2022-01-24T07:00:52.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 shutdown_connections 2022-01-24T07:00:52.944 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff020062fe0 0x7ff020136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff000052ab0 0x7ff000054f70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0200d0f50 0x7ff0200c8d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 --2- 172.21.15.142:0/519847186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0200d0b70 0x7ff02015ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:52.945 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 >> 172.21.15.142:0/519847186 conn(0x7ff020061ea0 msgr2=0x7ff02013a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:52.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 shutdown_connections 2022-01-24T07:00:52.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:52.943+0000 7ff028278700 1 -- 172.21.15.142:0/519847186 wait complete. 2022-01-24T07:00:52.946 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2022-01-24T07:00:52.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-24T07:00:53.064 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.064+0000 7ff271de8700 1 Processor -- start 2022-01-24T07:00:53.064 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.064+0000 7ff271de8700 1 -- start start 2022-01-24T07:00:53.067 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff271de8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c160c50 0x7ff26c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:53.068 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff271de8700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff26c145610 0x7ff26c0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:53.068 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff271de8700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c1600b0 con 0x7ff26c145230 2022-01-24T07:00:53.068 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff271de8700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c15fe90 con 0x7ff26c145610 2022-01-24T07:00:53.068 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff271de8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c160350 con 0x7ff26c160c50 2022-01-24T07:00:53.069 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff26c145230 0x7ff26c15f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47742/0 (socket says 172.21.15.142:47742) 2022-01-24T07:00:53.069 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26b7fe700 1 -- 172.21.15.142:0/3194282227 learned_addr learned my addr 172.21.15.142:0/3194282227 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:53.069 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26affd700 1 --2- 172.21.15.142:0/3194282227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c160c50 0x7ff26c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:53.070 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26bfff700 1 --2- 172.21.15.142:0/3194282227 >> v2:172.21.15.145:3300/0 conn(0x7ff26c145610 0x7ff26c0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:53.070 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26a7fc700 1 -- 172.21.15.142:0/3194282227 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753345747 0 0) 0x7ff26c1600b0 con 0x7ff26c145230 2022-01-24T07:00:53.070 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26a7fc700 1 -- 172.21.15.142:0/3194282227 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff258003260 con 0x7ff26c145230 2022-01-24T07:00:53.070 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26affd700 1 -- 172.21.15.142:0/3194282227 >> v2:172.21.15.145:3300/0 conn(0x7ff26c145610 msgr2=0x7ff26c0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:53.071 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26affd700 1 --2- 172.21.15.142:0/3194282227 >> v2:172.21.15.145:3300/0 conn(0x7ff26c145610 0x7ff26c0cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.071 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26affd700 1 -- 172.21.15.142:0/3194282227 >> v1:172.21.15.142:6789/0 conn(0x7ff26c145230 legacy=0x7ff26c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:53.071 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.065+0000 7ff26affd700 1 -- 172.21.15.142:0/3194282227 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c1605f0 con 0x7ff26c160c50 2022-01-24T07:00:53.071 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff26affd700 1 --2- 172.21.15.142:0/3194282227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c160c50 0x7ff26c0cc580 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff260002f70 tx=0x7ff260006df0).ready entity=mon.2 client_cookie=60f9a314c69e4d24 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff26a7fc700 1 -- 172.21.15.142:0/3194282227 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff26000d570 con 0x7ff26c160c50 2022-01-24T07:00:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff26a7fc700 1 -- 172.21.15.142:0/3194282227 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff260000e90 con 0x7ff26c160c50 2022-01-24T07:00:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff26a7fc700 1 -- 172.21.15.142:0/3194282227 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff26000d8c0 con 0x7ff26c160c50 2022-01-24T07:00:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 -- 172.21.15.142:0/3194282227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c160c50 msgr2=0x7ff26c0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:53.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 --2- 172.21.15.142:0/3194282227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c160c50 0x7ff26c0cc580 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff260002f70 tx=0x7ff260006df0).stop 2022-01-24T07:00:53.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 -- 172.21.15.142:0/3194282227 shutdown_connections 2022-01-24T07:00:53.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 --2- 172.21.15.142:0/3194282227 >> v2:172.21.15.145:3300/0 conn(0x7ff26c145610 0x7ff26c0cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 --2- 172.21.15.142:0/3194282227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c160c50 0x7ff26c0cc580 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 -- 172.21.15.142:0/3194282227 >> 172.21.15.142:0/3194282227 conn(0x7ff26c0d5fc0 msgr2=0x7ff26c0d63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:53.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 -- 172.21.15.142:0/3194282227 shutdown_connections 2022-01-24T07:00:53.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.066+0000 7ff271de8700 1 -- 172.21.15.142:0/3194282227 wait complete. 2022-01-24T07:00:53.075 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.067+0000 7ff271de8700 1 Processor -- start 2022-01-24T07:00:53.075 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.067+0000 7ff271de8700 1 -- start start 2022-01-24T07:00:53.079 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff271de8700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c145230 0x7ff26c0d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:53.079 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff271de8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff26c145610 0x7ff26c145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff271de8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff26c160c50 0x7ff26c161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff271de8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c173430 con 0x7ff26c145610 2022-01-24T07:00:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff271de8700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c172580 con 0x7ff26c160c50 2022-01-24T07:00:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff271de8700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1727b0 con 0x7ff26c145230 2022-01-24T07:00:53.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff26b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c145230 0x7ff26c0d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:53.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff26affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff26c145610 0x7ff26c145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:53.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff26b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c145230 0x7ff26c0d19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53144/0 (socket says 172.21.15.142:53144) 2022-01-24T07:00:53.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.068+0000 7ff26b7fe700 1 -- 172.21.15.142:0/1676264185 learned_addr learned my addr 172.21.15.142:0/1676264185 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:53.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26bfff700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff26c160c50 0x7ff26c161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:53.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26b7fe700 1 -- 172.21.15.142:0/1676264185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff26c160c50 msgr2=0x7ff26c161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:53.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26b7fe700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff26c160c50 0x7ff26c161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26b7fe700 1 -- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff26c145610 msgr2=0x7ff26c145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:53.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26b7fe700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff26c145610 0x7ff26c145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26b7fe700 1 -- 172.21.15.142:0/1676264185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26000b180 con 0x7ff26c145230 2022-01-24T07:00:53.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26affd700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff26c145610 0x7ff26c145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:53.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26bfff700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff26c160c50 0x7ff26c161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:00:53.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff26b7fe700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c145230 0x7ff26c0d19b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff26c13eb10 tx=0x7ff25c007e50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:53.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff268ff9700 1 -- 172.21.15.142:0/1676264185 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff25c005ba0 con 0x7ff26c145230 2022-01-24T07:00:53.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff268ff9700 1 -- 172.21.15.142:0/1676264185 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c005d00 con 0x7ff26c145230 2022-01-24T07:00:53.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c172a50 con 0x7ff26c145230 2022-01-24T07:00:53.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff268ff9700 1 -- 172.21.15.142:0/1676264185 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff25c0072c0 con 0x7ff26c145230 2022-01-24T07:00:53.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.069+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c172f90 con 0x7ff26c145230 2022-01-24T07:00:53.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.070+0000 7ff268ff9700 1 -- 172.21.15.142:0/1676264185 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7ff25c01a070 con 0x7ff26c145230 2022-01-24T07:00:53.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.070+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c057950 con 0x7ff26c145230 2022-01-24T07:00:53.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.070+0000 7ff268ff9700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff24c052ab0 0x7ff24c054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.070+0000 7ff268ff9700 1 -- 172.21.15.142:0/1676264185 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ff25c069f80 con 0x7ff26c145230 2022-01-24T07:00:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.070+0000 7ff26affd700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff24c052ab0 0x7ff24c054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.071+0000 7ff26affd700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff24c052ab0 0x7ff24c054f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff26001a000 tx=0x7ff260014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.074+0000 7ff268ff9700 1 -- 172.21.15.142:0/1676264185 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7ff25c041870 con 0x7ff26c145230 2022-01-24T07:00:53.207 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.207+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7ff26c159b30 con 0x7ff26c145230 2022-01-24T07:00:53.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.942+0000 7ff268ff9700 1 -- 172.21.15.142:0/1676264185 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v21) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff25c044e90 con 0x7ff26c145230 2022-01-24T07:00:53.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.945+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff24c052ab0 msgr2=0x7ff24c054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:53.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.945+0000 7ff271de8700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff24c052ab0 0x7ff24c054f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff26001a000 tx=0x7ff260014000).stop 2022-01-24T07:00:53.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.945+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c145230 msgr2=0x7ff26c0d19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:53.946 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.945+0000 7ff271de8700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c145230 0x7ff26c0d19b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff26c13eb10 tx=0x7ff25c007e50).stop 2022-01-24T07:00:53.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.946+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 shutdown_connections 2022-01-24T07:00:53.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.946+0000 7ff271de8700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff26c160c50 0x7ff26c161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.946+0000 7ff271de8700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff24c052ab0 0x7ff24c054f70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.946+0000 7ff271de8700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff26c145230 0x7ff26c0d19b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.946+0000 7ff271de8700 1 --2- 172.21.15.142:0/1676264185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff26c145610 0x7ff26c145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:53.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.946+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 >> 172.21.15.142:0/1676264185 conn(0x7ff26c0d5fc0 msgr2=0x7ff26c15ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:53.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.947+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 shutdown_connections 2022-01-24T07:00:53.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:53.947+0000 7ff271de8700 1 -- 172.21.15.142:0/1676264185 wait complete. 2022-01-24T07:00:53.951 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2022-01-24T07:00:53.963 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-24T07:00:54.070 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.070+0000 7fa864f04700 1 Processor -- start 2022-01-24T07:00:54.071 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.070+0000 7fa864f04700 1 -- start start 2022-01-24T07:00:54.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa864f04700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa860161490 0x7fa8600637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa864f04700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa86005c410 0x7fa860146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa864f04700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86005c8c0 con 0x7fa8601610b0 2022-01-24T07:00:54.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa864f04700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600ceca0 con 0x7fa86005c410 2022-01-24T07:00:54.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa864f04700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86005b4f0 con 0x7fa860161490 2022-01-24T07:00:54.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa85ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa86005c410 0x7fa860146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.074 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa85f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa8601610b0 0x7fa8600ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47754/0 (socket says 172.21.15.142:47754) 2022-01-24T07:00:54.075 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa85ffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa86005c410 0x7fa860146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50394/0 (socket says 172.21.15.142:50394) 2022-01-24T07:00:54.075 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.071+0000 7fa85f7fe700 1 -- 172.21.15.142:0/3056712583 learned_addr learned my addr 172.21.15.142:0/3056712583 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:54.075 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85effd700 1 --2- 172.21.15.142:0/3056712583 >> v2:172.21.15.145:3300/0 conn(0x7fa860161490 0x7fa8600637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.075 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85ffff700 1 -- 172.21.15.142:0/3056712583 >> v2:172.21.15.145:3300/0 conn(0x7fa860161490 msgr2=0x7fa8600637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:54.076 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85ffff700 1 --2- 172.21.15.142:0/3056712583 >> v2:172.21.15.145:3300/0 conn(0x7fa860161490 0x7fa8600637e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.076 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85ffff700 1 -- 172.21.15.142:0/3056712583 >> v1:172.21.15.142:6789/0 conn(0x7fa8601610b0 legacy=0x7fa8600ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.076 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85ffff700 1 -- 172.21.15.142:0/3056712583 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86005b790 con 0x7fa86005c410 2022-01-24T07:00:54.076 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85e7fc700 1 -- 172.21.15.142:0/3056712583 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981560806 0 0) 0x7fa850001490 con 0x7fa8601610b0 2022-01-24T07:00:54.076 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85ffff700 1 --2- 172.21.15.142:0/3056712583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86005c410 0x7fa860146430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa858002f70 tx=0x7fa858006df0).ready entity=mon.0 client_cookie=93d53e64da941b61 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.077 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85e7fc700 1 -- 172.21.15.142:0/3056712583 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85800d5c0 con 0x7fa86005c410 2022-01-24T07:00:54.077 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85e7fc700 1 -- 172.21.15.142:0/3056712583 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858000e90 con 0x7fa86005c410 2022-01-24T07:00:54.077 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa85e7fc700 1 -- 172.21.15.142:0/3056712583 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85800d910 con 0x7fa86005c410 2022-01-24T07:00:54.077 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa864f04700 1 -- 172.21.15.142:0/3056712583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86005c410 msgr2=0x7fa860146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.077 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa864f04700 1 --2- 172.21.15.142:0/3056712583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86005c410 0x7fa860146430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa858002f70 tx=0x7fa858006df0).stop 2022-01-24T07:00:54.078 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa864f04700 1 -- 172.21.15.142:0/3056712583 shutdown_connections 2022-01-24T07:00:54.078 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa864f04700 1 --2- 172.21.15.142:0/3056712583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa86005c410 0x7fa860146430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.078 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa864f04700 1 --2- 172.21.15.142:0/3056712583 >> v2:172.21.15.145:3300/0 conn(0x7fa860161490 0x7fa8600637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.078 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.072+0000 7fa864f04700 1 -- 172.21.15.142:0/3056712583 >> 172.21.15.142:0/3056712583 conn(0x7fa860065c40 msgr2=0x7fa860066050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:54.078 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.073+0000 7fa864f04700 1 -- 172.21.15.142:0/3056712583 shutdown_connections 2022-01-24T07:00:54.079 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.073+0000 7fa864f04700 1 -- 172.21.15.142:0/3056712583 wait complete. 2022-01-24T07:00:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.074+0000 7fa864f04700 1 Processor -- start 2022-01-24T07:00:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.074+0000 7fa864f04700 1 -- start start 2022-01-24T07:00:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa86005c410 0x7fa86015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8601610b0 0x7fa8600d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa860161490 0x7fa8601703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015d740 con 0x7fa860161490 2022-01-24T07:00:54.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015d9e0 con 0x7fa86005c410 2022-01-24T07:00:54.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015dc80 con 0x7fa8601610b0 2022-01-24T07:00:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa860161490 0x7fa8601703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8601610b0 0x7fa8600d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8601610b0 0x7fa8600d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53160/0 (socket says 172.21.15.142:53160) 2022-01-24T07:00:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa860161490 0x7fa8601703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50400/0 (socket says 172.21.15.142:50400) 2022-01-24T07:00:54.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85effd700 1 -- 172.21.15.142:0/3868149371 learned_addr learned my addr 172.21.15.142:0/3868149371 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85f7fe700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa86005c410 0x7fa86015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 -- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8601610b0 msgr2=0x7fa8600d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8601610b0 0x7fa8600d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 -- 172.21.15.142:0/3868149371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa86005c410 msgr2=0x7fa86015b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa86005c410 0x7fa86015b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 -- 172.21.15.142:0/3868149371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85800b180 con 0x7fa860161490 2022-01-24T07:00:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85f7fe700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa86005c410 0x7fa86015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:00:54.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85ffff700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa860161490 0x7fa8601703d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa858002f70 tx=0x7fa858014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85cff9700 1 -- 172.21.15.142:0/3868149371 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa858016070 con 0x7fa860161490 2022-01-24T07:00:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85cff9700 1 -- 172.21.15.142:0/3868149371 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858013910 con 0x7fa860161490 2022-01-24T07:00:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860145140 con 0x7fa860161490 2022-01-24T07:00:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa85cff9700 1 -- 172.21.15.142:0/3868149371 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa858013c70 con 0x7fa860161490 2022-01-24T07:00:54.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.075+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa860145680 con 0x7fa860161490 2022-01-24T07:00:54.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.076+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86005ba30 con 0x7fa860161490 2022-01-24T07:00:54.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.076+0000 7fa85cff9700 1 -- 172.21.15.142:0/3868149371 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fa858025030 con 0x7fa860161490 2022-01-24T07:00:54.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.077+0000 7fa85cff9700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa840052ab0 0x7fa840054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.077+0000 7fa85cff9700 1 -- 172.21.15.142:0/3868149371 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fa85806ba00 con 0x7fa860161490 2022-01-24T07:00:54.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.077+0000 7fa85f7fe700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa840052ab0 0x7fa840054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.077+0000 7fa85f7fe700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa840052ab0 0x7fa840054f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa850008000 tx=0x7fa850009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.080+0000 7fa85cff9700 1 -- 172.21.15.142:0/3868149371 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fa858043190 con 0x7fa860161490 2022-01-24T07:00:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.257+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa860057950 con 0x7fa860161490 2022-01-24T07:00:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.261+0000 7fa85cff9700 1 -- 172.21.15.142:0/3868149371 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa858023020 con 0x7fa860161490 2022-01-24T07:00:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.264+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa840052ab0 msgr2=0x7fa840054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.265 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.264+0000 7fa864f04700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa840052ab0 0x7fa840054f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa850008000 tx=0x7fa850009040).stop 2022-01-24T07:00:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.264+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa860161490 msgr2=0x7fa8601703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.266 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.264+0000 7fa864f04700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa860161490 0x7fa8601703d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa858002f70 tx=0x7fa858014000).stop 2022-01-24T07:00:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.266+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 shutdown_connections 2022-01-24T07:00:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.266+0000 7fa864f04700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa86005c410 0x7fa86015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.266+0000 7fa864f04700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa840052ab0 0x7fa840054f70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.266+0000 7fa864f04700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa860161490 0x7fa8601703d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.266+0000 7fa864f04700 1 --2- 172.21.15.142:0/3868149371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8601610b0 0x7fa8600d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.266+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 >> 172.21.15.142:0/3868149371 conn(0x7fa860065c40 msgr2=0x7fa860066020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.267+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 shutdown_connections 2022-01-24T07:00:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.267+0000 7fa864f04700 1 -- 172.21.15.142:0/3868149371 wait complete. 2022-01-24T07:00:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 3 and data pool 4 2022-01-24T07:00:54.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:54.381 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.381+0000 7f09af831700 1 Processor -- start 2022-01-24T07:00:54.381 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.381+0000 7f09af831700 1 -- start start 2022-01-24T07:00:54.384 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09af831700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a80d0b30 0x7f09a8067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09af831700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09a8149050 0x7f09a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09af831700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a81607c0 con 0x7f09a8148c70 2022-01-24T07:00:54.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09af831700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a8066db0 con 0x7f09a8149050 2022-01-24T07:00:54.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09af831700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8067050 con 0x7f09a80d0b30 2022-01-24T07:00:54.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09acdcc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a80d0b30 0x7f09a8067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09a8149050 0x7f09a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09a8149050 0x7f09a8067f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50408/0 (socket says 172.21.15.142:50408) 2022-01-24T07:00:54.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09acdcc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a80d0b30 0x7f09a8067a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53168/0 (socket says 172.21.15.142:53168) 2022-01-24T07:00:54.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 -- 172.21.15.142:0/2020656057 learned_addr learned my addr 172.21.15.142:0/2020656057 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:54.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 -- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a80d0b30 msgr2=0x7f09a8067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:54.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 --2- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a80d0b30 0x7f09a8067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 -- 172.21.15.142:0/2020656057 >> v1:172.21.15.145:6789/0 conn(0x7f09a8148c70 legacy=0x7f09a80bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 -- 172.21.15.142:0/2020656057 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80672f0 con 0x7f09a8149050 2022-01-24T07:00:54.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09acdcc700 1 --2- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a80d0b30 0x7f09a8067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:54.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f09addce700 1 --2- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a8149050 0x7f09a8067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f09a00032f0 tx=0x7f09a0009290).ready entity=mon.0 client_cookie=363f0d93f22d63b9 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f0997fff700 1 -- 172.21.15.142:0/2020656057 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a000b8a0 con 0x7f09a8149050 2022-01-24T07:00:54.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f0997fff700 1 -- 172.21.15.142:0/2020656057 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000ba00 con 0x7f09a8149050 2022-01-24T07:00:54.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.382+0000 7f0997fff700 1 -- 172.21.15.142:0/2020656057 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a000bb70 con 0x7f09a8149050 2022-01-24T07:00:54.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 -- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a8149050 msgr2=0x7f09a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 --2- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a8149050 0x7f09a8067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f09a00032f0 tx=0x7f09a0009290).stop 2022-01-24T07:00:54.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 -- 172.21.15.142:0/2020656057 shutdown_connections 2022-01-24T07:00:54.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 --2- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a8149050 0x7f09a8067f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 --2- 172.21.15.142:0/2020656057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a80d0b30 0x7f09a8067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 -- 172.21.15.142:0/2020656057 >> 172.21.15.142:0/2020656057 conn(0x7f09a805fc90 msgr2=0x7f09a80600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:54.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 -- 172.21.15.142:0/2020656057 shutdown_connections 2022-01-24T07:00:54.391 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.383+0000 7f09af831700 1 -- 172.21.15.142:0/2020656057 wait complete. 2022-01-24T07:00:54.391 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.384+0000 7f09af831700 1 Processor -- start 2022-01-24T07:00:54.391 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.384+0000 7f09af831700 1 -- start start 2022-01-24T07:00:54.394 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09af831700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a80d0b30 0x7f09a816f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.394 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09af831700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a8148c70 0x7f09a80d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.395 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09af831700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09a8149050 0x7f09a80d3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.395 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09af831700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80d3940 con 0x7f09a80d0b30 2022-01-24T07:00:54.395 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09af831700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80d2040 con 0x7f09a8149050 2022-01-24T07:00:54.395 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09af831700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80d22e0 con 0x7f09a8148c70 2022-01-24T07:00:54.396 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a8148c70 0x7f09a80d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.396 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09ad5cd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a80d0b30 0x7f09a816f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.396 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a8148c70 0x7f09a80d2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53174/0 (socket says 172.21.15.142:53174) 2022-01-24T07:00:54.396 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09ad5cd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a80d0b30 0x7f09a816f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50410/0 (socket says 172.21.15.142:50410) 2022-01-24T07:00:54.396 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 -- 172.21.15.142:0/3041601182 learned_addr learned my addr 172.21.15.142:0/3041601182 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:54.397 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09addce700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09a8149050 0x7f09a80d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.397 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 -- 172.21.15.142:0/3041601182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09a8149050 msgr2=0x7f09a80d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.397 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09a8149050 0x7f09a80d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.397 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 -- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a80d0b30 msgr2=0x7f09a816f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.398 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a80d0b30 0x7f09a816f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09acdcc700 1 -- 172.21.15.142:0/3041601182 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099800b180 con 0x7f09a8148c70 2022-01-24T07:00:54.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.385+0000 7f09ad5cd700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a80d0b30 0x7f09a816f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:54.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.386+0000 7f09acdcc700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a8148c70 0x7f09a80d2f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f099800c000 tx=0x7f0998006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.386+0000 7f09967fc700 1 -- 172.21.15.142:0/3041601182 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099800c890 con 0x7f09a8148c70 2022-01-24T07:00:54.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.386+0000 7f09967fc700 1 -- 172.21.15.142:0/3041601182 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800c9f0 con 0x7f09a8148c70 2022-01-24T07:00:54.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.386+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a0009530 con 0x7f09a8148c70 2022-01-24T07:00:54.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.386+0000 7f09967fc700 1 -- 172.21.15.142:0/3041601182 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099800cd50 con 0x7f09a8148c70 2022-01-24T07:00:54.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.386+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a80d2820 con 0x7f09a8148c70 2022-01-24T07:00:54.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.387+0000 7f09967fc700 1 -- 172.21.15.142:0/3041601182 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f099801c460 con 0x7f09a8148c70 2022-01-24T07:00:54.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.387+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a80d2c80 con 0x7f09a8148c70 2022-01-24T07:00:54.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.387+0000 7f09967fc700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0988052b40 0x7f0988055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.387+0000 7f09967fc700 1 -- 172.21.15.142:0/3041601182 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f099806b0e0 con 0x7f09a8148c70 2022-01-24T07:00:54.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.387+0000 7f09ad5cd700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0988052b40 0x7f0988055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.387+0000 7f09ad5cd700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0988052b40 0x7f0988055000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f09a400d000 tx=0x7f09a4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.391+0000 7f09967fc700 1 -- 172.21.15.142:0/3041601182 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f09980427a0 con 0x7f09a8148c70 2022-01-24T07:00:54.522 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.521+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09a8067590 con 0x7f09a8148c70 2022-01-24T07:00:54.523 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.522+0000 7f09967fc700 1 -- 172.21.15.142:0/3041601182 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16147 (secure 0 0 0) 0x7f0998045dc0 con 0x7f09a8148c70 2022-01-24T07:00:54.523 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:54.523 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":22,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:54.258916+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0988052b40 msgr2=0x7f0988055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0988052b40 0x7f0988055000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f09a400d000 tx=0x7f09a4009040).stop 2022-01-24T07:00:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a8148c70 msgr2=0x7f09a80d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a8148c70 0x7f09a80d2f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f099800c000 tx=0x7f0998006df0).stop 2022-01-24T07:00:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 shutdown_connections 2022-01-24T07:00:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f09a8149050 0x7f09a80d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0988052b40 0x7f0988055000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09a80d0b30 0x7f09a816f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 --2- 172.21.15.142:0/3041601182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09a8148c70 0x7f09a80d2f60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 >> 172.21.15.142:0/3041601182 conn(0x7f09a805fc90 msgr2=0x7f09a8160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 shutdown_connections 2022-01-24T07:00:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.524+0000 7f09af831700 1 -- 172.21.15.142:0/3041601182 wait complete. 2022-01-24T07:00:54.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:54.635 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.634+0000 7f584dbc2700 1 Processor -- start 2022-01-24T07:00:54.635 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.634+0000 7f584dbc2700 1 -- start start 2022-01-24T07:00:54.643 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f584dbc2700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f58480ca440 0x7f58480ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.643 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f584dbc2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f584805be50 0x7f584805c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.644 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f584dbc2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584805b4b0 con 0x7f5848062760 2022-01-24T07:00:54.644 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f584dbc2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584815e520 con 0x7f584805be50 2022-01-24T07:00:54.644 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f584dbc2700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584815dfe0 con 0x7f58480ca440 2022-01-24T07:00:54.644 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f5847fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f584805be50 0x7f584805c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.645 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f58477fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5848062760 0x7f584815d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47782/0 (socket says 172.21.15.142:47782) 2022-01-24T07:00:54.645 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f58477fe700 1 -- 172.21.15.142:0/2548290231 learned_addr learned my addr 172.21.15.142:0/2548290231 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:54.645 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f5847fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f584805be50 0x7f584805c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50422/0 (socket says 172.21.15.142:50422) 2022-01-24T07:00:54.645 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.635+0000 7f5846ffd700 1 --2- 172.21.15.142:0/2548290231 >> v2:172.21.15.145:3300/0 conn(0x7f58480ca440 0x7f58480ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.645 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f5847fff700 1 -- 172.21.15.142:0/2548290231 >> v2:172.21.15.145:3300/0 conn(0x7f58480ca440 msgr2=0x7f58480ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:54.646 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f5847fff700 1 --2- 172.21.15.142:0/2548290231 >> v2:172.21.15.145:3300/0 conn(0x7f58480ca440 0x7f58480ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.646 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f5847fff700 1 -- 172.21.15.142:0/2548290231 >> v1:172.21.15.142:6789/0 conn(0x7f5848062760 legacy=0x7f584815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.646 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f5847fff700 1 -- 172.21.15.142:0/2548290231 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584815e280 con 0x7f584805be50 2022-01-24T07:00:54.647 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f58467fc700 1 -- 172.21.15.142:0/2548290231 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862929630 0 0) 0x7f584805b4b0 con 0x7f5848062760 2022-01-24T07:00:54.647 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f5847fff700 1 --2- 172.21.15.142:0/2548290231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f584805be50 0x7f584805c2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f58400032f0 tx=0x7f58400091d0).ready entity=mon.0 client_cookie=2996067acaaf3cdd server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.647 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f58467fc700 1 -- 172.21.15.142:0/2548290231 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5840009ea0 con 0x7f584805be50 2022-01-24T07:00:54.647 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f58467fc700 1 -- 172.21.15.142:0/2548290231 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584000b870 con 0x7f584805be50 2022-01-24T07:00:54.647 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f58467fc700 1 -- 172.21.15.142:0/2548290231 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584000b9e0 con 0x7f584805be50 2022-01-24T07:00:54.648 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 -- 172.21.15.142:0/2548290231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f584805be50 msgr2=0x7f584805c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.648 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 --2- 172.21.15.142:0/2548290231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f584805be50 0x7f584805c2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f58400032f0 tx=0x7f58400091d0).stop 2022-01-24T07:00:54.648 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 -- 172.21.15.142:0/2548290231 shutdown_connections 2022-01-24T07:00:54.648 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 --2- 172.21.15.142:0/2548290231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f584805be50 0x7f584805c2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 --2- 172.21.15.142:0/2548290231 >> v2:172.21.15.145:3300/0 conn(0x7f58480ca440 0x7f58480ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 -- 172.21.15.142:0/2548290231 >> 172.21.15.142:0/2548290231 conn(0x7f58480d4830 msgr2=0x7f58480d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:54.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 -- 172.21.15.142:0/2548290231 shutdown_connections 2022-01-24T07:00:54.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.636+0000 7f584dbc2700 1 -- 172.21.15.142:0/2548290231 wait complete. 2022-01-24T07:00:54.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.637+0000 7f584dbc2700 1 Processor -- start 2022-01-24T07:00:54.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f584dbc2700 1 -- start start 2022-01-24T07:00:54.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f584dbc2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f584805be50 0x7f58480d2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f584dbc2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5848062760 0x7f58480d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f584dbc2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58480ca440 0x7f58480b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f584dbc2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480cb100 con 0x7f58480ca440 2022-01-24T07:00:54.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f584dbc2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480d3230 con 0x7f584805be50 2022-01-24T07:00:54.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f584dbc2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584816daa0 con 0x7f5848062760 2022-01-24T07:00:54.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.638+0000 7f5846ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5848062760 0x7f58480d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5848062760 0x7f58480d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53190/0 (socket says 172.21.15.142:53190) 2022-01-24T07:00:54.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 -- 172.21.15.142:0/1518551867 learned_addr learned my addr 172.21.15.142:0/1518551867 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:54.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5847fff700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58480ca440 0x7f58480b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f58477fe700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f584805be50 0x7f58480d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 -- 172.21.15.142:0/1518551867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f584805be50 msgr2=0x7f58480d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f584805be50 0x7f58480d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 -- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58480ca440 msgr2=0x7f58480b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58480ca440 0x7f58480b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 -- 172.21.15.142:0/1518551867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840009470 con 0x7f5848062760 2022-01-24T07:00:54.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5846ffd700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5848062760 0x7f58480d2d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f583c00a000 tx=0x7f583c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5844ff9700 1 -- 172.21.15.142:0/1518551867 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f583c011780 con 0x7f5848062760 2022-01-24T07:00:54.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5844ff9700 1 -- 172.21.15.142:0/1518551867 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0118e0 con 0x7f5848062760 2022-01-24T07:00:54.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58480cb2f0 con 0x7f5848062760 2022-01-24T07:00:54.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f5844ff9700 1 -- 172.21.15.142:0/1518551867 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f583c011c40 con 0x7f5848062760 2022-01-24T07:00:54.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.639+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58480cb830 con 0x7f5848062760 2022-01-24T07:00:54.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.640+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58480cbc90 con 0x7f5848062760 2022-01-24T07:00:54.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.640+0000 7f5844ff9700 1 -- 172.21.15.142:0/1518551867 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f583c01c460 con 0x7f5848062760 2022-01-24T07:00:54.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.641+0000 7f5844ff9700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5828052ab0 0x7f5828054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.656 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.641+0000 7f5844ff9700 1 -- 172.21.15.142:0/1518551867 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f583c06ac90 con 0x7f5848062760 2022-01-24T07:00:54.656 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.641+0000 7f58477fe700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5828052ab0 0x7f5828054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.656 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.641+0000 7f58477fe700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5828052ab0 0x7f5828054f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f583800b000 tx=0x7f5838009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.657 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.644+0000 7f5844ff9700 1 -- 172.21.15.142:0/1518551867 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f583c042350 con 0x7f5848062760 2022-01-24T07:00:54.777 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.777+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58480cc130 con 0x7f5848062760 2022-01-24T07:00:54.778 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.777+0000 7f5844ff9700 1 -- 172.21.15.142:0/1518551867 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16147 (secure 0 0 0) 0x7f583c045970 con 0x7f5848062760 2022-01-24T07:00:54.778 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:54.778 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":22,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:54.258916+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:54.780 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5828052ab0 msgr2=0x7f5828054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.780 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5828052ab0 0x7f5828054f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f583800b000 tx=0x7f5838009040).stop 2022-01-24T07:00:54.780 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5848062760 msgr2=0x7f58480d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.780 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5848062760 0x7f58480d2d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f583c00a000 tx=0x7f583c008040).stop 2022-01-24T07:00:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 shutdown_connections 2022-01-24T07:00:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f584805be50 0x7f58480d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5828052ab0 0x7f5828054f70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.781 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58480ca440 0x7f58480b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 --2- 172.21.15.142:0/1518551867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5848062760 0x7f58480d2d40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 >> 172.21.15.142:0/1518551867 conn(0x7f58480d4830 msgr2=0x7f58480d3620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 shutdown_connections 2022-01-24T07:00:54.782 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.779+0000 7f584dbc2700 1 -- 172.21.15.142:0/1518551867 wait complete. 2022-01-24T07:00:54.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-24T07:00:54.893 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.892+0000 7f83c1da6700 1 Processor -- start 2022-01-24T07:00:54.894 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.892+0000 7f83c1da6700 1 -- start start 2022-01-24T07:00:54.904 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.893+0000 7f83c1da6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f83bc141fb0 0x7f83bc05c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.893+0000 7f83c1da6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc05cef0 con 0x7f83bc0603a0 2022-01-24T07:00:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.893+0000 7f83c1da6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc05d190 con 0x7f83bc05c930 2022-01-24T07:00:54.905 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.893+0000 7f83c1da6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc061cc0 con 0x7f83bc141fb0 2022-01-24T07:00:54.906 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.893+0000 7f83bbfff700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f83bc0603a0 0x7f83bc0620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47798/0 (socket says 172.21.15.142:47798) 2022-01-24T07:00:54.907 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.893+0000 7f83bbfff700 1 -- 172.21.15.142:0/2710581305 learned_addr learned my addr 172.21.15.142:0/2710581305 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:54.907 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240613694 0 0) 0x7f83bc05cef0 con 0x7f83bc0603a0 2022-01-24T07:00:54.907 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83bb7fe700 1 --2- 172.21.15.142:0/2710581305 >> v2:172.21.15.145:3300/0 conn(0x7f83bc141fb0 0x7f83bc05c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a8003260 con 0x7f83bc0603a0 2022-01-24T07:00:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 <== mon.0 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2703863992 0 0) 0x7f83a8003260 con 0x7f83bc0603a0 2022-01-24T07:00:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 >> v2:172.21.15.145:3300/0 conn(0x7f83bc141fb0 msgr2=0x7f83bc05c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:54.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 --2- 172.21.15.142:0/2710581305 >> v2:172.21.15.145:3300/0 conn(0x7f83bc141fb0 0x7f83bc05c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.909 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 >> v1:172.21.15.145:6789/0 conn(0x7f83bc05c930 legacy=0x7f83bc05fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.910 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc05d430 con 0x7f83bc0603a0 2022-01-24T07:00:54.910 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 <== mon.0 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2378315007 0 0) 0x7f83b4001660 con 0x7f83bc0603a0 2022-01-24T07:00:54.910 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 >> v1:172.21.15.142:6789/0 conn(0x7f83bc0603a0 legacy=0x7f83bc0620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83a8003750 0x7f83a8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83a8004500 0x7f83a8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004e70 0x7f83a800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a800bcf0 con 0x7f83a8004500 2022-01-24T07:00:54.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a800be60 con 0x7f83a8003750 2022-01-24T07:00:54.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a800c020 con 0x7f83a8004e70 2022-01-24T07:00:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83baffd700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83a8004500 0x7f83a8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83bbfff700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004e70 0x7f83a800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.913 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83bb7fe700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83a8003750 0x7f83a8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.914 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83baffd700 1 -- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004e70 msgr2=0x7f83a800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:54.914 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83baffd700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004e70 0x7f83a800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.915 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83baffd700 1 -- 172.21.15.142:0/2710581305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83a8003750 msgr2=0x7f83a8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:54.915 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83baffd700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83a8003750 0x7f83a8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83baffd700 1 -- 172.21.15.142:0/2710581305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8003260 con 0x7f83a8004500 2022-01-24T07:00:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83bbfff700 1 -- 172.21.15.142:0/2710581305 reap_dead start 2022-01-24T07:00:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83baffd700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83a8004500 0x7f83a8004980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f83bc0c8b50 tx=0x7f83b0007a00).ready entity=mon.0 client_cookie=529ba1b304bcb213 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83b0007d10 con 0x7f83a8004500 2022-01-24T07:00:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b0007030 con 0x7f83a8004500 2022-01-24T07:00:54.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.894+0000 7f83ba7fc700 1 -- 172.21.15.142:0/2710581305 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83b0007390 con 0x7f83a8004500 2022-01-24T07:00:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.895+0000 7f83c1da6700 1 -- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83a8004500 msgr2=0x7f83a8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.918 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.895+0000 7f83c1da6700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83a8004500 0x7f83a8004980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f83bc0c8b50 tx=0x7f83b0007a00).stop 2022-01-24T07:00:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.895+0000 7f83c1da6700 1 -- 172.21.15.142:0/2710581305 shutdown_connections 2022-01-24T07:00:54.919 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.895+0000 7f83c1da6700 1 --2- 172.21.15.142:0/2710581305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83a8004500 0x7f83a8004980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.895+0000 7f83c1da6700 1 -- 172.21.15.142:0/2710581305 >> 172.21.15.142:0/2710581305 conn(0x7f83bc0d2ce0 msgr2=0x7f83bc0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.895+0000 7f83c1da6700 1 -- 172.21.15.142:0/2710581305 shutdown_connections 2022-01-24T07:00:54.920 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.895+0000 7f83c1da6700 1 -- 172.21.15.142:0/2710581305 wait complete. 2022-01-24T07:00:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.896+0000 7f83c1da6700 1 Processor -- start 2022-01-24T07:00:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.896+0000 7f83c1da6700 1 -- start start 2022-01-24T07:00:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83c1da6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004500 0x7f83bc16d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83c1da6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83bc1605a0 0x7f83bc170010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83c1da6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83bc15e1f0 0x7f83bc13bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83c1da6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc16d980 con 0x7f83bc1605a0 2022-01-24T07:00:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83c1da6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1708d0 con 0x7f83bc15e1f0 2022-01-24T07:00:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83c1da6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc170b70 con 0x7f83a8004500 2022-01-24T07:00:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004500 0x7f83bc16d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004500 0x7f83bc16d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53204/0 (socket says 172.21.15.142:53204) 2022-01-24T07:00:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 -- 172.21.15.142:0/452417850 learned_addr learned my addr 172.21.15.142:0/452417850 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83baffd700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83bc1605a0 0x7f83bc170010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bbfff700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83bc15e1f0 0x7f83bc13bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 -- 172.21.15.142:0/452417850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83bc15e1f0 msgr2=0x7f83bc13bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83bc15e1f0 0x7f83bc13bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 -- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83bc1605a0 msgr2=0x7f83bc170010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83bc1605a0 0x7f83bc170010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:54.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bb7fe700 1 -- 172.21.15.142:0/452417850 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc170e10 con 0x7f83a8004500 2022-01-24T07:00:54.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83bbfff700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83bc15e1f0 0x7f83bc13bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:00:54.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.897+0000 7f83baffd700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83bc1605a0 0x7f83bc170010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:54.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.898+0000 7f83bb7fe700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004500 0x7f83bc16d490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f83ac00b000 tx=0x7f83ac0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.898+0000 7f83b8ff9700 1 -- 172.21.15.142:0/452417850 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83ac00fac0 con 0x7f83a8004500 2022-01-24T07:00:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.898+0000 7f83b8ff9700 1 -- 172.21.15.142:0/452417850 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00fc20 con 0x7f83a8004500 2022-01-24T07:00:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.898+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc16cd50 con 0x7f83a8004500 2022-01-24T07:00:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.898+0000 7f83b8ff9700 1 -- 172.21.15.142:0/452417850 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83ac00fdd0 con 0x7f83a8004500 2022-01-24T07:00:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.898+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc16ca40 con 0x7f83a8004500 2022-01-24T07:00:54.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.899+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc16d1b0 con 0x7f83a8004500 2022-01-24T07:00:54.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.899+0000 7f83b8ff9700 1 -- 172.21.15.142:0/452417850 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f83ac024070 con 0x7f83a8004500 2022-01-24T07:00:54.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.899+0000 7f83b8ff9700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f839c052b70 0x7f839c055030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:54.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.899+0000 7f83b8ff9700 1 -- 172.21.15.142:0/452417850 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83ac06b8a0 con 0x7f83a8004500 2022-01-24T07:00:54.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.899+0000 7f83baffd700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f839c052b70 0x7f839c055030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:54.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.899+0000 7f83baffd700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f839c052b70 0x7f839c055030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f83b001b000 tx=0x7f83b0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:54.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:54.903+0000 7f83b8ff9700 1 -- 172.21.15.142:0/452417850 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f83ac042fc0 con 0x7f83a8004500 2022-01-24T07:00:55.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.084+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83bc15e840 con 0x7f83a8004500 2022-01-24T07:00:55.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.267+0000 7f83b8ff9700 1 -- 172.21.15.142:0/452417850 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83ac0465e0 con 0x7f83a8004500 2022-01-24T07:00:55.269 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f839c052b70 msgr2=0x7f839c055030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:55.270 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f839c052b70 0x7f839c055030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f83b001b000 tx=0x7f83b0015000).stop 2022-01-24T07:00:55.270 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004500 msgr2=0x7f83bc16d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:55.270 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004500 0x7f83bc16d490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f83ac00b000 tx=0x7f83ac0091d0).stop 2022-01-24T07:00:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 shutdown_connections 2022-01-24T07:00:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83bc15e1f0 0x7f83bc13bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f839c052b70 0x7f839c055030 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83a8004500 0x7f83bc16d490 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 --2- 172.21.15.142:0/452417850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83bc1605a0 0x7f83bc170010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:55.272 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 >> 172.21.15.142:0/452417850 conn(0x7f83bc0d2ce0 msgr2=0x7f83bc05fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:55.272 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 shutdown_connections 2022-01-24T07:00:55.272 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.269+0000 7f83c1da6700 1 -- 172.21.15.142:0/452417850 wait complete. 2022-01-24T07:00:55.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 9 2022-01-24T07:00:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.406+0000 7f5fe3a3a700 1 Processor -- start 2022-01-24T07:00:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.406+0000 7f5fe3a3a700 1 -- start start 2022-01-24T07:00:55.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe3a3a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0d0b70 0x7f5fdc064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:55.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe3a3a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc067b90 con 0x7f5fdc062fe0 2022-01-24T07:00:55.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe3a3a700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0634b0 con 0x7f5fdc0d0f50 2022-01-24T07:00:55.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe3a3a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc063750 con 0x7f5fdc0d0b70 2022-01-24T07:00:55.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe17d6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0d0b70 0x7f5fdc064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:55.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe0fd5700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5fdc062fe0 0x7f5fdc0ce760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47816/0 (socket says 172.21.15.142:47816) 2022-01-24T07:00:55.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe17d6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5fdc0d0b70 0x7f5fdc064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50452/0 (socket says 172.21.15.142:50452) 2022-01-24T07:00:55.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe0fd5700 1 -- 172.21.15.142:0/3328116895 learned_addr learned my addr 172.21.15.142:0/3328116895 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:55.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe17d6700 1 -- 172.21.15.142:0/3328116895 >> v1:172.21.15.145:6789/0 conn(0x7f5fdc0d0f50 legacy=0x7f5fdc13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:55.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe17d6700 1 -- 172.21.15.142:0/3328116895 >> v1:172.21.15.142:6789/0 conn(0x7f5fdc062fe0 legacy=0x7f5fdc0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:55.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe17d6700 1 -- 172.21.15.142:0/3328116895 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0639f0 con 0x7f5fdc0d0b70 2022-01-24T07:00:55.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fe17d6700 1 --2- 172.21.15.142:0/3328116895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc064670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5fd40032f0 tx=0x7f5fd40091d0).ready entity=mon.0 client_cookie=c1f80c6e80137ae5 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:55.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fcbfff700 1 -- 172.21.15.142:0/3328116895 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fd4009ea0 con 0x7f5fdc0d0b70 2022-01-24T07:00:55.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fcbfff700 1 -- 172.21.15.142:0/3328116895 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd400b870 con 0x7f5fdc0d0b70 2022-01-24T07:00:55.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.407+0000 7f5fcbfff700 1 -- 172.21.15.142:0/3328116895 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fd400b9e0 con 0x7f5fdc0d0b70 2022-01-24T07:00:55.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.408+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/3328116895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 msgr2=0x7f5fdc064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:55.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.408+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/3328116895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc064670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5fd40032f0 tx=0x7f5fd40091d0).stop 2022-01-24T07:00:55.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.408+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/3328116895 shutdown_connections 2022-01-24T07:00:55.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.408+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/3328116895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc064670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:55.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.408+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/3328116895 >> 172.21.15.142:0/3328116895 conn(0x7f5fdc061ea0 msgr2=0x7f5fdc0622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:55.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.408+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/3328116895 shutdown_connections 2022-01-24T07:00:55.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.408+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/3328116895 wait complete. 2022-01-24T07:00:55.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.409+0000 7f5fe3a3a700 1 Processor -- start 2022-01-24T07:00:55.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.409+0000 7f5fe3a3a700 1 -- start start 2022-01-24T07:00:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe3a3a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc062fe0 0x7f5fdc05cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe3a3a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc05b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe3a3a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fdc0d0f50 0x7f5fdc15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:55.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe3a3a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc174700 con 0x7f5fdc0d0b70 2022-01-24T07:00:55.419 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe3a3a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc173740 con 0x7f5fdc0d0f50 2022-01-24T07:00:55.419 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe3a3a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc1739e0 con 0x7f5fdc062fe0 2022-01-24T07:00:55.419 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc062fe0 0x7f5fdc05cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:55.419 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe0fd5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc05b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc062fe0 0x7f5fdc05cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53220/0 (socket says 172.21.15.142:53220) 2022-01-24T07:00:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe0fd5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc05b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50460/0 (socket says 172.21.15.142:50460) 2022-01-24T07:00:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 -- 172.21.15.142:0/366648606 learned_addr learned my addr 172.21.15.142:0/366648606 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe1fd7700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fdc0d0f50 0x7f5fdc15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:55.420 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 -- 172.21.15.142:0/366648606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fdc0d0f50 msgr2=0x7f5fdc15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:55.421 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fdc0d0f50 0x7f5fdc15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:55.421 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 -- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 msgr2=0x7f5fdc05b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:55.421 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc05b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:55.421 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 -- 172.21.15.142:0/366648606 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4009470 con 0x7f5fdc062fe0 2022-01-24T07:00:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe1fd7700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fdc0d0f50 0x7f5fdc15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe0fd5700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc05b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fe17d6700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc062fe0 0x7f5fdc05cf00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5fdc05cd70 tx=0x7f5fd4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:55.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.410+0000 7f5fca7fc700 1 -- 172.21.15.142:0/366648606 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fd4009ea0 con 0x7f5fdc062fe0 2022-01-24T07:00:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.411+0000 7f5fca7fc700 1 -- 172.21.15.142:0/366648606 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd401f3f0 con 0x7f5fdc062fe0 2022-01-24T07:00:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.411+0000 7f5fca7fc700 1 -- 172.21.15.142:0/366648606 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fd401f750 con 0x7f5fdc062fe0 2022-01-24T07:00:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.411+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc173c80 con 0x7f5fdc062fe0 2022-01-24T07:00:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.411+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc1741c0 con 0x7f5fdc062fe0 2022-01-24T07:00:55.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.412+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc13de70 con 0x7f5fdc062fe0 2022-01-24T07:00:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.412+0000 7f5fca7fc700 1 -- 172.21.15.142:0/366648606 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f5fd4026030 con 0x7f5fdc062fe0 2022-01-24T07:00:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.412+0000 7f5fca7fc700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5fbc052bd0 0x7f5fbc055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.412+0000 7f5fca7fc700 1 -- 172.21.15.142:0/366648606 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5fd406b940 con 0x7f5fdc062fe0 2022-01-24T07:00:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.412+0000 7f5fe0fd5700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5fbc052bd0 0x7f5fbc055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:55.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.413+0000 7f5fe0fd5700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5fbc052bd0 0x7f5fbc055090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5fcc00d000 tx=0x7f5fcc007b80).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:55.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.416+0000 7f5fca7fc700 1 -- 172.21.15.142:0/366648606 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f5fdc13de70 con 0x7f5fdc062fe0 2022-01-24T07:00:55.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:55.592+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "9"} v 0) v1 -- 0x7f5fdc13de70 con 0x7f5fdc062fe0 2022-01-24T07:00:55.716 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:00:55.723 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:00:55.728 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:00:56.273 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.272+0000 7f5fca7fc700 1 -- 172.21.15.142:0/366648606 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "9"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5fdc13de70 con 0x7f5fdc062fe0 2022-01-24T07:00:56.276 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5fbc052bd0 msgr2=0x7f5fbc055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:56.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5fbc052bd0 0x7f5fbc055090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5fcc00d000 tx=0x7f5fcc007b80).stop 2022-01-24T07:00:56.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc062fe0 msgr2=0x7f5fdc05cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:56.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc062fe0 0x7f5fdc05cf00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5fdc05cd70 tx=0x7f5fd4016000).stop 2022-01-24T07:00:56.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 shutdown_connections 2022-01-24T07:00:56.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5fdc0d0f50 0x7f5fdc15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5fbc052bd0 0x7f5fbc055090 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc062fe0 0x7f5fdc05cf00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 --2- 172.21.15.142:0/366648606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc0d0b70 0x7f5fdc05b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.279 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 >> 172.21.15.142:0/366648606 conn(0x7f5fdc061ea0 msgr2=0x7f5fdc1608b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:56.279 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 shutdown_connections 2022-01-24T07:00:56.279 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.276+0000 7f5fe3a3a700 1 -- 172.21.15.142:0/366648606 wait complete. 2022-01-24T07:00:56.292 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2022-01-24T07:00:56.397 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.397+0000 7f335878b700 1 Processor -- start 2022-01-24T07:00:56.397 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.397+0000 7f335878b700 1 -- start start 2022-01-24T07:00:56.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f335878b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f335015ec20 0x7f33500b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:56.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f335878b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146c20 0x7f33500b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:56.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f335878b700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500cca30 con 0x7f3350146840 2022-01-24T07:00:56.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f335878b700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500cccd0 con 0x7f335015ec20 2022-01-24T07:00:56.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f335878b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500ccf70 con 0x7f3350146c20 2022-01-24T07:00:56.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3355d26700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f335015ec20 0x7f33500b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:56.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3356d28700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146c20 0x7f33500b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:56.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3355d26700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f335015ec20 0x7f33500b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50468/0 (socket says 172.21.15.142:50468) 2022-01-24T07:00:56.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3355d26700 1 -- 172.21.15.142:0/4130097329 learned_addr learned my addr 172.21.15.142:0/4130097329 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:56.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3356d28700 1 -- 172.21.15.142:0/4130097329 >> v2:172.21.15.142:3300/0 conn(0x7f335015ec20 msgr2=0x7f33500b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:56.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3356d28700 1 --2- 172.21.15.142:0/4130097329 >> v2:172.21.15.142:3300/0 conn(0x7f335015ec20 0x7f33500b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3356d28700 1 -- 172.21.15.142:0/4130097329 >> v1:172.21.15.145:6789/0 conn(0x7f3350146840 legacy=0x7f33500cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:56.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3356d28700 1 -- 172.21.15.142:0/4130097329 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500cd210 con 0x7f3350146c20 2022-01-24T07:00:56.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3355d26700 1 --2- 172.21.15.142:0/4130097329 >> v2:172.21.15.142:3300/0 conn(0x7f335015ec20 0x7f33500b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:56.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.398+0000 7f3356d28700 1 --2- 172.21.15.142:0/4130097329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146c20 0x7f33500b63c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33480032f0 tx=0x7f33480091d0).ready entity=mon.2 client_cookie=51fdcd2d935cf25a server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:56.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f3355525700 1 -- 172.21.15.142:0/4130097329 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f334800b6c0 con 0x7f3350146c20 2022-01-24T07:00:56.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f3355525700 1 -- 172.21.15.142:0/4130097329 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334800b820 con 0x7f3350146c20 2022-01-24T07:00:56.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f3355525700 1 -- 172.21.15.142:0/4130097329 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f334800b990 con 0x7f3350146c20 2022-01-24T07:00:56.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 -- 172.21.15.142:0/4130097329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146c20 msgr2=0x7f33500b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:56.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 --2- 172.21.15.142:0/4130097329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146c20 0x7f33500b63c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33480032f0 tx=0x7f33480091d0).stop 2022-01-24T07:00:56.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 -- 172.21.15.142:0/4130097329 shutdown_connections 2022-01-24T07:00:56.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 --2- 172.21.15.142:0/4130097329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146c20 0x7f33500b63c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 --2- 172.21.15.142:0/4130097329 >> v2:172.21.15.142:3300/0 conn(0x7f335015ec20 0x7f33500b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 -- 172.21.15.142:0/4130097329 >> 172.21.15.142:0/4130097329 conn(0x7f33500d1bf0 msgr2=0x7f33500d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:56.406 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 -- 172.21.15.142:0/4130097329 shutdown_connections 2022-01-24T07:00:56.406 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.399+0000 7f335878b700 1 -- 172.21.15.142:0/4130097329 wait complete. 2022-01-24T07:00:56.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.400+0000 7f335878b700 1 Processor -- start 2022-01-24T07:00:56.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.400+0000 7f335878b700 1 -- start start 2022-01-24T07:00:56.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f335878b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146840 0x7f3350142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:56.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f335878b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3350146c20 0x7f33501725f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:56.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f335878b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335015ec20 0x7f3350172ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:56.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f335878b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350173150 con 0x7f335015ec20 2022-01-24T07:00:56.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f335878b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33501733f0 con 0x7f3350146c20 2022-01-24T07:00:56.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f335878b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500ca620 con 0x7f3350146840 2022-01-24T07:00:56.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f3356d28700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335015ec20 0x7f3350172ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:56.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f3356527700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146840 0x7f3350142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:56.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f3356d28700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335015ec20 0x7f3350172ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50476/0 (socket says 172.21.15.142:50476) 2022-01-24T07:00:56.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f3356d28700 1 -- 172.21.15.142:0/1522727365 learned_addr learned my addr 172.21.15.142:0/1522727365 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:56.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.401+0000 7f3355d26700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3350146c20 0x7f33501725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:56.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3356527700 1 -- 172.21.15.142:0/1522727365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3350146c20 msgr2=0x7f33501725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:56.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3356527700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3350146c20 0x7f33501725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3356527700 1 -- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335015ec20 msgr2=0x7f3350172ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:56.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3356527700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335015ec20 0x7f3350172ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:56.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3356527700 1 -- 172.21.15.142:0/1522727365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334000b1e0 con 0x7f3350146840 2022-01-24T07:00:56.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3356d28700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335015ec20 0x7f3350172ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:56.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3355d26700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3350146c20 0x7f33501725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:00:56.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f3356527700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146840 0x7f3350142730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f33500b13c0 tx=0x7f334c007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:56.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f333f7fe700 1 -- 172.21.15.142:0/1522727365 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f334c012400 con 0x7f3350146840 2022-01-24T07:00:56.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f333f7fe700 1 -- 172.21.15.142:0/1522727365 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c012560 con 0x7f3350146840 2022-01-24T07:00:56.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3348009470 con 0x7f3350146840 2022-01-24T07:00:56.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f333f7fe700 1 -- 172.21.15.142:0/1522727365 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f334c0128c0 con 0x7f3350146840 2022-01-24T07:00:56.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.402+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33500cab60 con 0x7f3350146840 2022-01-24T07:00:56.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.403+0000 7f333f7fe700 1 -- 172.21.15.142:0/1522727365 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f334c019030 con 0x7f3350146840 2022-01-24T07:00:56.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.403+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33500cd4b0 con 0x7f3350146840 2022-01-24T07:00:56.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.403+0000 7f333f7fe700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3330052ae0 0x7f3330054fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:56.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.403+0000 7f333f7fe700 1 -- 172.21.15.142:0/1522727365 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f334c069d90 con 0x7f3350146840 2022-01-24T07:00:56.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.403+0000 7f3355d26700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3330052ae0 0x7f3330054fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:56.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.404+0000 7f3355d26700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3330052ae0 0x7f3330054fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f334000b000 tx=0x7f3340008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:56.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.407+0000 7f333f7fe700 1 -- 172.21.15.142:0/1522727365 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f334c0414b0 con 0x7f3350146840 2022-01-24T07:00:56.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:56.581+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f3350057950 con 0x7f3350146840 2022-01-24T07:00:57.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.278+0000 7f333f7fe700 1 -- 172.21.15.142:0/1522727365 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7f334c044ad0 con 0x7f3350146840 2022-01-24T07:00:57.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3330052ae0 msgr2=0x7f3330054fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3330052ae0 0x7f3330054fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f334000b000 tx=0x7f3340008040).stop 2022-01-24T07:00:57.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146840 msgr2=0x7f3350142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146840 0x7f3350142730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f33500b13c0 tx=0x7f334c007b90).stop 2022-01-24T07:00:57.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 shutdown_connections 2022-01-24T07:00:57.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3330052ae0 0x7f3330054fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f335015ec20 0x7f3350172ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3350146840 0x7f3350142730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.282 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 --2- 172.21.15.142:0/1522727365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3350146c20 0x7f33501725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.282 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.279+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 >> 172.21.15.142:0/1522727365 conn(0x7f33500d1bf0 msgr2=0x7f33501443d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:57.282 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.280+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 shutdown_connections 2022-01-24T07:00:57.282 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.280+0000 7f335878b700 1 -- 172.21.15.142:0/1522727365 wait complete. 2022-01-24T07:00:57.295 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-24T07:00:57.395 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.394+0000 7f12ffcd9700 1 Processor -- start 2022-01-24T07:00:57.395 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.395+0000 7f12ffcd9700 1 -- start start 2022-01-24T07:00:57.398 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.395+0000 7f12ffcd9700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f12f8161480 0x7f12f80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.398 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.395+0000 7f12ffcd9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12f815d750 0x7f12f815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.395+0000 7f12ffcd9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f80b11a0 con 0x7f12f81610a0 2022-01-24T07:00:57.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.395+0000 7f12ffcd9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80ce4d0 con 0x7f12f815d750 2022-01-24T07:00:57.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12ffcd9700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80cc9b0 con 0x7f12f8161480 2022-01-24T07:00:57.399 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fe276700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12f815d750 0x7f12f815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fda75700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f12f81610a0 0x7f12f80cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47844/0 (socket says 172.21.15.142:47844) 2022-01-24T07:00:57.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fe276700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12f815d750 0x7f12f815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50484/0 (socket says 172.21.15.142:50484) 2022-01-24T07:00:57.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fda75700 1 -- 172.21.15.142:0/1992969217 learned_addr learned my addr 172.21.15.142:0/1992969217 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:57.400 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fd274700 1 --2- 172.21.15.142:0/1992969217 >> v2:172.21.15.145:3300/0 conn(0x7f12f8161480 0x7f12f80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fe276700 1 -- 172.21.15.142:0/1992969217 >> v2:172.21.15.145:3300/0 conn(0x7f12f8161480 msgr2=0x7f12f80cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:57.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fe276700 1 --2- 172.21.15.142:0/1992969217 >> v2:172.21.15.145:3300/0 conn(0x7f12f8161480 0x7f12f80cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fe276700 1 -- 172.21.15.142:0/1992969217 >> v1:172.21.15.142:6789/0 conn(0x7f12f81610a0 legacy=0x7f12f80cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.401 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fe276700 1 -- 172.21.15.142:0/1992969217 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80ccc50 con 0x7f12f815d750 2022-01-24T07:00:57.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fe276700 1 --2- 172.21.15.142:0/1992969217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f815d750 0x7f12f815dbc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f12f0002f70 tx=0x7f12f0006df0).ready entity=mon.0 client_cookie=929dfd8fba6e5d90 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fca73700 1 -- 172.21.15.142:0/1992969217 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f000d5c0 con 0x7f12f815d750 2022-01-24T07:00:57.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fca73700 1 -- 172.21.15.142:0/1992969217 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0000e90 con 0x7f12f815d750 2022-01-24T07:00:57.402 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.396+0000 7f12fca73700 1 -- 172.21.15.142:0/1992969217 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f000d910 con 0x7f12f815d750 2022-01-24T07:00:57.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1992969217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f815d750 msgr2=0x7f12f815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1992969217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f815d750 0x7f12f815dbc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f12f0002f70 tx=0x7f12f0006df0).stop 2022-01-24T07:00:57.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1992969217 shutdown_connections 2022-01-24T07:00:57.403 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1992969217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f815d750 0x7f12f815dbc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1992969217 >> v2:172.21.15.145:3300/0 conn(0x7f12f8161480 0x7f12f80cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1992969217 >> 172.21.15.142:0/1992969217 conn(0x7f12f80d1be0 msgr2=0x7f12f80d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:57.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1992969217 shutdown_connections 2022-01-24T07:00:57.404 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.397+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1992969217 wait complete. 2022-01-24T07:00:57.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.398+0000 7f12ffcd9700 1 Processor -- start 2022-01-24T07:00:57.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.398+0000 7f12ffcd9700 1 -- start start 2022-01-24T07:00:57.408 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f815d750 0x7f12f815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.408 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12f81610a0 0x7f12f8061da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f8161480 0x7f12f816dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8145dc0 con 0x7f12f8161480 2022-01-24T07:00:57.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80b1b10 con 0x7f12f81610a0 2022-01-24T07:00:57.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8160190 con 0x7f12f815d750 2022-01-24T07:00:57.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fda75700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f815d750 0x7f12f815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fe276700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f8161480 0x7f12f816dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fda75700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f815d750 0x7f12f815fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53248/0 (socket says 172.21.15.142:53248) 2022-01-24T07:00:57.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fda75700 1 -- 172.21.15.142:0/1982233766 learned_addr learned my addr 172.21.15.142:0/1982233766 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:57.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fd274700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12f81610a0 0x7f12f8061da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fe276700 1 -- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f815d750 msgr2=0x7f12f815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fe276700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f815d750 0x7f12f815fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fe276700 1 -- 172.21.15.142:0/1982233766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12f81610a0 msgr2=0x7f12f8061da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fe276700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12f81610a0 0x7f12f8061da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fe276700 1 -- 172.21.15.142:0/1982233766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f000b180 con 0x7f12f8161480 2022-01-24T07:00:57.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fd274700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12f81610a0 0x7f12f8061da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:57.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12fe276700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f8161480 0x7f12f816dbf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f12f0002f70 tx=0x7f12f0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12f6ffd700 1 -- 172.21.15.142:0/1982233766 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f0013e90 con 0x7f12f8161480 2022-01-24T07:00:57.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12f6ffd700 1 -- 172.21.15.142:0/1982233766 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f000de70 con 0x7f12f8161480 2022-01-24T07:00:57.413 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12f6ffd700 1 -- 172.21.15.142:0/1982233766 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f001e5f0 con 0x7f12f8161480 2022-01-24T07:00:57.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f8160430 con 0x7f12f8161480 2022-01-24T07:00:57.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.399+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f816d210 con 0x7f12f8161480 2022-01-24T07:00:57.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.400+0000 7f12f6ffd700 1 -- 172.21.15.142:0/1982233766 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f12f001c070 con 0x7f12f8161480 2022-01-24T07:00:57.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.400+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f816d910 con 0x7f12f8161480 2022-01-24T07:00:57.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.401+0000 7f12f6ffd700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f12d8052b40 0x7f12d8055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.401+0000 7f12f6ffd700 1 -- 172.21.15.142:0/1982233766 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f12f006b630 con 0x7f12f8161480 2022-01-24T07:00:57.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.401+0000 7f12fda75700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f12d8052b40 0x7f12d8055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.401+0000 7f12fda75700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f12d8052b40 0x7f12d8055000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f12e800d000 tx=0x7f12e8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.404+0000 7f12f6ffd700 1 -- 172.21.15.142:0/1982233766 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f12f0042d50 con 0x7f12f8161480 2022-01-24T07:00:57.576 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.575+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12f80ccef0 con 0x7f12f8161480 2022-01-24T07:00:57.576 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.576+0000 7f12f6ffd700 1 -- 172.21.15.142:0/1982233766 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f12f0023090 con 0x7f12f8161480 2022-01-24T07:00:57.577 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:57.577 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4241,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.145:6833/4266718599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4266718599},{"type":"v1","addr":"172.21.15.145:6833","nonce":4266718599}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4244,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.145:6836/2250566993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":2250566993},{"type":"v1","addr":"172.21.15.145:6836","nonce":2250566993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/3496603446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":3496603446},{"type":"v1","addr":"172.21.15.142:6839","nonce":3496603446}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6841/3300581089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3300581089},{"type":"v1","addr":"172.21.15.142:6841","nonce":3300581089}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6836/2798136120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2798136120},{"type":"v1","addr":"172.21.15.142:6836","nonce":2798136120}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2315856698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2315856698},{"type":"v1","addr":"172.21.15.142:6837","nonce":2315856698}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-24T07:00:54.259086+0000","modified":"2022-01-24T07:00:57.279154+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":9,"in":[0,1,2],"up":{"mds_0":4309,"mds_1":4315,"mds_2":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"f","rank":2,"incarnation":9,"state":"up:creating","state_seq":2,"addr":"172.21.15.145:6837/3395087110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3395087110},{"type":"v1","addr":"172.21.15.145:6837","nonce":3395087110}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4309":{"gid":4309,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.145:6839/2894168765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":2894168765},{"type":"v1","addr":"172.21.15.145:6839","nonce":2894168765}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4315":{"gid":4315,"name":"i","rank":1,"incarnation":7,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6841/1371026810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6840","nonce":1371026810},{"type":"v1","addr":"172.21.15.145:6841","nonce":1371026810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-24T07:00:57.578 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f12d8052b40 msgr2=0x7f12d8055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f12d8052b40 0x7f12d8055000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f12e800d000 tx=0x7f12e8009040).stop 2022-01-24T07:00:57.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f8161480 msgr2=0x7f12f816dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f8161480 0x7f12f816dbf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f12f0002f70 tx=0x7f12f0014000).stop 2022-01-24T07:00:57.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 shutdown_connections 2022-01-24T07:00:57.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f12d8052b40 0x7f12d8055000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f8161480 0x7f12f816dbf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f815d750 0x7f12f815fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 --2- 172.21.15.142:0/1982233766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12f81610a0 0x7f12f8061da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 >> 172.21.15.142:0/1982233766 conn(0x7f12f80d1be0 msgr2=0x7f12f8157280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:57.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 shutdown_connections 2022-01-24T07:00:57.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.577+0000 7f12ffcd9700 1 -- 172.21.15.142:0/1982233766 wait complete. 2022-01-24T07:00:57.581 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 9 2022-01-24T07:00:57.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:57.688 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.687+0000 7f53d83e5700 1 Processor -- start 2022-01-24T07:00:57.688 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.687+0000 7f53d83e5700 1 -- start start 2022-01-24T07:00:57.690 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.688+0000 7f53d83e5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d01630d0 0x7f53d0063270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.691 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.688+0000 7f53d83e5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00620b0 con 0x7f53d01634b0 2022-01-24T07:00:57.691 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.688+0000 7f53d83e5700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d0062350 con 0x7f53d0141ba0 2022-01-24T07:00:57.691 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.688+0000 7f53d83e5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00625f0 con 0x7f53d01630d0 2022-01-24T07:00:57.691 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d6181700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d01630d0 0x7f53d0063270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.691 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d5980700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f53d01634b0 0x7f53d00cd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47858/0 (socket says 172.21.15.142:47858) 2022-01-24T07:00:57.692 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d5980700 1 -- 172.21.15.142:0/4290959093 learned_addr learned my addr 172.21.15.142:0/4290959093 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:57.692 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d517f700 1 -- 172.21.15.142:0/4290959093 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434355920 0 0) 0x7f53d00620b0 con 0x7f53d01634b0 2022-01-24T07:00:57.692 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d6181700 1 -- 172.21.15.142:0/4290959093 >> v1:172.21.15.145:6789/0 conn(0x7f53d0141ba0 legacy=0x7f53d0142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:57.692 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d6181700 1 -- 172.21.15.142:0/4290959093 >> v1:172.21.15.142:6789/0 conn(0x7f53d01634b0 legacy=0x7f53d00cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.693 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d6181700 1 -- 172.21.15.142:0/4290959093 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0062890 con 0x7f53d01630d0 2022-01-24T07:00:57.693 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d6181700 1 --2- 172.21.15.142:0/4290959093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d01630d0 0x7f53d0063270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f53c00032f0 tx=0x7f53c00091d0).ready entity=mon.2 client_cookie=16a69c22ce0f6401 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.693 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d517f700 1 -- 172.21.15.142:0/4290959093 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c000b8a0 con 0x7f53d01630d0 2022-01-24T07:00:57.693 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d517f700 1 -- 172.21.15.142:0/4290959093 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000ba00 con 0x7f53d01630d0 2022-01-24T07:00:57.693 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.689+0000 7f53d517f700 1 -- 172.21.15.142:0/4290959093 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c000bb70 con 0x7f53d01630d0 2022-01-24T07:00:57.694 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.690+0000 7f53d83e5700 1 -- 172.21.15.142:0/4290959093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d01630d0 msgr2=0x7f53d0063270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.694 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.690+0000 7f53d83e5700 1 --2- 172.21.15.142:0/4290959093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d01630d0 0x7f53d0063270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f53c00032f0 tx=0x7f53c00091d0).stop 2022-01-24T07:00:57.694 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.690+0000 7f53d83e5700 1 -- 172.21.15.142:0/4290959093 shutdown_connections 2022-01-24T07:00:57.694 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.690+0000 7f53d83e5700 1 --2- 172.21.15.142:0/4290959093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d01630d0 0x7f53d0063270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.694 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.690+0000 7f53d83e5700 1 -- 172.21.15.142:0/4290959093 >> 172.21.15.142:0/4290959093 conn(0x7f53d00d2d50 msgr2=0x7f53d00d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:57.695 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.690+0000 7f53d83e5700 1 -- 172.21.15.142:0/4290959093 shutdown_connections 2022-01-24T07:00:57.695 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.690+0000 7f53d83e5700 1 -- 172.21.15.142:0/4290959093 wait complete. 2022-01-24T07:00:57.698 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.691+0000 7f53d83e5700 1 Processor -- start 2022-01-24T07:00:57.698 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.691+0000 7f53d83e5700 1 -- start start 2022-01-24T07:00:57.698 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0141ba0 0x7f53d0161c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.698 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d01630d0 0x7f53d0066130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.699 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53d01634b0 0x7f53d0066620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.699 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d016fc60 con 0x7f53d01630d0 2022-01-24T07:00:57.699 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0173020 con 0x7f53d01634b0 2022-01-24T07:00:57.699 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d016efe0 con 0x7f53d0141ba0 2022-01-24T07:00:57.699 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0141ba0 0x7f53d0161c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.700 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d5980700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d01630d0 0x7f53d0066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.700 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0141ba0 0x7f53d0161c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53262/0 (socket says 172.21.15.142:53262) 2022-01-24T07:00:57.700 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 -- 172.21.15.142:0/2795941057 learned_addr learned my addr 172.21.15.142:0/2795941057 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:57.700 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6982700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53d01634b0 0x7f53d0066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.701 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 -- 172.21.15.142:0/2795941057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53d01634b0 msgr2=0x7f53d0066620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.701 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53d01634b0 0x7f53d0066620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.701 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 -- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d01630d0 msgr2=0x7f53d0066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.701 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d01630d0 0x7f53d0066130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.701 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 -- 172.21.15.142:0/2795941057 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009470 con 0x7f53d0141ba0 2022-01-24T07:00:57.702 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6982700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53d01634b0 0x7f53d0066620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:57.702 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d5980700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d01630d0 0x7f53d0066130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:57.702 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d6181700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0141ba0 0x7f53d0161c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f53d016fda0 tx=0x7f53c0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.702 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53cf7fe700 1 -- 172.21.15.142:0/2795941057 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c000bb70 con 0x7f53d0141ba0 2022-01-24T07:00:57.703 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53cf7fe700 1 -- 172.21.15.142:0/2795941057 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c001f3f0 con 0x7f53d0141ba0 2022-01-24T07:00:57.703 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d016f280 con 0x7f53d0141ba0 2022-01-24T07:00:57.703 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53cf7fe700 1 -- 172.21.15.142:0/2795941057 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c001f750 con 0x7f53d0141ba0 2022-01-24T07:00:57.703 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.692+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d016f7c0 con 0x7f53d0141ba0 2022-01-24T07:00:57.703 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.693+0000 7f53cf7fe700 1 -- 172.21.15.142:0/2795941057 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f53c0026030 con 0x7f53d0141ba0 2022-01-24T07:00:57.704 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.693+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d0062b30 con 0x7f53d0141ba0 2022-01-24T07:00:57.704 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.694+0000 7f53cf7fe700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f53b0052bd0 0x7f53b0055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.704 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.694+0000 7f53cf7fe700 1 -- 172.21.15.142:0/2795941057 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f53c006b9a0 con 0x7f53d0141ba0 2022-01-24T07:00:57.704 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.694+0000 7f53d5980700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f53b0052bd0 0x7f53b0055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.704 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.694+0000 7f53d5980700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f53b0052bd0 0x7f53b0055090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f53c400d000 tx=0x7f53c4007c20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.705 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.697+0000 7f53cf7fe700 1 -- 172.21.15.142:0/2795941057 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f53c0043060 con 0x7f53d0141ba0 2022-01-24T07:00:57.827 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.827+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53d0057950 con 0x7f53d0141ba0 2022-01-24T07:00:57.828 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.827+0000 7f53cf7fe700 1 -- 172.21.15.142:0/2795941057 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f53c0024090 con 0x7f53d0141ba0 2022-01-24T07:00:57.828 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:57.829 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:56.271262+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:57.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f53b0052bd0 msgr2=0x7f53b0055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f53b0052bd0 0x7f53b0055090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f53c400d000 tx=0x7f53c4007c20).stop 2022-01-24T07:00:57.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0141ba0 msgr2=0x7f53d0161c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0141ba0 0x7f53d0161c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f53d016fda0 tx=0x7f53c0016000).stop 2022-01-24T07:00:57.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 shutdown_connections 2022-01-24T07:00:57.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53d01634b0 0x7f53d0066620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f53b0052bd0 0x7f53b0055090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53d0141ba0 0x7f53d0161c50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 --2- 172.21.15.142:0/2795941057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53d01630d0 0x7f53d0066130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 >> 172.21.15.142:0/2795941057 conn(0x7f53d00d2d50 msgr2=0x7f53d0162630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:57.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 shutdown_connections 2022-01-24T07:00:57.834 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.829+0000 7f53d83e5700 1 -- 172.21.15.142:0/2795941057 wait complete. 2022-01-24T07:00:57.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:57.841 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-01-24T07:00:57.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.940+0000 7f8e290db700 1 Processor -- start 2022-01-24T07:00:57.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.940+0000 7f8e290db700 1 -- start start 2022-01-24T07:00:57.947 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e290db700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415ced0 0x7f8e24064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e290db700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8e2415d2b0 0x7f8e240c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e290db700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e2405c590 0x7f8e240b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e290db700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e240c91e0 con 0x7f8e2405c590 2022-01-24T07:00:57.948 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e290db700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2405b3d0 con 0x7f8e2415d2b0 2022-01-24T07:00:57.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e290db700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2405b670 con 0x7f8e2415ced0 2022-01-24T07:00:57.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e22d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415ced0 0x7f8e24064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e2359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e2405c590 0x7f8e240b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.949 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e2359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e2405c590 0x7f8e240b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50508/0 (socket says 172.21.15.142:50508) 2022-01-24T07:00:57.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e22d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415ced0 0x7f8e24064520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53274/0 (socket says 172.21.15.142:53274) 2022-01-24T07:00:57.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e2359e700 1 -- 172.21.15.142:0/40524055 learned_addr learned my addr 172.21.15.142:0/40524055 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:57.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.941+0000 7f8e2259c700 1 --2- 172.21.15.142:0/40524055 >> v2:172.21.15.145:3300/0 conn(0x7f8e2415d2b0 0x7f8e240c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.950 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e2359e700 1 -- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415ced0 msgr2=0x7f8e24064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:57.951 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e2359e700 1 --2- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415ced0 0x7f8e24064520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.951 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e2359e700 1 -- 172.21.15.142:0/40524055 >> v2:172.21.15.145:3300/0 conn(0x7f8e2415d2b0 msgr2=0x7f8e240c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:57.951 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e2359e700 1 --2- 172.21.15.142:0/40524055 >> v2:172.21.15.145:3300/0 conn(0x7f8e2415d2b0 0x7f8e240c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.951 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e2359e700 1 -- 172.21.15.142:0/40524055 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2405b910 con 0x7f8e2405c590 2022-01-24T07:00:57.952 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e22d9d700 1 --2- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415ced0 0x7f8e24064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:57.952 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e2359e700 1 --2- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e240b2ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8e1c002f70 tx=0x7f8e1c006eb0).ready entity=mon.0 client_cookie=b7831a30224f2cf3 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.952 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e21d9b700 1 -- 172.21.15.142:0/40524055 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e1c00d570 con 0x7f8e2405c590 2022-01-24T07:00:57.952 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e21d9b700 1 -- 172.21.15.142:0/40524055 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c000e90 con 0x7f8e2405c590 2022-01-24T07:00:57.953 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e21d9b700 1 -- 172.21.15.142:0/40524055 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e1c00d900 con 0x7f8e2405c590 2022-01-24T07:00:57.953 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 -- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 msgr2=0x7f8e240b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.953 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 --2- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e240b2ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8e1c002f70 tx=0x7f8e1c006eb0).stop 2022-01-24T07:00:57.953 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 -- 172.21.15.142:0/40524055 shutdown_connections 2022-01-24T07:00:57.954 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 --2- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e240b2ba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.954 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 --2- 172.21.15.142:0/40524055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415ced0 0x7f8e24064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.954 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 --2- 172.21.15.142:0/40524055 >> v2:172.21.15.145:3300/0 conn(0x7f8e2415d2b0 0x7f8e240c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.954 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 -- 172.21.15.142:0/40524055 >> 172.21.15.142:0/40524055 conn(0x7f8e240d4830 msgr2=0x7f8e240d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:57.955 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 -- 172.21.15.142:0/40524055 shutdown_connections 2022-01-24T07:00:57.955 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.942+0000 7f8e290db700 1 -- 172.21.15.142:0/40524055 wait complete. 2022-01-24T07:00:57.955 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 Processor -- start 2022-01-24T07:00:57.955 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 -- start start 2022-01-24T07:00:57.956 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e24152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.956 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2415ced0 0x7f8e24151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.956 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415d2b0 0x7f8e24157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.956 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240ced60 con 0x7f8e2405c590 2022-01-24T07:00:57.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24153620 con 0x7f8e2415ced0 2022-01-24T07:00:57.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e290db700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24152900 con 0x7f8e2415d2b0 2022-01-24T07:00:57.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e22d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e24152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e22d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e24152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50514/0 (socket says 172.21.15.142:50514) 2022-01-24T07:00:57.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e22d9d700 1 -- 172.21.15.142:0/3987657323 learned_addr learned my addr 172.21.15.142:0/3987657323 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:57.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.944+0000 7f8e2359e700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415d2b0 0x7f8e24157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e2259c700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2415ced0 0x7f8e24151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e22d9d700 1 -- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415d2b0 msgr2=0x7f8e24157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e22d9d700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415d2b0 0x7f8e24157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e22d9d700 1 -- 172.21.15.142:0/3987657323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2415ced0 msgr2=0x7f8e24151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:57.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e22d9d700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2415ced0 0x7f8e24151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:57.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e22d9d700 1 -- 172.21.15.142:0/3987657323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009470 con 0x7f8e2405c590 2022-01-24T07:00:57.960 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e22d9d700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e24152120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8e24153760 tx=0x7f8e140091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.960 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e1bfff700 1 -- 172.21.15.142:0/3987657323 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e1400c920 con 0x7f8e2405c590 2022-01-24T07:00:57.960 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e1bfff700 1 -- 172.21.15.142:0/3987657323 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1400ca80 con 0x7f8e2405c590 2022-01-24T07:00:57.960 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c00b1e0 con 0x7f8e2405c590 2022-01-24T07:00:57.961 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e1bfff700 1 -- 172.21.15.142:0/3987657323 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e1400cde0 con 0x7f8e2405c590 2022-01-24T07:00:57.961 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.945+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e241530e0 con 0x7f8e2405c590 2022-01-24T07:00:57.961 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.946+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2405bbb0 con 0x7f8e2405c590 2022-01-24T07:00:57.961 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.946+0000 7f8e1bfff700 1 -- 172.21.15.142:0/3987657323 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f8e1401b400 con 0x7f8e2405c590 2022-01-24T07:00:57.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.946+0000 7f8e1bfff700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8e08052ae0 0x7f8e08054fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:57.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.946+0000 7f8e1bfff700 1 -- 172.21.15.142:0/3987657323 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e1406b530 con 0x7f8e2405c590 2022-01-24T07:00:57.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.947+0000 7f8e2259c700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8e08052ae0 0x7f8e08054fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:57.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.947+0000 7f8e2259c700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8e08052ae0 0x7f8e08054fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8e0c00c000 tx=0x7f8e0c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:57.963 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:57.950+0000 7f8e1bfff700 1 -- 172.21.15.142:0/3987657323 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f8e14042bf0 con 0x7f8e2405c590 2022-01-24T07:00:58.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.082+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e24057950 con 0x7f8e2405c590 2022-01-24T07:00:58.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.083+0000 7f8e1bfff700 1 -- 172.21.15.142:0/3987657323 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f8e14046210 con 0x7f8e2405c590 2022-01-24T07:00:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:58.084 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:56.271262+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:58.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.084+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8e08052ae0 msgr2=0x7f8e08054fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.084+0000 7f8e290db700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8e08052ae0 0x7f8e08054fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8e0c00c000 tx=0x7f8e0c008040).stop 2022-01-24T07:00:58.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.084+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 msgr2=0x7f8e24152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.084+0000 7f8e290db700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e24152120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8e24153760 tx=0x7f8e140091d0).stop 2022-01-24T07:00:58.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 shutdown_connections 2022-01-24T07:00:58.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8e08052ae0 0x7f8e08054fa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415d2b0 0x7f8e24157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e2405c590 0x7f8e24152120 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 --2- 172.21.15.142:0/3987657323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e2415ced0 0x7f8e24151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 >> 172.21.15.142:0/3987657323 conn(0x7f8e240d4830 msgr2=0x7f8e2415aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 shutdown_connections 2022-01-24T07:00:58.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.085+0000 7f8e290db700 1 -- 172.21.15.142:0/3987657323 wait complete. 2022-01-24T07:00:58.095 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-24T07:00:40.161690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-24T07:00:49.517379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-24T07:00:52.172405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-24T07:00:53.230682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-24T07:00:58.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-24T07:00:58.198 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.197+0000 7f8d39e3a700 1 Processor -- start 2022-01-24T07:00:58.198 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.198+0000 7f8d39e3a700 1 -- start start 2022-01-24T07:00:58.201 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.198+0000 7f8d39e3a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d340b9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.202 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.198+0000 7f8d39e3a700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d3415d3c0 0x7f8d340b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.202 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.198+0000 7f8d39e3a700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d340b6ed0 con 0x7f8d3415cfe0 2022-01-24T07:00:58.202 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.198+0000 7f8d39e3a700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d340d17f0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.202 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.198+0000 7f8d39e3a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d340b7170 con 0x7f8d34064790 2022-01-24T07:00:58.203 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d33fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d3415d3c0 0x7f8d340b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.203 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d32ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d340b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.203 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d32ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d340b9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53286/0 (socket says 172.21.15.142:53286) 2022-01-24T07:00:58.203 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d33fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d3415d3c0 0x7f8d340b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50526/0 (socket says 172.21.15.142:50526) 2022-01-24T07:00:58.204 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d32ffd700 1 -- 172.21.15.142:0/852794802 learned_addr learned my addr 172.21.15.142:0/852794802 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.204 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d33fff700 1 -- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 msgr2=0x7f8d340b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:58.204 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d33fff700 1 --2- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d340b9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.204 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d33fff700 1 -- 172.21.15.142:0/852794802 >> v1:172.21.15.142:6789/0 conn(0x7f8d3415cfe0 legacy=0x7f8d34064080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.205 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d327fc700 1 -- 172.21.15.142:0/852794802 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223902096 0 0) 0x7f8d340b6ed0 con 0x7f8d3415cfe0 2022-01-24T07:00:58.205 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d33fff700 1 -- 172.21.15.142:0/852794802 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340b7410 con 0x7f8d3415d3c0 2022-01-24T07:00:58.205 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d32ffd700 1 --2- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d340b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:58.205 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d33fff700 1 --2- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d340b9760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8d2c0032f0 tx=0x7f8d2c0091d0).ready entity=mon.0 client_cookie=fd2c0dfe39e91ce5 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.206 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d327fc700 1 -- 172.21.15.142:0/852794802 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d2c00b6c0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.206 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d327fc700 1 -- 172.21.15.142:0/852794802 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c00b820 con 0x7f8d3415d3c0 2022-01-24T07:00:58.206 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.199+0000 7f8d327fc700 1 -- 172.21.15.142:0/852794802 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d2c00b990 con 0x7f8d3415d3c0 2022-01-24T07:00:58.206 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 -- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 msgr2=0x7f8d340b9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.207 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d340b9760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8d2c0032f0 tx=0x7f8d2c0091d0).stop 2022-01-24T07:00:58.207 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 -- 172.21.15.142:0/852794802 shutdown_connections 2022-01-24T07:00:58.207 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d340b9760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.207 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/852794802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d340b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.207 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 -- 172.21.15.142:0/852794802 >> 172.21.15.142:0/852794802 conn(0x7f8d340d48e0 msgr2=0x7f8d340d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.208 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 -- 172.21.15.142:0/852794802 shutdown_connections 2022-01-24T07:00:58.208 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.200+0000 7f8d39e3a700 1 -- 172.21.15.142:0/852794802 wait complete. 2022-01-24T07:00:58.208 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.201+0000 7f8d39e3a700 1 Processor -- start 2022-01-24T07:00:58.208 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.201+0000 7f8d39e3a700 1 -- start start 2022-01-24T07:00:58.212 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d3413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.212 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d3415cfe0 0x7f8d341561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.212 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d341566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.212 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3413f990 con 0x7f8d3415d3c0 2022-01-24T07:00:58.213 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d34173150 con 0x7f8d3415cfe0 2022-01-24T07:00:58.213 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d340c9e80 con 0x7f8d34064790 2022-01-24T07:00:58.213 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d341566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.213 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d337fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d3413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.214 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d341566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50532/0 (socket says 172.21.15.142:50532) 2022-01-24T07:00:58.214 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 -- 172.21.15.142:0/2810176440 learned_addr learned my addr 172.21.15.142:0/2810176440 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.214 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d337fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d3413f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53290/0 (socket says 172.21.15.142:53290) 2022-01-24T07:00:58.214 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d32ffd700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d3415cfe0 0x7f8d341561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.215 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 -- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 msgr2=0x7f8d3413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.215 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d3413f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.215 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 -- 172.21.15.142:0/2810176440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d3415cfe0 msgr2=0x7f8d341561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.215 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d3415cfe0 0x7f8d341561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.216 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 -- 172.21.15.142:0/2810176440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2800b1e0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.216 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d32ffd700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d3415cfe0 0x7f8d341561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:58.216 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d337fe700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d3413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:58.216 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d33fff700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d341566b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8d2c0032f0 tx=0x7f8d2c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.216 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d30ff9700 1 -- 172.21.15.142:0/2810176440 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d2c00b6c0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.217 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d30ff9700 1 -- 172.21.15.142:0/2810176440 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c021630 con 0x7f8d3415d3c0 2022-01-24T07:00:58.217 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c009470 con 0x7f8d3415d3c0 2022-01-24T07:00:58.218 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d30ff9700 1 -- 172.21.15.142:0/2810176440 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d2c021990 con 0x7f8d3415d3c0 2022-01-24T07:00:58.218 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.202+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d340ca3c0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.218 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.203+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d340caac0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.218 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.204+0000 7f8d30ff9700 1 -- 172.21.15.142:0/2810176440 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f8d2c027020 con 0x7f8d3415d3c0 2022-01-24T07:00:58.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.204+0000 7f8d30ff9700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8d14052bd0 0x7f8d14055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.204+0000 7f8d30ff9700 1 -- 172.21.15.142:0/2810176440 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d2c06bee0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.204+0000 7f8d337fe700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8d14052bd0 0x7f8d14055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.204+0000 7f8d337fe700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8d14052bd0 0x7f8d14055090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8d2400d000 tx=0x7f8d24009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.207+0000 7f8d30ff9700 1 -- 172.21.15.142:0/2810176440 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f8d2c043600 con 0x7f8d3415d3c0 2022-01-24T07:00:58.346 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.346+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8d34057950 con 0x7f8d3415d3c0 2022-01-24T07:00:58.347 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.346+0000 7f8d30ff9700 1 -- 172.21.15.142:0/2810176440 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8d2c0150b0 con 0x7f8d3415d3c0 2022-01-24T07:00:58.347 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2022-01-24T07:00:58.348 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.347+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8d14052bd0 msgr2=0x7f8d14055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.347+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8d14052bd0 0x7f8d14055090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8d2400d000 tx=0x7f8d24009040).stop 2022-01-24T07:00:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.347+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 msgr2=0x7f8d341566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.347+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d341566b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8d2c0032f0 tx=0x7f8d2c016000).stop 2022-01-24T07:00:58.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 shutdown_connections 2022-01-24T07:00:58.350 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8d14052bd0 0x7f8d14055090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.350 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d3415d3c0 0x7f8d341566b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.350 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d34064790 0x7f8d3413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.350 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 --2- 172.21.15.142:0/2810176440 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8d3415cfe0 0x7f8d341561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.351 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 >> 172.21.15.142:0/2810176440 conn(0x7f8d340d48e0 msgr2=0x7f8d3405b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.351 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 shutdown_connections 2022-01-24T07:00:58.351 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.348+0000 7f8d39e3a700 1 -- 172.21.15.142:0/2810176440 wait complete. 2022-01-24T07:00:58.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-24T07:00:58.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.460+0000 7feca2f9e700 1 Processor -- start 2022-01-24T07:00:58.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.460+0000 7feca2f9e700 1 -- start start 2022-01-24T07:00:58.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7feca2f9e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fec9c13f2d0 0x7fec9c05c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7feca2f9e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fec9c0603a0 0x7fec9c061cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7feca2f9e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c05c9f0 con 0x7fec9c13eef0 2022-01-24T07:00:58.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7feca2f9e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c15d490 con 0x7fec9c13f2d0 2022-01-24T07:00:58.465 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7feca2f9e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c05cc90 con 0x7fec9c0603a0 2022-01-24T07:00:58.465 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7fec9bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fec9c13f2d0 0x7fec9c05c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.465 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7fec9bfff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fec9c13f2d0 0x7fec9c05c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50548/0 (socket says 172.21.15.142:50548) 2022-01-24T07:00:58.466 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7fec9bfff700 1 -- 172.21.15.142:0/1816085143 learned_addr learned my addr 172.21.15.142:0/1816085143 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.466 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7fec9bfff700 1 -- 172.21.15.142:0/1816085143 >> v2:172.21.15.145:3300/0 conn(0x7fec9c0603a0 msgr2=0x7fec9c061cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:58.466 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7feca153b700 1 --2- 172.21.15.142:0/1816085143 >> v2:172.21.15.145:3300/0 conn(0x7fec9c0603a0 0x7fec9c061cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.466 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7fec9bfff700 1 --2- 172.21.15.142:0/1816085143 >> v2:172.21.15.145:3300/0 conn(0x7fec9c0603a0 0x7fec9c061cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.467 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7fec9bfff700 1 -- 172.21.15.142:0/1816085143 >> v1:172.21.15.145:6789/0 conn(0x7fec9c13eef0 legacy=0x7fec9c05fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:58.467 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.461+0000 7fec9bfff700 1 -- 172.21.15.142:0/1816085143 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c05cf30 con 0x7fec9c13f2d0 2022-01-24T07:00:58.467 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7fec9bfff700 1 --2- 172.21.15.142:0/1816085143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c13f2d0 0x7fec9c05c440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fec9c0c8c70 tx=0x7fec88006eb0).ready entity=mon.0 client_cookie=da6fe7fc6812b50a server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.467 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7fec9b7fe700 1 -- 172.21.15.142:0/1816085143 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8800d5c0 con 0x7fec9c13f2d0 2022-01-24T07:00:58.468 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7fec9b7fe700 1 -- 172.21.15.142:0/1816085143 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88000e90 con 0x7fec9c13f2d0 2022-01-24T07:00:58.468 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7fec9b7fe700 1 -- 172.21.15.142:0/1816085143 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8800d950 con 0x7fec9c13f2d0 2022-01-24T07:00:58.468 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 -- 172.21.15.142:0/1816085143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c13f2d0 msgr2=0x7fec9c05c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.468 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 --2- 172.21.15.142:0/1816085143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c13f2d0 0x7fec9c05c440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fec9c0c8c70 tx=0x7fec88006eb0).stop 2022-01-24T07:00:58.468 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 -- 172.21.15.142:0/1816085143 shutdown_connections 2022-01-24T07:00:58.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 --2- 172.21.15.142:0/1816085143 >> v2:172.21.15.145:3300/0 conn(0x7fec9c0603a0 0x7fec9c061cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 --2- 172.21.15.142:0/1816085143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c13f2d0 0x7fec9c05c440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 -- 172.21.15.142:0/1816085143 >> 172.21.15.142:0/1816085143 conn(0x7fec9c0d2d20 msgr2=0x7fec9c0d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 -- 172.21.15.142:0/1816085143 shutdown_connections 2022-01-24T07:00:58.470 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.462+0000 7feca2f9e700 1 -- 172.21.15.142:0/1816085143 wait complete. 2022-01-24T07:00:58.470 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.463+0000 7feca2f9e700 1 Processor -- start 2022-01-24T07:00:58.470 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.463+0000 7feca2f9e700 1 -- start start 2022-01-24T07:00:58.474 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca2f9e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c0603a0 0x7fec9c13e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.474 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca2f9e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c13eef0 0x7fec9c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.475 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca2f9e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9c0629d0 0x7fec9c1707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.475 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca2f9e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0af810 con 0x7fec9c0603a0 2022-01-24T07:00:58.475 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca2f9e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c170360 con 0x7fec9c13eef0 2022-01-24T07:00:58.475 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca2f9e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0afa40 con 0x7fec9c0629d0 2022-01-24T07:00:58.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca0d3a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c0603a0 0x7fec9c13e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca153b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9c0629d0 0x7fec9c1707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca0d3a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c0603a0 0x7fec9c13e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50552/0 (socket says 172.21.15.142:50552) 2022-01-24T07:00:58.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.464+0000 7feca0d3a700 1 -- 172.21.15.142:0/2263608343 learned_addr learned my addr 172.21.15.142:0/2263608343 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7fec9bfff700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c13eef0 0x7fec9c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca153b700 1 -- 172.21.15.142:0/2263608343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c13eef0 msgr2=0x7fec9c0c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca153b700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c13eef0 0x7fec9c0c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca153b700 1 -- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c0603a0 msgr2=0x7fec9c13e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca153b700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c0603a0 0x7fec9c13e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca153b700 1 -- 172.21.15.142:0/2263608343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8800b1e0 con 0x7fec9c0629d0 2022-01-24T07:00:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca0d3a700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c0603a0 0x7fec9c13e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca153b700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9c0629d0 0x7fec9c1707c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fec94007000 tx=0x7fec94008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.479 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7fec99ffb700 1 -- 172.21.15.142:0/2263608343 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec94010580 con 0x7fec9c0629d0 2022-01-24T07:00:58.479 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7fec99ffb700 1 -- 172.21.15.142:0/2263608343 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec940106e0 con 0x7fec9c0629d0 2022-01-24T07:00:58.479 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c0afce0 con 0x7fec9c0629d0 2022-01-24T07:00:58.479 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7fec99ffb700 1 -- 172.21.15.142:0/2263608343 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec94010a40 con 0x7fec9c0629d0 2022-01-24T07:00:58.479 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.465+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c0b0220 con 0x7fec9c0629d0 2022-01-24T07:00:58.480 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.466+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c05d1d0 con 0x7fec9c0629d0 2022-01-24T07:00:58.480 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.466+0000 7fec99ffb700 1 -- 172.21.15.142:0/2263608343 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fec94010ba0 con 0x7fec9c0629d0 2022-01-24T07:00:58.480 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.466+0000 7fec99ffb700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fec7c052bd0 0x7fec7c055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.480 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.466+0000 7fec99ffb700 1 -- 172.21.15.142:0/2263608343 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec9406ae60 con 0x7fec9c0629d0 2022-01-24T07:00:58.481 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.466+0000 7feca0d3a700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fec7c052bd0 0x7fec7c055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.481 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.467+0000 7feca0d3a700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fec7c052bd0 0x7fec7c055090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fec9000d000 tx=0x7fec90007c30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.481 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.470+0000 7fec99ffb700 1 -- 172.21.15.142:0/2263608343 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fec94042580 con 0x7fec9c0629d0 2022-01-24T07:00:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.601+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec9c057950 con 0x7fec9c0629d0 2022-01-24T07:00:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.602+0000 7fec99ffb700 1 -- 172.21.15.142:0/2263608343 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec94045ba0 con 0x7fec9c0629d0 2022-01-24T07:00:58.603 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:00:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fec7c052bd0 msgr2=0x7fec7c055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fec7c052bd0 0x7fec7c055090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fec9000d000 tx=0x7fec90007c30).stop 2022-01-24T07:00:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9c0629d0 msgr2=0x7fec9c1707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9c0629d0 0x7fec9c1707c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fec94007000 tx=0x7fec94008040).stop 2022-01-24T07:00:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 shutdown_connections 2022-01-24T07:00:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fec7c052bd0 0x7fec7c055090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec9c0629d0 0x7fec9c1707c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec9c0603a0 0x7fec9c13e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 --2- 172.21.15.142:0/2263608343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec9c13eef0 0x7fec9c0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 >> 172.21.15.142:0/2263608343 conn(0x7fec9c0d2d20 msgr2=0x7fec9c0d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 shutdown_connections 2022-01-24T07:00:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.603+0000 7feca2f9e700 1 -- 172.21.15.142:0/2263608343 wait complete. 2022-01-24T07:00:58.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-24T07:00:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.715+0000 7fb591c9f700 1 Processor -- start 2022-01-24T07:00:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.715+0000 7fb591c9f700 1 -- start start 2022-01-24T07:00:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb591c9f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb58c062d50 0x7fb58c05d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb591c9f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c05b330 0x7fb58c05b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb591c9f700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c0ccf30 con 0x7fb58c062970 2022-01-24T07:00:58.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb591c9f700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c0cd1d0 con 0x7fb58c062d50 2022-01-24T07:00:58.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb591c9f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0cd470 con 0x7fb58c05b330 2022-01-24T07:00:58.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb58affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb58c062d50 0x7fb58c05d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb58bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c05b330 0x7fb58c05b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb58affd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb58c062d50 0x7fb58c05d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50562/0 (socket says 172.21.15.142:50562) 2022-01-24T07:00:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb58b7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb58c062970 0x7fb58c0cf5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47924/0 (socket says 172.21.15.142:47924) 2022-01-24T07:00:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb58bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c05b330 0x7fb58c05b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53326/0 (socket says 172.21.15.142:53326) 2022-01-24T07:00:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb58affd700 1 -- 172.21.15.142:0/1986674710 learned_addr learned my addr 172.21.15.142:0/1986674710 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.716+0000 7fb58affd700 1 -- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c05b330 msgr2=0x7fb58c05b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58affd700 1 --2- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c05b330 0x7fb58c05b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58affd700 1 -- 172.21.15.142:0/1986674710 >> v1:172.21.15.142:6789/0 conn(0x7fb58c062970 legacy=0x7fb58c0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58affd700 1 -- 172.21.15.142:0/1986674710 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0cd710 con 0x7fb58c062d50 2022-01-24T07:00:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58a7fc700 1 -- 172.21.15.142:0/1986674710 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348626467 0 0) 0x7fb58c0ccf30 con 0x7fb58c062970 2022-01-24T07:00:58.723 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58bfff700 1 --2- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c05b330 0x7fb58c05b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:58.723 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58affd700 1 --2- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c062d50 0x7fb58c05d280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb580002f70 tx=0x7fb580006f40).ready entity=mon.0 client_cookie=4f6cb1e11472e61b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.723 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58a7fc700 1 -- 172.21.15.142:0/1986674710 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb58000e9b0 con 0x7fb58c062d50 2022-01-24T07:00:58.723 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58a7fc700 1 -- 172.21.15.142:0/1986674710 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb580000e90 con 0x7fb58c062d50 2022-01-24T07:00:58.724 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb58a7fc700 1 -- 172.21.15.142:0/1986674710 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb58000ed00 con 0x7fb58c062d50 2022-01-24T07:00:58.724 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 -- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c062d50 msgr2=0x7fb58c05d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.724 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c062d50 0x7fb58c05d280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb580002f70 tx=0x7fb580006f40).stop 2022-01-24T07:00:58.724 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 -- 172.21.15.142:0/1986674710 shutdown_connections 2022-01-24T07:00:58.724 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c05b330 0x7fb58c05b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.725 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1986674710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c062d50 0x7fb58c05d280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.725 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 -- 172.21.15.142:0/1986674710 >> 172.21.15.142:0/1986674710 conn(0x7fb58c0d2ee0 msgr2=0x7fb58c0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.725 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 -- 172.21.15.142:0/1986674710 shutdown_connections 2022-01-24T07:00:58.725 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.717+0000 7fb591c9f700 1 -- 172.21.15.142:0/1986674710 wait complete. 2022-01-24T07:00:58.726 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.718+0000 7fb591c9f700 1 Processor -- start 2022-01-24T07:00:58.726 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb591c9f700 1 -- start start 2022-01-24T07:00:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb591c9f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c05b330 0x7fb58c168180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb591c9f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c062970 0x7fb58c0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb591c9f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb58c062d50 0x7fb58c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb591c9f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c1592c0 con 0x7fb58c05b330 2022-01-24T07:00:58.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb591c9f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c16b450 con 0x7fb58c062d50 2022-01-24T07:00:58.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb591c9f700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c141bf0 con 0x7fb58c062970 2022-01-24T07:00:58.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb58affd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c062970 0x7fb58c0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.719+0000 7fb58b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c05b330 0x7fb58c168180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58affd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c062970 0x7fb58c0c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53328/0 (socket says 172.21.15.142:53328) 2022-01-24T07:00:58.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58affd700 1 -- 172.21.15.142:0/1793285341 learned_addr learned my addr 172.21.15.142:0/1793285341 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58b7fe700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c05b330 0x7fb58c168180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50566/0 (socket says 172.21.15.142:50566) 2022-01-24T07:00:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58b7fe700 1 -- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c062970 msgr2=0x7fb58c0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58b7fe700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c062970 0x7fb58c0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58bfff700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb58c062d50 0x7fb58c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58b7fe700 1 -- 172.21.15.142:0/1793285341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb58c062d50 msgr2=0x7fb58c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58b7fe700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb58c062d50 0x7fb58c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58b7fe700 1 -- 172.21.15.142:0/1793285341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58400d910 con 0x7fb58c05b330 2022-01-24T07:00:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58affd700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c062970 0x7fb58c0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58bfff700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb58c062d50 0x7fb58c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:00:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb58b7fe700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c05b330 0x7fb58c168180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb57c000ed0 tx=0x7fb57c007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb588ff9700 1 -- 172.21.15.142:0/1793285341 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb57c0070d0 con 0x7fb58c05b330 2022-01-24T07:00:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb588ff9700 1 -- 172.21.15.142:0/1793285341 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c007230 con 0x7fb58c05b330 2022-01-24T07:00:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58000c2e0 con 0x7fb58c05b330 2022-01-24T07:00:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb588ff9700 1 -- 172.21.15.142:0/1793285341 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb57c005550 con 0x7fb58c05b330 2022-01-24T07:00:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.720+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c13fda0 con 0x7fb58c05b330 2022-01-24T07:00:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.721+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c140740 con 0x7fb58c05b330 2022-01-24T07:00:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.721+0000 7fb588ff9700 1 -- 172.21.15.142:0/1793285341 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fb57c01a060 con 0x7fb58c05b330 2022-01-24T07:00:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.722+0000 7fb588ff9700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fb56c052bd0 0x7fb56c055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.722+0000 7fb588ff9700 1 -- 172.21.15.142:0/1793285341 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb57c06a1b0 con 0x7fb58c05b330 2022-01-24T07:00:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.722+0000 7fb58affd700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fb56c052bd0 0x7fb56c055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.722+0000 7fb58affd700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fb56c052bd0 0x7fb56c055090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb58001c000 tx=0x7fb580015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.725+0000 7fb588ff9700 1 -- 172.21.15.142:0/1793285341 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fb57c0418d0 con 0x7fb58c05b330 2022-01-24T07:00:58.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.857+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb58c0cd9b0 con 0x7fb58c05b330 2022-01-24T07:00:58.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.858+0000 7fb588ff9700 1 -- 172.21.15.142:0/1793285341 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb57c018020 con 0x7fb58c05b330 2022-01-24T07:00:58.859 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:00:58.860 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fb56c052bd0 msgr2=0x7fb56c055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fb56c052bd0 0x7fb56c055090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb58001c000 tx=0x7fb580015000).stop 2022-01-24T07:00:58.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c05b330 msgr2=0x7fb58c168180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c05b330 0x7fb58c168180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb57c000ed0 tx=0x7fb57c007a00).stop 2022-01-24T07:00:58.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 shutdown_connections 2022-01-24T07:00:58.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb58c062d50 0x7fb58c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fb56c052bd0 0x7fb56c055090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb58c05b330 0x7fb58c168180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 --2- 172.21.15.142:0/1793285341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb58c062970 0x7fb58c0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 >> 172.21.15.142:0/1793285341 conn(0x7fb58c0d2ee0 msgr2=0x7fb58c1596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 shutdown_connections 2022-01-24T07:00:58.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.859+0000 7fb591c9f700 1 -- 172.21.15.142:0/1793285341 wait complete. 2022-01-24T07:00:58.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-24T07:00:58.973 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.973+0000 7ff10df5d700 1 Processor -- start 2022-01-24T07:00:58.974 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.973+0000 7ff10df5d700 1 -- start start 2022-01-24T07:00:58.980 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10df5d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1080b2f70 0x7ff1080cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.981 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10df5d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080cd9c0 0x7ff10815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.981 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10df5d700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff1080b3350 0x7ff10815ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.981 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10df5d700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1080cde60 con 0x7ff1080b2f70 2022-01-24T07:00:58.981 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10df5d700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1080ce100 con 0x7ff1080b3350 2022-01-24T07:00:58.982 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10df5d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080ce3a0 con 0x7ff1080cd9c0 2022-01-24T07:00:58.982 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080cd9c0 0x7ff10815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.982 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10cf5b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1080b2f70 0x7ff1080cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.983 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080cd9c0 0x7ff10815d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53338/0 (socket says 172.21.15.142:53338) 2022-01-24T07:00:58.983 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 -- 172.21.15.142:0/4281189532 learned_addr learned my addr 172.21.15.142:0/4281189532 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.983 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10d75c700 1 --2- 172.21.15.142:0/4281189532 >> v2:172.21.15.145:3300/0 conn(0x7ff1080b3350 0x7ff10815ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.983 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 -- 172.21.15.142:0/4281189532 >> v2:172.21.15.145:3300/0 conn(0x7ff1080b3350 msgr2=0x7ff10815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:58.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 --2- 172.21.15.142:0/4281189532 >> v2:172.21.15.145:3300/0 conn(0x7ff1080b3350 0x7ff10815ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 -- 172.21.15.142:0/4281189532 >> v2:172.21.15.142:3300/0 conn(0x7ff1080b2f70 msgr2=0x7ff1080cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:58.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 --2- 172.21.15.142:0/4281189532 >> v2:172.21.15.142:3300/0 conn(0x7ff1080b2f70 0x7ff1080cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff107fff700 1 -- 172.21.15.142:0/4281189532 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1080ce640 con 0x7ff1080cd9c0 2022-01-24T07:00:58.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10d75c700 1 --2- 172.21.15.142:0/4281189532 >> v2:172.21.15.145:3300/0 conn(0x7ff1080b3350 0x7ff10815ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:58.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.974+0000 7ff10cf5b700 1 --2- 172.21.15.142:0/4281189532 >> v2:172.21.15.142:3300/0 conn(0x7ff1080b2f70 0x7ff1080cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:58.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff107fff700 1 --2- 172.21.15.142:0/4281189532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080cd9c0 0x7ff10815d8d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff0f0002f70 tx=0x7ff0f0006eb0).ready entity=mon.2 client_cookie=a179d4d00520a6f3 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff1077fe700 1 -- 172.21.15.142:0/4281189532 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f000d570 con 0x7ff1080cd9c0 2022-01-24T07:00:58.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff1077fe700 1 -- 172.21.15.142:0/4281189532 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f0000e90 con 0x7ff1080cd9c0 2022-01-24T07:00:58.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff1077fe700 1 -- 172.21.15.142:0/4281189532 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f000d900 con 0x7ff1080cd9c0 2022-01-24T07:00:58.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 -- 172.21.15.142:0/4281189532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080cd9c0 msgr2=0x7ff10815d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 --2- 172.21.15.142:0/4281189532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080cd9c0 0x7ff10815d8d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff0f0002f70 tx=0x7ff0f0006eb0).stop 2022-01-24T07:00:58.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 -- 172.21.15.142:0/4281189532 shutdown_connections 2022-01-24T07:00:58.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 --2- 172.21.15.142:0/4281189532 >> v2:172.21.15.145:3300/0 conn(0x7ff1080b3350 0x7ff10815ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 --2- 172.21.15.142:0/4281189532 >> v2:172.21.15.142:3300/0 conn(0x7ff1080b2f70 0x7ff1080cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 --2- 172.21.15.142:0/4281189532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080cd9c0 0x7ff10815d8d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 -- 172.21.15.142:0/4281189532 >> 172.21.15.142:0/4281189532 conn(0x7ff1080d2b30 msgr2=0x7ff1080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 -- 172.21.15.142:0/4281189532 shutdown_connections 2022-01-24T07:00:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.975+0000 7ff10df5d700 1 -- 172.21.15.142:0/4281189532 wait complete. 2022-01-24T07:00:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.976+0000 7ff10df5d700 1 Processor -- start 2022-01-24T07:00:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.976+0000 7ff10df5d700 1 -- start start 2022-01-24T07:00:58.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff10df5d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1080b2f70 0x7ff10805d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff10df5d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080b3350 0x7ff1080c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff10df5d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1080cd9c0 0x7ff10816c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff10df5d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10816d7f0 con 0x7ff1080cd9c0 2022-01-24T07:00:58.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff10df5d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080b5c00 con 0x7ff1080b2f70 2022-01-24T07:00:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff10df5d700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080b5ea0 con 0x7ff1080b3350 2022-01-24T07:00:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff107fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080b3350 0x7ff1080c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff10d75c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1080cd9c0 0x7ff10816c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff107fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080b3350 0x7ff1080c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53344/0 (socket says 172.21.15.142:53344) 2022-01-24T07:00:58.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.977+0000 7ff107fff700 1 -- 172.21.15.142:0/796251908 learned_addr learned my addr 172.21.15.142:0/796251908 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:58.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10cf5b700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1080b2f70 0x7ff10805d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10d75c700 1 -- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080b3350 msgr2=0x7ff1080c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10d75c700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080b3350 0x7ff1080c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10d75c700 1 -- 172.21.15.142:0/796251908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1080b2f70 msgr2=0x7ff10805d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10d75c700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1080b2f70 0x7ff10805d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10d75c700 1 -- 172.21.15.142:0/796251908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8009470 con 0x7ff1080cd9c0 2022-01-24T07:00:58.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10d75c700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1080cd9c0 0x7ff10816c910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff10000a000 tx=0x7ff100008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff105ffb700 1 -- 172.21.15.142:0/796251908 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff100011780 con 0x7ff1080cd9c0 2022-01-24T07:00:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff105ffb700 1 -- 172.21.15.142:0/796251908 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10000de90 con 0x7ff1080cd9c0 2022-01-24T07:00:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f000b1e0 con 0x7ff1080cd9c0 2022-01-24T07:00:58.993 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff105ffb700 1 -- 172.21.15.142:0/796251908 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff100011ad0 con 0x7ff1080cd9c0 2022-01-24T07:00:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.978+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1080b63e0 con 0x7ff1080cd9c0 2022-01-24T07:00:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.979+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1080b6840 con 0x7ff1080cd9c0 2022-01-24T07:00:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.979+0000 7ff105ffb700 1 -- 172.21.15.142:0/796251908 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7ff100011c30 con 0x7ff1080cd9c0 2022-01-24T07:00:58.994 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.979+0000 7ff105ffb700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff0ec052ab0 0x7ff0ec054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:58.995 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.980+0000 7ff105ffb700 1 -- 172.21.15.142:0/796251908 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff10006a880 con 0x7ff1080cd9c0 2022-01-24T07:00:58.995 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.980+0000 7ff10cf5b700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff0ec052ab0 0x7ff0ec054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:58.995 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.980+0000 7ff10cf5b700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff0ec052ab0 0x7ff0ec054f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff0f800b000 tx=0x7ff0f8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:58.996 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:58.983+0000 7ff105ffb700 1 -- 172.21.15.142:0/796251908 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7ff100041fa0 con 0x7ff1080cd9c0 2022-01-24T07:00:59.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.115+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1080ce8e0 con 0x7ff1080cd9c0 2022-01-24T07:00:59.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.116+0000 7ff105ffb700 1 -- 172.21.15.142:0/796251908 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff1000455c0 con 0x7ff1080cd9c0 2022-01-24T07:00:59.116 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:00:59.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff0ec052ab0 msgr2=0x7ff0ec054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff0ec052ab0 0x7ff0ec054f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff0f800b000 tx=0x7ff0f8008040).stop 2022-01-24T07:00:59.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1080cd9c0 msgr2=0x7ff10816c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1080cd9c0 0x7ff10816c910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff10000a000 tx=0x7ff100008040).stop 2022-01-24T07:00:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 shutdown_connections 2022-01-24T07:00:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1080b2f70 0x7ff10805d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff0ec052ab0 0x7ff0ec054f70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1080cd9c0 0x7ff10816c910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 --2- 172.21.15.142:0/796251908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1080b3350 0x7ff1080c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 >> 172.21.15.142:0/796251908 conn(0x7ff1080d2b30 msgr2=0x7ff1081598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:59.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 shutdown_connections 2022-01-24T07:00:59.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.117+0000 7ff10df5d700 1 -- 172.21.15.142:0/796251908 wait complete. 2022-01-24T07:00:59.128 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-01-24T07:00:59.128 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-01-24T07:00:59.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-01-24T07:00:59.228 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.228+0000 7fbd30cfb700 1 Processor -- start 2022-01-24T07:00:59.228 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.228+0000 7fbd30cfb700 1 -- start start 2022-01-24T07:00:59.231 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd30cfb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd2c148c70 0x7fbd2c0bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd30cfb700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fbd2c0d0b30 0x7fbd2c067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd30cfb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c149050 0x7fbd2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd30cfb700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c1607c0 con 0x7fbd2c148c70 2022-01-24T07:00:59.232 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd30cfb700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c066db0 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd30cfb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c067050 con 0x7fbd2c149050 2022-01-24T07:00:59.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd2c148c70 0x7fbd2c0bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2ad9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c149050 0x7fbd2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd2c148c70 0x7fbd2c0bb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50588/0 (socket says 172.21.15.142:50588) 2022-01-24T07:00:59.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2ad9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c149050 0x7fbd2c067f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53354/0 (socket says 172.21.15.142:53354) 2022-01-24T07:00:59.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 -- 172.21.15.142:0/1433212084 learned_addr learned my addr 172.21.15.142:0/1433212084 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:59.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd29d9b700 1 --2- 172.21.15.142:0/1433212084 >> v2:172.21.15.145:3300/0 conn(0x7fbd2c0d0b30 0x7fbd2c067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 -- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c149050 msgr2=0x7fbd2c067f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:59.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 --2- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c149050 0x7fbd2c067f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 -- 172.21.15.142:0/1433212084 >> v2:172.21.15.145:3300/0 conn(0x7fbd2c0d0b30 msgr2=0x7fbd2c067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:59.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 --2- 172.21.15.142:0/1433212084 >> v2:172.21.15.145:3300/0 conn(0x7fbd2c0d0b30 0x7fbd2c067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 -- 172.21.15.142:0/1433212084 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0672f0 con 0x7fbd2c148c70 2022-01-24T07:00:59.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2ad9d700 1 --2- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c149050 0x7fbd2c067f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:59.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2a59c700 1 --2- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c0bb670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbd1c002f70 tx=0x7fbd1c006eb0).ready entity=mon.0 client_cookie=481ef8b6323a572f server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2959a700 1 -- 172.21.15.142:0/1433212084 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c00d570 con 0x7fbd2c148c70 2022-01-24T07:00:59.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2959a700 1 -- 172.21.15.142:0/1433212084 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c000e90 con 0x7fbd2c148c70 2022-01-24T07:00:59.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.229+0000 7fbd2959a700 1 -- 172.21.15.142:0/1433212084 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c00d900 con 0x7fbd2c148c70 2022-01-24T07:00:59.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 -- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 msgr2=0x7fbd2c0bb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c0bb670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbd1c002f70 tx=0x7fbd1c006eb0).stop 2022-01-24T07:00:59.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 -- 172.21.15.142:0/1433212084 shutdown_connections 2022-01-24T07:00:59.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c149050 0x7fbd2c067f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/1433212084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c0bb670 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/1433212084 >> v2:172.21.15.145:3300/0 conn(0x7fbd2c0d0b30 0x7fbd2c067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 -- 172.21.15.142:0/1433212084 >> 172.21.15.142:0/1433212084 conn(0x7fbd2c05fc90 msgr2=0x7fbd2c0600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:59.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 -- 172.21.15.142:0/1433212084 shutdown_connections 2022-01-24T07:00:59.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.230+0000 7fbd30cfb700 1 -- 172.21.15.142:0/1433212084 wait complete. 2022-01-24T07:00:59.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.231+0000 7fbd30cfb700 1 Processor -- start 2022-01-24T07:00:59.239 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.231+0000 7fbd30cfb700 1 -- start start 2022-01-24T07:00:59.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd30cfb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c0d0b30 0x7fbd2c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd30cfb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd30cfb700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd2c149050 0x7fbd2c16f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd30cfb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c16f180 con 0x7fbd2c148c70 2022-01-24T07:00:59.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd30cfb700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c172c90 con 0x7fbd2c149050 2022-01-24T07:00:59.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd30cfb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c172f30 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c0d0b30 0x7fbd2c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd29d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd29d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50596/0 (socket says 172.21.15.142:50596) 2022-01-24T07:00:59.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c0d0b30 0x7fbd2c0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53356/0 (socket says 172.21.15.142:53356) 2022-01-24T07:00:59.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd29d9b700 1 -- 172.21.15.142:0/3053323168 learned_addr learned my addr 172.21.15.142:0/3053323168 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:59.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2ad9d700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd2c149050 0x7fbd2c16f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 -- 172.21.15.142:0/3053323168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd2c149050 msgr2=0x7fbd2c16f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd2c149050 0x7fbd2c16f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 -- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 msgr2=0x7fbd2c15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 -- 172.21.15.142:0/3053323168 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24009470 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd29d9b700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:59.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd2a59c700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c0d0b30 0x7fbd2c0c9ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbd2c0d3080 tx=0x7fbd1c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.232+0000 7fbd1b7fe700 1 -- 172.21.15.142:0/3053323168 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c00de60 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.233+0000 7fbd1b7fe700 1 -- 172.21.15.142:0/3053323168 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c011bf0 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.233+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c00b1e0 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.233+0000 7fbd1b7fe700 1 -- 172.21.15.142:0/3053323168 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c01e460 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.233+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c173470 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.234+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c16f530 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.234+0000 7fbd1b7fe700 1 -- 172.21.15.142:0/3053323168 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fbd1c025030 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.234+0000 7fbd1b7fe700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fbd08052bd0 0x7fbd08055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.234+0000 7fbd1b7fe700 1 -- 172.21.15.142:0/3053323168 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbd1c06bbf0 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.234+0000 7fbd29d9b700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fbd08052bd0 0x7fbd08055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.249 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.234+0000 7fbd29d9b700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fbd08052bd0 0x7fbd08055090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbd20008000 tx=0x7fbd20008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.249 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.238+0000 7fbd1b7fe700 1 -- 172.21.15.142:0/3053323168 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fbd1c043310 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.407+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbd2c067590 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.410+0000 7fbd1b7fe700 1 -- 172.21.15.142:0/3053323168 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+129435 (secure 0 0 0) 0x7fbd1c023020 con 0x7fbd2c0d0b30 2022-01-24T07:00:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:59.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.411+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fbd08052bd0 msgr2=0x7fbd08055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.411+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fbd08052bd0 0x7fbd08055090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbd20008000 tx=0x7fbd20008040).stop 2022-01-24T07:00:59.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.411+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c0d0b30 msgr2=0x7fbd2c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.411+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c0d0b30 0x7fbd2c0c9ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbd2c0d3080 tx=0x7fbd1c015000).stop 2022-01-24T07:00:59.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 shutdown_connections 2022-01-24T07:00:59.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd2c149050 0x7fbd2c16f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fbd08052bd0 0x7fbd08055090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2c0d0b30 0x7fbd2c0c9ed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 --2- 172.21.15.142:0/3053323168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2c148c70 0x7fbd2c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 >> 172.21.15.142:0/3053323168 conn(0x7fbd2c05fc90 msgr2=0x7fbd2c1467c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:59.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 shutdown_connections 2022-01-24T07:00:59.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.412+0000 7fbd30cfb700 1 -- 172.21.15.142:0/3053323168 wait complete. 2022-01-24T07:00:59.422 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":4,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":64452},{"type":"v1","addr":"172.21.15.142:6801","nonce":64452}]},"active_addr":"172.21.15.142:6801/64452","active_change":"2022-01-24T07:00:40.131596+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1458997882}]},{"addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2777782815}]},{"addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":732382308}]}]}} 2022-01-24T07:00:59.428 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-01-24T07:00:59.428 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-01-24T07:00:59.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:59.528 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.528+0000 7fd6d033e700 1 Processor -- start 2022-01-24T07:00:59.529 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.528+0000 7fd6d033e700 1 -- start start 2022-01-24T07:00:59.531 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6d033e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c8064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6d033e700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c80c91a0 con 0x7fd6c815d2b0 2022-01-24T07:00:59.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6d033e700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c805b3d0 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6d033e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c805cca0 con 0x7fd6c815ced0 2022-01-24T07:00:59.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6ce0da700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c8064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6cd8d9700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd6c815d2b0 0x7fd6c805c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47978/0 (socket says 172.21.15.142:47978) 2022-01-24T07:00:59.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6cd8d9700 1 -- 172.21.15.142:0/1822198879 learned_addr learned my addr 172.21.15.142:0/1822198879 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:59.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6ce0da700 1 -- 172.21.15.142:0/1822198879 >> v1:172.21.15.145:6789/0 conn(0x7fd6c80c8cf0 legacy=0x7fd6c80b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6cd0d8700 1 -- 172.21.15.142:0/1822198879 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983934578 0 0) 0x7fd6c80c91a0 con 0x7fd6c815d2b0 2022-01-24T07:00:59.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6ce0da700 1 -- 172.21.15.142:0/1822198879 >> v1:172.21.15.142:6789/0 conn(0x7fd6c815d2b0 legacy=0x7fd6c805c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.529+0000 7fd6ce0da700 1 -- 172.21.15.142:0/1822198879 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c805b670 con 0x7fd6c815ced0 2022-01-24T07:00:59.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6ce0da700 1 --2- 172.21.15.142:0/1822198879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c8064520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd6b80032f0 tx=0x7fd6b80091d0).ready entity=mon.2 client_cookie=e6b2ca38ad2d1c9b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6cd0d8700 1 -- 172.21.15.142:0/1822198879 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b800b8a0 con 0x7fd6c815ced0 2022-01-24T07:00:59.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6cd0d8700 1 -- 172.21.15.142:0/1822198879 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800ba00 con 0x7fd6c815ced0 2022-01-24T07:00:59.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6cd0d8700 1 -- 172.21.15.142:0/1822198879 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b800bb70 con 0x7fd6c815ced0 2022-01-24T07:00:59.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6d033e700 1 -- 172.21.15.142:0/1822198879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 msgr2=0x7fd6c8064520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6d033e700 1 --2- 172.21.15.142:0/1822198879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c8064520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd6b80032f0 tx=0x7fd6b80091d0).stop 2022-01-24T07:00:59.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6d033e700 1 -- 172.21.15.142:0/1822198879 shutdown_connections 2022-01-24T07:00:59.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6d033e700 1 --2- 172.21.15.142:0/1822198879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c8064520 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6d033e700 1 -- 172.21.15.142:0/1822198879 >> 172.21.15.142:0/1822198879 conn(0x7fd6c80d4830 msgr2=0x7fd6c80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:59.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6d033e700 1 -- 172.21.15.142:0/1822198879 shutdown_connections 2022-01-24T07:00:59.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.530+0000 7fd6d033e700 1 -- 172.21.15.142:0/1822198879 wait complete. 2022-01-24T07:00:59.537 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.531+0000 7fd6d033e700 1 Processor -- start 2022-01-24T07:00:59.537 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.531+0000 7fd6d033e700 1 -- start start 2022-01-24T07:00:59.540 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6d033e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6c80c8cf0 0x7fd6c815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.540 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6d033e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c81523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.540 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6d033e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6c815d2b0 0x7fd6c81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.541 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6d033e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8163c00 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.541 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6d033e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8151fb0 con 0x7fd6c815d2b0 2022-01-24T07:00:59.541 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6d033e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80d1d40 con 0x7fd6c815ced0 2022-01-24T07:00:59.541 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce0da700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6c80c8cf0 0x7fd6c815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.542 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6cd8d9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c81523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.542 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce0da700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6c80c8cf0 0x7fd6c815b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50620/0 (socket says 172.21.15.142:50620) 2022-01-24T07:00:59.542 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce0da700 1 -- 172.21.15.142:0/3776489204 learned_addr learned my addr 172.21.15.142:0/3776489204 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:59.542 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce8db700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6c815d2b0 0x7fd6c81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.543 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce0da700 1 -- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 msgr2=0x7fd6c81523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.543 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce0da700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c81523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.543 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce0da700 1 -- 172.21.15.142:0/3776489204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6c815d2b0 msgr2=0x7fd6c81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.543 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.532+0000 7fd6ce0da700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6c815d2b0 0x7fd6c81528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.543 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.533+0000 7fd6ce0da700 1 -- 172.21.15.142:0/3776489204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009470 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.544 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.533+0000 7fd6ce0da700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6c80c8cf0 0x7fd6c815b120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd6b80032f0 tx=0x7fd6b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.544 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.533+0000 7fd6c77fe700 1 -- 172.21.15.142:0/3776489204 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b800bb70 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.544 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.533+0000 7fd6c77fe700 1 -- 172.21.15.142:0/3776489204 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b801f3f0 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.544 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.533+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c80d1fe0 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.545 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.533+0000 7fd6c77fe700 1 -- 172.21.15.142:0/3776489204 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b801f750 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.545 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.533+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c80d27c0 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.545 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.534+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c805b910 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.545 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.534+0000 7fd6c77fe700 1 -- 172.21.15.142:0/3776489204 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fd6b8026030 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.546 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.534+0000 7fd6c77fe700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd6a8052bd0 0x7fd6a8055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.546 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.534+0000 7fd6c77fe700 1 -- 172.21.15.142:0/3776489204 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd6b806b680 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.546 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.534+0000 7fd6cd8d9700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd6a8052bd0 0x7fd6a8055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.546 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.535+0000 7fd6cd8d9700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd6a8052bd0 0x7fd6a8055090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd6bc00d000 tx=0x7fd6bc007c20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.546 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.538+0000 7fd6c77fe700 1 -- 172.21.15.142:0/3776489204 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fd6b8042da0 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.669 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.669+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6c80d2310 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.670 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.670+0000 7fd6c77fe700 1 -- 172.21.15.142:0/3776489204 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16134 (secure 0 0 0) 0x7fd6b8024090 con 0x7fd6c80c8cf0 2022-01-24T07:00:59.671 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:59.671 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:56.271262+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:59.672 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd6a8052bd0 msgr2=0x7fd6a8055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd6a8052bd0 0x7fd6a8055090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd6bc00d000 tx=0x7fd6bc007c20).stop 2022-01-24T07:00:59.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6c80c8cf0 msgr2=0x7fd6c815b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6c80c8cf0 0x7fd6c815b120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd6b80032f0 tx=0x7fd6b8016000).stop 2022-01-24T07:00:59.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 shutdown_connections 2022-01-24T07:00:59.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6c815d2b0 0x7fd6c81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd6a8052bd0 0x7fd6a8055090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6c80c8cf0 0x7fd6c815b120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 --2- 172.21.15.142:0/3776489204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6c815ced0 0x7fd6c81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 >> 172.21.15.142:0/3776489204 conn(0x7fd6c80d4830 msgr2=0x7fd6c8159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:59.675 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 shutdown_connections 2022-01-24T07:00:59.675 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.671+0000 7fd6d033e700 1 -- 172.21.15.142:0/3776489204 wait complete. 2022-01-24T07:00:59.682 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-01-24T07:00:59.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:00:59.782 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.781+0000 7f4c63392700 1 Processor -- start 2022-01-24T07:00:59.782 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.781+0000 7f4c63392700 1 -- start start 2022-01-24T07:00:59.785 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.782+0000 7f4c63392700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15ced0 0x7f4c5c064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.785 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.782+0000 7f4c63392700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c0c91a0 con 0x7f4c5c15d2b0 2022-01-24T07:00:59.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.782+0000 7f4c63392700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c05b3d0 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.782+0000 7f4c63392700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c05cca0 con 0x7f4c5c15ced0 2022-01-24T07:00:59.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.782+0000 7f4c6112e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15ced0 0x7f4c5c064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.782+0000 7f4c6092d700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4c5c15d2b0 0x7f4c5c05c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:47990/0 (socket says 172.21.15.142:47990) 2022-01-24T07:00:59.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.782+0000 7f4c6092d700 1 -- 172.21.15.142:0/1208591898 learned_addr learned my addr 172.21.15.142:0/1208591898 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:00:59.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c5bfff700 1 -- 172.21.15.142:0/1208591898 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507645269 0 0) 0x7f4c5c0c91a0 con 0x7f4c5c15d2b0 2022-01-24T07:00:59.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c5bfff700 1 -- 172.21.15.142:0/1208591898 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c48003260 con 0x7f4c5c15d2b0 2022-01-24T07:00:59.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c6112e700 1 -- 172.21.15.142:0/1208591898 >> v1:172.21.15.145:6789/0 conn(0x7f4c5c0c8cf0 legacy=0x7f4c5c0b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:00:59.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c6112e700 1 -- 172.21.15.142:0/1208591898 >> v1:172.21.15.142:6789/0 conn(0x7f4c5c15d2b0 legacy=0x7f4c5c05c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c6112e700 1 -- 172.21.15.142:0/1208591898 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c05b670 con 0x7f4c5c15ced0 2022-01-24T07:00:59.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c6112e700 1 --2- 172.21.15.142:0/1208591898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15ced0 0x7f4c5c064520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4c5c0b3710 tx=0x7f4c4c0091d0).ready entity=mon.2 client_cookie=67b5b27af4dc3b2e server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c5bfff700 1 -- 172.21.15.142:0/1208591898 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c00b680 con 0x7f4c5c15ced0 2022-01-24T07:00:59.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c5bfff700 1 -- 172.21.15.142:0/1208591898 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c00b7e0 con 0x7f4c5c15ced0 2022-01-24T07:00:59.789 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.783+0000 7f4c5bfff700 1 -- 172.21.15.142:0/1208591898 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c00b950 con 0x7f4c5c15ced0 2022-01-24T07:00:59.789 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.784+0000 7f4c63392700 1 -- 172.21.15.142:0/1208591898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15ced0 msgr2=0x7f4c5c064520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.789 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.784+0000 7f4c63392700 1 --2- 172.21.15.142:0/1208591898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15ced0 0x7f4c5c064520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4c5c0b3710 tx=0x7f4c4c0091d0).stop 2022-01-24T07:00:59.789 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.784+0000 7f4c63392700 1 -- 172.21.15.142:0/1208591898 shutdown_connections 2022-01-24T07:00:59.790 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.784+0000 7f4c63392700 1 --2- 172.21.15.142:0/1208591898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15ced0 0x7f4c5c064520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.790 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.784+0000 7f4c63392700 1 -- 172.21.15.142:0/1208591898 >> 172.21.15.142:0/1208591898 conn(0x7f4c5c0d4830 msgr2=0x7f4c5c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:59.790 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.784+0000 7f4c63392700 1 -- 172.21.15.142:0/1208591898 shutdown_connections 2022-01-24T07:00:59.790 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.784+0000 7f4c63392700 1 -- 172.21.15.142:0/1208591898 wait complete. 2022-01-24T07:00:59.791 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.785+0000 7f4c63392700 1 Processor -- start 2022-01-24T07:00:59.791 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.785+0000 7f4c63392700 1 -- start start 2022-01-24T07:00:59.794 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c5c0c8cf0 0x7f4c5c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.794 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c15ced0 0x7f4c5c171940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.795 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15d2b0 0x7f4c5c171e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.795 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c170780 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.795 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c170a20 con 0x7f4c5c15ced0 2022-01-24T07:00:59.795 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c170cc0 con 0x7f4c5c15d2b0 2022-01-24T07:00:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c5c0c8cf0 0x7f4c5c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c5c0c8cf0 0x7f4c5c15b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50632/0 (socket says 172.21.15.142:50632) 2022-01-24T07:00:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6192f700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15d2b0 0x7f4c5c171e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 -- 172.21.15.142:0/2055066276 learned_addr learned my addr 172.21.15.142:0/2055066276 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:00:59.797 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6092d700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c15ced0 0x7f4c5c171940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.797 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 -- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15d2b0 msgr2=0x7f4c5c171e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.797 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15d2b0 0x7f4c5c171e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.797 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 -- 172.21.15.142:0/2055066276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c15ced0 msgr2=0x7f4c5c171940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.798 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c15ced0 0x7f4c5c171940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.798 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 -- 172.21.15.142:0/2055066276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c009470 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.798 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6092d700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c15ced0 0x7f4c5c171940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:00:59.798 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6192f700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15d2b0 0x7f4c5c171e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:00:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c6112e700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c5c0c8cf0 0x7f4c5c15b3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4c5c0b3710 tx=0x7f4c4c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c5a7fc700 1 -- 172.21.15.142:0/2055066276 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c00b950 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c5a7fc700 1 -- 172.21.15.142:0/2055066276 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c021630 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c5a7fc700 1 -- 172.21.15.142:0/2055066276 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c00b680 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c170f60 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.786+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c1714a0 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.787+0000 7f4c5a7fc700 1 -- 172.21.15.142:0/2055066276 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f4c4c028070 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.787+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c16d000 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.787+0000 7f4c5a7fc700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4c3c052bd0 0x7f4c3c055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:00:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.788+0000 7f4c5a7fc700 1 -- 172.21.15.142:0/2055066276 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c4c06bb30 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.788+0000 7f4c6092d700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4c3c052bd0 0x7f4c3c055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:00:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.788+0000 7f4c6092d700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4c3c052bd0 0x7f4c3c055090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4c5000b000 tx=0x7f4c50009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:00:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.791+0000 7f4c5a7fc700 1 -- 172.21.15.142:0/2055066276 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f4c4c043250 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.923 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.922+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c5c05b910 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.923 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.923+0000 7f4c5a7fc700 1 -- 172.21.15.142:0/2055066276 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f4c4c015020 con 0x7f4c5c0c8cf0 2022-01-24T07:00:59.924 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:00:59.924 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:56.271262+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:00:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4c3c052bd0 msgr2=0x7f4c3c055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4c3c052bd0 0x7f4c3c055090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4c5000b000 tx=0x7f4c50009040).stop 2022-01-24T07:00:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c5c0c8cf0 msgr2=0x7f4c5c15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:00:59.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c5c0c8cf0 0x7f4c5c15b3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4c5c0b3710 tx=0x7f4c4c016000).stop 2022-01-24T07:00:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 shutdown_connections 2022-01-24T07:00:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f4c3c052bd0 0x7f4c3c055090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c5c15d2b0 0x7f4c5c171e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c5c0c8cf0 0x7f4c5c15b3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 --2- 172.21.15.142:0/2055066276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c5c15ced0 0x7f4c5c171940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:00:59.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 >> 172.21.15.142:0/2055066276 conn(0x7f4c5c0d4830 msgr2=0x7f4c5c15be90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:00:59.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 shutdown_connections 2022-01-24T07:00:59.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:00:59.925+0000 7f4c63392700 1 -- 172.21.15.142:0/2055066276 wait complete. 2022-01-24T07:00:59.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-01-24T07:01:00.038 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.038+0000 7fa8ddc19700 1 Processor -- start 2022-01-24T07:01:00.039 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.038+0000 7fa8ddc19700 1 -- start start 2022-01-24T07:01:00.043 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8ddc19700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.043 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8ddc19700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa8d80c8cf0 0x7fa8d80b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8ddc19700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d80c91a0 con 0x7fa8d815d2b0 2022-01-24T07:01:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8ddc19700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d805cca0 con 0x7fa8d80c8cf0 2022-01-24T07:01:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8ddc19700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d805b3d0 con 0x7fa8d815ced0 2022-01-24T07:01:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8ceffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa8d815d2b0 0x7fa8d805c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48004/0 (socket says 172.21.15.142:48004) 2022-01-24T07:01:00.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d77fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8ceffd700 1 -- 172.21.15.142:0/3316914707 learned_addr learned my addr 172.21.15.142:0/3316914707 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:00.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d7fff700 1 --2- 172.21.15.142:0/3316914707 >> v2:172.21.15.145:3300/0 conn(0x7fa8d80c8cf0 0x7fa8d80b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d6ffd700 1 -- 172.21.15.142:0/3316914707 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791788846 0 0) 0x7fa8d80c91a0 con 0x7fa8d815d2b0 2022-01-24T07:01:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d77fe700 1 -- 172.21.15.142:0/3316914707 >> v2:172.21.15.145:3300/0 conn(0x7fa8d80c8cf0 msgr2=0x7fa8d80b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d77fe700 1 --2- 172.21.15.142:0/3316914707 >> v2:172.21.15.145:3300/0 conn(0x7fa8d80c8cf0 0x7fa8d80b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d77fe700 1 -- 172.21.15.142:0/3316914707 >> v1:172.21.15.142:6789/0 conn(0x7fa8d815d2b0 legacy=0x7fa8d805c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d77fe700 1 -- 172.21.15.142:0/3316914707 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d805b670 con 0x7fa8d815ced0 2022-01-24T07:01:00.047 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d77fe700 1 --2- 172.21.15.142:0/3316914707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8064520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa8c8002f70 tx=0x7fa8c8006df0).ready entity=mon.2 client_cookie=a02eaf863153003b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.047 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d6ffd700 1 -- 172.21.15.142:0/3316914707 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c800d570 con 0x7fa8d815ced0 2022-01-24T07:01:00.047 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d6ffd700 1 -- 172.21.15.142:0/3316914707 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8000e90 con 0x7fa8d815ced0 2022-01-24T07:01:00.047 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.039+0000 7fa8d6ffd700 1 -- 172.21.15.142:0/3316914707 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c800d8c0 con 0x7fa8d815ced0 2022-01-24T07:01:00.047 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3316914707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 msgr2=0x7fa8d8064520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.048 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 --2- 172.21.15.142:0/3316914707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8064520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa8c8002f70 tx=0x7fa8c8006df0).stop 2022-01-24T07:01:00.048 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3316914707 shutdown_connections 2022-01-24T07:01:00.048 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 --2- 172.21.15.142:0/3316914707 >> v2:172.21.15.145:3300/0 conn(0x7fa8d80c8cf0 0x7fa8d80b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.048 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 --2- 172.21.15.142:0/3316914707 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8064520 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3316914707 >> 172.21.15.142:0/3316914707 conn(0x7fa8d80d4830 msgr2=0x7fa8d80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3316914707 shutdown_connections 2022-01-24T07:01:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.040+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3316914707 wait complete. 2022-01-24T07:01:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.041+0000 7fa8ddc19700 1 Processor -- start 2022-01-24T07:01:00.049 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.041+0000 7fa8ddc19700 1 -- start start 2022-01-24T07:01:00.050 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ddc19700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8d80c8cf0 0x7fa8d80d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.050 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ddc19700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8170390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.050 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ddc19700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d815d2b0 0x7fa8d816f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.050 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ddc19700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80b5380 con 0x7fa8d815d2b0 2022-01-24T07:01:00.051 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ddc19700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80d2050 con 0x7fa8d80c8cf0 2022-01-24T07:01:00.051 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ddc19700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80b55e0 con 0x7fa8d815ced0 2022-01-24T07:01:00.051 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d815d2b0 0x7fa8d816f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.051 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ceffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8170390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.052 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d815d2b0 0x7fa8d816f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50648/0 (socket says 172.21.15.142:50648) 2022-01-24T07:01:00.052 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 -- 172.21.15.142:0/3836466829 learned_addr learned my addr 172.21.15.142:0/3836466829 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.052 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d77fe700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8d80c8cf0 0x7fa8d80d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.052 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 -- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 msgr2=0x7fa8d8170390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.052 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8170390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.053 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 -- 172.21.15.142:0/3836466829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8d80c8cf0 msgr2=0x7fa8d80d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.053 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8d80c8cf0 0x7fa8d80d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.053 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 -- 172.21.15.142:0/3836466829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c800b180 con 0x7fa8d815d2b0 2022-01-24T07:01:00.053 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8ceffd700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8d815ced0 0x7fa8d8170390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.054 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d77fe700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa8d80c8cf0 0x7fa8d80d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:00.054 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.042+0000 7fa8d7fff700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d815d2b0 0x7fa8d816f870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa8d000a000 tx=0x7fa8d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.054 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.043+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d0013620 con 0x7fa8d815d2b0 2022-01-24T07:01:00.054 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.043+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d0013780 con 0x7fa8d815d2b0 2022-01-24T07:01:00.054 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.043+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d0013ae0 con 0x7fa8d815d2b0 2022-01-24T07:01:00.055 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.043+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d80b5880 con 0x7fa8d815d2b0 2022-01-24T07:01:00.055 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.043+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d80b5dc0 con 0x7fa8d815d2b0 2022-01-24T07:01:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8d80b5f80 con 0x7fa8d815d2b0 2022-01-24T07:01:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fa8d0013c40 con 0x7fa8d815d2b0 2022-01-24T07:01:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8d57fa700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa8bc052ab0 0x7fa8bc054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.057 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa8d006a880 con 0x7fa8d815d2b0 2022-01-24T07:01:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8d77fe700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa8bc052ab0 0x7fa8bc054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8d57fa700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6802/65050,v1:172.21.15.142:6803/65050] conn(0x7fa8bc059f40 0x7fa8bc05c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 --> [v2:172.21.15.142:6802/65050,v1:172.21.15.142:6803/65050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8bc05c9c0 con 0x7fa8bc059f40 2022-01-24T07:01:00.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.044+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8d006f240 con 0x7fa8d815d2b0 2022-01-24T07:01:00.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.045+0000 7fa8ceffd700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6802/65050,v1:172.21.15.142:6803/65050] conn(0x7fa8bc059f40 0x7fa8bc05c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.045+0000 7fa8d77fe700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa8bc052ab0 0x7fa8bc054f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fa8c801a000 tx=0x7fa8c8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.045+0000 7fa8ceffd700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6802/65050,v1:172.21.15.142:6803/65050] conn(0x7fa8bc059f40 0x7fa8bc05c360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.045+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== osd.0 v2:172.21.15.142:6802/65050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fa8bc05c9c0 con 0x7fa8bc059f40 2022-01-24T07:01:00.060 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.060+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 --> [v2:172.21.15.142:6802/65050,v1:172.21.15.142:6803/65050] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa8d80d39a0 con 0x7fa8bc059f40 2022-01-24T07:01:00.061 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8d57fa700 1 -- 172.21.15.142:0/3836466829 <== osd.0 v2:172.21.15.142:6802/65050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa8d80d39a0 con 0x7fa8bc059f40 2022-01-24T07:01:00.062 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6802/65050,v1:172.21.15.142:6803/65050] conn(0x7fa8bc059f40 msgr2=0x7fa8bc05c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.062 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6802/65050,v1:172.21.15.142:6803/65050] conn(0x7fa8bc059f40 0x7fa8bc05c360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.063 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa8bc052ab0 msgr2=0x7fa8bc054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.063 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa8bc052ab0 0x7fa8bc054f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fa8c801a000 tx=0x7fa8c8015000).stop 2022-01-24T07:01:00.063 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d815d2b0 msgr2=0x7fa8d816f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.063 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 --2- 172.21.15.142:0/3836466829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d815d2b0 0x7fa8d816f870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa8d000a000 tx=0x7fa8d0008040).stop 2022-01-24T07:01:00.064 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8d7fff700 1 -- 172.21.15.142:0/3836466829 reap_dead start 2022-01-24T07:01:00.064 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 shutdown_connections 2022-01-24T07:01:00.064 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 >> 172.21.15.142:0/3836466829 conn(0x7fa8d80d4830 msgr2=0x7fa8d805d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.064 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 shutdown_connections 2022-01-24T07:01:00.065 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.061+0000 7fa8ddc19700 1 -- 172.21.15.142:0/3836466829 wait complete. 2022-01-24T07:01:00.071 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2022-01-24T07:01:00.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-01-24T07:01:00.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.172+0000 7f94f078c700 1 Processor -- start 2022-01-24T07:01:00.173 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.172+0000 7f94f078c700 1 -- start start 2022-01-24T07:01:00.175 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94f078c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e815d2b0 0x7f94e8064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.175 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94f078c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80c91a0 con 0x7f94e80c8cf0 2022-01-24T07:01:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94f078c700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e805b3d0 con 0x7f94e815ced0 2022-01-24T07:01:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94f078c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e805cca0 con 0x7f94e815d2b0 2022-01-24T07:01:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94edd27700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e815d2b0 0x7f94e8064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94eed29700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f94e80c8cf0 0x7f94e80b2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48020/0 (socket says 172.21.15.142:48020) 2022-01-24T07:01:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94eed29700 1 -- 172.21.15.142:0/1232637252 learned_addr learned my addr 172.21.15.142:0/1232637252 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94edd27700 1 -- 172.21.15.142:0/1232637252 >> v1:172.21.15.145:6789/0 conn(0x7f94e815ced0 legacy=0x7f94e805c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94ed526700 1 -- 172.21.15.142:0/1232637252 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629039240 0 0) 0x7f94e80c91a0 con 0x7f94e80c8cf0 2022-01-24T07:01:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94edd27700 1 -- 172.21.15.142:0/1232637252 >> v1:172.21.15.142:6789/0 conn(0x7f94e80c8cf0 legacy=0x7f94e80b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.173+0000 7f94edd27700 1 -- 172.21.15.142:0/1232637252 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e805b670 con 0x7f94e815d2b0 2022-01-24T07:01:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94edd27700 1 --2- 172.21.15.142:0/1232637252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e815d2b0 0x7f94e8064520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f94dc002f70 tx=0x7f94dc006df0).ready entity=mon.2 client_cookie=a24d8edd9a895833 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94ed526700 1 -- 172.21.15.142:0/1232637252 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94dc00d5c0 con 0x7f94e815d2b0 2022-01-24T07:01:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94ed526700 1 -- 172.21.15.142:0/1232637252 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc000e90 con 0x7f94e815d2b0 2022-01-24T07:01:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94ed526700 1 -- 172.21.15.142:0/1232637252 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94dc00d910 con 0x7f94e815d2b0 2022-01-24T07:01:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94f078c700 1 -- 172.21.15.142:0/1232637252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e815d2b0 msgr2=0x7f94e8064520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94f078c700 1 --2- 172.21.15.142:0/1232637252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e815d2b0 0x7f94e8064520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f94dc002f70 tx=0x7f94dc006df0).stop 2022-01-24T07:01:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94f078c700 1 -- 172.21.15.142:0/1232637252 shutdown_connections 2022-01-24T07:01:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94f078c700 1 --2- 172.21.15.142:0/1232637252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e815d2b0 0x7f94e8064520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.180 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94f078c700 1 -- 172.21.15.142:0/1232637252 >> 172.21.15.142:0/1232637252 conn(0x7f94e80d4830 msgr2=0x7f94e80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.180 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94f078c700 1 -- 172.21.15.142:0/1232637252 shutdown_connections 2022-01-24T07:01:00.180 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.174+0000 7f94f078c700 1 -- 172.21.15.142:0/1232637252 wait complete. 2022-01-24T07:01:00.184 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.175+0000 7f94f078c700 1 Processor -- start 2022-01-24T07:01:00.184 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.175+0000 7f94f078c700 1 -- start start 2022-01-24T07:01:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94f078c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e80c8cf0 0x7f94e80d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94f078c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e815ced0 0x7f94e8172f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94f078c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94e815d2b0 0x7f94e8154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94f078c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8162870 con 0x7f94e815ced0 2022-01-24T07:01:00.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94f078c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80b57c0 con 0x7f94e815d2b0 2022-01-24T07:01:00.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94f078c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80b5a60 con 0x7f94e80c8cf0 2022-01-24T07:01:00.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94ee528700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e80c8cf0 0x7f94e80d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94edd27700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e815ced0 0x7f94e8172f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.187 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94edd27700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e815ced0 0x7f94e8172f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50662/0 (socket says 172.21.15.142:50662) 2022-01-24T07:01:00.187 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94ee528700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e80c8cf0 0x7f94e80d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53422/0 (socket says 172.21.15.142:53422) 2022-01-24T07:01:00.187 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.176+0000 7f94edd27700 1 -- 172.21.15.142:0/2987165108 learned_addr learned my addr 172.21.15.142:0/2987165108 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.187 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94eed29700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94e815d2b0 0x7f94e8154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94ee528700 1 -- 172.21.15.142:0/2987165108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94e815d2b0 msgr2=0x7f94e8154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94ee528700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94e815d2b0 0x7f94e8154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94ee528700 1 -- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e815ced0 msgr2=0x7f94e8172f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94ee528700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e815ced0 0x7f94e8172f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94ee528700 1 -- 172.21.15.142:0/2987165108 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc00b180 con 0x7f94e80c8cf0 2022-01-24T07:01:00.189 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94edd27700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94e815ced0 0x7f94e8172f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.189 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94ee528700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e80c8cf0 0x7f94e80d0d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f94e8162f00 tx=0x7f94d8007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.189 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d800f470 con 0x7f94e80c8cf0 2022-01-24T07:01:00.189 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d800f5d0 con 0x7f94e80c8cf0 2022-01-24T07:01:00.190 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e8155000 con 0x7f94e80c8cf0 2022-01-24T07:01:00.190 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d800f930 con 0x7f94e80c8cf0 2022-01-24T07:01:00.190 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.177+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e8155540 con 0x7f94e80c8cf0 2022-01-24T07:01:00.191 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94e81559a0 con 0x7f94e80c8cf0 2022-01-24T07:01:00.191 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f94d8019030 con 0x7f94e80c8cf0 2022-01-24T07:01:00.191 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94e77fe700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f94c8052ae0 0x7f94c8054fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.191 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f94d806a460 con 0x7f94e80c8cf0 2022-01-24T07:01:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94edd27700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f94c8052ae0 0x7f94c8054fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94e77fe700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6810/65051,v1:172.21.15.142:6811/65051] conn(0x7f94c8059f70 0x7f94c805c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 --> [v2:172.21.15.142:6810/65051,v1:172.21.15.142:6811/65051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94c805c9f0 con 0x7f94c8059f70 2022-01-24T07:01:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.178+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d806caf0 con 0x7f94e80c8cf0 2022-01-24T07:01:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.179+0000 7f94eed29700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6810/65051,v1:172.21.15.142:6811/65051] conn(0x7f94c8059f70 0x7f94c805c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.193 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.179+0000 7f94edd27700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f94c8052ae0 0x7f94c8054fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f94dc01c000 tx=0x7f94dc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.193 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.179+0000 7f94eed29700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6810/65051,v1:172.21.15.142:6811/65051] conn(0x7f94c8059f70 0x7f94c805c390 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.193 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.179+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== osd.1 v2:172.21.15.142:6810/65051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f94c805c9f0 con 0x7f94c8059f70 2022-01-24T07:01:00.195 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.194+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 --> [v2:172.21.15.142:6810/65051,v1:172.21.15.142:6811/65051] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94e805b910 con 0x7f94c8059f70 2022-01-24T07:01:00.195 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94e77fe700 1 -- 172.21.15.142:0/2987165108 <== osd.1 v2:172.21.15.142:6810/65051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f94e805b910 con 0x7f94c8059f70 2022-01-24T07:01:00.196 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6810/65051,v1:172.21.15.142:6811/65051] conn(0x7f94c8059f70 msgr2=0x7f94c805c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.197 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6810/65051,v1:172.21.15.142:6811/65051] conn(0x7f94c8059f70 0x7f94c805c390 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.197 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f94c8052ae0 msgr2=0x7f94c8054fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.197 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f94c8052ae0 0x7f94c8054fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f94dc01c000 tx=0x7f94dc015000).stop 2022-01-24T07:01:00.197 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e80c8cf0 msgr2=0x7f94e80d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.198 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 --2- 172.21.15.142:0/2987165108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94e80c8cf0 0x7f94e80d0d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f94e8162f00 tx=0x7f94d8007f10).stop 2022-01-24T07:01:00.198 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94eed29700 1 -- 172.21.15.142:0/2987165108 reap_dead start 2022-01-24T07:01:00.198 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 shutdown_connections 2022-01-24T07:01:00.198 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 >> 172.21.15.142:0/2987165108 conn(0x7f94e80d4830 msgr2=0x7f94e815a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.199 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 shutdown_connections 2022-01-24T07:01:00.199 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.195+0000 7f94f078c700 1 -- 172.21.15.142:0/2987165108 wait complete. 2022-01-24T07:01:00.205 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:00.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-01-24T07:01:00.312 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.311+0000 7f3281965700 1 Processor -- start 2022-01-24T07:01:00.312 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.311+0000 7f3281965700 1 -- start start 2022-01-24T07:01:00.314 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.312+0000 7f3281965700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c05d810 0x7f327c140010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.315 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.312+0000 7f3281965700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f327c15f580 0x7f327c15f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.315 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.312+0000 7f3281965700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327c0ce3e0 con 0x7f327c05d430 2022-01-24T07:01:00.315 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f3281965700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327c0ce680 con 0x7f327c15f580 2022-01-24T07:01:00.315 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f3281965700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c15eba0 con 0x7f327c05d810 2022-01-24T07:01:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c05d810 0x7f327c140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c05d810 0x7f327c140010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53444/0 (socket says 172.21.15.142:53444) 2022-01-24T07:01:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 -- 172.21.15.142:0/2385625674 learned_addr learned my addr 172.21.15.142:0/2385625674 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327b7fe700 1 --2- 172.21.15.142:0/2385625674 >> v2:172.21.15.145:3300/0 conn(0x7f327c15f580 0x7f327c15f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 -- 172.21.15.142:0/2385625674 >> v2:172.21.15.145:3300/0 conn(0x7f327c15f580 msgr2=0x7f327c15f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 --2- 172.21.15.142:0/2385625674 >> v2:172.21.15.145:3300/0 conn(0x7f327c15f580 0x7f327c15f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 -- 172.21.15.142:0/2385625674 >> v1:172.21.15.145:6789/0 conn(0x7f327c05d430 legacy=0x7f327c13f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 -- 172.21.15.142:0/2385625674 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c15ee40 con 0x7f327c05d810 2022-01-24T07:01:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f327a7fc700 1 --2- 172.21.15.142:0/2385625674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c05d810 0x7f327c140010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f327c15f460 tx=0x7f3270006eb0).ready entity=mon.2 client_cookie=b472e96176a720f8 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f3279ffb700 1 -- 172.21.15.142:0/2385625674 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327000d570 con 0x7f327c05d810 2022-01-24T07:01:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f3279ffb700 1 -- 172.21.15.142:0/2385625674 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270000e90 con 0x7f327c05d810 2022-01-24T07:01:00.318 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.313+0000 7f3279ffb700 1 -- 172.21.15.142:0/2385625674 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327000d8c0 con 0x7f327c05d810 2022-01-24T07:01:00.319 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 -- 172.21.15.142:0/2385625674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c05d810 msgr2=0x7f327c140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.319 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 --2- 172.21.15.142:0/2385625674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c05d810 0x7f327c140010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f327c15f460 tx=0x7f3270006eb0).stop 2022-01-24T07:01:00.319 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 -- 172.21.15.142:0/2385625674 shutdown_connections 2022-01-24T07:01:00.319 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 --2- 172.21.15.142:0/2385625674 >> v2:172.21.15.145:3300/0 conn(0x7f327c15f580 0x7f327c15f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.320 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 --2- 172.21.15.142:0/2385625674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c05d810 0x7f327c140010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.320 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 -- 172.21.15.142:0/2385625674 >> 172.21.15.142:0/2385625674 conn(0x7f327c0cef20 msgr2=0x7f327c0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.320 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 -- 172.21.15.142:0/2385625674 shutdown_connections 2022-01-24T07:01:00.320 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.314+0000 7f3281965700 1 -- 172.21.15.142:0/2385625674 wait complete. 2022-01-24T07:01:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.315+0000 7f3281965700 1 Processor -- start 2022-01-24T07:01:00.324 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.315+0000 7f3281965700 1 -- start start 2022-01-24T07:01:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f327c05d430 0x7f327c13b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f327c05d810 0x7f327c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c15f580 0x7f327c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.325 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c139150 con 0x7f327c05d810 2022-01-24T07:01:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c1393f0 con 0x7f327c05d430 2022-01-24T07:01:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c139690 con 0x7f327c15f580 2022-01-24T07:01:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c15f580 0x7f327c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.326 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f327c05d810 0x7f327c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.327 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c15f580 0x7f327c15bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53452/0 (socket says 172.21.15.142:53452) 2022-01-24T07:01:00.327 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 -- 172.21.15.142:0/3710539845 learned_addr learned my addr 172.21.15.142:0/3710539845 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.327 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327affd700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f327c05d430 0x7f327c13b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.327 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 -- 172.21.15.142:0/3710539845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f327c05d430 msgr2=0x7f327c13b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.328 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f327c05d430 0x7f327c13b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.328 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 -- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f327c05d810 msgr2=0x7f327c15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.328 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f327c05d810 0x7f327c15b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.328 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 -- 172.21.15.142:0/3710539845 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327000b1e0 con 0x7f327c15f580 2022-01-24T07:01:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327a7fc700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f327c05d810 0x7f327c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f327b7fe700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c15f580 0x7f327c15bae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f327400a000 tx=0x7f3274008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3274013620 con 0x7f327c15f580 2022-01-24T07:01:00.329 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3274013780 con 0x7f327c15f580 2022-01-24T07:01:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c139930 con 0x7f327c15f580 2022-01-24T07:01:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3274013ae0 con 0x7f327c15f580 2022-01-24T07:01:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.316+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c13b940 con 0x7f327c15f580 2022-01-24T07:01:00.330 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.317+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f327c139d90 con 0x7f327c15f580 2022-01-24T07:01:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f3274013c40 con 0x7f327c15f580 2022-01-24T07:01:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f326bfff700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3258052ab0 0x7f3258054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f327406ac20 con 0x7f327c15f580 2022-01-24T07:01:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f327affd700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3258052ab0 0x7f3258054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.331 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f326bfff700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6818/65052,v1:172.21.15.142:6819/65052] conn(0x7f3258059f40 0x7f325805c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.332 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 --> [v2:172.21.15.142:6818/65052,v1:172.21.15.142:6819/65052] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f325805c9c0 con 0x7f3258059f40 2022-01-24T07:01:00.332 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f327406d2b0 con 0x7f327c15f580 2022-01-24T07:01:00.332 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f327a7fc700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6818/65052,v1:172.21.15.142:6819/65052] conn(0x7f3258059f40 0x7f325805c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.332 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f327affd700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3258052ab0 0x7f3258054f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f326c00c000 tx=0x7f326c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.333 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.318+0000 7f327a7fc700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6818/65052,v1:172.21.15.142:6819/65052] conn(0x7f3258059f40 0x7f325805c360 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.333 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.319+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== osd.2 v2:172.21.15.142:6818/65052 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f325805c9c0 con 0x7f3258059f40 2022-01-24T07:01:00.334 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 --> [v2:172.21.15.142:6818/65052,v1:172.21.15.142:6819/65052] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f327c0cd110 con 0x7f3258059f40 2022-01-24T07:01:00.334 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f326bfff700 1 -- 172.21.15.142:0/3710539845 <== osd.2 v2:172.21.15.142:6818/65052 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f327c0cd110 con 0x7f3258059f40 2022-01-24T07:01:00.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6818/65052,v1:172.21.15.142:6819/65052] conn(0x7f3258059f40 msgr2=0x7f325805c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6818/65052,v1:172.21.15.142:6819/65052] conn(0x7f3258059f40 0x7f325805c360 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3258052ab0 msgr2=0x7f3258054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f3258052ab0 0x7f3258054f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f326c00c000 tx=0x7f326c008040).stop 2022-01-24T07:01:00.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c15f580 msgr2=0x7f327c15bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 --2- 172.21.15.142:0/3710539845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f327c15f580 0x7f327c15bae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f327400a000 tx=0x7f3274008040).stop 2022-01-24T07:01:00.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f327b7fe700 1 -- 172.21.15.142:0/3710539845 reap_dead start 2022-01-24T07:01:00.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 shutdown_connections 2022-01-24T07:01:00.338 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 >> 172.21.15.142:0/3710539845 conn(0x7f327c0cef20 msgr2=0x7f327c13c970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.338 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 shutdown_connections 2022-01-24T07:01:00.338 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.334+0000 7f3281965700 1 -- 172.21.15.142:0/3710539845 wait complete. 2022-01-24T07:01:00.345 INFO:teuthology.orchestra.run.smithi142.stdout:60129542148 2022-01-24T07:01:00.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-01-24T07:01:00.444 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.444+0000 7f0b943f5700 1 Processor -- start 2022-01-24T07:01:00.444 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.444+0000 7f0b943f5700 1 -- start start 2022-01-24T07:01:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b943f5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0b8c149050 0x7f0b8c15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b943f5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c1607c0 con 0x7f0b8c0d0b30 2022-01-24T07:01:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b943f5700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c066db0 con 0x7f0b8c148c70 2022-01-24T07:01:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b943f5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c067050 con 0x7f0b8c149050 2022-01-24T07:01:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b92992700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0b8c149050 0x7f0b8c15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b91990700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0b8c0d0b30 0x7f0b8c067a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48060/0 (socket says 172.21.15.142:48060) 2022-01-24T07:01:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b92992700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0b8c149050 0x7f0b8c15fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50698/0 (socket says 172.21.15.142:50698) 2022-01-24T07:01:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b91990700 1 -- 172.21.15.142:0/2263132130 learned_addr learned my addr 172.21.15.142:0/2263132130 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b92992700 1 -- 172.21.15.142:0/2263132130 >> v1:172.21.15.145:6789/0 conn(0x7f0b8c148c70 legacy=0x7f0b8c0bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b92992700 1 -- 172.21.15.142:0/2263132130 >> v1:172.21.15.142:6789/0 conn(0x7f0b8c0d0b30 legacy=0x7f0b8c067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b9118f700 1 -- 172.21.15.142:0/2263132130 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875101308 0 0) 0x7f0b8c1607c0 con 0x7f0b8c0d0b30 2022-01-24T07:01:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b92992700 1 -- 172.21.15.142:0/2263132130 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0672f0 con 0x7f0b8c149050 2022-01-24T07:01:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b92992700 1 --2- 172.21.15.142:0/2263132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c149050 0x7f0b8c15fae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0b840032f0 tx=0x7f0b840091d0).ready entity=mon.0 client_cookie=de45cc09f7998d60 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.445+0000 7f0b9118f700 1 -- 172.21.15.142:0/2263132130 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b84009ea0 con 0x7f0b8c149050 2022-01-24T07:01:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b9118f700 1 -- 172.21.15.142:0/2263132130 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8400b8a0 con 0x7f0b8c149050 2022-01-24T07:01:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b9118f700 1 -- 172.21.15.142:0/2263132130 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8400ba10 con 0x7f0b8c149050 2022-01-24T07:01:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b943f5700 1 -- 172.21.15.142:0/2263132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c149050 msgr2=0x7f0b8c15fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b943f5700 1 --2- 172.21.15.142:0/2263132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c149050 0x7f0b8c15fae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0b840032f0 tx=0x7f0b840091d0).stop 2022-01-24T07:01:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b943f5700 1 -- 172.21.15.142:0/2263132130 shutdown_connections 2022-01-24T07:01:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b943f5700 1 --2- 172.21.15.142:0/2263132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c149050 0x7f0b8c15fae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b943f5700 1 -- 172.21.15.142:0/2263132130 >> 172.21.15.142:0/2263132130 conn(0x7f0b8c05fc90 msgr2=0x7f0b8c0600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.452 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b943f5700 1 -- 172.21.15.142:0/2263132130 shutdown_connections 2022-01-24T07:01:00.452 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.446+0000 7f0b943f5700 1 -- 172.21.15.142:0/2263132130 wait complete. 2022-01-24T07:01:00.456 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.447+0000 7f0b943f5700 1 Processor -- start 2022-01-24T07:01:00.456 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.447+0000 7f0b943f5700 1 -- start start 2022-01-24T07:01:00.456 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b943f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b8c0d0b30 0x7f0b8c172ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.456 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b943f5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c148c70 0x7f0b8c05b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.457 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b943f5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b8c149050 0x7f0b8c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.457 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b943f5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c173df0 con 0x7f0b8c148c70 2022-01-24T07:01:00.457 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b943f5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1733d0 con 0x7f0b8c149050 2022-01-24T07:01:00.457 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b943f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c173610 con 0x7f0b8c0d0b30 2022-01-24T07:01:00.458 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c148c70 0x7f0b8c05b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.458 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b92191700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b8c0d0b30 0x7f0b8c172ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.458 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c148c70 0x7f0b8c05b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50702/0 (socket says 172.21.15.142:50702) 2022-01-24T07:01:00.458 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b92191700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b8c0d0b30 0x7f0b8c172ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53462/0 (socket says 172.21.15.142:53462) 2022-01-24T07:01:00.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 -- 172.21.15.142:0/2081651618 learned_addr learned my addr 172.21.15.142:0/2081651618 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b92992700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b8c149050 0x7f0b8c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 -- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b8c0d0b30 msgr2=0x7f0b8c172ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b8c0d0b30 0x7f0b8c172ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 -- 172.21.15.142:0/2081651618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b8c149050 msgr2=0x7f0b8c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b8c149050 0x7f0b8c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 -- 172.21.15.142:0/2081651618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84009470 con 0x7f0b8c148c70 2022-01-24T07:01:00.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b92191700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b8c0d0b30 0x7f0b8c172ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b91990700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c148c70 0x7f0b8c05b6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0b7c000bc0 tx=0x7f0b7c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.448+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7c00cea0 con 0x7f0b8c148c70 2022-01-24T07:01:00.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.449+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c0070d0 con 0x7f0b8c148c70 2022-01-24T07:01:00.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.449+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c1738b0 con 0x7f0b8c148c70 2022-01-24T07:01:00.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.449+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7c007430 con 0x7f0b8c148c70 2022-01-24T07:01:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.449+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c0c9f00 con 0x7f0b8c148c70 2022-01-24T07:01:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.449+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b8c0ca360 con 0x7f0b8c148c70 2022-01-24T07:01:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f0b7c01a060 con 0x7f0b8c148c70 2022-01-24T07:01:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b7b7fe700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0b6c052b40 0x7f0b6c055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b7c069db0 con 0x7f0b8c148c70 2022-01-24T07:01:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b92191700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0b6c052b40 0x7f0b6c055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b7b7fe700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6820/65053,v1:172.21.15.142:6822/65053] conn(0x7f0b6c059f30 0x7f0b6c05c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 --> [v2:172.21.15.142:6820/65053,v1:172.21.15.142:6822/65053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b6c05c9b0 con 0x7f0b6c059f30 2022-01-24T07:01:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b7c06c440 con 0x7f0b8c148c70 2022-01-24T07:01:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b92992700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6820/65053,v1:172.21.15.142:6822/65053] conn(0x7f0b6c059f30 0x7f0b6c05c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b92191700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0b6c052b40 0x7f0b6c055000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0b8800d000 tx=0x7f0b88009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.450+0000 7f0b92992700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6820/65053,v1:172.21.15.142:6822/65053] conn(0x7f0b6c059f30 0x7f0b6c05c350 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.451+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== osd.3 v2:172.21.15.142:6820/65053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f0b6c05c9b0 con 0x7f0b6c059f30 2022-01-24T07:01:00.467 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.466+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 --> [v2:172.21.15.142:6820/65053,v1:172.21.15.142:6822/65053] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b8c067590 con 0x7f0b6c059f30 2022-01-24T07:01:00.467 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.466+0000 7f0b7b7fe700 1 -- 172.21.15.142:0/2081651618 <== osd.3 v2:172.21.15.142:6820/65053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b8c067590 con 0x7f0b6c059f30 2022-01-24T07:01:00.468 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6820/65053,v1:172.21.15.142:6822/65053] conn(0x7f0b6c059f30 msgr2=0x7f0b6c05c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6820/65053,v1:172.21.15.142:6822/65053] conn(0x7f0b6c059f30 0x7f0b6c05c350 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0b6c052b40 msgr2=0x7f0b6c055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0b6c052b40 0x7f0b6c055000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0b8800d000 tx=0x7f0b88009040).stop 2022-01-24T07:01:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c148c70 msgr2=0x7f0b8c05b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 --2- 172.21.15.142:0/2081651618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c148c70 0x7f0b8c05b6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0b7c000bc0 tx=0x7f0b7c007a60).stop 2022-01-24T07:01:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b92992700 1 -- 172.21.15.142:0/2081651618 reap_dead start 2022-01-24T07:01:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 shutdown_connections 2022-01-24T07:01:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 >> 172.21.15.142:0/2081651618 conn(0x7f0b8c05fc90 msgr2=0x7f0b8c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 shutdown_connections 2022-01-24T07:01:00.471 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.467+0000 7f0b943f5700 1 -- 172.21.15.142:0/2081651618 wait complete. 2022-01-24T07:01:00.477 INFO:teuthology.orchestra.run.smithi142.stdout:60129542148 2022-01-24T07:01:00.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-01-24T07:01:00.577 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.577+0000 7f976f5d6700 1 Processor -- start 2022-01-24T07:01:00.578 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.577+0000 7f976f5d6700 1 -- start start 2022-01-24T07:01:00.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976f5d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f97680ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976f5d6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f976805be50 0x7f976805c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976f5d6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976805b4b0 con 0x7f9768062760 2022-01-24T07:01:00.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976f5d6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976815e520 con 0x7f976805be50 2022-01-24T07:01:00.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976f5d6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976815dfe0 con 0x7f97680ca440 2022-01-24T07:01:00.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976db73700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f976805be50 0x7f976805c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976cb71700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f97680ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976db73700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f976805be50 0x7f976805c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50712/0 (socket says 172.21.15.142:50712) 2022-01-24T07:01:00.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.578+0000 7f976db73700 1 -- 172.21.15.142:0/2906053884 learned_addr learned my addr 172.21.15.142:0/2906053884 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976db73700 1 -- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 msgr2=0x7f97680ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976db73700 1 --2- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f97680ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976db73700 1 -- 172.21.15.142:0/2906053884 >> v1:172.21.15.145:6789/0 conn(0x7f9768062760 legacy=0x7f976815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.584 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976db73700 1 -- 172.21.15.142:0/2906053884 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976815e280 con 0x7f976805be50 2022-01-24T07:01:00.584 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976cb71700 1 --2- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f97680ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.584 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976db73700 1 --2- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f976805be50 0x7f976805c2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9760002f70 tx=0x7f9760006eb0).ready entity=mon.0 client_cookie=391211a1be3fbcab server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.584 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f9767fff700 1 -- 172.21.15.142:0/2906053884 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f976000d570 con 0x7f976805be50 2022-01-24T07:01:00.585 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f9767fff700 1 -- 172.21.15.142:0/2906053884 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9760000e90 con 0x7f976805be50 2022-01-24T07:01:00.585 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f9767fff700 1 -- 172.21.15.142:0/2906053884 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f976000d900 con 0x7f976805be50 2022-01-24T07:01:00.585 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976f5d6700 1 -- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f976805be50 msgr2=0x7f976805c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.585 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976f5d6700 1 --2- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f976805be50 0x7f976805c2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9760002f70 tx=0x7f9760006eb0).stop 2022-01-24T07:01:00.585 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976f5d6700 1 -- 172.21.15.142:0/2906053884 shutdown_connections 2022-01-24T07:01:00.586 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976f5d6700 1 --2- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f976805be50 0x7f976805c2c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.586 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976f5d6700 1 --2- 172.21.15.142:0/2906053884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f97680ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.586 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.579+0000 7f976f5d6700 1 -- 172.21.15.142:0/2906053884 >> 172.21.15.142:0/2906053884 conn(0x7f97680d4830 msgr2=0x7f97680d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.586 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.580+0000 7f976f5d6700 1 -- 172.21.15.142:0/2906053884 shutdown_connections 2022-01-24T07:01:00.587 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.580+0000 7f976f5d6700 1 -- 172.21.15.142:0/2906053884 wait complete. 2022-01-24T07:01:00.587 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 Processor -- start 2022-01-24T07:01:00.587 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 -- start start 2022-01-24T07:01:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f976805be50 0x7f976815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9768062760 0x7f97680604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f9768151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976816c0d0 con 0x7f9768062760 2022-01-24T07:01:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976816b170 con 0x7f976805be50 2022-01-24T07:01:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976f5d6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976816b3b0 con 0x7f97680ca440 2022-01-24T07:01:00.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976cb71700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9768062760 0x7f97680604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.593 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976db73700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f9768151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.593 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976cb71700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9768062760 0x7f97680604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50716/0 (socket says 172.21.15.142:50716) 2022-01-24T07:01:00.593 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976cb71700 1 -- 172.21.15.142:0/3627410974 learned_addr learned my addr 172.21.15.142:0/3627410974 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.593 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.581+0000 7f976db73700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f9768151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53480/0 (socket says 172.21.15.142:53480) 2022-01-24T07:01:00.594 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976cb71700 1 -- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 msgr2=0x7f9768151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.594 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976cb71700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f9768151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.594 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976d372700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f976805be50 0x7f976815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.594 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976cb71700 1 -- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f976805be50 msgr2=0x7f976815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.595 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976cb71700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f976805be50 0x7f976815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.595 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976cb71700 1 -- 172.21.15.142:0/3627410974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c00d590 con 0x7f9768062760 2022-01-24T07:01:00.595 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976db73700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97680ca440 0x7f9768151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.595 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976d372700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f976805be50 0x7f976815cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:01:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976cb71700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9768062760 0x7f97680604b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f975c010000 tx=0x7f975c00f040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f975c010790 con 0x7f9768062760 2022-01-24T07:01:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c013040 con 0x7f9768062760 2022-01-24T07:01:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976000b1e0 con 0x7f9768062760 2022-01-24T07:01:00.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f975c010ae0 con 0x7f9768062760 2022-01-24T07:01:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.582+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976816b8f0 con 0x7f9768062760 2022-01-24T07:01:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.583+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f976805b710 con 0x7f9768062760 2022-01-24T07:01:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.583+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f975c01f030 con 0x7f9768062760 2022-01-24T07:01:00.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f97667fc700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9748052b40 0x7f9748055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f975c06e8c0 con 0x7f9768062760 2022-01-24T07:01:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f976d372700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9748052b40 0x7f9748055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f97667fc700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:6800/65085,v1:172.21.15.145:6801/65085] conn(0x7f9748059f30 0x7f974805c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 --> [v2:172.21.15.145:6800/65085,v1:172.21.15.145:6801/65085] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f974805c9b0 con 0x7f9748059f30 2022-01-24T07:01:00.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f975c073240 con 0x7f9768062760 2022-01-24T07:01:00.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f976d372700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9748052b40 0x7f9748055000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9758008000 tx=0x7f9758009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f976db73700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:6800/65085,v1:172.21.15.145:6801/65085] conn(0x7f9748059f30 0x7f974805c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.584+0000 7f976db73700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:6800/65085,v1:172.21.15.145:6801/65085] conn(0x7f9748059f30 0x7f974805c350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.600 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.585+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== osd.4 v2:172.21.15.145:6800/65085 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f974805c9b0 con 0x7f9748059f30 2022-01-24T07:01:00.600 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.600+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 --> [v2:172.21.15.145:6800/65085,v1:172.21.15.145:6801/65085] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f976816bc20 con 0x7f9748059f30 2022-01-24T07:01:00.601 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.600+0000 7f97667fc700 1 -- 172.21.15.142:0/3627410974 <== osd.4 v2:172.21.15.145:6800/65085 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f976816bc20 con 0x7f9748059f30 2022-01-24T07:01:00.602 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:6800/65085,v1:172.21.15.145:6801/65085] conn(0x7f9748059f30 msgr2=0x7f974805c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.602 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.145:6800/65085,v1:172.21.15.145:6801/65085] conn(0x7f9748059f30 0x7f974805c350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.603 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9748052b40 msgr2=0x7f9748055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.603 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9748052b40 0x7f9748055000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9758008000 tx=0x7f9758009040).stop 2022-01-24T07:01:00.603 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9768062760 msgr2=0x7f97680604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.603 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 --2- 172.21.15.142:0/3627410974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9768062760 0x7f97680604b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f975c010000 tx=0x7f975c00f040).stop 2022-01-24T07:01:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976db73700 1 -- 172.21.15.142:0/3627410974 reap_dead start 2022-01-24T07:01:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 shutdown_connections 2022-01-24T07:01:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 >> 172.21.15.142:0/3627410974 conn(0x7f97680d4830 msgr2=0x7f976815d710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 shutdown_connections 2022-01-24T07:01:00.604 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.601+0000 7f976f5d6700 1 -- 172.21.15.142:0/3627410974 wait complete. 2022-01-24T07:01:00.611 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2022-01-24T07:01:00.612 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-01-24T07:01:00.711 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.711+0000 7efc70503700 1 Processor -- start 2022-01-24T07:01:00.712 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.711+0000 7efc70503700 1 -- start start 2022-01-24T07:01:00.715 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc70503700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc681630d0 0x7efc68063270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.715 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc70503700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681634b0 0x7efc680cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.715 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc70503700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc680620b0 con 0x7efc68141ba0 2022-01-24T07:01:00.715 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc70503700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc68062350 con 0x7efc681630d0 2022-01-24T07:01:00.716 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc70503700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc680625f0 con 0x7efc681634b0 2022-01-24T07:01:00.716 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc6da9e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681634b0 0x7efc680cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.716 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc6e29f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc681630d0 0x7efc68063270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.716 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc6da9e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681634b0 0x7efc680cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53488/0 (socket says 172.21.15.142:53488) 2022-01-24T07:01:00.717 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc6e29f700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc681630d0 0x7efc68063270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50724/0 (socket says 172.21.15.142:50724) 2022-01-24T07:01:00.717 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.712+0000 7efc6da9e700 1 -- 172.21.15.142:0/3281123540 learned_addr learned my addr 172.21.15.142:0/3281123540 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.717 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6da9e700 1 -- 172.21.15.142:0/3281123540 >> v2:172.21.15.142:3300/0 conn(0x7efc681630d0 msgr2=0x7efc68063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.717 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6da9e700 1 --2- 172.21.15.142:0/3281123540 >> v2:172.21.15.142:3300/0 conn(0x7efc681630d0 0x7efc68063270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.718 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6da9e700 1 -- 172.21.15.142:0/3281123540 >> v1:172.21.15.145:6789/0 conn(0x7efc68141ba0 legacy=0x7efc68141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.718 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6da9e700 1 -- 172.21.15.142:0/3281123540 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68062890 con 0x7efc681634b0 2022-01-24T07:01:00.718 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6e29f700 1 --2- 172.21.15.142:0/3281123540 >> v2:172.21.15.142:3300/0 conn(0x7efc681630d0 0x7efc68063270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.718 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6da9e700 1 --2- 172.21.15.142:0/3281123540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681634b0 0x7efc680cd6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7efc5c002f70 tx=0x7efc5c006eb0).ready entity=mon.2 client_cookie=31bfd21d89f88b5b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.719 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6d29d700 1 -- 172.21.15.142:0/3281123540 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5c00d570 con 0x7efc681634b0 2022-01-24T07:01:00.719 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6d29d700 1 -- 172.21.15.142:0/3281123540 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c000e90 con 0x7efc681634b0 2022-01-24T07:01:00.719 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc6d29d700 1 -- 172.21.15.142:0/3281123540 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5c00d900 con 0x7efc681634b0 2022-01-24T07:01:00.719 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 -- 172.21.15.142:0/3281123540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681634b0 msgr2=0x7efc680cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 --2- 172.21.15.142:0/3281123540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681634b0 0x7efc680cd6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7efc5c002f70 tx=0x7efc5c006eb0).stop 2022-01-24T07:01:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 -- 172.21.15.142:0/3281123540 shutdown_connections 2022-01-24T07:01:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 --2- 172.21.15.142:0/3281123540 >> v2:172.21.15.142:3300/0 conn(0x7efc681630d0 0x7efc68063270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 --2- 172.21.15.142:0/3281123540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681634b0 0x7efc680cd6f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 -- 172.21.15.142:0/3281123540 >> 172.21.15.142:0/3281123540 conn(0x7efc680d2d50 msgr2=0x7efc680d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 -- 172.21.15.142:0/3281123540 shutdown_connections 2022-01-24T07:01:00.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.713+0000 7efc70503700 1 -- 172.21.15.142:0/3281123540 wait complete. 2022-01-24T07:01:00.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 Processor -- start 2022-01-24T07:01:00.721 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 -- start start 2022-01-24T07:01:00.725 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc68141ba0 0x7efc68165a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.726 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681630d0 0x7efc68165f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.726 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc681634b0 0x7efc680cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.726 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6805d4e0 con 0x7efc681634b0 2022-01-24T07:01:00.726 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68164b70 con 0x7efc68141ba0 2022-01-24T07:01:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc70503700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc68164e10 con 0x7efc681630d0 2022-01-24T07:01:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc6eaa0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc681634b0 0x7efc680cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc6da9e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681630d0 0x7efc68165f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.715+0000 7efc6eaa0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc681634b0 0x7efc680cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50734/0 (socket says 172.21.15.142:50734) 2022-01-24T07:01:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6eaa0700 1 -- 172.21.15.142:0/610887060 learned_addr learned my addr 172.21.15.142:0/610887060 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6e29f700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc68141ba0 0x7efc68165a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6da9e700 1 -- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc68141ba0 msgr2=0x7efc68165a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6da9e700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efc68141ba0 0x7efc68165a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6da9e700 1 -- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc681634b0 msgr2=0x7efc680cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.729 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6da9e700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc681634b0 0x7efc680cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.729 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6da9e700 1 -- 172.21.15.142:0/610887060 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009470 con 0x7efc681630d0 2022-01-24T07:01:00.729 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6eaa0700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc681634b0 0x7efc680cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.729 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc6da9e700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681630d0 0x7efc68165f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7efc5c002f70 tx=0x7efc5c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5c011860 con 0x7efc681630d0 2022-01-24T07:01:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c0119c0 con 0x7efc681630d0 2022-01-24T07:01:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c00b1e0 con 0x7efc681630d0 2022-01-24T07:01:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5c011d20 con 0x7efc681630d0 2022-01-24T07:01:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.716+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc68165350 con 0x7efc681630d0 2022-01-24T07:01:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc681657b0 con 0x7efc681630d0 2022-01-24T07:01:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7efc5c025030 con 0x7efc681630d0 2022-01-24T07:01:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc677fe700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7efc48052c60 0x7efc48055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc5c06bcb0 con 0x7efc681630d0 2022-01-24T07:01:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc6e29f700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7efc48052c60 0x7efc48055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc677fe700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:6808/65086,v1:172.21.15.145:6809/65086] conn(0x7efc4805a050 0x7efc4805c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 --> [v2:172.21.15.145:6808/65086,v1:172.21.15.145:6809/65086] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc4805ca30 con 0x7efc4805a050 2022-01-24T07:01:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.717+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc5c06e340 con 0x7efc681630d0 2022-01-24T07:01:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.718+0000 7efc6e29f700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7efc48052c60 0x7efc48055120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7efc5800b000 tx=0x7efc58008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.718+0000 7efc6eaa0700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:6808/65086,v1:172.21.15.145:6809/65086] conn(0x7efc4805a050 0x7efc4805c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.718+0000 7efc6eaa0700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:6808/65086,v1:172.21.15.145:6809/65086] conn(0x7efc4805a050 0x7efc4805c470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.719+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== osd.5 v2:172.21.15.145:6808/65086 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7efc4805ca30 con 0x7efc4805a050 2022-01-24T07:01:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.734+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 --> [v2:172.21.15.145:6808/65086,v1:172.21.15.145:6809/65086] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc68062b30 con 0x7efc4805a050 2022-01-24T07:01:00.735 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc677fe700 1 -- 172.21.15.142:0/610887060 <== osd.5 v2:172.21.15.145:6808/65086 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc68062b30 con 0x7efc4805a050 2022-01-24T07:01:00.736 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:6808/65086,v1:172.21.15.145:6809/65086] conn(0x7efc4805a050 msgr2=0x7efc4805c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.736 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.145:6808/65086,v1:172.21.15.145:6809/65086] conn(0x7efc4805a050 0x7efc4805c470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.736 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7efc48052c60 msgr2=0x7efc48055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7efc48052c60 0x7efc48055120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7efc5800b000 tx=0x7efc58008040).stop 2022-01-24T07:01:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681630d0 msgr2=0x7efc68165f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 --2- 172.21.15.142:0/610887060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc681630d0 0x7efc68165f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7efc5c002f70 tx=0x7efc5c015000).stop 2022-01-24T07:01:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc6eaa0700 1 -- 172.21.15.142:0/610887060 reap_dead start 2022-01-24T07:01:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 shutdown_connections 2022-01-24T07:01:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 >> 172.21.15.142:0/610887060 conn(0x7efc680d2d50 msgr2=0x7efc681610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 shutdown_connections 2022-01-24T07:01:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.735+0000 7efc70503700 1 -- 172.21.15.142:0/610887060 wait complete. 2022-01-24T07:01:00.745 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:00.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-01-24T07:01:00.846 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.846+0000 7f2fbd08c700 1 Processor -- start 2022-01-24T07:01:00.847 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.846+0000 7f2fbd08c700 1 -- start start 2022-01-24T07:01:00.853 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fbd08c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2fb815ced0 0x7f2fb8064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fbd08c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fbd08c700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb80c91e0 con 0x7f2fb805c590 2022-01-24T07:01:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fbd08c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb805b3d0 con 0x7f2fb815ced0 2022-01-24T07:01:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fbd08c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb805b670 con 0x7f2fb815d2b0 2022-01-24T07:01:00.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb6d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2fb815ced0 0x7f2fb8064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb659c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb6d9d700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2fb815ced0 0x7f2fb8064520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50740/0 (socket says 172.21.15.142:50740) 2022-01-24T07:01:00.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb6d9d700 1 -- 172.21.15.142:0/295517553 learned_addr learned my addr 172.21.15.142:0/295517553 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb6d9d700 1 -- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 msgr2=0x7f2fb80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb6d9d700 1 --2- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb80c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb6d9d700 1 -- 172.21.15.142:0/295517553 >> v1:172.21.15.145:6789/0 conn(0x7f2fb805c590 legacy=0x7f2fb80b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb6d9d700 1 -- 172.21.15.142:0/295517553 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb805b910 con 0x7f2fb815ced0 2022-01-24T07:01:00.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.847+0000 7f2fb659c700 1 --2- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:00.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fb6d9d700 1 --2- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb8064520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2fb805c470 tx=0x7f2fa8009290).ready entity=mon.0 client_cookie=114f03e06fd353cd server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fb5d9b700 1 -- 172.21.15.142:0/295517553 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa800b860 con 0x7f2fb815ced0 2022-01-24T07:01:00.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fb5d9b700 1 -- 172.21.15.142:0/295517553 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa800b9c0 con 0x7f2fb815ced0 2022-01-24T07:01:00.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fb5d9b700 1 -- 172.21.15.142:0/295517553 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa800bb70 con 0x7f2fb815ced0 2022-01-24T07:01:00.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 -- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 msgr2=0x7f2fb8064520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 --2- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb8064520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2fb805c470 tx=0x7f2fa8009290).stop 2022-01-24T07:01:00.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 -- 172.21.15.142:0/295517553 shutdown_connections 2022-01-24T07:01:00.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 --2- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb8064520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 --2- 172.21.15.142:0/295517553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 -- 172.21.15.142:0/295517553 >> 172.21.15.142:0/295517553 conn(0x7f2fb80d4830 msgr2=0x7f2fb80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 -- 172.21.15.142:0/295517553 shutdown_connections 2022-01-24T07:01:00.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.848+0000 7f2fbd08c700 1 -- 172.21.15.142:0/295517553 wait complete. 2022-01-24T07:01:00.860 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.849+0000 7f2fbd08c700 1 Processor -- start 2022-01-24T07:01:00.860 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.849+0000 7f2fbd08c700 1 -- start start 2022-01-24T07:01:00.860 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fbd08c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fb805c590 0x7f2fb814e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.860 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fbd08c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fbd08c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb8156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fbd08c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb815bd90 con 0x7f2fb815ced0 2022-01-24T07:01:00.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fbd08c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81726b0 con 0x7f2fb805c590 2022-01-24T07:01:00.861 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fbd08c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb8172950 con 0x7f2fb815d2b0 2022-01-24T07:01:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb81566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50746/0 (socket says 172.21.15.142:50746) 2022-01-24T07:01:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb659c700 1 -- 172.21.15.142:0/2776265984 learned_addr learned my addr 172.21.15.142:0/2776265984 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb759e700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb8156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb6d9d700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fb805c590 0x7f2fb814e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb659c700 1 -- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 msgr2=0x7f2fb8156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb659c700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fb815d2b0 0x7f2fb8156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb659c700 1 -- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fb805c590 msgr2=0x7f2fb814e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.850+0000 7f2fb659c700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fb805c590 0x7f2fb814e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2fb659c700 1 -- 172.21.15.142:0/2776265984 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa000b180 con 0x7f2fb815ced0 2022-01-24T07:01:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2fb659c700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb81566a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2fa000c000 tx=0x7f2fa0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa0010780 con 0x7f2fb815ced0 2022-01-24T07:01:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa00108e0 con 0x7f2fb815ced0 2022-01-24T07:01:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa8009530 con 0x7f2fb815ced0 2022-01-24T07:01:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa0010c40 con 0x7f2fb815ced0 2022-01-24T07:01:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb8172e90 con 0x7f2fb815ced0 2022-01-24T07:01:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.851+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fb81732f0 con 0x7f2fb815ced0 2022-01-24T07:01:00.866 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.852+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f2fa001c460 con 0x7f2fb815ced0 2022-01-24T07:01:00.866 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.852+0000 7f2faffff700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2f9c052b40 0x7f2f9c055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.866 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.852+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2fa006b1d0 con 0x7f2fb815ced0 2022-01-24T07:01:00.866 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.852+0000 7f2fb6d9d700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2f9c052b40 0x7f2f9c055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.867 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.852+0000 7f2faffff700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:6815/65087,v1:172.21.15.145:6818/65087] conn(0x7f2f9c059f30 0x7f2f9c05c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.867 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.852+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 --> [v2:172.21.15.145:6815/65087,v1:172.21.15.145:6818/65087] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f9c05c9b0 con 0x7f2f9c059f30 2022-01-24T07:01:00.867 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.852+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fa006d750 con 0x7f2fb815ced0 2022-01-24T07:01:00.867 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.853+0000 7f2fb6d9d700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2f9c052b40 0x7f2f9c055000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2fa8019000 tx=0x7f2fa8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.867 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.853+0000 7f2fb759e700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:6815/65087,v1:172.21.15.145:6818/65087] conn(0x7f2f9c059f30 0x7f2f9c05c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.868 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.853+0000 7f2fb759e700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:6815/65087,v1:172.21.15.145:6818/65087] conn(0x7f2f9c059f30 0x7f2f9c05c350 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.868 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.854+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== osd.6 v2:172.21.15.145:6815/65087 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f2f9c05c9b0 con 0x7f2f9c059f30 2022-01-24T07:01:00.869 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 --> [v2:172.21.15.145:6815/65087,v1:172.21.15.145:6818/65087] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fb805bbb0 con 0x7f2f9c059f30 2022-01-24T07:01:00.869 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2faffff700 1 -- 172.21.15.142:0/2776265984 <== osd.6 v2:172.21.15.145:6815/65087 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fb805bbb0 con 0x7f2f9c059f30 2022-01-24T07:01:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:6815/65087,v1:172.21.15.145:6818/65087] conn(0x7f2f9c059f30 msgr2=0x7f2f9c05c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fbd08c700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.145:6815/65087,v1:172.21.15.145:6818/65087] conn(0x7f2f9c059f30 0x7f2f9c05c350 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2f9c052b40 msgr2=0x7f2f9c055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fbd08c700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2f9c052b40 0x7f2f9c055000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2fa8019000 tx=0x7f2fa8016000).stop 2022-01-24T07:01:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 msgr2=0x7f2fb81566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fbd08c700 1 --2- 172.21.15.142:0/2776265984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fb815ced0 0x7f2fb81566a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2fa000c000 tx=0x7f2fa0006df0).stop 2022-01-24T07:01:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.869+0000 7f2fb759e700 1 -- 172.21.15.142:0/2776265984 reap_dead start 2022-01-24T07:01:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.870+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 shutdown_connections 2022-01-24T07:01:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.870+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 >> 172.21.15.142:0/2776265984 conn(0x7f2fb80d4830 msgr2=0x7f2fb80b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.870+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 shutdown_connections 2022-01-24T07:01:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.870+0000 7f2fbd08c700 1 -- 172.21.15.142:0/2776265984 wait complete. 2022-01-24T07:01:00.879 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:00.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-01-24T07:01:00.982 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.981+0000 7f0ed5315700 1 Processor -- start 2022-01-24T07:01:00.982 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.981+0000 7f0ed5315700 1 -- start start 2022-01-24T07:01:00.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.982+0000 7f0ed5315700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0ed01630d0 0x7f0ed0063270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.982+0000 7f0ed5315700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed0141ba0 0x7f0ed0142030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.982+0000 7f0ed5315700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed00620b0 con 0x7f0ed01634b0 2022-01-24T07:01:00.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.982+0000 7f0ed5315700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed0062350 con 0x7f0ed01630d0 2022-01-24T07:01:00.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.982+0000 7f0ed5315700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00625f0 con 0x7f0ed0141ba0 2022-01-24T07:01:00.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecf7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed0141ba0 0x7f0ed0142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ece7fc700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0ed01634b0 0x7f0ed00cd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48122/0 (socket says 172.21.15.142:48122) 2022-01-24T07:01:00.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ece7fc700 1 -- 172.21.15.142:0/1349562462 learned_addr learned my addr 172.21.15.142:0/1349562462 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:00.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0eceffd700 1 --2- 172.21.15.142:0/1349562462 >> v2:172.21.15.145:3300/0 conn(0x7f0ed01630d0 0x7f0ed0063270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecdffb700 1 -- 172.21.15.142:0/1349562462 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687114352 0 0) 0x7f0ed00620b0 con 0x7f0ed01634b0 2022-01-24T07:01:00.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecdffb700 1 -- 172.21.15.142:0/1349562462 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb0003260 con 0x7f0ed01634b0 2022-01-24T07:01:00.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecf7fe700 1 -- 172.21.15.142:0/1349562462 >> v2:172.21.15.145:3300/0 conn(0x7f0ed01630d0 msgr2=0x7f0ed0063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:00.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecf7fe700 1 --2- 172.21.15.142:0/1349562462 >> v2:172.21.15.145:3300/0 conn(0x7f0ed01630d0 0x7f0ed0063270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecf7fe700 1 -- 172.21.15.142:0/1349562462 >> v1:172.21.15.142:6789/0 conn(0x7f0ed01634b0 legacy=0x7f0ed00cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.988 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecf7fe700 1 -- 172.21.15.142:0/1349562462 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0062890 con 0x7f0ed0141ba0 2022-01-24T07:01:00.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecf7fe700 1 --2- 172.21.15.142:0/1349562462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed0141ba0 0x7f0ed0142030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0ec8002f70 tx=0x7f0ec8006df0).ready entity=mon.2 client_cookie=29d2526ab6f9007b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecdffb700 1 -- 172.21.15.142:0/1349562462 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec800d4a0 con 0x7f0ed0141ba0 2022-01-24T07:01:00.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecdffb700 1 -- 172.21.15.142:0/1349562462 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8000e90 con 0x7f0ed0141ba0 2022-01-24T07:01:00.989 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.983+0000 7f0ecdffb700 1 -- 172.21.15.142:0/1349562462 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec800d7f0 con 0x7f0ed0141ba0 2022-01-24T07:01:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 -- 172.21.15.142:0/1349562462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed0141ba0 msgr2=0x7f0ed0142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 --2- 172.21.15.142:0/1349562462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed0141ba0 0x7f0ed0142030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0ec8002f70 tx=0x7f0ec8006df0).stop 2022-01-24T07:01:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 -- 172.21.15.142:0/1349562462 shutdown_connections 2022-01-24T07:01:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 --2- 172.21.15.142:0/1349562462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed0141ba0 0x7f0ed0142030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 --2- 172.21.15.142:0/1349562462 >> v2:172.21.15.145:3300/0 conn(0x7f0ed01630d0 0x7f0ed0063270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 -- 172.21.15.142:0/1349562462 >> 172.21.15.142:0/1349562462 conn(0x7f0ed00d2d50 msgr2=0x7f0ed00d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 -- 172.21.15.142:0/1349562462 shutdown_connections 2022-01-24T07:01:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.984+0000 7f0ed5315700 1 -- 172.21.15.142:0/1349562462 wait complete. 2022-01-24T07:01:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.985+0000 7f0ed5315700 1 Processor -- start 2022-01-24T07:01:00.992 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.985+0000 7f0ed5315700 1 -- start start 2022-01-24T07:01:00.995 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed0141ba0 0x7f0ed0139440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.995 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0ed01630d0 0x7f0ed00662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.995 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed01634b0 0x7f0ed00667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:00.996 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0139930 con 0x7f0ed0141ba0 2022-01-24T07:01:00.996 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed005baa0 con 0x7f0ed01630d0 2022-01-24T07:01:00.996 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed005bd40 con 0x7f0ed01634b0 2022-01-24T07:01:00.996 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed0141ba0 0x7f0ed0139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.996 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed0141ba0 0x7f0ed0139440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50762/0 (socket says 172.21.15.142:50762) 2022-01-24T07:01:00.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 -- 172.21.15.142:0/3029286915 learned_addr learned my addr 172.21.15.142:0/3029286915 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:00.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ecf7fe700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed01634b0 0x7f0ed00667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ece7fc700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0ed01630d0 0x7f0ed00662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:00.997 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 -- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed01634b0 msgr2=0x7f0ed00667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ed01634b0 0x7f0ed00667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 -- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0ed01630d0 msgr2=0x7f0ed00662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:00.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0ed01630d0 0x7f0ed00662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:00.998 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 -- 172.21.15.142:0/3029286915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec800b180 con 0x7f0ed0141ba0 2022-01-24T07:01:00.999 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ece7fc700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0ed01630d0 0x7f0ed00662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:00.999 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0eceffd700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed0141ba0 0x7f0ed0139440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0ec000c000 tx=0x7f0ec00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:00.999 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec000c850 con 0x7f0ed0141ba0 2022-01-24T07:01:00.999 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000c9b0 con 0x7f0ed0141ba0 2022-01-24T07:01:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed005bfe0 con 0x7f0ed0141ba0 2022-01-24T07:01:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec000cd10 con 0x7f0ed0141ba0 2022-01-24T07:01:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.986+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed005c520 con 0x7f0ed0141ba0 2022-01-24T07:01:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.987+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ed005c6e0 con 0x7f0ed0141ba0 2022-01-24T07:01:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f0ec0022070 con 0x7f0ed0141ba0 2022-01-24T07:01:01.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ec7fff700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0eb4052b40 0x7f0eb4055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ec006b120 con 0x7f0ed0141ba0 2022-01-24T07:01:01.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ece7fc700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0eb4052b40 0x7f0eb4055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.001 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ec7fff700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:6816/65088,v1:172.21.15.145:6819/65088] conn(0x7f0eb4059f30 0x7f0eb405c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 --> [v2:172.21.15.145:6816/65088,v1:172.21.15.145:6819/65088] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0eb405c9b0 con 0x7f0eb4059f30 2022-01-24T07:01:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ec006d7b0 con 0x7f0ed0141ba0 2022-01-24T07:01:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ecf7fe700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:6816/65088,v1:172.21.15.145:6819/65088] conn(0x7f0eb4059f30 0x7f0eb405c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.988+0000 7f0ece7fc700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0eb4052b40 0x7f0eb4055000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0eb800b000 tx=0x7f0eb8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.003 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.989+0000 7f0ecf7fe700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:6816/65088,v1:172.21.15.145:6819/65088] conn(0x7f0eb4059f30 0x7f0eb405c350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.003 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:00.989+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== osd.7 v2:172.21.15.145:6816/65088 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f0eb405c9b0 con 0x7f0eb4059f30 2022-01-24T07:01:01.004 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.004+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 --> [v2:172.21.15.145:6816/65088,v1:172.21.15.145:6819/65088] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ed0062b30 con 0x7f0eb4059f30 2022-01-24T07:01:01.005 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ec7fff700 1 -- 172.21.15.142:0/3029286915 <== osd.7 v2:172.21.15.145:6816/65088 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ed0062b30 con 0x7f0eb4059f30 2022-01-24T07:01:01.006 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:6816/65088,v1:172.21.15.145:6819/65088] conn(0x7f0eb4059f30 msgr2=0x7f0eb405c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.145:6816/65088,v1:172.21.15.145:6819/65088] conn(0x7f0eb4059f30 0x7f0eb405c350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0eb4052b40 msgr2=0x7f0eb4055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0eb4052b40 0x7f0eb4055000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0eb800b000 tx=0x7f0eb8009040).stop 2022-01-24T07:01:01.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed0141ba0 msgr2=0x7f0ed0139440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 --2- 172.21.15.142:0/3029286915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed0141ba0 0x7f0ed0139440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0ec000c000 tx=0x7f0ec00091d0).stop 2022-01-24T07:01:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ecf7fe700 1 -- 172.21.15.142:0/3029286915 reap_dead start 2022-01-24T07:01:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 shutdown_connections 2022-01-24T07:01:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 >> 172.21.15.142:0/3029286915 conn(0x7f0ed00d2d50 msgr2=0x7f0ed01487f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:01.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 shutdown_connections 2022-01-24T07:01:01.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.005+0000 7f0ed5315700 1 -- 172.21.15.142:0/3029286915 wait complete. 2022-01-24T07:01:01.015 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:01.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-01-24T07:01:01.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.115+0000 7f911f0d5700 1 Processor -- start 2022-01-24T07:01:01.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.115+0000 7f911f0d5700 1 -- start start 2022-01-24T07:01:01.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911f0d5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91181467a0 0x7f911805b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911f0d5700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9118066ab0 con 0x7f911815e330 2022-01-24T07:01:01.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911f0d5700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9118068310 con 0x7f9118146b80 2022-01-24T07:01:01.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911f0d5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9118066ce0 con 0x7f91181467a0 2022-01-24T07:01:01.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911ce71700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91181467a0 0x7f911805b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911ce71700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91181467a0 0x7f911805b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50772/0 (socket says 172.21.15.142:50772) 2022-01-24T07:01:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911ce71700 1 -- 172.21.15.142:0/1598281593 learned_addr learned my addr 172.21.15.142:0/1598281593 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911ce71700 1 -- 172.21.15.142:0/1598281593 >> v1:172.21.15.145:6789/0 conn(0x7f9118146b80 legacy=0x7f9118065d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911ce71700 1 -- 172.21.15.142:0/1598281593 >> v1:172.21.15.142:6789/0 conn(0x7f911815e330 legacy=0x7f9118067c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f91177fe700 1 -- 172.21.15.142:0/1598281593 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272049716 0 0) 0x7f9118066ab0 con 0x7f911815e330 2022-01-24T07:01:01.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911ce71700 1 -- 172.21.15.142:0/1598281593 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118066f80 con 0x7f91181467a0 2022-01-24T07:01:01.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f911ce71700 1 --2- 172.21.15.142:0/1598281593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91181467a0 0x7f911805b330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9118065c50 tx=0x7f9110006eb0).ready entity=mon.0 client_cookie=4d3cb4d464171dc server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f91177fe700 1 -- 172.21.15.142:0/1598281593 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911000d610 con 0x7f91181467a0 2022-01-24T07:01:01.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f91177fe700 1 -- 172.21.15.142:0/1598281593 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9110000e90 con 0x7f91181467a0 2022-01-24T07:01:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.116+0000 7f91177fe700 1 -- 172.21.15.142:0/1598281593 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911000d960 con 0x7f91181467a0 2022-01-24T07:01:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.117+0000 7f911f0d5700 1 -- 172.21.15.142:0/1598281593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91181467a0 msgr2=0x7f911805b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.117+0000 7f911f0d5700 1 --2- 172.21.15.142:0/1598281593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91181467a0 0x7f911805b330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9118065c50 tx=0x7f9110006eb0).stop 2022-01-24T07:01:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.117+0000 7f911f0d5700 1 -- 172.21.15.142:0/1598281593 shutdown_connections 2022-01-24T07:01:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.117+0000 7f911f0d5700 1 --2- 172.21.15.142:0/1598281593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91181467a0 0x7f911805b330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.117+0000 7f911f0d5700 1 -- 172.21.15.142:0/1598281593 >> 172.21.15.142:0/1598281593 conn(0x7f91180d2ca0 msgr2=0x7f91180d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.117+0000 7f911f0d5700 1 -- 172.21.15.142:0/1598281593 shutdown_connections 2022-01-24T07:01:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.117+0000 7f911f0d5700 1 -- 172.21.15.142:0/1598281593 wait complete. 2022-01-24T07:01:01.124 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.118+0000 7f911f0d5700 1 Processor -- start 2022-01-24T07:01:01.124 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.118+0000 7f911f0d5700 1 -- start start 2022-01-24T07:01:01.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911f0d5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91181467a0 0x7f91180a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911f0d5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9118146b80 0x7f911813c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911f0d5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91180a1570 0x7f9118143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911f0d5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911816cfd0 con 0x7f91180a1570 2022-01-24T07:01:01.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911f0d5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911816d270 con 0x7f9118146b80 2022-01-24T07:01:01.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911f0d5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911816d510 con 0x7f91181467a0 2022-01-24T07:01:01.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91181467a0 0x7f91180a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911d672700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91180a1570 0x7f9118143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.129 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91181467a0 0x7f91180a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53540/0 (socket says 172.21.15.142:53540) 2022-01-24T07:01:01.129 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 -- 172.21.15.142:0/3801776195 learned_addr learned my addr 172.21.15.142:0/3801776195 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:01.129 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f9117fff700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9118146b80 0x7f911813c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.129 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 -- 172.21.15.142:0/3801776195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9118146b80 msgr2=0x7f911813c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.130 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9118146b80 0x7f911813c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.130 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 -- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91180a1570 msgr2=0x7f9118143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.130 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91180a1570 0x7f9118143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.130 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 -- 172.21.15.142:0/3801776195 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911000b1e0 con 0x7f91181467a0 2022-01-24T07:01:01.131 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911d672700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91180a1570 0x7f9118143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:01.131 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.119+0000 7f911ce71700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91181467a0 0x7f91180a1080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9118065c50 tx=0x7f9110015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.131 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.120+0000 7f9115ffb700 1 -- 172.21.15.142:0/3801776195 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911000bec0 con 0x7f91181467a0 2022-01-24T07:01:01.131 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.120+0000 7f9115ffb700 1 -- 172.21.15.142:0/3801776195 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9110011c30 con 0x7f91181467a0 2022-01-24T07:01:01.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.120+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911816d7b0 con 0x7f91181467a0 2022-01-24T07:01:01.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.120+0000 7f9115ffb700 1 -- 172.21.15.142:0/3801776195 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f911001e460 con 0x7f91181467a0 2022-01-24T07:01:01.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.120+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911816ccc0 con 0x7f91181467a0 2022-01-24T07:01:01.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.121+0000 7f9115ffb700 1 -- 172.21.15.142:0/3801776195 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f9110025030 con 0x7f91181467a0 2022-01-24T07:01:01.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.121+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911816dc10 con 0x7f91181467a0 2022-01-24T07:01:01.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.121+0000 7f9115ffb700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f90fc052bd0 0x7f90fc055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.121+0000 7f9115ffb700 1 -- 172.21.15.142:0/3801776195 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f911006bfd0 con 0x7f91181467a0 2022-01-24T07:01:01.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.121+0000 7f9117fff700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f90fc052bd0 0x7f90fc055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.121+0000 7f9117fff700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f90fc052bd0 0x7f90fc055090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f910800b000 tx=0x7f9108009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.134 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.124+0000 7f9115ffb700 1 -- 172.21.15.142:0/3801776195 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f91100436f0 con 0x7f91181467a0 2022-01-24T07:01:01.256 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.256+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9118067220 con 0x7f91181467a0 2022-01-24T07:01:01.257 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.256+0000 7f9115ffb700 1 -- 172.21.15.142:0/3801776195 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9110023020 con 0x7f91181467a0 2022-01-24T07:01:01.257 INFO:teuthology.orchestra.run.smithi142.stdout:55834574854 2022-01-24T07:01:01.259 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.257+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f90fc052bd0 msgr2=0x7f90fc055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.259 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.257+0000 7f911f0d5700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f90fc052bd0 0x7f90fc055090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f910800b000 tx=0x7f9108009040).stop 2022-01-24T07:01:01.259 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.257+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91181467a0 msgr2=0x7f91180a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.260 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.257+0000 7f911f0d5700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91181467a0 0x7f91180a1080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9118065c50 tx=0x7f9110015000).stop 2022-01-24T07:01:01.260 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 shutdown_connections 2022-01-24T07:01:01.260 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f90fc052bd0 0x7f90fc055090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.261 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91180a1570 0x7f9118143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.261 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91181467a0 0x7f91180a1080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.261 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 --2- 172.21.15.142:0/3801776195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9118146b80 0x7f911813c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.261 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 >> 172.21.15.142:0/3801776195 conn(0x7f91180d2ca0 msgr2=0x7f91180d3080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:01.261 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 shutdown_connections 2022-01-24T07:01:01.262 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.258+0000 7f911f0d5700 1 -- 172.21.15.142:0/3801776195 wait complete. 2022-01-24T07:01:01.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2022-01-24T07:01:01.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-01-24T07:01:01.376 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.376+0000 7f8543fff700 1 Processor -- start 2022-01-24T07:01:01.376 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.376+0000 7f8543fff700 1 -- start start 2022-01-24T07:01:01.382 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.376+0000 7f8543fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.382 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.376+0000 7f8543fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f85440d2fc0 0x7f8544145460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.382 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.376+0000 7f8543fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8544163870 con 0x7f8544145950 2022-01-24T07:01:01.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.376+0000 7f8543fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85440b9820 con 0x7f85440d2fc0 2022-01-24T07:01:01.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.376+0000 7f8543fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8544163b10 con 0x7f85440d2be0 2022-01-24T07:01:01.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.383 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544162fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53560/0 (socket says 172.21.15.142:53560) 2022-01-24T07:01:01.384 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 -- 172.21.15.142:0/1304780695 learned_addr learned my addr 172.21.15.142:0/1304780695 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:01.384 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f85427fc700 1 --2- 172.21.15.142:0/1304780695 >> v2:172.21.15.145:3300/0 conn(0x7f85440d2fc0 0x7f8544145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.384 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 -- 172.21.15.142:0/1304780695 >> v2:172.21.15.145:3300/0 conn(0x7f85440d2fc0 msgr2=0x7f8544145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:01.384 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 --2- 172.21.15.142:0/1304780695 >> v2:172.21.15.145:3300/0 conn(0x7f85440d2fc0 0x7f8544145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.384 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 -- 172.21.15.142:0/1304780695 >> v1:172.21.15.145:6789/0 conn(0x7f8544145950 legacy=0x7f85440d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:01.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 -- 172.21.15.142:0/1304780695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544163db0 con 0x7f85440d2be0 2022-01-24T07:01:01.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8542ffd700 1 --2- 172.21.15.142:0/1304780695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544162fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f85440cd160 tx=0x7f8534006eb0).ready entity=mon.2 client_cookie=a23c591cc70e0b57 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8541ffb700 1 -- 172.21.15.142:0/1304780695 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853400d570 con 0x7f85440d2be0 2022-01-24T07:01:01.385 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8541ffb700 1 -- 172.21.15.142:0/1304780695 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534000e90 con 0x7f85440d2be0 2022-01-24T07:01:01.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.377+0000 7f8541ffb700 1 -- 172.21.15.142:0/1304780695 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853400d8c0 con 0x7f85440d2be0 2022-01-24T07:01:01.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 -- 172.21.15.142:0/1304780695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 msgr2=0x7f8544162fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 --2- 172.21.15.142:0/1304780695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544162fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f85440cd160 tx=0x7f8534006eb0).stop 2022-01-24T07:01:01.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 -- 172.21.15.142:0/1304780695 shutdown_connections 2022-01-24T07:01:01.386 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 --2- 172.21.15.142:0/1304780695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544162fb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 --2- 172.21.15.142:0/1304780695 >> v2:172.21.15.145:3300/0 conn(0x7f85440d2fc0 0x7f8544145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 -- 172.21.15.142:0/1304780695 >> 172.21.15.142:0/1304780695 conn(0x7f8544061970 msgr2=0x7f854405fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:01.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 -- 172.21.15.142:0/1304780695 shutdown_connections 2022-01-24T07:01:01.387 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.378+0000 7f8543fff700 1 -- 172.21.15.142:0/1304780695 wait complete. 2022-01-24T07:01:01.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.379+0000 7f8543fff700 1 Processor -- start 2022-01-24T07:01:01.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.379+0000 7f8543fff700 1 -- start start 2022-01-24T07:01:01.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85440d2fc0 0x7f8544141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.388 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8544145950 0x7f8544141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544141b20 con 0x7f85440d2fc0 2022-01-24T07:01:01.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544156080 con 0x7f8544145950 2022-01-24T07:01:01.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854416cf40 con 0x7f85440d2be0 2022-01-24T07:01:01.389 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53566/0 (socket says 172.21.15.142:53566) 2022-01-24T07:01:01.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 -- 172.21.15.142:0/4044315500 learned_addr learned my addr 172.21.15.142:0/4044315500 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:01.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f85427fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85440d2fc0 0x7f8544141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f85437fe700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8544145950 0x7f8544141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.390 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 -- 172.21.15.142:0/4044315500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8544145950 msgr2=0x7f8544141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.391 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8544145950 0x7f8544141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.391 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 -- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85440d2fc0 msgr2=0x7f8544141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.391 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85440d2fc0 0x7f8544141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.391 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 -- 172.21.15.142:0/4044315500 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853400b1e0 con 0x7f85440d2be0 2022-01-24T07:01:01.392 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8542ffd700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544160570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8544158030 tx=0x7f8534015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.392 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8533fff700 1 -- 172.21.15.142:0/4044315500 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85340117e0 con 0x7f85440d2be0 2022-01-24T07:01:01.392 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8533fff700 1 -- 172.21.15.142:0/4044315500 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534011940 con 0x7f85440d2be0 2022-01-24T07:01:01.392 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8544172ba0 con 0x7f85440d2be0 2022-01-24T07:01:01.392 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8533fff700 1 -- 172.21.15.142:0/4044315500 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8534011ca0 con 0x7f85440d2be0 2022-01-24T07:01:01.393 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.380+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8544173380 con 0x7f85440d2be0 2022-01-24T07:01:01.393 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.381+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85440d0960 con 0x7f85440d2be0 2022-01-24T07:01:01.393 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.381+0000 7f8533fff700 1 -- 172.21.15.142:0/4044315500 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f8534025030 con 0x7f85440d2be0 2022-01-24T07:01:01.393 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.382+0000 7f8533fff700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8520052bd0 0x7f8520055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:01.394 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.382+0000 7f8533fff700 1 -- 172.21.15.142:0/4044315500 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f853406bd60 con 0x7f85440d2be0 2022-01-24T07:01:01.394 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.382+0000 7f85427fc700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8520052bd0 0x7f8520055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:01.394 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.382+0000 7f85427fc700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8520052bd0 0x7f8520055090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f853800c000 tx=0x7f8538008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:01.395 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.385+0000 7f8533fff700 1 -- 172.21.15.142:0/4044315500 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f85340433e0 con 0x7f85440d2be0 2022-01-24T07:01:01.516 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.516+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85441561c0 con 0x7f85440d2be0 2022-01-24T07:01:01.517 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.516+0000 7f8533fff700 1 -- 172.21.15.142:0/4044315500 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8534023070 con 0x7f85440d2be0 2022-01-24T07:01:01.517 INFO:teuthology.orchestra.run.smithi142.stdout:60129542148 2022-01-24T07:01:01.518 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8520052bd0 msgr2=0x7f8520055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.519 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8520052bd0 0x7f8520055090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f853800c000 tx=0x7f8538008040).stop 2022-01-24T07:01:01.519 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 msgr2=0x7f8544160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:01.519 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544160570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8544158030 tx=0x7f8534015000).stop 2022-01-24T07:01:01.519 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 shutdown_connections 2022-01-24T07:01:01.519 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8544145950 0x7f8544141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.520 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8520052bd0 0x7f8520055090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.520 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85440d2be0 0x7f8544160570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.520 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 --2- 172.21.15.142:0/4044315500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85440d2fc0 0x7f8544141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:01.520 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 >> 172.21.15.142:0/4044315500 conn(0x7f8544061970 msgr2=0x7f85440d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:01.521 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 shutdown_connections 2022-01-24T07:01:01.521 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:01.518+0000 7f8543fff700 1 -- 172.21.15.142:0/4044315500 wait complete. 2022-01-24T07:01:01.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2022-01-24T07:01:02.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-01-24T07:01:02.644 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.645+0000 7f5754bbb700 1 Processor -- start 2022-01-24T07:01:02.645 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.645+0000 7f5754bbb700 1 -- start start 2022-01-24T07:01:02.648 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f5754bbb700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f57500b8930 0x7f575015ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.648 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f5754bbb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f5750160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f5754bbb700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5750160950 con 0x7f5750148b50 2022-01-24T07:01:02.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f5754bbb700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500b7650 con 0x7f57500b8930 2022-01-24T07:01:02.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f5754bbb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5750067de0 con 0x7f5750148f30 2022-01-24T07:01:02.649 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f574ed9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f5750160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f574e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5750148b50 0x7f57500b8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48182/0 (socket says 172.21.15.142:48182) 2022-01-24T07:01:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f574ed9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f5750160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53578/0 (socket says 172.21.15.142:53578) 2022-01-24T07:01:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f574e59c700 1 -- 172.21.15.142:0/570787920 learned_addr learned my addr 172.21.15.142:0/570787920 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:02.650 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f574dd9b700 1 --2- 172.21.15.142:0/570787920 >> v2:172.21.15.145:3300/0 conn(0x7f57500b8930 0x7f575015ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.646+0000 7f574d59a700 1 -- 172.21.15.142:0/570787920 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313154212 0 0) 0x7f5750160950 con 0x7f5750148b50 2022-01-24T07:01:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574d59a700 1 -- 172.21.15.142:0/570787920 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5734003260 con 0x7f5750148b50 2022-01-24T07:01:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574ed9d700 1 -- 172.21.15.142:0/570787920 >> v2:172.21.15.145:3300/0 conn(0x7f57500b8930 msgr2=0x7f575015ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574ed9d700 1 --2- 172.21.15.142:0/570787920 >> v2:172.21.15.145:3300/0 conn(0x7f57500b8930 0x7f575015ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574ed9d700 1 -- 172.21.15.142:0/570787920 >> v1:172.21.15.142:6789/0 conn(0x7f5750148b50 legacy=0x7f57500b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574ed9d700 1 -- 172.21.15.142:0/570787920 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750068080 con 0x7f5750148f30 2022-01-24T07:01:02.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574ed9d700 1 --2- 172.21.15.142:0/570787920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f5750160460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f57400032f0 tx=0x7f57400091d0).ready entity=mon.2 client_cookie=96f15cf72459ec6b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:02.652 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574d59a700 1 -- 172.21.15.142:0/570787920 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574000b600 con 0x7f5750148f30 2022-01-24T07:01:02.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574d59a700 1 -- 172.21.15.142:0/570787920 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574000b760 con 0x7f5750148f30 2022-01-24T07:01:02.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f574d59a700 1 -- 172.21.15.142:0/570787920 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574000b8d0 con 0x7f5750148f30 2022-01-24T07:01:02.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 -- 172.21.15.142:0/570787920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 msgr2=0x7f5750160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.653 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 --2- 172.21.15.142:0/570787920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f5750160460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f57400032f0 tx=0x7f57400091d0).stop 2022-01-24T07:01:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 -- 172.21.15.142:0/570787920 shutdown_connections 2022-01-24T07:01:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 --2- 172.21.15.142:0/570787920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f5750160460 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 --2- 172.21.15.142:0/570787920 >> v2:172.21.15.145:3300/0 conn(0x7f57500b8930 0x7f575015ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 -- 172.21.15.142:0/570787920 >> 172.21.15.142:0/570787920 conn(0x7f575005fc90 msgr2=0x7f57500600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:02.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 -- 172.21.15.142:0/570787920 shutdown_connections 2022-01-24T07:01:02.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.647+0000 7f5754bbb700 1 -- 172.21.15.142:0/570787920 wait complete. 2022-01-24T07:01:02.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 Processor -- start 2022-01-24T07:01:02.655 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 -- start start 2022-01-24T07:01:02.659 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57500b8930 0x7f575013f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.659 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5750148b50 0x7f5750143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.660 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f57501422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.660 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57501411f0 con 0x7f5750148b50 2022-01-24T07:01:02.660 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5750141490 con 0x7f57500b8930 2022-01-24T07:01:02.660 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f5754bbb700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575013e670 con 0x7f5750148f30 2022-01-24T07:01:02.661 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f574ed9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f57501422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.661 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.649+0000 7f574dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5750148b50 0x7f5750143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.661 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f57501422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53586/0 (socket says 172.21.15.142:53586) 2022-01-24T07:01:02.661 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 -- 172.21.15.142:0/3484940904 learned_addr learned my addr 172.21.15.142:0/3484940904 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:02.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5750148b50 0x7f5750143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50820/0 (socket says 172.21.15.142:50820) 2022-01-24T07:01:02.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574e59c700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57500b8930 0x7f575013f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 -- 172.21.15.142:0/3484940904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57500b8930 msgr2=0x7f575013f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57500b8930 0x7f575013f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 -- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5750148b50 msgr2=0x7f5750143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5750148b50 0x7f5750143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 -- 172.21.15.142:0/3484940904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009470 con 0x7f5750148f30 2022-01-24T07:01:02.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574e59c700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57500b8930 0x7f575013f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:01:02.664 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574dd9b700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5750148b50 0x7f5750143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:02.664 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f574ed9d700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f57501422c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f57400032f0 tx=0x7f5740016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:02.664 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f573f7fe700 1 -- 172.21.15.142:0/3484940904 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5740020400 con 0x7f5750148f30 2022-01-24T07:01:02.664 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f573f7fe700 1 -- 172.21.15.142:0/3484940904 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5740020560 con 0x7f5750148f30 2022-01-24T07:01:02.665 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575013e910 con 0x7f5750148f30 2022-01-24T07:01:02.665 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f573f7fe700 1 -- 172.21.15.142:0/3484940904 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57400208c0 con 0x7f5750148f30 2022-01-24T07:01:02.665 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.650+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575013ee50 con 0x7f5750148f30 2022-01-24T07:01:02.665 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.651+0000 7f573f7fe700 1 -- 172.21.15.142:0/3484940904 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f5740027030 con 0x7f5750148f30 2022-01-24T07:01:02.666 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.651+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575013f010 con 0x7f5750148f30 2022-01-24T07:01:02.666 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.651+0000 7f573f7fe700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f572c052bd0 0x7f572c055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.666 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.651+0000 7f573f7fe700 1 -- 172.21.15.142:0/3484940904 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f574006ba30 con 0x7f5750148f30 2022-01-24T07:01:02.666 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.652+0000 7f574e59c700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f572c052bd0 0x7f572c055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.667 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.652+0000 7f574e59c700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f572c052bd0 0x7f572c055090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5748008000 tx=0x7f5748009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:02.667 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.655+0000 7f573f7fe700 1 -- 172.21.15.142:0/3484940904 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f5740043190 con 0x7f5750148f30 2022-01-24T07:01:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.788+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57500b7840 con 0x7f5750148f30 2022-01-24T07:01:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.789+0000 7f573f7fe700 1 -- 172.21.15.142:0/3484940904 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5740025090 con 0x7f5750148f30 2022-01-24T07:01:02.789 INFO:teuthology.orchestra.run.smithi142.stdout:60129542150 2022-01-24T07:01:02.790 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f572c052bd0 msgr2=0x7f572c055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f572c052bd0 0x7f572c055090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5748008000 tx=0x7f5748009040).stop 2022-01-24T07:01:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 msgr2=0x7f57501422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f57501422c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f57400032f0 tx=0x7f5740016000).stop 2022-01-24T07:01:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 shutdown_connections 2022-01-24T07:01:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57500b8930 0x7f575013f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f572c052bd0 0x7f572c055090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5750148f30 0x7f57501422c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 --2- 172.21.15.142:0/3484940904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5750148b50 0x7f5750143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.793 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 >> 172.21.15.142:0/3484940904 conn(0x7f575005fc90 msgr2=0x7f57500b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:02.793 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 shutdown_connections 2022-01-24T07:01:02.793 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.790+0000 7f5754bbb700 1 -- 172.21.15.142:0/3484940904 wait complete. 2022-01-24T07:01:02.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.1 2022-01-24T07:01:02.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-01-24T07:01:02.901 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.901+0000 7facf359e700 1 Processor -- start 2022-01-24T07:01:02.901 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.901+0000 7facf359e700 1 -- start start 2022-01-24T07:01:02.907 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.902+0000 7facf359e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7facf4067af0 0x7facf405ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.907 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf359e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7facf4067ed0 0x7facf40ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.907 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf4160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.907 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf359e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf40cef60 con 0x7facf4067ed0 2022-01-24T07:01:02.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf359e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf4062a60 con 0x7facf4067af0 2022-01-24T07:01:02.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf4062d00 con 0x7facf40ceab0 2022-01-24T07:01:02.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf4160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf1d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7facf4067ed0 0x7facf40ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.908 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf4160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53590/0 (socket says 172.21.15.142:53590) 2022-01-24T07:01:02.909 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 -- 172.21.15.142:0/815594917 learned_addr learned my addr 172.21.15.142:0/815594917 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:02.909 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf259c700 1 --2- 172.21.15.142:0/815594917 >> v2:172.21.15.145:3300/0 conn(0x7facf4067af0 0x7facf405ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.909 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 -- 172.21.15.142:0/815594917 >> v2:172.21.15.145:3300/0 conn(0x7facf4067af0 msgr2=0x7facf405ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:02.909 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 --2- 172.21.15.142:0/815594917 >> v2:172.21.15.145:3300/0 conn(0x7facf4067af0 0x7facf405ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.909 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 -- 172.21.15.142:0/815594917 >> v2:172.21.15.142:3300/0 conn(0x7facf4067ed0 msgr2=0x7facf40ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:02.910 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 --2- 172.21.15.142:0/815594917 >> v2:172.21.15.142:3300/0 conn(0x7facf4067ed0 0x7facf40ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.910 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 -- 172.21.15.142:0/815594917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4062fa0 con 0x7facf40ceab0 2022-01-24T07:01:02.910 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf259c700 1 --2- 172.21.15.142:0/815594917 >> v2:172.21.15.145:3300/0 conn(0x7facf4067af0 0x7facf405ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:01:02.910 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf1d9b700 1 --2- 172.21.15.142:0/815594917 >> v2:172.21.15.142:3300/0 conn(0x7facf4067ed0 0x7facf40ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:02.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf2d9d700 1 --2- 172.21.15.142:0/815594917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf4160ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7facec002f70 tx=0x7facec006eb0).ready entity=mon.2 client_cookie=45b127ef4ca6262b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:02.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf159a700 1 -- 172.21.15.142:0/815594917 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facec00d570 con 0x7facf40ceab0 2022-01-24T07:01:02.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf159a700 1 -- 172.21.15.142:0/815594917 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec000e90 con 0x7facf40ceab0 2022-01-24T07:01:02.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.903+0000 7facf159a700 1 -- 172.21.15.142:0/815594917 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facec00d900 con 0x7facf40ceab0 2022-01-24T07:01:02.911 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 -- 172.21.15.142:0/815594917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 msgr2=0x7facf4160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 --2- 172.21.15.142:0/815594917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf4160ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7facec002f70 tx=0x7facec006eb0).stop 2022-01-24T07:01:02.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 -- 172.21.15.142:0/815594917 shutdown_connections 2022-01-24T07:01:02.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 --2- 172.21.15.142:0/815594917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf4160ad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 --2- 172.21.15.142:0/815594917 >> v2:172.21.15.145:3300/0 conn(0x7facf4067af0 0x7facf405ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.912 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 --2- 172.21.15.142:0/815594917 >> v2:172.21.15.142:3300/0 conn(0x7facf4067ed0 0x7facf40ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.913 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 -- 172.21.15.142:0/815594917 >> 172.21.15.142:0/815594917 conn(0x7facf40d3c20 msgr2=0x7facf40d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:02.913 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 -- 172.21.15.142:0/815594917 shutdown_connections 2022-01-24T07:01:02.913 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.904+0000 7facf359e700 1 -- 172.21.15.142:0/815594917 wait complete. 2022-01-24T07:01:02.913 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.905+0000 7facf359e700 1 Processor -- start 2022-01-24T07:01:02.914 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.905+0000 7facf359e700 1 -- start start 2022-01-24T07:01:02.914 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facf4067af0 0x7facf40d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.914 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facf4067ed0 0x7facf416e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.914 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf416e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.915 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf41700b0 con 0x7facf4067ed0 2022-01-24T07:01:02.915 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf416eef0 con 0x7facf4067af0 2022-01-24T07:01:02.915 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf416f190 con 0x7facf40ceab0 2022-01-24T07:01:02.915 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf416e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facf4067ed0 0x7facf416e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf416e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53598/0 (socket says 172.21.15.142:53598) 2022-01-24T07:01:02.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf1d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facf4067ed0 0x7facf416e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50834/0 (socket says 172.21.15.142:50834) 2022-01-24T07:01:02.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 -- 172.21.15.142:0/3235794981 learned_addr learned my addr 172.21.15.142:0/3235794981 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:02.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf259c700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facf4067af0 0x7facf40d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 -- 172.21.15.142:0/3235794981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facf4067af0 msgr2=0x7facf40d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facf4067af0 0x7facf40d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 -- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facf4067ed0 msgr2=0x7facf416e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:02.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facf4067ed0 0x7facf416e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:02.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 -- 172.21.15.142:0/3235794981 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc00b180 con 0x7facf40ceab0 2022-01-24T07:01:02.918 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf1d9b700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facf4067ed0 0x7facf416e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:02.918 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf2d9d700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf416e690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7facf41701f0 tx=0x7facec015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:02.918 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7faceb7fe700 1 -- 172.21.15.142:0/3235794981 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facec0068b0 con 0x7facf40ceab0 2022-01-24T07:01:02.918 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7faceb7fe700 1 -- 172.21.15.142:0/3235794981 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec00de20 con 0x7facf40ceab0 2022-01-24T07:01:02.918 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec00b1e0 con 0x7facf40ceab0 2022-01-24T07:01:02.919 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7faceb7fe700 1 -- 172.21.15.142:0/3235794981 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facec011da0 con 0x7facf40ceab0 2022-01-24T07:01:02.919 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.906+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf416f6d0 con 0x7facf40ceab0 2022-01-24T07:01:02.919 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.907+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf416fdd0 con 0x7facf40ceab0 2022-01-24T07:01:02.919 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.907+0000 7faceb7fe700 1 -- 172.21.15.142:0/3235794981 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7facec025030 con 0x7facf40ceab0 2022-01-24T07:01:02.920 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.908+0000 7faceb7fe700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7facd8052bd0 0x7facd8055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:02.920 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.908+0000 7faceb7fe700 1 -- 172.21.15.142:0/3235794981 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7facec06bc90 con 0x7facf40ceab0 2022-01-24T07:01:02.921 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.908+0000 7facf259c700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7facd8052bd0 0x7facd8055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:02.921 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.908+0000 7facf259c700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7facd8052bd0 0x7facd8055090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7face400b000 tx=0x7face4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:02.921 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:02.911+0000 7faceb7fe700 1 -- 172.21.15.142:0/3235794981 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7facec0433b0 con 0x7facf40ceab0 2022-01-24T07:01:03.042 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.043+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7facf4063240 con 0x7facf40ceab0 2022-01-24T07:01:03.042 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.043+0000 7faceb7fe700 1 -- 172.21.15.142:0/3235794981 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7facec023020 con 0x7facf40ceab0 2022-01-24T07:01:03.043 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7facd8052bd0 msgr2=0x7facd8055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7facd8052bd0 0x7facd8055090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7face400b000 tx=0x7face4008040).stop 2022-01-24T07:01:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 msgr2=0x7facf416e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf416e690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7facf41701f0 tx=0x7facec015000).stop 2022-01-24T07:01:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 shutdown_connections 2022-01-24T07:01:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7facf4067af0 0x7facf40d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7facd8052bd0 0x7facd8055090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7facf40ceab0 0x7facf416e690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 --2- 172.21.15.142:0/3235794981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facf4067ed0 0x7facf416e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.044+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 >> 172.21.15.142:0/3235794981 conn(0x7facf40d3c20 msgr2=0x7facf40d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.045+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 shutdown_connections 2022-01-24T07:01:03.046 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.045+0000 7facf359e700 1 -- 172.21.15.142:0/3235794981 wait complete. 2022-01-24T07:01:03.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.2 2022-01-24T07:01:03.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-01-24T07:01:03.154 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.155+0000 7ff133f3b700 1 Processor -- start 2022-01-24T07:01:03.154 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.155+0000 7ff133f3b700 1 -- start start 2022-01-24T07:01:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff133f3b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff133f3b700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ff12c15d2b0 0x7ff12c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.158 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff133f3b700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c0c91e0 con 0x7ff12c05c590 2022-01-24T07:01:03.158 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff133f3b700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c05b3d0 con 0x7ff12c15d2b0 2022-01-24T07:01:03.158 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff133f3b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c05b670 con 0x7ff12c15ced0 2022-01-24T07:01:03.158 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff131cd7700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.159 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff1324d8700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff12c05c590 0x7ff12c0b2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48206/0 (socket says 172.21.15.142:48206) 2022-01-24T07:01:03.159 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff1324d8700 1 -- 172.21.15.142:0/192323961 learned_addr learned my addr 172.21.15.142:0/192323961 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:03.159 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff1314d6700 1 --2- 172.21.15.142:0/192323961 >> v2:172.21.15.145:3300/0 conn(0x7ff12c15d2b0 0x7ff12c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.159 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff130cd5700 1 -- 172.21.15.142:0/192323961 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300684008 0 0) 0x7ff128001490 con 0x7ff12c05c590 2022-01-24T07:01:03.159 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff131cd7700 1 -- 172.21.15.142:0/192323961 >> v2:172.21.15.145:3300/0 conn(0x7ff12c15d2b0 msgr2=0x7ff12c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:03.160 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff131cd7700 1 --2- 172.21.15.142:0/192323961 >> v2:172.21.15.145:3300/0 conn(0x7ff12c15d2b0 0x7ff12c0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.160 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff131cd7700 1 -- 172.21.15.142:0/192323961 >> v1:172.21.15.142:6789/0 conn(0x7ff12c05c590 legacy=0x7ff12c0b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.160 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff131cd7700 1 -- 172.21.15.142:0/192323961 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c05b910 con 0x7ff12c15ced0 2022-01-24T07:01:03.160 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.156+0000 7ff1314d6700 1 --2- 172.21.15.142:0/192323961 >> v2:172.21.15.145:3300/0 conn(0x7ff12c15d2b0 0x7ff12c0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:03.160 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff131cd7700 1 --2- 172.21.15.142:0/192323961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c064520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff124002f70 tx=0x7ff124006df0).ready entity=mon.2 client_cookie=a1efa54d70dee28d server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.161 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff130cd5700 1 -- 172.21.15.142:0/192323961 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff12400d570 con 0x7ff12c15ced0 2022-01-24T07:01:03.161 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff130cd5700 1 -- 172.21.15.142:0/192323961 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124000e90 con 0x7ff12c15ced0 2022-01-24T07:01:03.161 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff130cd5700 1 -- 172.21.15.142:0/192323961 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff12400d8c0 con 0x7ff12c15ced0 2022-01-24T07:01:03.161 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 -- 172.21.15.142:0/192323961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 msgr2=0x7ff12c064520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.162 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 --2- 172.21.15.142:0/192323961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c064520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff124002f70 tx=0x7ff124006df0).stop 2022-01-24T07:01:03.162 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 -- 172.21.15.142:0/192323961 shutdown_connections 2022-01-24T07:01:03.162 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 --2- 172.21.15.142:0/192323961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c064520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.162 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 --2- 172.21.15.142:0/192323961 >> v2:172.21.15.145:3300/0 conn(0x7ff12c15d2b0 0x7ff12c0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.162 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 -- 172.21.15.142:0/192323961 >> 172.21.15.142:0/192323961 conn(0x7ff12c0d4830 msgr2=0x7ff12c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.163 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 -- 172.21.15.142:0/192323961 shutdown_connections 2022-01-24T07:01:03.163 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.157+0000 7ff133f3b700 1 -- 172.21.15.142:0/192323961 wait complete. 2022-01-24T07:01:03.163 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.158+0000 7ff133f3b700 1 Processor -- start 2022-01-24T07:01:03.163 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.158+0000 7ff133f3b700 1 -- start start 2022-01-24T07:01:03.166 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff133f3b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c05c590 0x7ff12c13faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.166 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff133f3b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c16f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.166 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff133f3b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff12c15d2b0 0x7ff12c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.167 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff133f3b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c170330 con 0x7ff12c05c590 2022-01-24T07:01:03.167 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff133f3b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c16fdf0 con 0x7ff12c15d2b0 2022-01-24T07:01:03.167 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff133f3b700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c170090 con 0x7ff12c15ced0 2022-01-24T07:01:03.167 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff131cd7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c05c590 0x7ff12c13faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.168 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c16f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.168 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c16f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53610/0 (socket says 172.21.15.142:53610) 2022-01-24T07:01:03.168 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 -- 172.21.15.142:0/134139144 learned_addr learned my addr 172.21.15.142:0/134139144 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:03.168 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff131cd7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c05c590 0x7ff12c13faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50846/0 (socket says 172.21.15.142:50846) 2022-01-24T07:01:03.168 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1324d8700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff12c15d2b0 0x7ff12c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.169 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 -- 172.21.15.142:0/134139144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff12c15d2b0 msgr2=0x7ff12c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.169 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff12c15d2b0 0x7ff12c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.169 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 -- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c05c590 msgr2=0x7ff12c13faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.169 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c05c590 0x7ff12c13faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.170 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff1314d6700 1 -- 172.21.15.142:0/134139144 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12400b180 con 0x7ff12c15ced0 2022-01-24T07:01:03.170 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.159+0000 7ff131cd7700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c05c590 0x7ff12c13faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:03.170 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.160+0000 7ff1314d6700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c16f380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff11c006940 tx=0x7ff11c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.170 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.160+0000 7ff11affd700 1 -- 172.21.15.142:0/134139144 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff11c011780 con 0x7ff12c15ced0 2022-01-24T07:01:03.170 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.160+0000 7ff11affd700 1 -- 172.21.15.142:0/134139144 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c0118e0 con 0x7ff12c15ced0 2022-01-24T07:01:03.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.160+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c155480 con 0x7ff12c15ced0 2022-01-24T07:01:03.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.160+0000 7ff11affd700 1 -- 172.21.15.142:0/134139144 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff11c011c40 con 0x7ff12c15ced0 2022-01-24T07:01:03.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.160+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c1559c0 con 0x7ff12c15ced0 2022-01-24T07:01:03.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.161+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c05bbb0 con 0x7ff12c15ced0 2022-01-24T07:01:03.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.161+0000 7ff11affd700 1 -- 172.21.15.142:0/134139144 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7ff11c01c460 con 0x7ff12c15ced0 2022-01-24T07:01:03.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.161+0000 7ff11affd700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff10c052ae0 0x7ff10c054fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.161+0000 7ff11affd700 1 -- 172.21.15.142:0/134139144 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff11c06aeb0 con 0x7ff12c15ced0 2022-01-24T07:01:03.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.161+0000 7ff131cd7700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff10c052ae0 0x7ff10c054fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.162+0000 7ff131cd7700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff10c052ae0 0x7ff10c054fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff12401c000 tx=0x7ff124015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.173 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.165+0000 7ff11affd700 1 -- 172.21.15.142:0/134139144 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7ff11c042570 con 0x7ff12c15ced0 2022-01-24T07:01:03.295 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.296+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff12c057950 con 0x7ff12c15ced0 2022-01-24T07:01:03.296 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.296+0000 7ff11affd700 1 -- 172.21.15.142:0/134139144 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff11c045b90 con 0x7ff12c15ced0 2022-01-24T07:01:03.296 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:03.297 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff10c052ae0 msgr2=0x7ff10c054fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.297 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff10c052ae0 0x7ff10c054fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff12401c000 tx=0x7ff124015000).stop 2022-01-24T07:01:03.298 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 msgr2=0x7ff12c16f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.298 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c16f380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff11c006940 tx=0x7ff11c008040).stop 2022-01-24T07:01:03.298 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 shutdown_connections 2022-01-24T07:01:03.298 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff12c15d2b0 0x7ff12c15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.299 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff10c052ae0 0x7ff10c054fa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.299 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c05c590 0x7ff12c13faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.299 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 --2- 172.21.15.142:0/134139144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff12c15ced0 0x7ff12c16f380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.299 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 >> 172.21.15.142:0/134139144 conn(0x7ff12c0d4830 msgr2=0x7ff12c15c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.299 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 shutdown_connections 2022-01-24T07:01:03.300 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.298+0000 7ff133f3b700 1 -- 172.21.15.142:0/134139144 wait complete. 2022-01-24T07:01:03.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.3 2022-01-24T07:01:03.309 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-01-24T07:01:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.412+0000 7fae855fa700 1 Processor -- start 2022-01-24T07:01:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.412+0000 7fae855fa700 1 -- start start 2022-01-24T07:01:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.413+0000 7fae855fa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148b50 0x7fae800b8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.413+0000 7fae855fa700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae80067de0 con 0x7fae80160680 2022-01-24T07:01:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.413+0000 7fae855fa700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae80068080 con 0x7fae80148f30 2022-01-24T07:01:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.413+0000 7fae855fa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae800b7650 con 0x7fae80148b50 2022-01-24T07:01:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148b50 0x7fae800b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7f7fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fae80160680 0x7fae800d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48218/0 (socket says 172.21.15.142:48218) 2022-01-24T07:01:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7f7fe700 1 -- 172.21.15.142:0/2585997056 learned_addr learned my addr 172.21.15.142:0/2585997056 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:03.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7dffb700 1 -- 172.21.15.142:0/2585997056 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608529524 0 0) 0x7fae80067de0 con 0x7fae80160680 2022-01-24T07:01:03.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7effd700 1 -- 172.21.15.142:0/2585997056 >> v1:172.21.15.145:6789/0 conn(0x7fae80148f30 legacy=0x7fae8015ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7effd700 1 -- 172.21.15.142:0/2585997056 >> v1:172.21.15.142:6789/0 conn(0x7fae80160680 legacy=0x7fae800d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.416 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7effd700 1 -- 172.21.15.142:0/2585997056 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800b7840 con 0x7fae80148b50 2022-01-24T07:01:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7effd700 1 --2- 172.21.15.142:0/2585997056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148b50 0x7fae800b8220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fae70002f70 tx=0x7fae70006df0).ready entity=mon.2 client_cookie=85cfb4a7f77e855d server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7dffb700 1 -- 172.21.15.142:0/2585997056 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7000d5c0 con 0x7fae80148b50 2022-01-24T07:01:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7dffb700 1 -- 172.21.15.142:0/2585997056 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70000e90 con 0x7fae80148b50 2022-01-24T07:01:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.414+0000 7fae7dffb700 1 -- 172.21.15.142:0/2585997056 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae7000d910 con 0x7fae80148b50 2022-01-24T07:01:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.415+0000 7fae855fa700 1 -- 172.21.15.142:0/2585997056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148b50 msgr2=0x7fae800b8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.415+0000 7fae855fa700 1 --2- 172.21.15.142:0/2585997056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148b50 0x7fae800b8220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fae70002f70 tx=0x7fae70006df0).stop 2022-01-24T07:01:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.415+0000 7fae855fa700 1 -- 172.21.15.142:0/2585997056 shutdown_connections 2022-01-24T07:01:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.415+0000 7fae855fa700 1 --2- 172.21.15.142:0/2585997056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148b50 0x7fae800b8220 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.415+0000 7fae855fa700 1 -- 172.21.15.142:0/2585997056 >> 172.21.15.142:0/2585997056 conn(0x7fae8005fc90 msgr2=0x7fae800600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.415+0000 7fae855fa700 1 -- 172.21.15.142:0/2585997056 shutdown_connections 2022-01-24T07:01:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.415+0000 7fae855fa700 1 -- 172.21.15.142:0/2585997056 wait complete. 2022-01-24T07:01:03.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.416+0000 7fae855fa700 1 Processor -- start 2022-01-24T07:01:03.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.416+0000 7fae855fa700 1 -- start start 2022-01-24T07:01:03.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae80148b50 0x7fae800d6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148f30 0x7fae8016f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80160680 0x7fae8015c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8016ff50 con 0x7fae80160680 2022-01-24T07:01:03.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8016fa10 con 0x7fae80148b50 2022-01-24T07:01:03.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8016fcb0 con 0x7fae80148f30 2022-01-24T07:01:03.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80160680 0x7fae8015c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7e7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148f30 0x7fae8016f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80160680 0x7fae8015c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50864/0 (socket says 172.21.15.142:50864) 2022-01-24T07:01:03.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 -- 172.21.15.142:0/1394672106 learned_addr learned my addr 172.21.15.142:0/1394672106 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:03.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7effd700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae80148b50 0x7fae800d6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 -- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148f30 msgr2=0x7fae8016f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148f30 0x7fae8016f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 -- 172.21.15.142:0/1394672106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae80148b50 msgr2=0x7fae800d6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae80148b50 0x7fae800d6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 -- 172.21.15.142:0/1394672106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7000b180 con 0x7fae80160680 2022-01-24T07:01:03.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7e7fc700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148f30 0x7fae8016f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:03.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae7f7fe700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80160680 0x7fae8015c8a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fae78001250 tx=0x7fae7800c7f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae6ffff700 1 -- 172.21.15.142:0/1394672106 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae78005ba0 con 0x7fae80160680 2022-01-24T07:01:03.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae6ffff700 1 -- 172.21.15.142:0/1394672106 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae78005d00 con 0x7fae80160680 2022-01-24T07:01:03.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae800d1750 con 0x7fae80160680 2022-01-24T07:01:03.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae6ffff700 1 -- 172.21.15.142:0/1394672106 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae78004a90 con 0x7fae80160680 2022-01-24T07:01:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.417+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae800d1c90 con 0x7fae80160680 2022-01-24T07:01:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.418+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae800d1e50 con 0x7fae80160680 2022-01-24T07:01:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.418+0000 7fae6ffff700 1 -- 172.21.15.142:0/1394672106 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fae78004bf0 con 0x7fae80160680 2022-01-24T07:01:03.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.419+0000 7fae6ffff700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fae5c052b40 0x7fae5c055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.419+0000 7fae6ffff700 1 -- 172.21.15.142:0/1394672106 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae7806a610 con 0x7fae80160680 2022-01-24T07:01:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.419+0000 7fae7effd700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fae5c052b40 0x7fae5c055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.419+0000 7fae7effd700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fae5c052b40 0x7fae5c055000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fae7001a000 tx=0x7fae70015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.422+0000 7fae6ffff700 1 -- 172.21.15.142:0/1394672106 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fae78041d30 con 0x7fae80160680 2022-01-24T07:01:03.550 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.551+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fae800b7ae0 con 0x7fae80160680 2022-01-24T07:01:03.551 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.551+0000 7fae6ffff700 1 -- 172.21.15.142:0/1394672106 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae78045350 con 0x7fae80160680 2022-01-24T07:01:03.551 INFO:teuthology.orchestra.run.smithi142.stdout:55834574855 2022-01-24T07:01:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fae5c052b40 msgr2=0x7fae5c055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fae5c052b40 0x7fae5c055000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fae7001a000 tx=0x7fae70015000).stop 2022-01-24T07:01:03.553 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80160680 msgr2=0x7fae8015c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.553 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80160680 0x7fae8015c8a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fae78001250 tx=0x7fae7800c7f0).stop 2022-01-24T07:01:03.553 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 shutdown_connections 2022-01-24T07:01:03.553 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae80148b50 0x7fae800d6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.554 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fae5c052b40 0x7fae5c055000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.554 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae80160680 0x7fae8015c8a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.554 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 --2- 172.21.15.142:0/1394672106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae80148f30 0x7fae8016f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.554 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 >> 172.21.15.142:0/1394672106 conn(0x7fae8005fc90 msgr2=0x7fae8015ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.555 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 shutdown_connections 2022-01-24T07:01:03.555 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.553+0000 7fae855fa700 1 -- 172.21.15.142:0/1394672106 wait complete. 2022-01-24T07:01:03.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2022-01-24T07:01:03.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-01-24T07:01:03.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.663+0000 7f16a3e60700 1 Processor -- start 2022-01-24T07:01:03.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.663+0000 7f16a3e60700 1 -- start start 2022-01-24T07:01:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a3e60700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f169c0b8930 0x7f169c15ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a3e60700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c067de0 con 0x7f169c148f30 2022-01-24T07:01:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a3e60700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c068080 con 0x7f169c148b50 2022-01-24T07:01:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a3e60700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0b7650 con 0x7f169c0b8930 2022-01-24T07:01:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a13fb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f169c0b8930 0x7f169c15ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a23fd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f169c148f30 0x7f169c0d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48234/0 (socket says 172.21.15.142:48234) 2022-01-24T07:01:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a13fb700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f169c0b8930 0x7f169c15ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50870/0 (socket says 172.21.15.142:50870) 2022-01-24T07:01:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.664+0000 7f16a23fd700 1 -- 172.21.15.142:0/2397113809 learned_addr learned my addr 172.21.15.142:0/2397113809 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a13fb700 1 -- 172.21.15.142:0/2397113809 >> v1:172.21.15.145:6789/0 conn(0x7f169c148b50 legacy=0x7f169c0b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a13fb700 1 -- 172.21.15.142:0/2397113809 >> v1:172.21.15.142:6789/0 conn(0x7f169c148f30 legacy=0x7f169c0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a0bfa700 1 -- 172.21.15.142:0/2397113809 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473553800 0 0) 0x7f169c067de0 con 0x7f169c148f30 2022-01-24T07:01:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a13fb700 1 -- 172.21.15.142:0/2397113809 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0b7840 con 0x7f169c0b8930 2022-01-24T07:01:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a13fb700 1 --2- 172.21.15.142:0/2397113809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c0b8930 0x7f169c15ff70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1690002f70 tx=0x7f1690006df0).ready entity=mon.0 client_cookie=73c6e2683d5d3b4 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.673 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a0bfa700 1 -- 172.21.15.142:0/2397113809 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169000d610 con 0x7f169c0b8930 2022-01-24T07:01:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a0bfa700 1 -- 172.21.15.142:0/2397113809 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1690000e90 con 0x7f169c0b8930 2022-01-24T07:01:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a0bfa700 1 -- 172.21.15.142:0/2397113809 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169000d960 con 0x7f169c0b8930 2022-01-24T07:01:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a3e60700 1 -- 172.21.15.142:0/2397113809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c0b8930 msgr2=0x7f169c15ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.674 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a3e60700 1 --2- 172.21.15.142:0/2397113809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c0b8930 0x7f169c15ff70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1690002f70 tx=0x7f1690006df0).stop 2022-01-24T07:01:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a3e60700 1 -- 172.21.15.142:0/2397113809 shutdown_connections 2022-01-24T07:01:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a3e60700 1 --2- 172.21.15.142:0/2397113809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c0b8930 0x7f169c15ff70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.675 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.665+0000 7f16a3e60700 1 -- 172.21.15.142:0/2397113809 >> 172.21.15.142:0/2397113809 conn(0x7f169c05fc90 msgr2=0x7f169c0600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.666+0000 7f16a3e60700 1 -- 172.21.15.142:0/2397113809 shutdown_connections 2022-01-24T07:01:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.666+0000 7f16a3e60700 1 -- 172.21.15.142:0/2397113809 wait complete. 2022-01-24T07:01:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.667+0000 7f16a3e60700 1 Processor -- start 2022-01-24T07:01:03.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.667+0000 7f16a3e60700 1 -- start start 2022-01-24T07:01:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.667+0000 7f16a3e60700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f169c0b8930 0x7f169c0d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.677 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.667+0000 7f16a3e60700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f169c148b50 0x7f169c171de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.678 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.667+0000 7f16a3e60700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c148f30 0x7f169c141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.678 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a3e60700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c13e6c0 con 0x7f169c148f30 2022-01-24T07:01:03.678 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a3e60700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c16ffd0 con 0x7f169c148b50 2022-01-24T07:01:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a3e60700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c16f550 con 0x7f169c0b8930 2022-01-24T07:01:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a1bfc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f169c0b8930 0x7f169c0d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a23fd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c148f30 0x7f169c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a1bfc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f169c0b8930 0x7f169c0d42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53634/0 (socket says 172.21.15.142:53634) 2022-01-24T07:01:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a1bfc700 1 -- 172.21.15.142:0/779001375 learned_addr learned my addr 172.21.15.142:0/779001375 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a13fb700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f169c148b50 0x7f169c171de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a23fd700 1 -- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f169c0b8930 msgr2=0x7f169c0d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a23fd700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f169c0b8930 0x7f169c0d42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a23fd700 1 -- 172.21.15.142:0/779001375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f169c148b50 msgr2=0x7f169c171de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a23fd700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f169c148b50 0x7f169c171de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a23fd700 1 -- 172.21.15.142:0/779001375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169000b180 con 0x7f169c148f30 2022-01-24T07:01:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a23fd700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c148f30 0x7f169c141140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f169c0d5ba0 tx=0x7f1694007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f169affd700 1 -- 172.21.15.142:0/779001375 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169400ce30 con 0x7f169c148f30 2022-01-24T07:01:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f169affd700 1 -- 172.21.15.142:0/779001375 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940070d0 con 0x7f169c148f30 2022-01-24T07:01:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c16f7f0 con 0x7f169c148f30 2022-01-24T07:01:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f169affd700 1 -- 172.21.15.142:0/779001375 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1694007430 con 0x7f169c148f30 2022-01-24T07:01:03.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.668+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c16fd30 con 0x7f169c148f30 2022-01-24T07:01:03.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.669+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c140e60 con 0x7f169c148f30 2022-01-24T07:01:03.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.669+0000 7f169affd700 1 -- 172.21.15.142:0/779001375 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f169401a060 con 0x7f169c148f30 2022-01-24T07:01:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.670+0000 7f169affd700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f167c052c60 0x7f167c055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.685 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.670+0000 7f169affd700 1 -- 172.21.15.142:0/779001375 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f169406a080 con 0x7f169c148f30 2022-01-24T07:01:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.670+0000 7f16a1bfc700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f167c052c60 0x7f167c055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.670+0000 7f16a1bfc700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f167c052c60 0x7f167c055120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f168c00d000 tx=0x7f168c0014a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.673+0000 7f169affd700 1 -- 172.21.15.142:0/779001375 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f16940417a0 con 0x7f169c148f30 2022-01-24T07:01:03.803 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.804+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f169c057950 con 0x7f169c148f30 2022-01-24T07:01:03.804 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.804+0000 7f169affd700 1 -- 172.21.15.142:0/779001375 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1694018030 con 0x7f169c148f30 2022-01-24T07:01:03.804 INFO:teuthology.orchestra.run.smithi142.stdout:60129542150 2022-01-24T07:01:03.805 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f167c052c60 msgr2=0x7f167c055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.806 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f167c052c60 0x7f167c055120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f168c00d000 tx=0x7f168c0014a0).stop 2022-01-24T07:01:03.806 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c148f30 msgr2=0x7f169c141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.806 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c148f30 0x7f169c141140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f169c0d5ba0 tx=0x7f1694007b90).stop 2022-01-24T07:01:03.807 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 shutdown_connections 2022-01-24T07:01:03.807 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f167c052c60 0x7f167c055120 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.807 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f169c148f30 0x7f169c141140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.807 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f169c0b8930 0x7f169c0d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.808 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 --2- 172.21.15.142:0/779001375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f169c148b50 0x7f169c171de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.808 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 >> 172.21.15.142:0/779001375 conn(0x7f169c05fc90 msgr2=0x7f169c147390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.808 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 shutdown_connections 2022-01-24T07:01:03.808 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.806+0000 7f16a3e60700 1 -- 172.21.15.142:0/779001375 wait complete. 2022-01-24T07:01:03.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.5 2022-01-24T07:01:03.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-01-24T07:01:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.917+0000 7f8e0a0d6700 1 Processor -- start 2022-01-24T07:01:03.917 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.917+0000 7f8e0a0d6700 1 -- start start 2022-01-24T07:01:03.923 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e0a0d6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e04148b50 0x7f8e040b8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e0a0d6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e04067de0 con 0x7f8e04148f30 2022-01-24T07:01:03.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e0a0d6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e04068080 con 0x7f8e04160680 2022-01-24T07:01:03.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e0a0d6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e040b7650 con 0x7f8e04148b50 2022-01-24T07:01:03.924 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e037fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e04148b50 0x7f8e040b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e037fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e04148b50 0x7f8e040b8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50880/0 (socket says 172.21.15.142:50880) 2022-01-24T07:01:03.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e037fe700 1 -- 172.21.15.142:0/3156251084 learned_addr learned my addr 172.21.15.142:0/3156251084 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:03.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e02ffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8e04148f30 0x7f8e0415ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48244/0 (socket says 172.21.15.142:48244) 2022-01-24T07:01:03.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e037fe700 1 -- 172.21.15.142:0/3156251084 >> v1:172.21.15.145:6789/0 conn(0x7f8e04160680 legacy=0x7f8e040d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:03.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e037fe700 1 -- 172.21.15.142:0/3156251084 >> v1:172.21.15.142:6789/0 conn(0x7f8e04148f30 legacy=0x7f8e0415ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.926 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.918+0000 7f8e027fc700 1 -- 172.21.15.142:0/3156251084 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606063392 0 0) 0x7f8e04067de0 con 0x7f8e04148f30 2022-01-24T07:01:03.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e037fe700 1 -- 172.21.15.142:0/3156251084 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e040b7840 con 0x7f8e04148b50 2022-01-24T07:01:03.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e037fe700 1 --2- 172.21.15.142:0/3156251084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e040b8220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8df40032f0 tx=0x7f8df4009290).ready entity=mon.0 client_cookie=2aa0042bb4642618 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e027fc700 1 -- 172.21.15.142:0/3156251084 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df400b8a0 con 0x7f8e04148b50 2022-01-24T07:01:03.927 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e027fc700 1 -- 172.21.15.142:0/3156251084 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400ba00 con 0x7f8e04148b50 2022-01-24T07:01:03.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e027fc700 1 -- 172.21.15.142:0/3156251084 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df400bb70 con 0x7f8e04148b50 2022-01-24T07:01:03.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/3156251084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 msgr2=0x7f8e040b8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/3156251084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e040b8220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8df40032f0 tx=0x7f8df4009290).stop 2022-01-24T07:01:03.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/3156251084 shutdown_connections 2022-01-24T07:01:03.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/3156251084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e040b8220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/3156251084 >> 172.21.15.142:0/3156251084 conn(0x7f8e0405fc90 msgr2=0x7f8e040600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:03.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/3156251084 shutdown_connections 2022-01-24T07:01:03.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.919+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/3156251084 wait complete. 2022-01-24T07:01:03.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.920+0000 7f8e0a0d6700 1 Processor -- start 2022-01-24T07:01:03.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.920+0000 7f8e0a0d6700 1 -- start start 2022-01-24T07:01:03.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e0a0d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e0415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e0a0d6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e04148f30 0x7f8e0416efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e0a0d6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e04160680 0x7f8e04161620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e0a0d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0416f9a0 con 0x7f8e04148b50 2022-01-24T07:01:03.932 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e0a0d6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0416fc40 con 0x7f8e04148f30 2022-01-24T07:01:03.932 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e0a0d6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0416fee0 con 0x7f8e04160680 2022-01-24T07:01:03.932 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e037fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e0415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.933 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e037fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e0415ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50882/0 (socket says 172.21.15.142:50882) 2022-01-24T07:01:03.933 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e037fe700 1 -- 172.21.15.142:0/1595649596 learned_addr learned my addr 172.21.15.142:0/1595649596 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:03.933 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.921+0000 7f8e03fff700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e04160680 0x7f8e04161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e02ffd700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e04148f30 0x7f8e0416efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e037fe700 1 -- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e04160680 msgr2=0x7f8e04161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e037fe700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e04160680 0x7f8e04161620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e037fe700 1 -- 172.21.15.142:0/1595649596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e04148f30 msgr2=0x7f8e0416efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:03.935 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e037fe700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e04148f30 0x7f8e0416efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:03.935 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e037fe700 1 -- 172.21.15.142:0/1595649596 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009530 con 0x7f8e04148b50 2022-01-24T07:01:03.935 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e02ffd700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e04148f30 0x7f8e0416efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:01:03.935 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e037fe700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e0415ccd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f8df40032f0 tx=0x7f8df4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.936 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e00ff9700 1 -- 172.21.15.142:0/1595649596 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df401f3f0 con 0x7f8e04148b50 2022-01-24T07:01:03.936 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e00ff9700 1 -- 172.21.15.142:0/1595649596 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df401f550 con 0x7f8e04148b50 2022-01-24T07:01:03.936 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e04160c40 con 0x7f8e04148b50 2022-01-24T07:01:03.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e00ff9700 1 -- 172.21.15.142:0/1595649596 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8df401f8b0 con 0x7f8e04148b50 2022-01-24T07:01:03.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.922+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e04161180 con 0x7f8e04148b50 2022-01-24T07:01:03.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.923+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0415d380 con 0x7f8e04148b50 2022-01-24T07:01:03.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.923+0000 7f8e00ff9700 1 -- 172.21.15.142:0/1595649596 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f8df4026030 con 0x7f8e04148b50 2022-01-24T07:01:03.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.923+0000 7f8e00ff9700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8de4052bd0 0x7f8de4055090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:03.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.923+0000 7f8e00ff9700 1 -- 172.21.15.142:0/1595649596 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8df406b910 con 0x7f8e04148b50 2022-01-24T07:01:03.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.923+0000 7f8e02ffd700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8de4052bd0 0x7f8de4055090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:03.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.924+0000 7f8e02ffd700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8de4052bd0 0x7f8de4055090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8df8008000 tx=0x7f8df8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:03.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:03.927+0000 7f8e00ff9700 1 -- 172.21.15.142:0/1595649596 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f8df4043030 con 0x7f8e04148b50 2022-01-24T07:01:04.055 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.056+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8e040cd900 con 0x7f8e04148b50 2022-01-24T07:01:04.056 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.056+0000 7f8e00ff9700 1 -- 172.21.15.142:0/1595649596 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8df4024090 con 0x7f8e04148b50 2022-01-24T07:01:04.056 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:04.057 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8de4052bd0 msgr2=0x7f8de4055090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8de4052bd0 0x7f8de4055090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8df8008000 tx=0x7f8df8009040).stop 2022-01-24T07:01:04.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 msgr2=0x7f8e0415ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e0415ccd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f8df40032f0 tx=0x7f8df4016000).stop 2022-01-24T07:01:04.058 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 shutdown_connections 2022-01-24T07:01:04.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8de4052bd0 0x7f8de4055090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e04160680 0x7f8e04161620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e04148b50 0x7f8e0415ccd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.059 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 --2- 172.21.15.142:0/1595649596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e04148f30 0x7f8e0416efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.060 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 >> 172.21.15.142:0/1595649596 conn(0x7f8e0405fc90 msgr2=0x7f8e040b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.060 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.057+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 shutdown_connections 2022-01-24T07:01:04.060 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.058+0000 7f8e0a0d6700 1 -- 172.21.15.142:0/1595649596 wait complete. 2022-01-24T07:01:04.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2022-01-24T07:01:04.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-01-24T07:01:04.167 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.168+0000 7fa033149700 1 Processor -- start 2022-01-24T07:01:04.168 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.168+0000 7fa033149700 1 -- start start 2022-01-24T07:01:04.170 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa033149700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa02c1630d0 0x7fa02c063270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa033149700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fa02c1634b0 0x7fa02c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa033149700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0620b0 con 0x7fa02c141ba0 2022-01-24T07:01:04.171 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa033149700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c062350 con 0x7fa02c1630d0 2022-01-24T07:01:04.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa033149700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0625f0 con 0x7fa02c1634b0 2022-01-24T07:01:04.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa030ee5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa02c1630d0 0x7fa02c063270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa0316e6700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa02c141ba0 0x7fa02c141ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48256/0 (socket says 172.21.15.142:48256) 2022-01-24T07:01:04.172 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa0316e6700 1 -- 172.21.15.142:0/354545641 learned_addr learned my addr 172.21.15.142:0/354545641 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:04.173 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa02bfff700 1 --2- 172.21.15.142:0/354545641 >> v2:172.21.15.145:3300/0 conn(0x7fa02c1634b0 0x7fa02c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.173 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa030ee5700 1 -- 172.21.15.142:0/354545641 >> v2:172.21.15.145:3300/0 conn(0x7fa02c1634b0 msgr2=0x7fa02c0cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:04.173 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa02b7fe700 1 -- 172.21.15.142:0/354545641 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887225361 0 0) 0x7fa02c0620b0 con 0x7fa02c141ba0 2022-01-24T07:01:04.173 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa030ee5700 1 --2- 172.21.15.142:0/354545641 >> v2:172.21.15.145:3300/0 conn(0x7fa02c1634b0 0x7fa02c0cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.174 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa030ee5700 1 -- 172.21.15.142:0/354545641 >> v1:172.21.15.142:6789/0 conn(0x7fa02c141ba0 legacy=0x7fa02c141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.174 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa030ee5700 1 -- 172.21.15.142:0/354545641 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c062890 con 0x7fa02c1630d0 2022-01-24T07:01:04.174 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa030ee5700 1 --2- 172.21.15.142:0/354545641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1630d0 0x7fa02c063270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa01c0032f0 tx=0x7fa01c0091d0).ready entity=mon.0 client_cookie=8f23d8f5b864b5d5 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.174 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa02b7fe700 1 -- 172.21.15.142:0/354545641 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c009ea0 con 0x7fa02c1630d0 2022-01-24T07:01:04.175 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa02b7fe700 1 -- 172.21.15.142:0/354545641 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c00b870 con 0x7fa02c1630d0 2022-01-24T07:01:04.175 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.169+0000 7fa02b7fe700 1 -- 172.21.15.142:0/354545641 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c00b9e0 con 0x7fa02c1630d0 2022-01-24T07:01:04.175 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 -- 172.21.15.142:0/354545641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1630d0 msgr2=0x7fa02c063270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.175 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 --2- 172.21.15.142:0/354545641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1630d0 0x7fa02c063270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa01c0032f0 tx=0x7fa01c0091d0).stop 2022-01-24T07:01:04.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 -- 172.21.15.142:0/354545641 shutdown_connections 2022-01-24T07:01:04.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 --2- 172.21.15.142:0/354545641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1630d0 0x7fa02c063270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 --2- 172.21.15.142:0/354545641 >> v2:172.21.15.145:3300/0 conn(0x7fa02c1634b0 0x7fa02c0cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 -- 172.21.15.142:0/354545641 >> 172.21.15.142:0/354545641 conn(0x7fa02c0d2d50 msgr2=0x7fa02c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.176 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 -- 172.21.15.142:0/354545641 shutdown_connections 2022-01-24T07:01:04.177 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.170+0000 7fa033149700 1 -- 172.21.15.142:0/354545641 wait complete. 2022-01-24T07:01:04.177 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.171+0000 7fa033149700 1 Processor -- start 2022-01-24T07:01:04.177 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.171+0000 7fa033149700 1 -- start start 2022-01-24T07:01:04.180 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa033149700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa02c141ba0 0x7fa02c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.180 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa033149700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa02c1630d0 0x7fa02c139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.181 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa033149700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1634b0 0x7fa02c13a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.181 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa033149700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c13abc0 con 0x7fa02c1634b0 2022-01-24T07:01:04.181 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa033149700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c172550 con 0x7fa02c1630d0 2022-01-24T07:01:04.181 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa033149700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c13a920 con 0x7fa02c141ba0 2022-01-24T07:01:04.182 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa02c141ba0 0x7fa02c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.182 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa0316e6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1634b0 0x7fa02c13a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.182 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa02c141ba0 0x7fa02c15c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53656/0 (socket says 172.21.15.142:53656) 2022-01-24T07:01:04.182 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 -- 172.21.15.142:0/501126897 learned_addr learned my addr 172.21.15.142:0/501126897 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:04.183 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa0316e6700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1634b0 0x7fa02c13a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50898/0 (socket says 172.21.15.142:50898) 2022-01-24T07:01:04.183 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa02bfff700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa02c1630d0 0x7fa02c139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.183 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 -- 172.21.15.142:0/501126897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa02c1630d0 msgr2=0x7fa02c139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.183 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa02c1630d0 0x7fa02c139c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.183 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 -- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1634b0 msgr2=0x7fa02c13a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.184 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1634b0 0x7fa02c13a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.184 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 -- 172.21.15.142:0/501126897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c009470 con 0x7fa02c141ba0 2022-01-24T07:01:04.184 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa0316e6700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1634b0 0x7fa02c13a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:04.184 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa030ee5700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa02c141ba0 0x7fa02c15c200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa02c13da10 tx=0x7fa01c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.172+0000 7fa029ffb700 1 -- 172.21.15.142:0/501126897 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c011e90 con 0x7fa02c141ba0 2022-01-24T07:01:04.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.173+0000 7fa029ffb700 1 -- 172.21.15.142:0/501126897 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c00b9e0 con 0x7fa02c141ba0 2022-01-24T07:01:04.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.173+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c1727b0 con 0x7fa02c141ba0 2022-01-24T07:01:04.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.173+0000 7fa029ffb700 1 -- 172.21.15.142:0/501126897 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa01c01f5e0 con 0x7fa02c141ba0 2022-01-24T07:01:04.185 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.173+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c172cf0 con 0x7fa02c141ba0 2022-01-24T07:01:04.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.173+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c172eb0 con 0x7fa02c141ba0 2022-01-24T07:01:04.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.174+0000 7fa029ffb700 1 -- 172.21.15.142:0/501126897 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fa01c026030 con 0x7fa02c141ba0 2022-01-24T07:01:04.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.174+0000 7fa029ffb700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa010052c60 0x7fa010055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.186 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.174+0000 7fa029ffb700 1 -- 172.21.15.142:0/501126897 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa01c06b790 con 0x7fa02c141ba0 2022-01-24T07:01:04.187 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.174+0000 7fa02bfff700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa010052c60 0x7fa010055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.187 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.174+0000 7fa02bfff700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa010052c60 0x7fa010055120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa01400c000 tx=0x7fa014006f90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.187 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.177+0000 7fa029ffb700 1 -- 172.21.15.142:0/501126897 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fa01c042eb0 con 0x7fa02c141ba0 2022-01-24T07:01:04.307 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.308+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa02c142620 con 0x7fa02c141ba0 2022-01-24T07:01:04.308 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.308+0000 7fa029ffb700 1 -- 172.21.15.142:0/501126897 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa01c015020 con 0x7fa02c141ba0 2022-01-24T07:01:04.308 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2022-01-24T07:01:04.309 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa010052c60 msgr2=0x7fa010055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.310 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa010052c60 0x7fa010055120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa01400c000 tx=0x7fa014006f90).stop 2022-01-24T07:01:04.310 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa02c141ba0 msgr2=0x7fa02c15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.310 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa02c141ba0 0x7fa02c15c200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa02c13da10 tx=0x7fa01c016000).stop 2022-01-24T07:01:04.310 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 shutdown_connections 2022-01-24T07:01:04.311 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa010052c60 0x7fa010055120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.311 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa02c1634b0 0x7fa02c13a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.311 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa02c141ba0 0x7fa02c15c200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.311 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 --2- 172.21.15.142:0/501126897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa02c1630d0 0x7fa02c139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.312 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 >> 172.21.15.142:0/501126897 conn(0x7fa02c0d2d50 msgr2=0x7fa02c165a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.312 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 shutdown_connections 2022-01-24T07:01:04.312 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.310+0000 7fa033149700 1 -- 172.21.15.142:0/501126897 wait complete. 2022-01-24T07:01:04.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2022-01-24T07:01:04.320 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-01-24T07:01:04.321 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-01-24T07:01:04.419 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.420+0000 7f9e22a44700 1 Processor -- start 2022-01-24T07:01:04.420 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.420+0000 7f9e22a44700 1 -- start start 2022-01-24T07:01:04.422 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e22a44700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15ced0 0x7f9e1c064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e22a44700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e1c15d2b0 0x7f9e1c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e22a44700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f9e1c05c590 0x7f9e1c0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e22a44700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c0c91e0 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.423 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e22a44700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c05b3d0 con 0x7f9e1c05c590 2022-01-24T07:01:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e22a44700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c05b670 con 0x7f9e1c15ced0 2022-01-24T07:01:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e1c15d2b0 0x7f9e1c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15ced0 0x7f9e1c064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15ced0 0x7f9e1c064520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53664/0 (socket says 172.21.15.142:53664) 2022-01-24T07:01:04.424 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1b7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e1c15d2b0 0x7f9e1c0c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50904/0 (socket says 172.21.15.142:50904) 2022-01-24T07:01:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1bfff700 1 -- 172.21.15.142:0/3957032579 learned_addr learned my addr 172.21.15.142:0/3957032579 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e20fe1700 1 --2- 172.21.15.142:0/3957032579 >> v2:172.21.15.145:3300/0 conn(0x7f9e1c05c590 0x7f9e1c0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1b7fe700 1 -- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15ced0 msgr2=0x7f9e1c064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:04.425 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1b7fe700 1 --2- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15ced0 0x7f9e1c064520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1b7fe700 1 -- 172.21.15.142:0/3957032579 >> v2:172.21.15.145:3300/0 conn(0x7f9e1c05c590 msgr2=0x7f9e1c0b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1b7fe700 1 --2- 172.21.15.142:0/3957032579 >> v2:172.21.15.145:3300/0 conn(0x7f9e1c05c590 0x7f9e1c0b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1b7fe700 1 -- 172.21.15.142:0/3957032579 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c05b910 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.421+0000 7f9e1bfff700 1 --2- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15ced0 0x7f9e1c064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:04.426 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e1b7fe700 1 --2- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15d2b0 0x7f9e1c0c8cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9e10002f70 tx=0x7f9e10006df0).ready entity=mon.0 client_cookie=f55485a4aad5de7b server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e1affd700 1 -- 172.21.15.142:0/3957032579 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1000d4a0 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e1affd700 1 -- 172.21.15.142:0/3957032579 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10000e90 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e1affd700 1 -- 172.21.15.142:0/3957032579 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1000d7f0 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.427 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 -- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15d2b0 msgr2=0x7f9e1c0c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 --2- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15d2b0 0x7f9e1c0c8cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9e10002f70 tx=0x7f9e10006df0).stop 2022-01-24T07:01:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 -- 172.21.15.142:0/3957032579 shutdown_connections 2022-01-24T07:01:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 --2- 172.21.15.142:0/3957032579 >> v2:172.21.15.145:3300/0 conn(0x7f9e1c05c590 0x7f9e1c0b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 --2- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15ced0 0x7f9e1c064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.428 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 --2- 172.21.15.142:0/3957032579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15d2b0 0x7f9e1c0c8cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.429 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 -- 172.21.15.142:0/3957032579 >> 172.21.15.142:0/3957032579 conn(0x7f9e1c0d4830 msgr2=0x7f9e1c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.429 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 -- 172.21.15.142:0/3957032579 shutdown_connections 2022-01-24T07:01:04.429 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.422+0000 7f9e22a44700 1 -- 172.21.15.142:0/3957032579 wait complete. 2022-01-24T07:01:04.429 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.423+0000 7f9e22a44700 1 Processor -- start 2022-01-24T07:01:04.429 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.423+0000 7f9e22a44700 1 -- start start 2022-01-24T07:01:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e22a44700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e1c05c590 0x7f9e1c0d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.432 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e22a44700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15ced0 0x7f9e1c1729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e22a44700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15d2b0 0x7f9e1c172eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e22a44700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c16fc80 con 0x7f9e1c15ced0 2022-01-24T07:01:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e22a44700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c1552b0 con 0x7f9e1c05c590 2022-01-24T07:01:04.433 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e22a44700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c155550 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e1b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15ced0 0x7f9e1c1729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e20fe1700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15d2b0 0x7f9e1c172eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e1b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15ced0 0x7f9e1c1729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50910/0 (socket says 172.21.15.142:50910) 2022-01-24T07:01:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.424+0000 7f9e1b7fe700 1 -- 172.21.15.142:0/1858603180 learned_addr learned my addr 172.21.15.142:0/1858603180 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:04.434 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e1bfff700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e1c05c590 0x7f9e1c0d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.435 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e20fe1700 1 -- 172.21.15.142:0/1858603180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e1c05c590 msgr2=0x7f9e1c0d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.435 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e20fe1700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e1c05c590 0x7f9e1c0d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.435 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e20fe1700 1 -- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15ced0 msgr2=0x7f9e1c1729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.435 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e20fe1700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15ced0 0x7f9e1c1729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.436 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e20fe1700 1 -- 172.21.15.142:0/1858603180 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c00b1e0 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.436 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e1b7fe700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15ced0 0x7f9e1c1729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:04.436 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e20fe1700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15d2b0 0x7f9e1c172eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9e1400c000 tx=0x7f9e140091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.436 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e197fa700 1 -- 172.21.15.142:0/1858603180 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1400c670 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e197fa700 1 -- 172.21.15.142:0/1858603180 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1400c7d0 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1000b180 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e197fa700 1 -- 172.21.15.142:0/1858603180 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1400cb30 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.425+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c155a90 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.437 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.426+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c155c50 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.426+0000 7f9e197fa700 1 -- 172.21.15.142:0/1858603180 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f9e14022070 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.426+0000 7f9e197fa700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9dfc052ab0 0x7f9dfc054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.426+0000 7f9e197fa700 1 -- 172.21.15.142:0/1858603180 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e1406b150 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.438 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.426+0000 7f9e1bfff700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9dfc052ab0 0x7f9dfc054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.427+0000 7f9e1bfff700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9dfc052ab0 0x7f9dfc054f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9e0c00b000 tx=0x7f9e0c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.439 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.430+0000 7f9e197fa700 1 -- 172.21.15.142:0/1858603180 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f9e14042810 con 0x7f9e1c15d2b0 2022-01-24T07:01:04.555 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.556+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 --> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e1c05bbb0 con 0x7f9dfc052ab0 2022-01-24T07:01:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.559+0000 7f9e197fa700 1 -- 172.21.15.142:0/1858603180 <== mgr.4105 v2:172.21.15.142:6800/64452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82416 (secure 0 0 0) 0x7f9e1c05bbb0 con 0x7f9dfc052ab0 2022-01-24T07:01:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9dfc052ab0 msgr2=0x7f9dfc054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9dfc052ab0 0x7f9dfc054f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9e0c00b000 tx=0x7f9e0c008040).stop 2022-01-24T07:01:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15d2b0 msgr2=0x7f9e1c172eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15d2b0 0x7f9e1c172eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9e1400c000 tx=0x7f9e140091d0).stop 2022-01-24T07:01:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 shutdown_connections 2022-01-24T07:01:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9e1c05c590 0x7f9e1c0d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f9dfc052ab0 0x7f9dfc054f70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e1c15d2b0 0x7f9e1c172eb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 --2- 172.21.15.142:0/1858603180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e1c15ced0 0x7f9e1c1729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 >> 172.21.15.142:0/1858603180 conn(0x7f9e1c0d4830 msgr2=0x7f9e1c1548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.560+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 shutdown_connections 2022-01-24T07:01:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.561+0000 7f9e22a44700 1 -- 172.21.15.142:0/1858603180 wait complete. 2022-01-24T07:01:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2022-01-24T07:01:04.570 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2022-01-24T07:01:04.139353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8949,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":76,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390928,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583792,"statfs":{"total":773094113280,"available":764501803008,"internally_reserved":8589934592,"allocated":2310144,"data_stored":803274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8949,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.866328"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576348+0000","last_change":"2022-01-24T07:00:54.272160+0000","last_active":"2022-01-24T07:00:55.576348+0000","last_peered":"2022-01-24T07:00:55.576348+0000","last_clean":"2022-01-24T07:00:55.576348+0000","last_became_active":"2022-01-24T07:00:54.271817+0000","last_became_peered":"2022-01-24T07:00:54.271817+0000","last_unstale":"2022-01-24T07:00:55.576348+0000","last_undegraded":"2022-01-24T07:00:55.576348+0000","last_fullsized":"2022-01-24T07:00:55.576348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576365+0000","last_change":"2022-01-24T07:00:51.582379+0000","last_active":"2022-01-24T07:00:55.576365+0000","last_peered":"2022-01-24T07:00:55.576365+0000","last_clean":"2022-01-24T07:00:55.576365+0000","last_became_active":"2022-01-24T07:00:51.582036+0000","last_became_peered":"2022-01-24T07:00:51.582036+0000","last_unstale":"2022-01-24T07:00:55.576365+0000","last_undegraded":"2022-01-24T07:00:55.576365+0000","last_fullsized":"2022-01-24T07:00:55.576365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'26","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.307001+0000","last_change":"2022-01-24T07:00:53.951941+0000","last_active":"2022-01-24T07:01:00.307001+0000","last_peered":"2022-01-24T07:01:00.307001+0000","last_clean":"2022-01-24T07:01:00.307001+0000","last_became_active":"2022-01-24T07:00:53.951578+0000","last_became_peered":"2022-01-24T07:00:53.951578+0000","last_unstale":"2022-01-24T07:01:00.307001+0000","last_undegraded":"2022-01-24T07:01:00.307001+0000","last_fullsized":"2022-01-24T07:01:00.307001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":825,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576519+0000","last_change":"2022-01-24T07:00:54.269100+0000","last_active":"2022-01-24T07:00:55.576519+0000","last_peered":"2022-01-24T07:00:55.576519+0000","last_clean":"2022-01-24T07:00:55.576519+0000","last_became_active":"2022-01-24T07:00:54.268863+0000","last_became_peered":"2022-01-24T07:00:54.268863+0000","last_unstale":"2022-01-24T07:00:55.576519+0000","last_undegraded":"2022-01-24T07:00:55.576519+0000","last_fullsized":"2022-01-24T07:00:55.576519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.274633+0000","last_change":"2022-01-24T07:00:50.823475+0000","last_active":"2022-01-24T07:00:55.274633+0000","last_peered":"2022-01-24T07:00:55.274633+0000","last_clean":"2022-01-24T07:00:55.274633+0000","last_became_active":"2022-01-24T07:00:50.823137+0000","last_became_peered":"2022-01-24T07:00:50.823137+0000","last_unstale":"2022-01-24T07:00:55.274633+0000","last_undegraded":"2022-01-24T07:00:55.274633+0000","last_fullsized":"2022-01-24T07:00:55.274633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'32","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.312669+0000","last_change":"2022-01-24T07:00:53.951317+0000","last_active":"2022-01-24T07:01:00.312669+0000","last_peered":"2022-01-24T07:01:00.312669+0000","last_clean":"2022-01-24T07:01:00.312669+0000","last_became_active":"2022-01-24T07:00:53.950995+0000","last_became_peered":"2022-01-24T07:00:53.950995+0000","last_unstale":"2022-01-24T07:01:00.312669+0000","last_undegraded":"2022-01-24T07:01:00.312669+0000","last_fullsized":"2022-01-24T07:01:00.312669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576438+0000","last_change":"2022-01-24T07:00:54.272256+0000","last_active":"2022-01-24T07:00:55.576438+0000","last_peered":"2022-01-24T07:00:55.576438+0000","last_clean":"2022-01-24T07:00:55.576438+0000","last_became_active":"2022-01-24T07:00:54.271881+0000","last_became_peered":"2022-01-24T07:00:54.271881+0000","last_unstale":"2022-01-24T07:00:55.576438+0000","last_undegraded":"2022-01-24T07:00:55.576438+0000","last_fullsized":"2022-01-24T07:00:55.576438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597235+0000","last_change":"2022-01-24T07:00:50.824045+0000","last_active":"2022-01-24T07:00:55.597235+0000","last_peered":"2022-01-24T07:00:55.597235+0000","last_clean":"2022-01-24T07:00:55.597235+0000","last_became_active":"2022-01-24T07:00:50.823697+0000","last_became_peered":"2022-01-24T07:00:50.823697+0000","last_unstale":"2022-01-24T07:00:55.597235+0000","last_undegraded":"2022-01-24T07:00:55.597235+0000","last_fullsized":"2022-01-24T07:00:55.597235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'31","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309859+0000","last_change":"2022-01-24T07:00:53.950837+0000","last_active":"2022-01-24T07:01:00.309859+0000","last_peered":"2022-01-24T07:01:00.309859+0000","last_clean":"2022-01-24T07:01:00.309859+0000","last_became_active":"2022-01-24T07:00:53.950222+0000","last_became_peered":"2022-01-24T07:00:53.950222+0000","last_unstale":"2022-01-24T07:01:00.309859+0000","last_undegraded":"2022-01-24T07:01:00.309859+0000","last_fullsized":"2022-01-24T07:01:00.309859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":687,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.278582+0000","last_change":"2022-01-24T07:00:55.278094+0000","last_active":"2022-01-24T07:00:55.278582+0000","last_peered":"2022-01-24T07:00:55.278582+0000","last_clean":"2022-01-24T07:00:55.278582+0000","last_became_active":"2022-01-24T07:00:55.277662+0000","last_became_peered":"2022-01-24T07:00:55.277662+0000","last_unstale":"2022-01-24T07:00:55.278582+0000","last_undegraded":"2022-01-24T07:00:55.278582+0000","last_fullsized":"2022-01-24T07:00:55.278582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.274722+0000","last_change":"2022-01-24T07:00:50.822785+0000","last_active":"2022-01-24T07:00:55.274722+0000","last_peered":"2022-01-24T07:00:55.274722+0000","last_clean":"2022-01-24T07:00:55.274722+0000","last_became_active":"2022-01-24T07:00:50.822522+0000","last_became_peered":"2022-01-24T07:00:50.822522+0000","last_unstale":"2022-01-24T07:00:55.274722+0000","last_undegraded":"2022-01-24T07:00:55.274722+0000","last_fullsized":"2022-01-24T07:00:55.274722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597462+0000","last_change":"2022-01-24T07:00:46.804897+0000","last_active":"2022-01-24T07:00:55.597462+0000","last_peered":"2022-01-24T07:00:55.597462+0000","last_clean":"2022-01-24T07:00:55.597462+0000","last_became_active":"2022-01-24T07:00:46.804350+0000","last_became_peered":"2022-01-24T07:00:46.804350+0000","last_unstale":"2022-01-24T07:00:55.597462+0000","last_undegraded":"2022-01-24T07:00:55.597462+0000","last_fullsized":"2022-01-24T07:00:55.597462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:40.293177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:40.293177+0000","last_clean_scrub_stamp":"2022-01-24T07:00:40.293177+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'25","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309368+0000","last_change":"2022-01-24T07:00:53.951396+0000","last_active":"2022-01-24T07:01:00.309368+0000","last_peered":"2022-01-24T07:01:00.309368+0000","last_clean":"2022-01-24T07:01:00.309368+0000","last_became_active":"2022-01-24T07:00:53.950250+0000","last_became_peered":"2022-01-24T07:00:53.950250+0000","last_unstale":"2022-01-24T07:01:00.309368+0000","last_undegraded":"2022-01-24T07:01:00.309368+0000","last_fullsized":"2022-01-24T07:01:00.309368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":664,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597311+0000","last_change":"2022-01-24T07:00:54.271098+0000","last_active":"2022-01-24T07:00:55.597311+0000","last_peered":"2022-01-24T07:00:55.597311+0000","last_clean":"2022-01-24T07:00:55.597311+0000","last_became_active":"2022-01-24T07:00:54.270784+0000","last_became_peered":"2022-01-24T07:00:54.270784+0000","last_unstale":"2022-01-24T07:00:55.597311+0000","last_undegraded":"2022-01-24T07:00:55.597311+0000","last_fullsized":"2022-01-24T07:00:55.597311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597522+0000","last_change":"2022-01-24T07:00:50.823712+0000","last_active":"2022-01-24T07:00:55.597522+0000","last_peered":"2022-01-24T07:00:55.597522+0000","last_clean":"2022-01-24T07:00:55.597522+0000","last_became_active":"2022-01-24T07:00:50.823346+0000","last_became_peered":"2022-01-24T07:00:50.823346+0000","last_unstale":"2022-01-24T07:00:55.597522+0000","last_undegraded":"2022-01-24T07:00:55.597522+0000","last_fullsized":"2022-01-24T07:00:55.597522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'20","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:00:59.306128+0000","last_change":"2022-01-24T07:00:53.954204+0000","last_active":"2022-01-24T07:00:59.306128+0000","last_peered":"2022-01-24T07:00:59.306128+0000","last_clean":"2022-01-24T07:00:59.306128+0000","last_became_active":"2022-01-24T07:00:53.953786+0000","last_became_peered":"2022-01-24T07:00:53.953786+0000","last_unstale":"2022-01-24T07:00:59.306128+0000","last_undegraded":"2022-01-24T07:00:59.306128+0000","last_fullsized":"2022-01-24T07:00:59.306128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":742,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597411+0000","last_change":"2022-01-24T07:00:54.272855+0000","last_active":"2022-01-24T07:00:55.597411+0000","last_peered":"2022-01-24T07:00:55.597411+0000","last_clean":"2022-01-24T07:00:55.597411+0000","last_became_active":"2022-01-24T07:00:54.272484+0000","last_became_peered":"2022-01-24T07:00:54.272484+0000","last_unstale":"2022-01-24T07:00:55.597411+0000","last_undegraded":"2022-01-24T07:00:55.597411+0000","last_fullsized":"2022-01-24T07:00:55.597411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597451+0000","last_change":"2022-01-24T07:00:51.582696+0000","last_active":"2022-01-24T07:00:55.597451+0000","last_peered":"2022-01-24T07:00:55.597451+0000","last_clean":"2022-01-24T07:00:55.597451+0000","last_became_active":"2022-01-24T07:00:51.582385+0000","last_became_peered":"2022-01-24T07:00:51.582385+0000","last_unstale":"2022-01-24T07:00:55.597451+0000","last_undegraded":"2022-01-24T07:00:55.597451+0000","last_fullsized":"2022-01-24T07:00:55.597451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'25","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309665+0000","last_change":"2022-01-24T07:00:53.949849+0000","last_active":"2022-01-24T07:01:00.309665+0000","last_peered":"2022-01-24T07:01:00.309665+0000","last_clean":"2022-01-24T07:01:00.309665+0000","last_became_active":"2022-01-24T07:00:53.949610+0000","last_became_peered":"2022-01-24T07:00:53.949610+0000","last_unstale":"2022-01-24T07:01:00.309665+0000","last_undegraded":"2022-01-24T07:01:00.309665+0000","last_fullsized":"2022-01-24T07:01:00.309665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3734,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.275693+0000","last_change":"2022-01-24T07:00:54.272582+0000","last_active":"2022-01-24T07:00:55.275693+0000","last_peered":"2022-01-24T07:00:55.275693+0000","last_clean":"2022-01-24T07:00:55.275693+0000","last_became_active":"2022-01-24T07:00:54.272258+0000","last_became_peered":"2022-01-24T07:00:54.272258+0000","last_unstale":"2022-01-24T07:00:55.275693+0000","last_undegraded":"2022-01-24T07:00:55.275693+0000","last_fullsized":"2022-01-24T07:00:55.275693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'28","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.308256+0000","last_change":"2022-01-24T07:00:53.950770+0000","last_active":"2022-01-24T07:01:00.308256+0000","last_peered":"2022-01-24T07:01:00.308256+0000","last_clean":"2022-01-24T07:01:00.308256+0000","last_became_active":"2022-01-24T07:00:53.950335+0000","last_became_peered":"2022-01-24T07:00:53.950335+0000","last_unstale":"2022-01-24T07:01:00.308256+0000","last_undegraded":"2022-01-24T07:01:00.308256+0000","last_fullsized":"2022-01-24T07:01:00.308256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":867,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576460+0000","last_change":"2022-01-24T07:00:50.823984+0000","last_active":"2022-01-24T07:00:55.576460+0000","last_peered":"2022-01-24T07:00:55.576460+0000","last_clean":"2022-01-24T07:00:55.576460+0000","last_became_active":"2022-01-24T07:00:50.823646+0000","last_became_peered":"2022-01-24T07:00:50.823646+0000","last_unstale":"2022-01-24T07:00:55.576460+0000","last_undegraded":"2022-01-24T07:00:55.576460+0000","last_fullsized":"2022-01-24T07:00:55.576460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.273272+0000","last_change":"2022-01-24T07:00:54.271592+0000","last_active":"2022-01-24T07:00:55.273272+0000","last_peered":"2022-01-24T07:00:55.273272+0000","last_clean":"2022-01-24T07:00:55.273272+0000","last_became_active":"2022-01-24T07:00:54.271266+0000","last_became_peered":"2022-01-24T07:00:54.271266+0000","last_unstale":"2022-01-24T07:00:55.273272+0000","last_undegraded":"2022-01-24T07:00:55.273272+0000","last_fullsized":"2022-01-24T07:00:55.273272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.276133+0000","last_change":"2022-01-24T07:00:50.824087+0000","last_active":"2022-01-24T07:00:55.276133+0000","last_peered":"2022-01-24T07:00:55.276133+0000","last_clean":"2022-01-24T07:00:55.276133+0000","last_became_active":"2022-01-24T07:00:50.823749+0000","last_became_peered":"2022-01-24T07:00:50.823749+0000","last_unstale":"2022-01-24T07:00:55.276133+0000","last_undegraded":"2022-01-24T07:00:55.276133+0000","last_fullsized":"2022-01-24T07:00:55.276133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'22","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309918+0000","last_change":"2022-01-24T07:00:53.951228+0000","last_active":"2022-01-24T07:01:00.309918+0000","last_peered":"2022-01-24T07:01:00.309918+0000","last_clean":"2022-01-24T07:01:00.309918+0000","last_became_active":"2022-01-24T07:00:53.950865+0000","last_became_peered":"2022-01-24T07:00:53.950865+0000","last_unstale":"2022-01-24T07:01:00.309918+0000","last_undegraded":"2022-01-24T07:01:00.309918+0000","last_fullsized":"2022-01-24T07:01:00.309918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8949,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":17898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":99039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":98172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048876,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322964,"statfs":{"total":96636764160,"available":95562715136,"internally_reserved":1073741824,"allocated":299008,"data_stored":99804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048880,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322960,"statfs":{"total":96636764160,"available":95562711040,"internally_reserved":1073741824,"allocated":303104,"data_stored":100344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048876,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322964,"statfs":{"total":96636764160,"available":95562715136,"internally_reserved":1073741824,"allocated":299008,"data_stored":103133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048872,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322968,"statfs":{"total":96636764160,"available":95562719232,"internally_reserved":1073741824,"allocated":294912,"data_stored":102593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048884,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322956,"statfs":{"total":96636764160,"available":95562706944,"internally_reserved":1073741824,"allocated":307200,"data_stored":100528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":99661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}]}} 2022-01-24T07:01:04.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-01-24T07:01:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.671+0000 7f5c14fdc700 1 Processor -- start 2022-01-24T07:01:04.671 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.671+0000 7f5c14fdc700 1 -- start start 2022-01-24T07:01:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.672+0000 7f5c14fdc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c100bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.672+0000 7f5c14fdc700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5c100d0b30 0x7f5c10067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.672+0000 7f5c14fdc700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c101607c0 con 0x7f5c10149050 2022-01-24T07:01:04.676 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.672+0000 7f5c14fdc700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c10066db0 con 0x7f5c100d0b30 2022-01-24T07:01:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.672+0000 7f5c14fdc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10067050 con 0x7f5c10148c70 2022-01-24T07:01:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.672+0000 7f5c0e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c100bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0e59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c100bb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53678/0 (socket says 172.21.15.142:53678) 2022-01-24T07:01:04.677 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0e59c700 1 -- 172.21.15.142:0/2162480067 learned_addr learned my addr 172.21.15.142:0/2162480067 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0dd9b700 1 --2- 172.21.15.142:0/2162480067 >> v2:172.21.15.145:3300/0 conn(0x7f5c100d0b30 0x7f5c10067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0e59c700 1 -- 172.21.15.142:0/2162480067 >> v2:172.21.15.145:3300/0 conn(0x7f5c100d0b30 msgr2=0x7f5c10067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0e59c700 1 --2- 172.21.15.142:0/2162480067 >> v2:172.21.15.145:3300/0 conn(0x7f5c100d0b30 0x7f5c10067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.678 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0e59c700 1 -- 172.21.15.142:0/2162480067 >> v1:172.21.15.145:6789/0 conn(0x7f5c10149050 legacy=0x7f5c1015fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0e59c700 1 -- 172.21.15.142:0/2162480067 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100672f0 con 0x7f5c10148c70 2022-01-24T07:01:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0dd9b700 1 --2- 172.21.15.142:0/2162480067 >> v2:172.21.15.145:3300/0 conn(0x7f5c100d0b30 0x7f5c10067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-24T07:01:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0e59c700 1 --2- 172.21.15.142:0/2162480067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c100bb670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5c1005c340 tx=0x7f5c00009290).ready entity=mon.2 client_cookie=2f46e0eeef9805e1 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0d59a700 1 -- 172.21.15.142:0/2162480067 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0000b860 con 0x7f5c10148c70 2022-01-24T07:01:04.679 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0d59a700 1 -- 172.21.15.142:0/2162480067 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0000b9c0 con 0x7f5c10148c70 2022-01-24T07:01:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c0d59a700 1 -- 172.21.15.142:0/2162480067 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0000bb70 con 0x7f5c10148c70 2022-01-24T07:01:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c14fdc700 1 -- 172.21.15.142:0/2162480067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 msgr2=0x7f5c100bb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.673+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/2162480067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c100bb670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5c1005c340 tx=0x7f5c00009290).stop 2022-01-24T07:01:04.680 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.674+0000 7f5c14fdc700 1 -- 172.21.15.142:0/2162480067 shutdown_connections 2022-01-24T07:01:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.674+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/2162480067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c100bb670 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.674+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/2162480067 >> v2:172.21.15.145:3300/0 conn(0x7f5c100d0b30 0x7f5c10067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.674+0000 7f5c14fdc700 1 -- 172.21.15.142:0/2162480067 >> 172.21.15.142:0/2162480067 conn(0x7f5c1005fc90 msgr2=0x7f5c100600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.674+0000 7f5c14fdc700 1 -- 172.21.15.142:0/2162480067 shutdown_connections 2022-01-24T07:01:04.681 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.674+0000 7f5c14fdc700 1 -- 172.21.15.142:0/2162480067 wait complete. 2022-01-24T07:01:04.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 Processor -- start 2022-01-24T07:01:04.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 -- start start 2022-01-24T07:01:04.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c100d0b30 0x7f5c100d4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.682 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c10143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10149050 0x7f5c10172ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100cad40 con 0x7f5c100d0b30 2022-01-24T07:01:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10172850 con 0x7f5c10149050 2022-01-24T07:01:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c14fdc700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100d4610 con 0x7f5c10148c70 2022-01-24T07:01:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c0dd9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c10143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.675+0000 7f5c0e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c100d0b30 0x7f5c100d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c100d0b30 0x7f5c100d4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50922/0 (socket says 172.21.15.142:50922) 2022-01-24T07:01:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0dd9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c10143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53686/0 (socket says 172.21.15.142:53686) 2022-01-24T07:01:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 -- 172.21.15.142:0/1162268718 learned_addr learned my addr 172.21.15.142:0/1162268718 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:04.684 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0ed9d700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10149050 0x7f5c10172ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 -- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 msgr2=0x7f5c10143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c10143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 -- 172.21.15.142:0/1162268718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10149050 msgr2=0x7f5c10172ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.685 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10149050 0x7f5c10172ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 -- 172.21.15.142:0/1162268718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00009530 con 0x7f5c100d0b30 2022-01-24T07:01:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0dd9b700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c10143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0ed9d700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10149050 0x7f5c10172ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c0e59c700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c100d0b30 0x7f5c100d4120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5c100cc010 tx=0x7f5c00016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.686 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c077fe700 1 -- 172.21.15.142:0/1162268718 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c00021440 con 0x7f5c100d0b30 2022-01-24T07:01:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c077fe700 1 -- 172.21.15.142:0/1162268718 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c000215a0 con 0x7f5c100d0b30 2022-01-24T07:01:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c100ca2c0 con 0x7f5c100d0b30 2022-01-24T07:01:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c077fe700 1 -- 172.21.15.142:0/1162268718 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c00021900 con 0x7f5c100d0b30 2022-01-24T07:01:04.687 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.676+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c100ca800 con 0x7f5c100d0b30 2022-01-24T07:01:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.677+0000 7f5c077fe700 1 -- 172.21.15.142:0/1162268718 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f5c00029070 con 0x7f5c100d0b30 2022-01-24T07:01:04.688 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.677+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c10172c00 con 0x7f5c100d0b30 2022-01-24T07:01:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.677+0000 7f5c077fe700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5bf4052ab0 0x7f5bf4054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.677+0000 7f5c077fe700 1 -- 172.21.15.142:0/1162268718 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c0006bb30 con 0x7f5c100d0b30 2022-01-24T07:01:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.678+0000 7f5c0dd9b700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5bf4052ab0 0x7f5bf4054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.678+0000 7f5c0dd9b700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5bf4052ab0 0x7f5bf4054f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5bf800d000 tx=0x7f5bf8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.689 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.681+0000 7f5c077fe700 1 -- 172.21.15.142:0/1162268718 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f5c00043290 con 0x7f5c100d0b30 2022-01-24T07:01:04.809 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.810+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 --> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c10067590 con 0x7f5bf4052ab0 2022-01-24T07:01:04.812 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.812+0000 7f5c077fe700 1 -- 172.21.15.142:0/1162268718 <== mgr.4105 v2:172.21.15.142:6800/64452 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82416 (secure 0 0 0) 0x7f5c10067590 con 0x7f5bf4052ab0 2022-01-24T07:01:04.813 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:04.814 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5bf4052ab0 msgr2=0x7f5bf4054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.815 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5bf4052ab0 0x7f5bf4054f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5bf800d000 tx=0x7f5bf8008040).stop 2022-01-24T07:01:04.815 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c100d0b30 msgr2=0x7f5c100d4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.815 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c100d0b30 0x7f5c100d4120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5c100cc010 tx=0x7f5c00016000).stop 2022-01-24T07:01:04.815 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 shutdown_connections 2022-01-24T07:01:04.816 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c10149050 0x7f5c10172ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.816 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f5bf4052ab0 0x7f5bf4054f70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.816 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c100d0b30 0x7f5c100d4120 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.816 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 --2- 172.21.15.142:0/1162268718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c10148c70 0x7f5c10143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.816 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.814+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 >> 172.21.15.142:0/1162268718 conn(0x7f5c1005fc90 msgr2=0x7f5c100ba870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.817 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.815+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 shutdown_connections 2022-01-24T07:01:04.817 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.815+0000 7f5c14fdc700 1 -- 172.21.15.142:0/1162268718 wait complete. 2022-01-24T07:01:04.817 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2022-01-24T07:01:04.824 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2022-01-24T07:01:04.139353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8949,"num_objects":114,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":76,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390928,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583792,"statfs":{"total":773094113280,"available":764501803008,"internally_reserved":8589934592,"allocated":2310144,"data_stored":803274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8949,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.866328"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576348+0000","last_change":"2022-01-24T07:00:54.272160+0000","last_active":"2022-01-24T07:00:55.576348+0000","last_peered":"2022-01-24T07:00:55.576348+0000","last_clean":"2022-01-24T07:00:55.576348+0000","last_became_active":"2022-01-24T07:00:54.271817+0000","last_became_peered":"2022-01-24T07:00:54.271817+0000","last_unstale":"2022-01-24T07:00:55.576348+0000","last_undegraded":"2022-01-24T07:00:55.576348+0000","last_fullsized":"2022-01-24T07:00:55.576348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576365+0000","last_change":"2022-01-24T07:00:51.582379+0000","last_active":"2022-01-24T07:00:55.576365+0000","last_peered":"2022-01-24T07:00:55.576365+0000","last_clean":"2022-01-24T07:00:55.576365+0000","last_became_active":"2022-01-24T07:00:51.582036+0000","last_became_peered":"2022-01-24T07:00:51.582036+0000","last_unstale":"2022-01-24T07:00:55.576365+0000","last_undegraded":"2022-01-24T07:00:55.576365+0000","last_fullsized":"2022-01-24T07:00:55.576365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'26","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.307001+0000","last_change":"2022-01-24T07:00:53.951941+0000","last_active":"2022-01-24T07:01:00.307001+0000","last_peered":"2022-01-24T07:01:00.307001+0000","last_clean":"2022-01-24T07:01:00.307001+0000","last_became_active":"2022-01-24T07:00:53.951578+0000","last_became_peered":"2022-01-24T07:00:53.951578+0000","last_unstale":"2022-01-24T07:01:00.307001+0000","last_undegraded":"2022-01-24T07:01:00.307001+0000","last_fullsized":"2022-01-24T07:01:00.307001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":825,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576519+0000","last_change":"2022-01-24T07:00:54.269100+0000","last_active":"2022-01-24T07:00:55.576519+0000","last_peered":"2022-01-24T07:00:55.576519+0000","last_clean":"2022-01-24T07:00:55.576519+0000","last_became_active":"2022-01-24T07:00:54.268863+0000","last_became_peered":"2022-01-24T07:00:54.268863+0000","last_unstale":"2022-01-24T07:00:55.576519+0000","last_undegraded":"2022-01-24T07:00:55.576519+0000","last_fullsized":"2022-01-24T07:00:55.576519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.274633+0000","last_change":"2022-01-24T07:00:50.823475+0000","last_active":"2022-01-24T07:00:55.274633+0000","last_peered":"2022-01-24T07:00:55.274633+0000","last_clean":"2022-01-24T07:00:55.274633+0000","last_became_active":"2022-01-24T07:00:50.823137+0000","last_became_peered":"2022-01-24T07:00:50.823137+0000","last_unstale":"2022-01-24T07:00:55.274633+0000","last_undegraded":"2022-01-24T07:00:55.274633+0000","last_fullsized":"2022-01-24T07:00:55.274633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'32","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.312669+0000","last_change":"2022-01-24T07:00:53.951317+0000","last_active":"2022-01-24T07:01:00.312669+0000","last_peered":"2022-01-24T07:01:00.312669+0000","last_clean":"2022-01-24T07:01:00.312669+0000","last_became_active":"2022-01-24T07:00:53.950995+0000","last_became_peered":"2022-01-24T07:00:53.950995+0000","last_unstale":"2022-01-24T07:01:00.312669+0000","last_undegraded":"2022-01-24T07:01:00.312669+0000","last_fullsized":"2022-01-24T07:01:00.312669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576438+0000","last_change":"2022-01-24T07:00:54.272256+0000","last_active":"2022-01-24T07:00:55.576438+0000","last_peered":"2022-01-24T07:00:55.576438+0000","last_clean":"2022-01-24T07:00:55.576438+0000","last_became_active":"2022-01-24T07:00:54.271881+0000","last_became_peered":"2022-01-24T07:00:54.271881+0000","last_unstale":"2022-01-24T07:00:55.576438+0000","last_undegraded":"2022-01-24T07:00:55.576438+0000","last_fullsized":"2022-01-24T07:00:55.576438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597235+0000","last_change":"2022-01-24T07:00:50.824045+0000","last_active":"2022-01-24T07:00:55.597235+0000","last_peered":"2022-01-24T07:00:55.597235+0000","last_clean":"2022-01-24T07:00:55.597235+0000","last_became_active":"2022-01-24T07:00:50.823697+0000","last_became_peered":"2022-01-24T07:00:50.823697+0000","last_unstale":"2022-01-24T07:00:55.597235+0000","last_undegraded":"2022-01-24T07:00:55.597235+0000","last_fullsized":"2022-01-24T07:00:55.597235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'31","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309859+0000","last_change":"2022-01-24T07:00:53.950837+0000","last_active":"2022-01-24T07:01:00.309859+0000","last_peered":"2022-01-24T07:01:00.309859+0000","last_clean":"2022-01-24T07:01:00.309859+0000","last_became_active":"2022-01-24T07:00:53.950222+0000","last_became_peered":"2022-01-24T07:00:53.950222+0000","last_unstale":"2022-01-24T07:01:00.309859+0000","last_undegraded":"2022-01-24T07:01:00.309859+0000","last_fullsized":"2022-01-24T07:01:00.309859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":687,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.278582+0000","last_change":"2022-01-24T07:00:55.278094+0000","last_active":"2022-01-24T07:00:55.278582+0000","last_peered":"2022-01-24T07:00:55.278582+0000","last_clean":"2022-01-24T07:00:55.278582+0000","last_became_active":"2022-01-24T07:00:55.277662+0000","last_became_peered":"2022-01-24T07:00:55.277662+0000","last_unstale":"2022-01-24T07:00:55.278582+0000","last_undegraded":"2022-01-24T07:00:55.278582+0000","last_fullsized":"2022-01-24T07:00:55.278582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.274722+0000","last_change":"2022-01-24T07:00:50.822785+0000","last_active":"2022-01-24T07:00:55.274722+0000","last_peered":"2022-01-24T07:00:55.274722+0000","last_clean":"2022-01-24T07:00:55.274722+0000","last_became_active":"2022-01-24T07:00:50.822522+0000","last_became_peered":"2022-01-24T07:00:50.822522+0000","last_unstale":"2022-01-24T07:00:55.274722+0000","last_undegraded":"2022-01-24T07:00:55.274722+0000","last_fullsized":"2022-01-24T07:00:55.274722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597462+0000","last_change":"2022-01-24T07:00:46.804897+0000","last_active":"2022-01-24T07:00:55.597462+0000","last_peered":"2022-01-24T07:00:55.597462+0000","last_clean":"2022-01-24T07:00:55.597462+0000","last_became_active":"2022-01-24T07:00:46.804350+0000","last_became_peered":"2022-01-24T07:00:46.804350+0000","last_unstale":"2022-01-24T07:00:55.597462+0000","last_undegraded":"2022-01-24T07:00:55.597462+0000","last_fullsized":"2022-01-24T07:00:55.597462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:40.293177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:40.293177+0000","last_clean_scrub_stamp":"2022-01-24T07:00:40.293177+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'25","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309368+0000","last_change":"2022-01-24T07:00:53.951396+0000","last_active":"2022-01-24T07:01:00.309368+0000","last_peered":"2022-01-24T07:01:00.309368+0000","last_clean":"2022-01-24T07:01:00.309368+0000","last_became_active":"2022-01-24T07:00:53.950250+0000","last_became_peered":"2022-01-24T07:00:53.950250+0000","last_unstale":"2022-01-24T07:01:00.309368+0000","last_undegraded":"2022-01-24T07:01:00.309368+0000","last_fullsized":"2022-01-24T07:01:00.309368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":664,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597311+0000","last_change":"2022-01-24T07:00:54.271098+0000","last_active":"2022-01-24T07:00:55.597311+0000","last_peered":"2022-01-24T07:00:55.597311+0000","last_clean":"2022-01-24T07:00:55.597311+0000","last_became_active":"2022-01-24T07:00:54.270784+0000","last_became_peered":"2022-01-24T07:00:54.270784+0000","last_unstale":"2022-01-24T07:00:55.597311+0000","last_undegraded":"2022-01-24T07:00:55.597311+0000","last_fullsized":"2022-01-24T07:00:55.597311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597522+0000","last_change":"2022-01-24T07:00:50.823712+0000","last_active":"2022-01-24T07:00:55.597522+0000","last_peered":"2022-01-24T07:00:55.597522+0000","last_clean":"2022-01-24T07:00:55.597522+0000","last_became_active":"2022-01-24T07:00:50.823346+0000","last_became_peered":"2022-01-24T07:00:50.823346+0000","last_unstale":"2022-01-24T07:00:55.597522+0000","last_undegraded":"2022-01-24T07:00:55.597522+0000","last_fullsized":"2022-01-24T07:00:55.597522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'20","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:00:59.306128+0000","last_change":"2022-01-24T07:00:53.954204+0000","last_active":"2022-01-24T07:00:59.306128+0000","last_peered":"2022-01-24T07:00:59.306128+0000","last_clean":"2022-01-24T07:00:59.306128+0000","last_became_active":"2022-01-24T07:00:53.953786+0000","last_became_peered":"2022-01-24T07:00:53.953786+0000","last_unstale":"2022-01-24T07:00:59.306128+0000","last_undegraded":"2022-01-24T07:00:59.306128+0000","last_fullsized":"2022-01-24T07:00:59.306128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":742,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597411+0000","last_change":"2022-01-24T07:00:54.272855+0000","last_active":"2022-01-24T07:00:55.597411+0000","last_peered":"2022-01-24T07:00:55.597411+0000","last_clean":"2022-01-24T07:00:55.597411+0000","last_became_active":"2022-01-24T07:00:54.272484+0000","last_became_peered":"2022-01-24T07:00:54.272484+0000","last_unstale":"2022-01-24T07:00:55.597411+0000","last_undegraded":"2022-01-24T07:00:55.597411+0000","last_fullsized":"2022-01-24T07:00:55.597411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.597451+0000","last_change":"2022-01-24T07:00:51.582696+0000","last_active":"2022-01-24T07:00:55.597451+0000","last_peered":"2022-01-24T07:00:55.597451+0000","last_clean":"2022-01-24T07:00:55.597451+0000","last_became_active":"2022-01-24T07:00:51.582385+0000","last_became_peered":"2022-01-24T07:00:51.582385+0000","last_unstale":"2022-01-24T07:00:55.597451+0000","last_undegraded":"2022-01-24T07:00:55.597451+0000","last_fullsized":"2022-01-24T07:00:55.597451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'25","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309665+0000","last_change":"2022-01-24T07:00:53.949849+0000","last_active":"2022-01-24T07:01:00.309665+0000","last_peered":"2022-01-24T07:01:00.309665+0000","last_clean":"2022-01-24T07:01:00.309665+0000","last_became_active":"2022-01-24T07:00:53.949610+0000","last_became_peered":"2022-01-24T07:00:53.949610+0000","last_unstale":"2022-01-24T07:01:00.309665+0000","last_undegraded":"2022-01-24T07:01:00.309665+0000","last_fullsized":"2022-01-24T07:01:00.309665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3734,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.275693+0000","last_change":"2022-01-24T07:00:54.272582+0000","last_active":"2022-01-24T07:00:55.275693+0000","last_peered":"2022-01-24T07:00:55.275693+0000","last_clean":"2022-01-24T07:00:55.275693+0000","last_became_active":"2022-01-24T07:00:54.272258+0000","last_became_peered":"2022-01-24T07:00:54.272258+0000","last_unstale":"2022-01-24T07:00:55.275693+0000","last_undegraded":"2022-01-24T07:00:55.275693+0000","last_fullsized":"2022-01-24T07:00:55.275693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'28","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.308256+0000","last_change":"2022-01-24T07:00:53.950770+0000","last_active":"2022-01-24T07:01:00.308256+0000","last_peered":"2022-01-24T07:01:00.308256+0000","last_clean":"2022-01-24T07:01:00.308256+0000","last_became_active":"2022-01-24T07:00:53.950335+0000","last_became_peered":"2022-01-24T07:00:53.950335+0000","last_unstale":"2022-01-24T07:01:00.308256+0000","last_undegraded":"2022-01-24T07:01:00.308256+0000","last_fullsized":"2022-01-24T07:01:00.308256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":867,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.576460+0000","last_change":"2022-01-24T07:00:50.823984+0000","last_active":"2022-01-24T07:00:55.576460+0000","last_peered":"2022-01-24T07:00:55.576460+0000","last_clean":"2022-01-24T07:00:55.576460+0000","last_became_active":"2022-01-24T07:00:50.823646+0000","last_became_peered":"2022-01-24T07:00:50.823646+0000","last_unstale":"2022-01-24T07:00:55.576460+0000","last_undegraded":"2022-01-24T07:00:55.576460+0000","last_fullsized":"2022-01-24T07:00:55.576460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.273272+0000","last_change":"2022-01-24T07:00:54.271592+0000","last_active":"2022-01-24T07:00:55.273272+0000","last_peered":"2022-01-24T07:00:55.273272+0000","last_clean":"2022-01-24T07:00:55.273272+0000","last_became_active":"2022-01-24T07:00:54.271266+0000","last_became_peered":"2022-01-24T07:00:54.271266+0000","last_unstale":"2022-01-24T07:00:55.273272+0000","last_undegraded":"2022-01-24T07:00:55.273272+0000","last_fullsized":"2022-01-24T07:00:55.273272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:53.936765+0000","last_clean_scrub_stamp":"2022-01-24T07:00:53.936765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-24T07:00:55.276133+0000","last_change":"2022-01-24T07:00:50.824087+0000","last_active":"2022-01-24T07:00:55.276133+0000","last_peered":"2022-01-24T07:00:55.276133+0000","last_clean":"2022-01-24T07:00:55.276133+0000","last_became_active":"2022-01-24T07:00:50.823749+0000","last_became_peered":"2022-01-24T07:00:50.823749+0000","last_unstale":"2022-01-24T07:00:55.276133+0000","last_undegraded":"2022-01-24T07:00:55.276133+0000","last_fullsized":"2022-01-24T07:00:55.276133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:49.807575+0000","last_clean_scrub_stamp":"2022-01-24T07:00:49.807575+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'22","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-24T07:01:00.309918+0000","last_change":"2022-01-24T07:00:53.951228+0000","last_active":"2022-01-24T07:01:00.309918+0000","last_peered":"2022-01-24T07:01:00.309918+0000","last_clean":"2022-01-24T07:01:00.309918+0000","last_became_active":"2022-01-24T07:00:53.950865+0000","last_became_peered":"2022-01-24T07:00:53.950865+0000","last_unstale":"2022-01-24T07:01:00.309918+0000","last_undegraded":"2022-01-24T07:01:00.309918+0000","last_fullsized":"2022-01-24T07:01:00.309918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-24T07:00:52.931199+0000","last_clean_scrub_stamp":"2022-01-24T07:00:52.931199+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8949,"num_objects":112,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":17898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":99039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":98172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048876,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322964,"statfs":{"total":96636764160,"available":95562715136,"internally_reserved":1073741824,"allocated":299008,"data_stored":99804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048880,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322960,"statfs":{"total":96636764160,"available":95562711040,"internally_reserved":1073741824,"allocated":303104,"data_stored":100344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048876,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322964,"statfs":{"total":96636764160,"available":95562715136,"internally_reserved":1073741824,"allocated":299008,"data_stored":103133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048872,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322968,"statfs":{"total":96636764160,"available":95562719232,"internally_reserved":1073741824,"allocated":294912,"data_stored":102593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048884,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322956,"statfs":{"total":96636764160,"available":95562706944,"internally_reserved":1073741824,"allocated":307200,"data_stored":100528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":99661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}]}} 2022-01-24T07:01:04.826 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-01-24T07:01:04.826 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-01-24T07:01:04.826 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-01-24T07:01:04.827 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-01-24T07:01:04.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.926+0000 7f521a296700 1 Processor -- start 2022-01-24T07:01:04.925 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.926+0000 7f521a296700 1 -- start start 2022-01-24T07:01:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f521a296700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f5214148c70 0x7f52140bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f521a296700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52140d0b30 0x7f5214067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.928 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f521a296700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52141607c0 con 0x7f5214149050 2022-01-24T07:01:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f521a296700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5214066db0 con 0x7f5214148c70 2022-01-24T07:01:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f521a296700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5214067050 con 0x7f52140d0b30 2022-01-24T07:01:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f520bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52140d0b30 0x7f5214067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f5218833700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5214149050 0x7f521415fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48298/0 (socket says 172.21.15.142:48298) 2022-01-24T07:01:04.929 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f5218833700 1 -- 172.21.15.142:0/228445897 learned_addr learned my addr 172.21.15.142:0/228445897 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:04.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f5213fff700 1 --2- 172.21.15.142:0/228445897 >> v2:172.21.15.145:3300/0 conn(0x7f5214148c70 0x7f52140bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f52137fe700 1 -- 172.21.15.142:0/228445897 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315577470 0 0) 0x7f52141607c0 con 0x7f5214149050 2022-01-24T07:01:04.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f520bfff700 1 -- 172.21.15.142:0/228445897 >> v2:172.21.15.145:3300/0 conn(0x7f5214148c70 msgr2=0x7f52140bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:04.930 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f520bfff700 1 --2- 172.21.15.142:0/228445897 >> v2:172.21.15.145:3300/0 conn(0x7f5214148c70 0x7f52140bb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f520bfff700 1 -- 172.21.15.142:0/228445897 >> v1:172.21.15.142:6789/0 conn(0x7f5214149050 legacy=0x7f521415fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f520bfff700 1 -- 172.21.15.142:0/228445897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140672f0 con 0x7f52140d0b30 2022-01-24T07:01:04.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f5213fff700 1 --2- 172.21.15.142:0/228445897 >> v2:172.21.15.145:3300/0 conn(0x7f5214148c70 0x7f52140bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:04.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f520bfff700 1 --2- 172.21.15.142:0/228445897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52140d0b30 0x7f5214067a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f51fc002f70 tx=0x7f51fc006df0).ready entity=mon.2 client_cookie=3dca3fa05b099e1 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.931 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f52137fe700 1 -- 172.21.15.142:0/228445897 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc00d570 con 0x7f52140d0b30 2022-01-24T07:01:04.932 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f52137fe700 1 -- 172.21.15.142:0/228445897 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc000e90 con 0x7f52140d0b30 2022-01-24T07:01:04.932 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.927+0000 7f52137fe700 1 -- 172.21.15.142:0/228445897 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc00d8c0 con 0x7f52140d0b30 2022-01-24T07:01:04.932 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 -- 172.21.15.142:0/228445897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52140d0b30 msgr2=0x7f5214067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.932 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 --2- 172.21.15.142:0/228445897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52140d0b30 0x7f5214067a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f51fc002f70 tx=0x7f51fc006df0).stop 2022-01-24T07:01:04.933 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 -- 172.21.15.142:0/228445897 shutdown_connections 2022-01-24T07:01:04.933 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 --2- 172.21.15.142:0/228445897 >> v2:172.21.15.145:3300/0 conn(0x7f5214148c70 0x7f52140bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.933 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 --2- 172.21.15.142:0/228445897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52140d0b30 0x7f5214067a30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.933 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 -- 172.21.15.142:0/228445897 >> 172.21.15.142:0/228445897 conn(0x7f521405fc90 msgr2=0x7f52140600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:04.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 -- 172.21.15.142:0/228445897 shutdown_connections 2022-01-24T07:01:04.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.928+0000 7f521a296700 1 -- 172.21.15.142:0/228445897 wait complete. 2022-01-24T07:01:04.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.929+0000 7f521a296700 1 Processor -- start 2022-01-24T07:01:04.934 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.929+0000 7f521a296700 1 -- start start 2022-01-24T07:01:04.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52140d0b30 0x7f52140bad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5214148c70 0x7f521415fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.937 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5214149050 0x7f521405b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521415f380 con 0x7f52140d0b30 2022-01-24T07:01:04.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214160360 con 0x7f5214149050 2022-01-24T07:01:04.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521416f1a0 con 0x7f5214148c70 2022-01-24T07:01:04.938 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f5213fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52140d0b30 0x7f52140bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f520bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5214148c70 0x7f521415fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f5213fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52140d0b30 0x7f52140bad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50936/0 (socket says 172.21.15.142:50936) 2022-01-24T07:01:04.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f5213fff700 1 -- 172.21.15.142:0/157166692 learned_addr learned my addr 172.21.15.142:0/157166692 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:04.939 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f520bfff700 1 -- 172.21.15.142:0/157166692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5214149050 msgr2=0x7f521405b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f520bfff700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5214149050 0x7f521405b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-24T07:01:04.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f520bfff700 1 -- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52140d0b30 msgr2=0x7f52140bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:04.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f520bfff700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52140d0b30 0x7f52140bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:04.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f520bfff700 1 -- 172.21.15.142:0/157166692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc00b180 con 0x7f5214148c70 2022-01-24T07:01:04.940 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f5213fff700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52140d0b30 0x7f52140bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:04.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f520bfff700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5214148c70 0x7f521415fe70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f51fc002f70 tx=0x7f51fc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f5211ffb700 1 -- 172.21.15.142:0/157166692 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc006b20 con 0x7f5214148c70 2022-01-24T07:01:04.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f5211ffb700 1 -- 172.21.15.142:0/157166692 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00d8f0 con 0x7f5214148c70 2022-01-24T07:01:04.941 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f5211ffb700 1 -- 172.21.15.142:0/157166692 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc01e650 con 0x7f5214148c70 2022-01-24T07:01:04.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521416f400 con 0x7f5214148c70 2022-01-24T07:01:04.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.930+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521416f940 con 0x7f5214148c70 2022-01-24T07:01:04.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.931+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5214170040 con 0x7f5214148c70 2022-01-24T07:01:04.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.931+0000 7f5211ffb700 1 -- 172.21.15.142:0/157166692 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f51fc01a040 con 0x7f5214148c70 2022-01-24T07:01:04.942 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.932+0000 7f5211ffb700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f51f8052b40 0x7f51f8055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:04.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.932+0000 7f5211ffb700 1 -- 172.21.15.142:0/157166692 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51fc06bee0 con 0x7f5214148c70 2022-01-24T07:01:04.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.932+0000 7f5213fff700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f51f8052b40 0x7f51f8055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:04.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.932+0000 7f5213fff700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f51f8052b40 0x7f51f8055000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5204008000 tx=0x7f5204008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:04.943 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:04.935+0000 7f5211ffb700 1 -- 172.21.15.142:0/157166692 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f51fc0436b0 con 0x7f5214148c70 2022-01-24T07:01:05.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.116+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5214067590 con 0x7f5214148c70 2022-01-24T07:01:05.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.116+0000 7f5211ffb700 1 -- 172.21.15.142:0/157166692 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f51fc046cd0 con 0x7f5214148c70 2022-01-24T07:01:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:05.117 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.117+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f51f8052b40 msgr2=0x7f51f8055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.117 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.117+0000 7f521a296700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f51f8052b40 0x7f51f8055000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5204008000 tx=0x7f5204008040).stop 2022-01-24T07:01:05.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.117+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5214148c70 msgr2=0x7f521415fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5214148c70 0x7f521415fe70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f51fc002f70 tx=0x7f51fc015000).stop 2022-01-24T07:01:05.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 shutdown_connections 2022-01-24T07:01:05.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5214149050 0x7f521405b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-24T07:01:05.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f51f8052b40 0x7f51f8055000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52140d0b30 0x7f52140bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 --2- 172.21.15.142:0/157166692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5214148c70 0x7f521415fe70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 >> 172.21.15.142:0/157166692 conn(0x7f521405fc90 msgr2=0x7f52140d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:05.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 shutdown_connections 2022-01-24T07:01:05.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.118+0000 7f521a296700 1 -- 172.21.15.142:0/157166692 wait complete. 2022-01-24T07:01:05.127 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-01-24T07:01:05.127 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-01-24T07:01:05.128 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:01:05.228 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.228+0000 7f2339028700 1 Processor -- start 2022-01-24T07:01:05.228 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.228+0000 7f2339028700 1 -- start start 2022-01-24T07:01:05.233 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2339028700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415ce80 0x7f233415f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2339028700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2334063e90 0x7f233415fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2339028700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23341600c0 con 0x7f233415caa0 2022-01-24T07:01:05.234 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2339028700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2334160320 con 0x7f2334063e90 2022-01-24T07:01:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2339028700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23341605c0 con 0x7f233415ce80 2022-01-24T07:01:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2338827700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2334063e90 0x7f233415fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f232bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415ce80 0x7f233415f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.235 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2338827700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2334063e90 0x7f233415fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50948/0 (socket says 172.21.15.142:50948) 2022-01-24T07:01:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2338827700 1 -- 172.21.15.142:0/142332891 learned_addr learned my addr 172.21.15.142:0/142332891 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f232bfff700 1 -- 172.21.15.142:0/142332891 >> v2:172.21.15.142:3300/0 conn(0x7f2334063e90 msgr2=0x7f233415fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f232bfff700 1 --2- 172.21.15.142:0/142332891 >> v2:172.21.15.142:3300/0 conn(0x7f2334063e90 0x7f233415fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f232bfff700 1 -- 172.21.15.142:0/142332891 >> v1:172.21.15.145:6789/0 conn(0x7f233415caa0 legacy=0x7f2334063780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f232bfff700 1 -- 172.21.15.142:0/142332891 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334062b00 con 0x7f233415ce80 2022-01-24T07:01:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.229+0000 7f2338827700 1 --2- 172.21.15.142:0/142332891 >> v2:172.21.15.142:3300/0 conn(0x7f2334063e90 0x7f233415fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f232bfff700 1 --2- 172.21.15.142:0/142332891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415ce80 0x7f233415f6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f231c002f70 tx=0x7f231c006df0).ready entity=mon.2 client_cookie=1c099a3784b158f4 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f23337fe700 1 -- 172.21.15.142:0/142332891 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231c00d570 con 0x7f233415ce80 2022-01-24T07:01:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f23337fe700 1 -- 172.21.15.142:0/142332891 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c000e90 con 0x7f233415ce80 2022-01-24T07:01:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f23337fe700 1 -- 172.21.15.142:0/142332891 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231c00d8c0 con 0x7f233415ce80 2022-01-24T07:01:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 -- 172.21.15.142:0/142332891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415ce80 msgr2=0x7f233415f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 --2- 172.21.15.142:0/142332891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415ce80 0x7f233415f6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f231c002f70 tx=0x7f231c006df0).stop 2022-01-24T07:01:05.238 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 -- 172.21.15.142:0/142332891 shutdown_connections 2022-01-24T07:01:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 --2- 172.21.15.142:0/142332891 >> v2:172.21.15.142:3300/0 conn(0x7f2334063e90 0x7f233415fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 --2- 172.21.15.142:0/142332891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415ce80 0x7f233415f6e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 -- 172.21.15.142:0/142332891 >> 172.21.15.142:0/142332891 conn(0x7f23340d3c20 msgr2=0x7f23340d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:05.239 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 -- 172.21.15.142:0/142332891 shutdown_connections 2022-01-24T07:01:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.230+0000 7f2339028700 1 -- 172.21.15.142:0/142332891 wait complete. 2022-01-24T07:01:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.231+0000 7f2339028700 1 Processor -- start 2022-01-24T07:01:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.231+0000 7f2339028700 1 -- start start 2022-01-24T07:01:05.240 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2339028700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2334063e90 0x7f23340b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2339028700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415caa0 0x7f23340b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2339028700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f233415ce80 0x7f2334173080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2339028700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340b31c0 con 0x7f2334063e90 2022-01-24T07:01:05.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2339028700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334172610 con 0x7f233415ce80 2022-01-24T07:01:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2339028700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2334171e30 con 0x7f233415caa0 2022-01-24T07:01:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2333fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2334063e90 0x7f23340b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f232bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415caa0 0x7f23340b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2333fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2334063e90 0x7f23340b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50950/0 (socket says 172.21.15.142:50950) 2022-01-24T07:01:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f2333fff700 1 -- 172.21.15.142:0/445388601 learned_addr learned my addr 172.21.15.142:0/445388601 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.232+0000 7f232bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415caa0 0x7f23340b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53714/0 (socket says 172.21.15.142:53714) 2022-01-24T07:01:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f2338827700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f233415ce80 0x7f2334173080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f232bfff700 1 -- 172.21.15.142:0/445388601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f233415ce80 msgr2=0x7f2334173080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f232bfff700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f233415ce80 0x7f2334173080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f232bfff700 1 -- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2334063e90 msgr2=0x7f23340b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.244 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f232bfff700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2334063e90 0x7f23340b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f232bfff700 1 -- 172.21.15.142:0/445388601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c009530 con 0x7f233415caa0 2022-01-24T07:01:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f2333fff700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2334063e90 0x7f23340b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f232bfff700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415caa0 0x7f23340b2cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f23340b3300 tx=0x7f231c014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.245 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f2331ffb700 1 -- 172.21.15.142:0/445388601 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231c013e10 con 0x7f233415caa0 2022-01-24T07:01:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f2331ffb700 1 -- 172.21.15.142:0/445388601 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c01e400 con 0x7f233415caa0 2022-01-24T07:01:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c00b180 con 0x7f233415caa0 2022-01-24T07:01:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f2331ffb700 1 -- 172.21.15.142:0/445388601 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231c01e760 con 0x7f233415caa0 2022-01-24T07:01:05.246 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.233+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2334172370 con 0x7f233415caa0 2022-01-24T07:01:05.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.234+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2334062da0 con 0x7f233415caa0 2022-01-24T07:01:05.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.234+0000 7f2331ffb700 1 -- 172.21.15.142:0/445388601 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f231c025030 con 0x7f233415caa0 2022-01-24T07:01:05.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.234+0000 7f2331ffb700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2318052ab0 0x7f2318054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.247 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.234+0000 7f2331ffb700 1 -- 172.21.15.142:0/445388601 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f231c06b7f0 con 0x7f233415caa0 2022-01-24T07:01:05.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.234+0000 7f2333fff700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2318052ab0 0x7f2318054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.248 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.235+0000 7f2333fff700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2318052ab0 0x7f2318054f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f232400d000 tx=0x7f2324009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.249 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.238+0000 7f2331ffb700 1 -- 172.21.15.142:0/445388601 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f231c042f10 con 0x7f233415caa0 2022-01-24T07:01:05.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.371+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2334057950 con 0x7f233415caa0 2022-01-24T07:01:05.455 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.372+0000 7f2331ffb700 1 -- 172.21.15.142:0/445388601 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f231c023090 con 0x7f233415caa0 2022-01-24T07:01:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:05.456 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:56.271262+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:01:05.458 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2318052ab0 msgr2=0x7f2318054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.458 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2318052ab0 0x7f2318054f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f232400d000 tx=0x7f2324009040).stop 2022-01-24T07:01:05.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415caa0 msgr2=0x7f23340b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415caa0 0x7f23340b2cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f23340b3300 tx=0x7f231c014000).stop 2022-01-24T07:01:05.459 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 shutdown_connections 2022-01-24T07:01:05.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f233415ce80 0x7f2334173080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f2318052ab0 0x7f2318054f70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2334063e90 0x7f23340b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.460 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 --2- 172.21.15.142:0/445388601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f233415caa0 0x7f23340b2cd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 >> 172.21.15.142:0/445388601 conn(0x7f23340d3c20 msgr2=0x7f233415f930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 shutdown_connections 2022-01-24T07:01:05.461 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.374+0000 7f2339028700 1 -- 172.21.15.142:0/445388601 wait complete. 2022-01-24T07:01:05.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-24T07:00:40.161690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-24T07:00:49.517379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-24T07:00:52.172405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-24T07:00:53.230682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-24T07:01:05.463 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-24T07:01:05.564 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.565+0000 7f8c560e2700 1 Processor -- start 2022-01-24T07:01:05.564 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.565+0000 7f8c560e2700 1 -- start start 2022-01-24T07:01:05.567 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.565+0000 7f8c560e2700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c5013eef0 0x7f8c5005c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.567 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.565+0000 7f8c560e2700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8c500603a0 0x7f8c50061cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.568 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.565+0000 7f8c560e2700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5005c9f0 con 0x7f8c5013f2d0 2022-01-24T07:01:05.568 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c560e2700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5015d490 con 0x7f8c5013eef0 2022-01-24T07:01:05.568 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c560e2700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5005cc90 con 0x7f8c500603a0 2022-01-24T07:01:05.568 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c5013eef0 0x7f8c5005c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.569 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c5013eef0 0x7f8c5005c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50958/0 (socket says 172.21.15.142:50958) 2022-01-24T07:01:05.569 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/4148229508 learned_addr learned my addr 172.21.15.142:0/4148229508 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:05.569 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4effd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8c5013f2d0 0x7f8c5005fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48322/0 (socket says 172.21.15.142:48322) 2022-01-24T07:01:05.569 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4ffff700 1 --2- 172.21.15.142:0/4148229508 >> v2:172.21.15.145:3300/0 conn(0x7f8c500603a0 0x7f8c50061cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.570 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/4148229508 >> v2:172.21.15.145:3300/0 conn(0x7f8c500603a0 msgr2=0x7f8c50061cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:05.570 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 --2- 172.21.15.142:0/4148229508 >> v2:172.21.15.145:3300/0 conn(0x7f8c500603a0 0x7f8c50061cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.570 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/4148229508 >> v1:172.21.15.142:6789/0 conn(0x7f8c5013f2d0 legacy=0x7f8c5005fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.570 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/4148229508 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5005cf30 con 0x7f8c5013eef0 2022-01-24T07:01:05.571 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4e7fc700 1 -- 172.21.15.142:0/4148229508 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16099178 0 0) 0x7f8c5005c9f0 con 0x7f8c5013f2d0 2022-01-24T07:01:05.571 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4f7fe700 1 --2- 172.21.15.142:0/4148229508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5013eef0 0x7f8c5005c440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8c500c8d90 tx=0x7f8c40006f40).ready entity=mon.0 client_cookie=9dc830b68cce274a server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.571 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4e7fc700 1 -- 172.21.15.142:0/4148229508 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4000dc30 con 0x7f8c5013eef0 2022-01-24T07:01:05.571 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4e7fc700 1 -- 172.21.15.142:0/4148229508 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40000e90 con 0x7f8c5013eef0 2022-01-24T07:01:05.571 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.566+0000 7f8c4e7fc700 1 -- 172.21.15.142:0/4148229508 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4000be90 con 0x7f8c5013eef0 2022-01-24T07:01:05.572 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 -- 172.21.15.142:0/4148229508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5013eef0 msgr2=0x7f8c5005c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.572 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 --2- 172.21.15.142:0/4148229508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5013eef0 0x7f8c5005c440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8c500c8d90 tx=0x7f8c40006f40).stop 2022-01-24T07:01:05.572 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 -- 172.21.15.142:0/4148229508 shutdown_connections 2022-01-24T07:01:05.572 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 --2- 172.21.15.142:0/4148229508 >> v2:172.21.15.145:3300/0 conn(0x7f8c500603a0 0x7f8c50061cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.573 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 --2- 172.21.15.142:0/4148229508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5013eef0 0x7f8c5005c440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.573 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 -- 172.21.15.142:0/4148229508 >> 172.21.15.142:0/4148229508 conn(0x7f8c500d2d20 msgr2=0x7f8c500d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:05.573 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 -- 172.21.15.142:0/4148229508 shutdown_connections 2022-01-24T07:01:05.573 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.567+0000 7f8c560e2700 1 -- 172.21.15.142:0/4148229508 wait complete. 2022-01-24T07:01:05.574 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.568+0000 7f8c560e2700 1 Processor -- start 2022-01-24T07:01:05.574 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.568+0000 7f8c560e2700 1 -- start start 2022-01-24T07:01:05.577 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c500603a0 0x7f8c50135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.577 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5013eef0 0x7f8c5013dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.578 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c5013e170 0x7f8c500c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.578 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5016f070 con 0x7f8c500603a0 2022-01-24T07:01:05.578 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5016f310 con 0x7f8c5013e170 2022-01-24T07:01:05.578 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5016f5b0 con 0x7f8c5013eef0 2022-01-24T07:01:05.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c500603a0 0x7f8c50135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c500603a0 0x7f8c50135ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50964/0 (socket says 172.21.15.142:50964) 2022-01-24T07:01:05.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4effd700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5013eef0 0x7f8c5013dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/1139240532 learned_addr learned my addr 172.21.15.142:0/1139240532 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:05.579 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4ffff700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c5013e170 0x7f8c500c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5013eef0 msgr2=0x7f8c5013dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5013eef0 0x7f8c5013dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/1139240532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c5013e170 msgr2=0x7f8c500c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.580 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c5013e170 0x7f8c500c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 -- 172.21.15.142:0/1139240532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4000b460 con 0x7f8c500603a0 2022-01-24T07:01:05.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4f7fe700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c500603a0 0x7f8c50135ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8c500c8d90 tx=0x7f8c50060860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4cff9700 1 -- 172.21.15.142:0/1139240532 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4001d070 con 0x7f8c500603a0 2022-01-24T07:01:05.581 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4cff9700 1 -- 172.21.15.142:0/1139240532 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40022410 con 0x7f8c500603a0 2022-01-24T07:01:05.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5016f850 con 0x7f8c500603a0 2022-01-24T07:01:05.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c4cff9700 1 -- 172.21.15.142:0/1139240532 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c40022770 con 0x7f8c500603a0 2022-01-24T07:01:05.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.569+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5016fd90 con 0x7f8c500603a0 2022-01-24T07:01:05.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.570+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5005d1d0 con 0x7f8c500603a0 2022-01-24T07:01:05.582 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.570+0000 7f8c4cff9700 1 -- 172.21.15.142:0/1139240532 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f8c40029070 con 0x7f8c500603a0 2022-01-24T07:01:05.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.571+0000 7f8c4cff9700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8c34052ab0 0x7f8c34054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.571+0000 7f8c4cff9700 1 -- 172.21.15.142:0/1139240532 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c4006beb0 con 0x7f8c500603a0 2022-01-24T07:01:05.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.571+0000 7f8c4effd700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8c34052ab0 0x7f8c34054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.583 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.571+0000 7f8c4effd700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8c34052ab0 0x7f8c34054f70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8c3800d000 tx=0x7f8c38007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.584 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.574+0000 7f8c4cff9700 1 -- 172.21.15.142:0/1139240532 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f8c400435d0 con 0x7f8c500603a0 2022-01-24T07:01:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.705+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8c50057950 con 0x7f8c500603a0 2022-01-24T07:01:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.706+0000 7f8c4cff9700 1 -- 172.21.15.142:0/1139240532 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8c40046bf0 con 0x7f8c500603a0 2022-01-24T07:01:05.706 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2022-01-24T07:01:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8c34052ab0 msgr2=0x7f8c34054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.707 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8c34052ab0 0x7f8c34054f70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8c3800d000 tx=0x7f8c38007bc0).stop 2022-01-24T07:01:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c500603a0 msgr2=0x7f8c50135ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c500603a0 0x7f8c50135ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8c500c8d90 tx=0x7f8c50060860).stop 2022-01-24T07:01:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 shutdown_connections 2022-01-24T07:01:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c5013e170 0x7f8c500c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8c34052ab0 0x7f8c34054f70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c500603a0 0x7f8c50135ed0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 --2- 172.21.15.142:0/1139240532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5013eef0 0x7f8c5013dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.709 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 >> 172.21.15.142:0/1139240532 conn(0x7f8c500d2d20 msgr2=0x7f8c500631e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 shutdown_connections 2022-01-24T07:01:05.710 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.707+0000 7f8c560e2700 1 -- 172.21.15.142:0/1139240532 wait complete. 2022-01-24T07:01:05.717 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-24T07:01:05.819 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.820+0000 7fd8e4bf9700 1 Processor -- start 2022-01-24T07:01:05.820 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.820+0000 7fd8e4bf9700 1 -- start start 2022-01-24T07:01:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8e4bf9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8e0160c40 0x7fd8e015f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8e4bf9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e005b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8e4bf9700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e00cce10 con 0x7fd8e00b86d0 2022-01-24T07:01:05.826 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8e4bf9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e01610a0 con 0x7fd8e0160c40 2022-01-24T07:01:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8e4bf9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00cb950 con 0x7fd8e015fc60 2022-01-24T07:01:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ddd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8e0160c40 0x7fd8e015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ded9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e005b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.827 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8de59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd8e00b86d0 0x7fd8e00cc700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48336/0 (socket says 172.21.15.142:48336) 2022-01-24T07:01:05.828 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ded9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e005b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53738/0 (socket says 172.21.15.142:53738) 2022-01-24T07:01:05.828 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ddd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8e0160c40 0x7fd8e015f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50974/0 (socket says 172.21.15.142:50974) 2022-01-24T07:01:05.828 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8de59c700 1 -- 172.21.15.142:0/1199863602 learned_addr learned my addr 172.21.15.142:0/1199863602 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:05.828 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ded9d700 1 -- 172.21.15.142:0/1199863602 >> v2:172.21.15.142:3300/0 conn(0x7fd8e0160c40 msgr2=0x7fd8e015f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:05.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ded9d700 1 --2- 172.21.15.142:0/1199863602 >> v2:172.21.15.142:3300/0 conn(0x7fd8e0160c40 0x7fd8e015f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ded9d700 1 -- 172.21.15.142:0/1199863602 >> v1:172.21.15.142:6789/0 conn(0x7fd8e00b86d0 legacy=0x7fd8e00cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ded9d700 1 -- 172.21.15.142:0/1199863602 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0160220 con 0x7fd8e015fc60 2022-01-24T07:01:05.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8dd59a700 1 -- 172.21.15.142:0/1199863602 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168845400 0 0) 0x7fd8e00cce10 con 0x7fd8e00b86d0 2022-01-24T07:01:05.829 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ddd9b700 1 --2- 172.21.15.142:0/1199863602 >> v2:172.21.15.142:3300/0 conn(0x7fd8e0160c40 0x7fd8e015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8ded9d700 1 --2- 172.21.15.142:0/1199863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e005b330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd8d0002f70 tx=0x7fd8d0006df0).ready entity=mon.2 client_cookie=418d89b1e060eba5 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8dd59a700 1 -- 172.21.15.142:0/1199863602 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d000d570 con 0x7fd8e015fc60 2022-01-24T07:01:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.821+0000 7fd8dd59a700 1 -- 172.21.15.142:0/1199863602 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0000e90 con 0x7fd8e015fc60 2022-01-24T07:01:05.830 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8dd59a700 1 -- 172.21.15.142:0/1199863602 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d000d8c0 con 0x7fd8e015fc60 2022-01-24T07:01:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/1199863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 msgr2=0x7fd8e005b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/1199863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e005b330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd8d0002f70 tx=0x7fd8d0006df0).stop 2022-01-24T07:01:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/1199863602 shutdown_connections 2022-01-24T07:01:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/1199863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e005b330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.831 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/1199863602 >> v2:172.21.15.142:3300/0 conn(0x7fd8e0160c40 0x7fd8e015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/1199863602 >> 172.21.15.142:0/1199863602 conn(0x7fd8e00d5ff0 msgr2=0x7fd8e00d6400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:05.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/1199863602 shutdown_connections 2022-01-24T07:01:05.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.822+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/1199863602 wait complete. 2022-01-24T07:01:05.832 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.823+0000 7fd8e4bf9700 1 Processor -- start 2022-01-24T07:01:05.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.823+0000 7fd8e4bf9700 1 -- start start 2022-01-24T07:01:05.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8e4bf9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e00b86d0 0x7fd8e013d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8e4bf9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e00b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8e4bf9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e0160c40 0x7fd8e00b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.833 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8e4bf9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00d2320 con 0x7fd8e00b86d0 2022-01-24T07:01:05.834 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8e4bf9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00d2080 con 0x7fd8e0160c40 2022-01-24T07:01:05.834 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8e4bf9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0161300 con 0x7fd8e015fc60 2022-01-24T07:01:05.834 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8de59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e00b86d0 0x7fd8e013d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.834 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e00b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.834 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8de59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e00b86d0 0x7fd8e013d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50978/0 (socket says 172.21.15.142:50978) 2022-01-24T07:01:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e00b93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53740/0 (socket says 172.21.15.142:53740) 2022-01-24T07:01:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8de59c700 1 -- 172.21.15.142:0/3820062492 learned_addr learned my addr 172.21.15.142:0/3820062492 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ded9d700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e0160c40 0x7fd8e00b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 -- 172.21.15.142:0/3820062492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e0160c40 msgr2=0x7fd8e00b98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e0160c40 0x7fd8e00b98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 -- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e00b86d0 msgr2=0x7fd8e013d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e00b86d0 0x7fd8e013d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 -- 172.21.15.142:0/3820062492 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009470 con 0x7fd8e015fc60 2022-01-24T07:01:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8de59c700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e00b86d0 0x7fd8e013d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:05.837 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8ddd9b700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e00b93b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd8d400c000 tx=0x7fd8d40091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.837 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.824+0000 7fd8cf7fe700 1 -- 172.21.15.142:0/3820062492 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d400c850 con 0x7fd8e015fc60 2022-01-24T07:01:05.837 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.825+0000 7fd8cf7fe700 1 -- 172.21.15.142:0/3820062492 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d400c9b0 con 0x7fd8e015fc60 2022-01-24T07:01:05.837 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.825+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d000b180 con 0x7fd8e015fc60 2022-01-24T07:01:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.825+0000 7fd8cf7fe700 1 -- 172.21.15.142:0/3820062492 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d400cd10 con 0x7fd8e015fc60 2022-01-24T07:01:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.825+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e0161840 con 0x7fd8e015fc60 2022-01-24T07:01:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.826+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e01604c0 con 0x7fd8e015fc60 2022-01-24T07:01:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.826+0000 7fd8cf7fe700 1 -- 172.21.15.142:0/3820062492 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fd8d4022070 con 0x7fd8e015fc60 2022-01-24T07:01:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.826+0000 7fd8cf7fe700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd8bc052ab0 0x7fd8bc054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.826+0000 7fd8cf7fe700 1 -- 172.21.15.142:0/3820062492 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8d406b270 con 0x7fd8e015fc60 2022-01-24T07:01:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.826+0000 7fd8de59c700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd8bc052ab0 0x7fd8bc054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.826+0000 7fd8de59c700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd8bc052ab0 0x7fd8bc054f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd8d800d000 tx=0x7fd8d8007ac0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:05.840 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.829+0000 7fd8cf7fe700 1 -- 172.21.15.142:0/3820062492 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fd8d40428f0 con 0x7fd8e015fc60 2022-01-24T07:01:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.960+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8e0057950 con 0x7fd8e015fc60 2022-01-24T07:01:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.960+0000 7fd8cf7fe700 1 -- 172.21.15.142:0/3820062492 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd8d4045f10 con 0x7fd8e015fc60 2022-01-24T07:01:05.960 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd8bc052ab0 msgr2=0x7fd8bc054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd8bc052ab0 0x7fd8bc054f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd8d800d000 tx=0x7fd8d8007ac0).stop 2022-01-24T07:01:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 msgr2=0x7fd8e00b93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e00b93b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd8d400c000 tx=0x7fd8d40091d0).stop 2022-01-24T07:01:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 shutdown_connections 2022-01-24T07:01:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e0160c40 0x7fd8e00b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fd8bc052ab0 0x7fd8bc054f70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8e00b86d0 0x7fd8e013d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 --2- 172.21.15.142:0/3820062492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8e015fc60 0x7fd8e00b93b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 >> 172.21.15.142:0/3820062492 conn(0x7fd8e00d5ff0 msgr2=0x7fd8e00662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 shutdown_connections 2022-01-24T07:01:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:05.962+0000 7fd8e4bf9700 1 -- 172.21.15.142:0/3820062492 wait complete. 2022-01-24T07:01:05.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-24T07:01:06.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.074+0000 7ffa1a5b5700 1 Processor -- start 2022-01-24T07:01:06.073 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.074+0000 7ffa1a5b5700 1 -- start start 2022-01-24T07:01:06.080 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa1a5b5700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7ffa140d0b70 0x7ffa14064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.080 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa1a5b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0f50 0x7ffa1413f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.080 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa1a5b5700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140634b0 con 0x7ffa14062fe0 2022-01-24T07:01:06.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa1a5b5700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa14067b90 con 0x7ffa140d0b70 2022-01-24T07:01:06.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa1a5b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14063750 con 0x7ffa140d0f50 2022-01-24T07:01:06.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0f50 0x7ffa1413f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.081 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0f50 0x7ffa1413f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53752/0 (socket says 172.21.15.142:53752) 2022-01-24T07:01:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 -- 172.21.15.142:0/3578577741 learned_addr learned my addr 172.21.15.142:0/3578577741 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa13fff700 1 --2- 172.21.15.142:0/3578577741 >> v2:172.21.15.145:3300/0 conn(0x7ffa140d0b70 0x7ffa14064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 -- 172.21.15.142:0/3578577741 >> v2:172.21.15.145:3300/0 conn(0x7ffa140d0b70 msgr2=0x7ffa14064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:06.082 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 --2- 172.21.15.142:0/3578577741 >> v2:172.21.15.145:3300/0 conn(0x7ffa140d0b70 0x7ffa14064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 -- 172.21.15.142:0/3578577741 >> v1:172.21.15.145:6789/0 conn(0x7ffa14062fe0 legacy=0x7ffa140ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 -- 172.21.15.142:0/3578577741 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa140639f0 con 0x7ffa140d0f50 2022-01-24T07:01:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa18b52700 1 --2- 172.21.15.142:0/3578577741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0f50 0x7ffa1413f920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ffa0c0032f0 tx=0x7ffa0c009290).ready entity=mon.2 client_cookie=4712dd4c32b32b78 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.083 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa12ffd700 1 -- 172.21.15.142:0/3578577741 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa0c00b8a0 con 0x7ffa140d0f50 2022-01-24T07:01:06.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa12ffd700 1 -- 172.21.15.142:0/3578577741 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c00ba00 con 0x7ffa140d0f50 2022-01-24T07:01:06.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.075+0000 7ffa12ffd700 1 -- 172.21.15.142:0/3578577741 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa0c00bb70 con 0x7ffa140d0f50 2022-01-24T07:01:06.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/3578577741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0f50 msgr2=0x7ffa1413f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/3578577741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0f50 0x7ffa1413f920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ffa0c0032f0 tx=0x7ffa0c009290).stop 2022-01-24T07:01:06.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/3578577741 shutdown_connections 2022-01-24T07:01:06.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/3578577741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0f50 0x7ffa1413f920 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/3578577741 >> v2:172.21.15.145:3300/0 conn(0x7ffa140d0b70 0x7ffa14064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/3578577741 >> 172.21.15.142:0/3578577741 conn(0x7ffa14061ea0 msgr2=0x7ffa140622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:06.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/3578577741 shutdown_connections 2022-01-24T07:01:06.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.076+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/3578577741 wait complete. 2022-01-24T07:01:06.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.077+0000 7ffa1a5b5700 1 Processor -- start 2022-01-24T07:01:06.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.077+0000 7ffa1a5b5700 1 -- start start 2022-01-24T07:01:06.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa1a5b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa14062fe0 0x7ffa1416cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa1a5b5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0b70 0x7ffa14136f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.087 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa1a5b5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa140d0f50 0x7ffa141606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa1a5b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1413e290 con 0x7ffa14062fe0 2022-01-24T07:01:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa1a5b5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1416d300 con 0x7ffa140d0f50 2022-01-24T07:01:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa1a5b5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1416d5a0 con 0x7ffa140d0b70 2022-01-24T07:01:06.088 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0b70 0x7ffa14136f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa13fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa14062fe0 0x7ffa1416cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa13fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa14062fe0 0x7ffa1416cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50994/0 (socket says 172.21.15.142:50994) 2022-01-24T07:01:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0b70 0x7ffa14136f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53754/0 (socket says 172.21.15.142:53754) 2022-01-24T07:01:06.089 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa13fff700 1 -- 172.21.15.142:0/1453031734 learned_addr learned my addr 172.21.15.142:0/1453031734 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa18b52700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa140d0f50 0x7ffa141606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 -- 172.21.15.142:0/1453031734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa140d0f50 msgr2=0x7ffa141606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa140d0f50 0x7ffa141606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.090 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 -- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa14062fe0 msgr2=0x7ffa1416cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa14062fe0 0x7ffa1416cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 -- 172.21.15.142:0/1453031734 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009530 con 0x7ffa140d0b70 2022-01-24T07:01:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa13fff700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa14062fe0 0x7ffa1416cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:06.091 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.078+0000 7ffa137fe700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0b70 0x7ffa14136f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ffa1413db00 tx=0x7ffa04007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.092 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.079+0000 7ffa117fa700 1 -- 172.21.15.142:0/1453031734 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa04012400 con 0x7ffa140d0b70 2022-01-24T07:01:06.092 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.079+0000 7ffa117fa700 1 -- 172.21.15.142:0/1453031734 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04012560 con 0x7ffa140d0b70 2022-01-24T07:01:06.092 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.079+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1416d840 con 0x7ffa140d0b70 2022-01-24T07:01:06.092 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.079+0000 7ffa117fa700 1 -- 172.21.15.142:0/1453031734 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa040128c0 con 0x7ffa140d0b70 2022-01-24T07:01:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.079+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1415be00 con 0x7ffa140d0b70 2022-01-24T07:01:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.080+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1416d9d0 con 0x7ffa140d0b70 2022-01-24T07:01:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.080+0000 7ffa117fa700 1 -- 172.21.15.142:0/1453031734 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7ffa04019030 con 0x7ffa140d0b70 2022-01-24T07:01:06.093 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.080+0000 7ffa117fa700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff9f4052b40 0x7ff9f4055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.080+0000 7ffa117fa700 1 -- 172.21.15.142:0/1453031734 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa04069d90 con 0x7ffa140d0b70 2022-01-24T07:01:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.080+0000 7ffa13fff700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff9f4052b40 0x7ff9f4055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.094 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.080+0000 7ffa13fff700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff9f4052b40 0x7ff9f4055000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ffa08008000 tx=0x7ffa08008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.095 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.083+0000 7ffa117fa700 1 -- 172.21.15.142:0/1453031734 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7ffa040414b0 con 0x7ffa140d0b70 2022-01-24T07:01:06.215 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.216+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa141375b0 con 0x7ffa140d0b70 2022-01-24T07:01:06.216 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.216+0000 7ffa117fa700 1 -- 172.21.15.142:0/1453031734 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7ffa04044ad0 con 0x7ffa140d0b70 2022-01-24T07:01:06.216 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:06.217 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff9f4052b40 msgr2=0x7ff9f4055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff9f4052b40 0x7ff9f4055000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ffa08008000 tx=0x7ffa08008040).stop 2022-01-24T07:01:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0b70 msgr2=0x7ffa14136f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.218 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0b70 0x7ffa14136f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ffa1413db00 tx=0x7ffa04007b90).stop 2022-01-24T07:01:06.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 shutdown_connections 2022-01-24T07:01:06.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffa140d0f50 0x7ffa141606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7ff9f4052b40 0x7ff9f4055000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa14062fe0 0x7ffa1416cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.219 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 --2- 172.21.15.142:0/1453031734 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa140d0b70 0x7ffa14136f00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.220 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 >> 172.21.15.142:0/1453031734 conn(0x7ffa14061ea0 msgr2=0x7ffa1415fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:06.220 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 shutdown_connections 2022-01-24T07:01:06.220 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.218+0000 7ffa1a5b5700 1 -- 172.21.15.142:0/1453031734 wait complete. 2022-01-24T07:01:06.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-24T07:01:06.331 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.332+0000 7f8de1137700 1 Processor -- start 2022-01-24T07:01:06.331 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.332+0000 7f8de1137700 1 -- start start 2022-01-24T07:01:06.334 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8de1137700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f8ddc0b86d0 0x7f8ddc160c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.334 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8de1137700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0cc700 0x7f8ddc15f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.334 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8de1137700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc160220 con 0x7f8ddc0ccb60 2022-01-24T07:01:06.334 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8de1137700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc0cb950 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.335 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8de1137700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc1604c0 con 0x7f8ddc0cc700 2022-01-24T07:01:06.335 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0cc700 0x7f8ddc15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.335 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0cc700 0x7f8ddc15f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53764/0 (socket says 172.21.15.142:53764) 2022-01-24T07:01:06.335 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 -- 172.21.15.142:0/1721608000 learned_addr learned my addr 172.21.15.142:0/1721608000 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8ddad9d700 1 --2- 172.21.15.142:0/1721608000 >> v2:172.21.15.145:3300/0 conn(0x7f8ddc0b86d0 0x7f8ddc160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 -- 172.21.15.142:0/1721608000 >> v2:172.21.15.145:3300/0 conn(0x7f8ddc0b86d0 msgr2=0x7f8ddc160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dd9d9b700 1 -- 172.21.15.142:0/1721608000 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212293176 0 0) 0x7f8ddc160220 con 0x7f8ddc0ccb60 2022-01-24T07:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 --2- 172.21.15.142:0/1721608000 >> v2:172.21.15.145:3300/0 conn(0x7f8ddc0b86d0 0x7f8ddc160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 -- 172.21.15.142:0/1721608000 >> v1:172.21.15.142:6789/0 conn(0x7f8ddc0ccb60 legacy=0x7f8ddc05b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 -- 172.21.15.142:0/1721608000 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0cbd20 con 0x7f8ddc0cc700 2022-01-24T07:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dda59c700 1 --2- 172.21.15.142:0/1721608000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0cc700 0x7f8ddc15f770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8dd0002f70 tx=0x7f8dd0006eb0).ready entity=mon.2 client_cookie=508120e8592bd5e2 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.333+0000 7f8dd9d9b700 1 -- 172.21.15.142:0/1721608000 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd000d570 con 0x7f8ddc0cc700 2022-01-24T07:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8dd9d9b700 1 -- 172.21.15.142:0/1721608000 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0000e90 con 0x7f8ddc0cc700 2022-01-24T07:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8dd9d9b700 1 -- 172.21.15.142:0/1721608000 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dd000d8c0 con 0x7f8ddc0cc700 2022-01-24T07:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 -- 172.21.15.142:0/1721608000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0cc700 msgr2=0x7f8ddc15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 --2- 172.21.15.142:0/1721608000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0cc700 0x7f8ddc15f770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8dd0002f70 tx=0x7f8dd0006eb0).stop 2022-01-24T07:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 -- 172.21.15.142:0/1721608000 shutdown_connections 2022-01-24T07:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 --2- 172.21.15.142:0/1721608000 >> v2:172.21.15.145:3300/0 conn(0x7f8ddc0b86d0 0x7f8ddc160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 --2- 172.21.15.142:0/1721608000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0cc700 0x7f8ddc15f770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 -- 172.21.15.142:0/1721608000 >> 172.21.15.142:0/1721608000 conn(0x7f8ddc0d5ff0 msgr2=0x7f8ddc0d6400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 -- 172.21.15.142:0/1721608000 shutdown_connections 2022-01-24T07:01:06.340 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.334+0000 7f8de1137700 1 -- 172.21.15.142:0/1721608000 wait complete. 2022-01-24T07:01:06.343 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.335+0000 7f8de1137700 1 Processor -- start 2022-01-24T07:01:06.343 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.335+0000 7f8de1137700 1 -- start start 2022-01-24T07:01:06.343 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8de1137700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ddc0b86d0 0x7f8ddc172bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8de1137700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ddc0cc700 0x7f8ddc147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8de1137700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0ccb60 0x7f8ddc147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8de1137700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc15bba0 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8de1137700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0ce570 con 0x7f8ddc0cc700 2022-01-24T07:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8de1137700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc15b3c0 con 0x7f8ddc0ccb60 2022-01-24T07:01:06.345 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8ddad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ddc0b86d0 0x7f8ddc172bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.345 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8ddad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ddc0b86d0 0x7f8ddc172bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51006/0 (socket says 172.21.15.142:51006) 2022-01-24T07:01:06.345 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8ddad9d700 1 -- 172.21.15.142:0/2575835623 learned_addr learned my addr 172.21.15.142:0/2575835623 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:06.345 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8ddb59e700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0ccb60 0x7f8ddc147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.346 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.336+0000 7f8dda59c700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ddc0cc700 0x7f8ddc147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.346 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8ddad9d700 1 -- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0ccb60 msgr2=0x7f8ddc147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.346 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8ddad9d700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0ccb60 0x7f8ddc147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.346 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8ddad9d700 1 -- 172.21.15.142:0/2575835623 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ddc0cc700 msgr2=0x7f8ddc147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.347 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8ddad9d700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ddc0cc700 0x7f8ddc147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.347 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8ddad9d700 1 -- 172.21.15.142:0/2575835623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd000b1e0 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.347 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8ddb59e700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0ccb60 0x7f8ddc147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:06.347 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8ddad9d700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ddc0b86d0 0x7f8ddc172bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8dcc00c000 tx=0x7f8dcc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.347 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8dcbfff700 1 -- 172.21.15.142:0/2575835623 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dcc010780 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.348 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8dcbfff700 1 -- 172.21.15.142:0/2575835623 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc0108e0 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.348 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8dcbfff700 1 -- 172.21.15.142:0/2575835623 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dcc010c40 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.348 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc15b660 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.348 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.337+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc170860 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.338+0000 7f8dcbfff700 1 -- 172.21.15.142:0/2575835623 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f8dcc01c460 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.338+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc170cc0 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.338+0000 7f8dcbfff700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8db8052c60 0x7f8db8055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.338+0000 7f8dcbfff700 1 -- 172.21.15.142:0/2575835623 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8dcc06ae10 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.349 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.338+0000 7f8dda59c700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8db8052c60 0x7f8db8055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.350 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.339+0000 7f8dda59c700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8db8052c60 0x7f8db8055120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8dd001c000 tx=0x7f8dd0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.350 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.342+0000 7f8dcbfff700 1 -- 172.21.15.142:0/2575835623 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f8dcc0424d0 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.472 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.473+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ddc0cbfc0 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.473 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.474+0000 7f8dcbfff700 1 -- 172.21.15.142:0/2575835623 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8dcc045af0 con 0x7f8ddc0b86d0 2022-01-24T07:01:06.474 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8db8052c60 msgr2=0x7f8db8055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8db8052c60 0x7f8db8055120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8dd001c000 tx=0x7f8dd0015000).stop 2022-01-24T07:01:06.475 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ddc0b86d0 msgr2=0x7f8ddc172bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ddc0b86d0 0x7f8ddc172bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f8dcc00c000 tx=0x7f8dcc006df0).stop 2022-01-24T07:01:06.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 shutdown_connections 2022-01-24T07:01:06.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f8db8052c60 0x7f8db8055120 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ddc0ccb60 0x7f8ddc147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.476 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ddc0b86d0 0x7f8ddc172bd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 --2- 172.21.15.142:0/2575835623 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ddc0cc700 0x7f8ddc147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 >> 172.21.15.142:0/2575835623 conn(0x7f8ddc0d5ff0 msgr2=0x7f8ddc0b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:06.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 shutdown_connections 2022-01-24T07:01:06.477 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.475+0000 7f8de1137700 1 -- 172.21.15.142:0/2575835623 wait complete. 2022-01-24T07:01:06.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-24T07:01:06.584 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.585+0000 7fc36bbde700 1 Processor -- start 2022-01-24T07:01:06.585 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.585+0000 7fc36bbde700 1 -- start start 2022-01-24T07:01:06.587 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc36bbde700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3640ca440 0x7fc3640ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.588 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc36bbde700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36405b4b0 con 0x7fc36405be50 2022-01-24T07:01:06.588 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc36bbde700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36415dfe0 con 0x7fc364062760 2022-01-24T07:01:06.588 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc36bbde700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36415e520 con 0x7fc3640ca440 2022-01-24T07:01:06.588 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc369179700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3640ca440 0x7fc3640ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.589 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc36a17b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc36405be50 0x7fc36405c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48380/0 (socket says 172.21.15.142:48380) 2022-01-24T07:01:06.589 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc36a17b700 1 -- 172.21.15.142:0/486007624 learned_addr learned my addr 172.21.15.142:0/486007624 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:06.589 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc368978700 1 -- 172.21.15.142:0/486007624 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989063388 0 0) 0x7fc36405b4b0 con 0x7fc36405be50 2022-01-24T07:01:06.589 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc369179700 1 -- 172.21.15.142:0/486007624 >> v1:172.21.15.145:6789/0 conn(0x7fc364062760 legacy=0x7fc36415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.589 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc369179700 1 -- 172.21.15.142:0/486007624 >> v1:172.21.15.142:6789/0 conn(0x7fc36405be50 legacy=0x7fc36405c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.590 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.586+0000 7fc369179700 1 -- 172.21.15.142:0/486007624 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36415e280 con 0x7fc3640ca440 2022-01-24T07:01:06.590 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc369179700 1 --2- 172.21.15.142:0/486007624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3640ca440 0x7fc3640ca8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc354002f70 tx=0x7fc354006df0).ready entity=mon.2 client_cookie=9ccdc8bea1383099 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.590 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc368978700 1 -- 172.21.15.142:0/486007624 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35400d5c0 con 0x7fc3640ca440 2022-01-24T07:01:06.590 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc368978700 1 -- 172.21.15.142:0/486007624 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354000e90 con 0x7fc3640ca440 2022-01-24T07:01:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc368978700 1 -- 172.21.15.142:0/486007624 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35400d910 con 0x7fc3640ca440 2022-01-24T07:01:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc36bbde700 1 -- 172.21.15.142:0/486007624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3640ca440 msgr2=0x7fc3640ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc36bbde700 1 --2- 172.21.15.142:0/486007624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3640ca440 0x7fc3640ca8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc354002f70 tx=0x7fc354006df0).stop 2022-01-24T07:01:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc36bbde700 1 -- 172.21.15.142:0/486007624 shutdown_connections 2022-01-24T07:01:06.591 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc36bbde700 1 --2- 172.21.15.142:0/486007624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3640ca440 0x7fc3640ca8c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc36bbde700 1 -- 172.21.15.142:0/486007624 >> 172.21.15.142:0/486007624 conn(0x7fc3640d4830 msgr2=0x7fc3640d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc36bbde700 1 -- 172.21.15.142:0/486007624 shutdown_connections 2022-01-24T07:01:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.587+0000 7fc36bbde700 1 -- 172.21.15.142:0/486007624 wait complete. 2022-01-24T07:01:06.592 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.588+0000 7fc36bbde700 1 Processor -- start 2022-01-24T07:01:06.593 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.588+0000 7fc36bbde700 1 -- start start 2022-01-24T07:01:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36bbde700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc36405be50 0x7fc364170910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36bbde700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc364062760 0x7fc364147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36bbde700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ca440 0x7fc36415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.596 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36bbde700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3641710f0 con 0x7fc3640ca440 2022-01-24T07:01:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36bbde700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364171390 con 0x7fc36405be50 2022-01-24T07:01:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36bbde700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc364171630 con 0x7fc364062760 2022-01-24T07:01:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc364062760 0x7fc364147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc364062760 0x7fc364147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53784/0 (socket says 172.21.15.142:53784) 2022-01-24T07:01:06.597 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 -- 172.21.15.142:0/3266998377 learned_addr learned my addr 172.21.15.142:0/3266998377 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36a17b700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ca440 0x7fc36415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc36997a700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc36405be50 0x7fc364170910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 -- 172.21.15.142:0/3266998377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc36405be50 msgr2=0x7fc364170910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.598 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc36405be50 0x7fc364170910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 -- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ca440 msgr2=0x7fc36415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ca440 0x7fc36415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.589+0000 7fc369179700 1 -- 172.21.15.142:0/3266998377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35400b180 con 0x7fc364062760 2022-01-24T07:01:06.599 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.590+0000 7fc369179700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc364062760 0x7fc364147fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc354002f70 tx=0x7fc354015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.590+0000 7fc352ffd700 1 -- 172.21.15.142:0/3266998377 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35400de80 con 0x7fc364062760 2022-01-24T07:01:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.590+0000 7fc352ffd700 1 -- 172.21.15.142:0/3266998377 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354011bb0 con 0x7fc364062760 2022-01-24T07:01:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.590+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364159ce0 con 0x7fc364062760 2022-01-24T07:01:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.590+0000 7fc352ffd700 1 -- 172.21.15.142:0/3266998377 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc35401e460 con 0x7fc364062760 2022-01-24T07:01:06.600 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.590+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364170e00 con 0x7fc364062760 2022-01-24T07:01:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.591+0000 7fc352ffd700 1 -- 172.21.15.142:0/3266998377 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fc35401a040 con 0x7fc364062760 2022-01-24T07:01:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.591+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc364159b40 con 0x7fc364062760 2022-01-24T07:01:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.591+0000 7fc352ffd700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc344052c60 0x7fc344055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.591+0000 7fc352ffd700 1 -- 172.21.15.142:0/3266998377 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc35406bac0 con 0x7fc364062760 2022-01-24T07:01:06.601 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.591+0000 7fc36997a700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc344052c60 0x7fc344055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.591+0000 7fc36997a700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc344052c60 0x7fc344055120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc360008000 tx=0x7fc360009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:06.602 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.595+0000 7fc352ffd700 1 -- 172.21.15.142:0/3266998377 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fc364159b40 con 0x7fc364062760 2022-01-24T07:01:06.768 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.769+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc364171830 con 0x7fc364062760 2022-01-24T07:01:06.768 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.769+0000 7fc352ffd700 1 -- 172.21.15.142:0/3266998377 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4747 (secure 0 0 0) 0x7fc364171830 con 0x7fc364062760 2022-01-24T07:01:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:06.769 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-24T07:00:54.259086+0000","modified":"2022-01-24T07:01:04.320291+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":9,"in":[0,1,2,3,4,5,6,7,8],"up":{"mds_0":4309,"mds_1":4315,"mds_2":4306,"mds_3":4279,"mds_4":4276,"mds_5":4272,"mds_6":4269,"mds_7":4244,"mds_8":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"h","rank":8,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6833/4266718599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4266718599},{"type":"v1","addr":"172.21.15.145:6833","nonce":4266718599}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4244":{"gid":4244,"name":"g","rank":7,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.145:6836/2250566993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":2250566993},{"type":"v1","addr":"172.21.15.145:6836","nonce":2250566993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4269":{"gid":4269,"name":"c","rank":6,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6839/3496603446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":3496603446},{"type":"v1","addr":"172.21.15.142:6839","nonce":3496603446}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4272":{"gid":4272,"name":"d","rank":5,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3300581089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3300581089},{"type":"v1","addr":"172.21.15.142:6841","nonce":3300581089}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4276":{"gid":4276,"name":"b","rank":4,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6836/2798136120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2798136120},{"type":"v1","addr":"172.21.15.142:6836","nonce":2798136120}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4279":{"gid":4279,"name":"a","rank":3,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2315856698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2315856698},{"type":"v1","addr":"172.21.15.142:6837","nonce":2315856698}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4306":{"gid":4306,"name":"f","rank":2,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3395087110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3395087110},{"type":"v1","addr":"172.21.15.145:6837","nonce":3395087110}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4309":{"gid":4309,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.145:6839/2894168765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":2894168765},{"type":"v1","addr":"172.21.15.145:6839","nonce":2894168765}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4315":{"gid":4315,"name":"i","rank":1,"incarnation":7,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6841/1371026810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6840","nonce":1371026810},{"type":"v1","addr":"172.21.15.145:6841","nonce":1371026810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-24T07:01:06.770 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc344052c60 msgr2=0x7fc344055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc344052c60 0x7fc344055120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc360008000 tx=0x7fc360009040).stop 2022-01-24T07:01:06.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc364062760 msgr2=0x7fc364147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:06.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc364062760 0x7fc364147fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc354002f70 tx=0x7fc354015000).stop 2022-01-24T07:01:06.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 shutdown_connections 2022-01-24T07:01:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc36405be50 0x7fc364170910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc344052c60 0x7fc344055120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ca440 0x7fc36415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 --2- 172.21.15.142:0/3266998377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc364062760 0x7fc364147fd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:06.773 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 >> 172.21.15.142:0/3266998377 conn(0x7fc3640d4830 msgr2=0x7fc3640d3620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:06.773 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 shutdown_connections 2022-01-24T07:01:06.773 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:06.771+0000 7fc36bbde700 1 -- 172.21.15.142:0/3266998377 wait complete. 2022-01-24T07:01:06.773 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 22 2022-01-24T07:01:07.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-24T07:00:54.259086+0000', 'modified': '2022-01-24T07:01:04.320291+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 9, 'in': [0, 1, 2, 3, 4, 5, 6, 7, 8], 'up': {'mds_0': 4309, 'mds_1': 4315, 'mds_2': 4306, 'mds_3': 4279, 'mds_4': 4276, 'mds_5': 4272, 'mds_6': 4269, 'mds_7': 4244, 'mds_8': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'h', 'rank': 8, 'incarnation': 21, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.145:6833/4266718599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 4266718599}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 4266718599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4244': {'gid': 4244, 'name': 'g', 'rank': 7, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.145:6836/2250566993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 2250566993}, {'type': 'v1', 'addr': '172.21.15.145:6836', 'nonce': 2250566993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4269': {'gid': 4269, 'name': 'c', 'rank': 6, 'incarnation': 17, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6839/3496603446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6838', 'nonce': 3496603446}, {'type': 'v1', 'addr': '172.21.15.142:6839', 'nonce': 3496603446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4272': {'gid': 4272, 'name': 'd', 'rank': 5, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6841/3300581089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6840', 'nonce': 3300581089}, {'type': 'v1', 'addr': '172.21.15.142:6841', 'nonce': 3300581089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 4, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6836/2798136120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 2798136120}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 2798136120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4279': {'gid': 4279, 'name': 'a', 'rank': 3, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/2315856698', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 2315856698}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2315856698}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4306': {'gid': 4306, 'name': 'f', 'rank': 2, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6837/3395087110', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6835', 'nonce': 3395087110}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 3395087110}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4309': {'gid': 4309, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.145:6839/2894168765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 2894168765}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 2894168765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4315': {'gid': 4315, 'name': 'i', 'rank': 1, 'incarnation': 7, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6841/1371026810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6840', 'nonce': 1371026810}, {'type': 'v1', 'addr': '172.21.15.145:6841', 'nonce': 1371026810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-24T07:01:07.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 9/9 2022-01-24T07:01:07.688 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok --format=json status 2022-01-24T07:01:07.819 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":8,"id":4241,"want_state":"up:active","state":"up:active","rank_uptime":4.4902865949999997,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":16.857591541000001} 2022-01-24T07:01:07.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4241, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 4.490286595, "state": "up:active", "uptime": 16.857591541, "want_state": "up:active", "whoami": 8 } 2022-01-24T07:01:07.820 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok --format=json status 2022-01-24T07:01:07.936 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":7,"id":4244,"want_state":"up:active","state":"up:active","rank_uptime":5.6178301560000001,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":16.973245975000001} 2022-01-24T07:01:07.937 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4244, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 5.617830156, "state": "up:active", "uptime": 16.973245975, "want_state": "up:active", "whoami": 7 } 2022-01-24T07:01:07.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-24T07:01:08.067 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":6,"id":4269,"want_state":"up:active","state":"up:active","rank_uptime":6.7539454179999998,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":17.113828729000002} 2022-01-24T07:01:08.067 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4269, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 6.753945418, "state": "up:active", "uptime": 17.113828729, "want_state": "up:active", "whoami": 6 } 2022-01-24T07:01:08.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2022-01-24T07:01:08.185 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":5,"id":4272,"want_state":"up:active","state":"up:active","rank_uptime":7.8792035790000003,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":17.22986371} 2022-01-24T07:01:08.186 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4272, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 7.879203579, "state": "up:active", "uptime": 17.22986371, "want_state": "up:active", "whoami": 5 } 2022-01-24T07:01:08.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-24T07:01:08.304 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":4,"id":4276,"want_state":"up:active","state":"up:active","rank_uptime":8.9994427049999999,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":17.375491457999999} 2022-01-24T07:01:08.304 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4276, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 8.999442705, "state": "up:active", "uptime": 17.375491458, "want_state": "up:active", "whoami": 4 } 2022-01-24T07:01:08.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-24T07:01:08.423 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":3,"id":4279,"want_state":"up:active","state":"up:active","rank_uptime":10.126419385,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":17.494113846000001} 2022-01-24T07:01:08.423 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4279, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 10.126419385, "state": "up:active", "uptime": 17.494113846, "want_state": "up:active", "whoami": 3 } 2022-01-24T07:01:08.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok --format=json status 2022-01-24T07:01:08.546 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":2,"id":4306,"want_state":"up:active","state":"up:active","rank_uptime":11.253044962000001,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":17.580222923000001} 2022-01-24T07:01:08.546 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4306, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 11.253044962, "state": "up:active", "uptime": 17.580222923, "want_state": "up:active", "whoami": 2 } 2022-01-24T07:01:08.547 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok --format=json status 2022-01-24T07:01:08.663 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":0,"id":4309,"want_state":"up:active","state":"up:active","rank_uptime":14.394185845999999,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":17.695820126000001} 2022-01-24T07:01:08.663 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4309, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 14.394185846, "state": "up:active", "uptime": 17.695820126, "want_state": "up:active", "whoami": 0 } 2022-01-24T07:01:08.664 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok --format=json status 2022-01-24T07:01:08.781 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":1,"id":4315,"want_state":"up:active","state":"up:active","rank_uptime":12.497732444,"mdsmap_epoch":22,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":17.805850062000001} 2022-01-24T07:01:08.781 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4315, "mdsmap_epoch": 22, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 12.497732444, "state": "up:active", "uptime": 17.805850062, "want_state": "up:active", "whoami": 1 } 2022-01-24T07:01:08.782 INFO:teuthology.run_tasks:Running task exec... 2022-01-24T07:01:08.792 INFO:teuthology.task.exec:Executing custom commands... 2022-01-24T07:01:08.792 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi164.front.sepia.ceph.com 2022-01-24T07:01:08.793 DEBUG:teuthology.orchestra.run.smithi164:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2022-01-24T07:01:09.003 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.002+0000 7f3577fff700 1 Processor -- start 2022-01-24T07:01:09.004 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.003+0000 7f3577fff700 1 -- start start 2022-01-24T07:01:09.004 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.003+0000 7f3577fff700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f357810c890 0x7f357810ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.004 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.003+0000 7f3577fff700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3578113000 con 0x7f357810f260 2022-01-24T07:01:09.004 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.003+0000 7f3577fff700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35781141c0 con 0x7f35780677f0 2022-01-24T07:01:09.005 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.003+0000 7f3577fff700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3578045410 con 0x7f357810c890 2022-01-24T07:01:09.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.004+0000 7f35777fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f357810f260 0x7f3578111700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.164:34536/0 (socket says 172.21.15.164:34536) 2022-01-24T07:01:09.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.004+0000 7f35777fe700 1 -- 172.21.15.164:0/2771009040 learned_addr learned my addr 172.21.15.164:0/2771009040 (peer_addr_for_me v1:172.21.15.164:0/0) 2022-01-24T07:01:09.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.004+0000 7f356ffff700 1 --2- 172.21.15.164:0/2771009040 >> v2:172.21.15.145:3300/0 conn(0x7f357810c890 0x7f357810ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f35767fc700 1 -- 172.21.15.164:0/2771009040 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810291673 0 0) 0x7f3578113000 con 0x7f357810f260 2022-01-24T07:01:09.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f35767fc700 1 -- 172.21.15.164:0/2771009040 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3558003260 con 0x7f357810f260 2022-01-24T07:01:09.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f356ffff700 1 -- 172.21.15.164:0/2771009040 >> v1:172.21.15.145:6789/0 conn(0x7f35780677f0 legacy=0x7f3578067bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f35767fc700 1 -- 172.21.15.164:0/2771009040 <== mon.1 v1:172.21.15.145:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925497166 0 0) 0x7f35781141c0 con 0x7f35780677f0 2022-01-24T07:01:09.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f356ffff700 1 -- 172.21.15.164:0/2771009040 >> v1:172.21.15.142:6789/0 conn(0x7f357810f260 legacy=0x7f3578111700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.012 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f356ffff700 1 -- 172.21.15.164:0/2771009040 --> v2:172.21.15.145:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578115380 con 0x7f357810c890 2022-01-24T07:01:09.012 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f356ffff700 1 --2- 172.21.15.164:0/2771009040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810c890 0x7f357810ec80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3560002f70 tx=0x7f3560006df0).ready entity=mon.1 client_cookie=f895f3f817343ecf server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.012 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f35767fc700 1 -- 172.21.15.164:0/2771009040 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f356000d610 con 0x7f357810c890 2022-01-24T07:01:09.013 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f35767fc700 1 -- 172.21.15.164:0/2771009040 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3560000e90 con 0x7f357810c890 2022-01-24T07:01:09.013 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.005+0000 7f35767fc700 1 -- 172.21.15.164:0/2771009040 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f356000d960 con 0x7f357810c890 2022-01-24T07:01:09.013 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.006+0000 7f3577fff700 1 -- 172.21.15.164:0/2771009040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810c890 msgr2=0x7f357810ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.013 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.006+0000 7f3577fff700 1 --2- 172.21.15.164:0/2771009040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810c890 0x7f357810ec80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3560002f70 tx=0x7f3560006df0).stop 2022-01-24T07:01:09.014 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.006+0000 7f3577fff700 1 -- 172.21.15.164:0/2771009040 shutdown_connections 2022-01-24T07:01:09.014 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.006+0000 7f3577fff700 1 --2- 172.21.15.164:0/2771009040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810c890 0x7f357810ec80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.014 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.006+0000 7f3577fff700 1 -- 172.21.15.164:0/2771009040 >> 172.21.15.164:0/2771009040 conn(0x7f357805d8e0 msgr2=0x7f3578061cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:09.014 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.006+0000 7f3577fff700 1 -- 172.21.15.164:0/2771009040 shutdown_connections 2022-01-24T07:01:09.014 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.006+0000 7f3577fff700 1 -- 172.21.15.164:0/2771009040 wait complete. 2022-01-24T07:01:09.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 Processor -- start 2022-01-24T07:01:09.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 -- start start 2022-01-24T07:01:09.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35780677f0 0x7f3578119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f357810c890 0x7f357811a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810f260 0x7f3578108b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781135a0 con 0x7f357810c890 2022-01-24T07:01:09.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3578109270 con 0x7f357810f260 2022-01-24T07:01:09.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f3577fff700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3578109430 con 0x7f35780677f0 2022-01-24T07:01:09.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.007+0000 7f35777fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810f260 0x7f3578108b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810f260 0x7f3578108b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.164:48872/0 (socket says 172.21.15.164:48872) 2022-01-24T07:01:09.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 -- 172.21.15.164:0/2497289777 learned_addr learned my addr 172.21.15.164:0/2497289777 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-01-24T07:01:09.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f3576ffd700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35780677f0 0x7f3578119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f356ffff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f357810c890 0x7f357811a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 -- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35780677f0 msgr2=0x7f3578119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35780677f0 0x7f3578119db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 -- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f357810c890 msgr2=0x7f357811a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f357810c890 0x7f357811a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 -- 172.21.15.164:0/2497289777 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356000b180 con 0x7f357810f260 2022-01-24T07:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f356ffff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f357810c890 0x7f357811a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f3576ffd700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35780677f0 0x7f3578119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:09.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f35777fe700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810f260 0x7f3578108b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3570001490 tx=0x7f3570007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f3574ff9700 1 -- 172.21.15.164:0/2497289777 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3570005ba0 con 0x7f357810f260 2022-01-24T07:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f3574ff9700 1 -- 172.21.15.164:0/2497289777 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570005d00 con 0x7f357810f260 2022-01-24T07:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3578109710 con 0x7f357810f260 2022-01-24T07:01:09.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.008+0000 7f3574ff9700 1 -- 172.21.15.164:0/2497289777 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35700072c0 con 0x7f357810f260 2022-01-24T07:01:09.021 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.009+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3578120b00 con 0x7f357810f260 2022-01-24T07:01:09.021 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.010+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3578119870 con 0x7f357810f260 2022-01-24T07:01:09.022 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.010+0000 7f3574ff9700 1 -- 172.21.15.164:0/2497289777 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f3570010070 con 0x7f357810f260 2022-01-24T07:01:09.022 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.011+0000 7f3574ff9700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f355c052ab0 0x7f355c054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.011+0000 7f3574ff9700 1 -- 172.21.15.164:0/2497289777 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f357006a590 con 0x7f357810f260 2022-01-24T07:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.011+0000 7f3576ffd700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f355c052ab0 0x7f355c054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.012+0000 7f3576ffd700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f355c052ab0 0x7f355c054f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f356800b000 tx=0x7f3568009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.023 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.015+0000 7f3574ff9700 1 -- 172.21.15.164:0/2497289777 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f3570041c10 con 0x7f357810f260 2022-01-24T07:01:09.196 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.196+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3578057950 con 0x7f357810f260 2022-01-24T07:01:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.341+0000 7f3574ff9700 1 -- 172.21.15.164:0/2497289777 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v23) v1 ==== 168+0+0 (secure 0 0 0) 0x7f3570045230 con 0x7f357810f260 2022-01-24T07:01:09.343 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f355c052ab0 msgr2=0x7f355c054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.343 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f355c052ab0 0x7f355c054f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f356800b000 tx=0x7f3568009040).stop 2022-01-24T07:01:09.344 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810f260 msgr2=0x7f3578108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.344 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810f260 0x7f3578108b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f3570001490 tx=0x7f3570007e00).stop 2022-01-24T07:01:09.344 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 shutdown_connections 2022-01-24T07:01:09.344 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f357810f260 0x7f3578108b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.345 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f355c052ab0 0x7f355c054f70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.345 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35780677f0 0x7f3578119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.345 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 --2- 172.21.15.164:0/2497289777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f357810c890 0x7f357811a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.345 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 >> 172.21.15.164:0/2497289777 conn(0x7f357805d8e0 msgr2=0x7f3578064dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:09.346 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 shutdown_connections 2022-01-24T07:01:09.346 INFO:teuthology.orchestra.run.smithi164.stderr:2022-01-24T07:01:09.343+0000 7f3577fff700 1 -- 172.21.15.164:0/2497289777 wait complete. 2022-01-24T07:01:09.346 INFO:teuthology.orchestra.run.smithi164.stderr:inline data enabled 2022-01-24T07:01:09.368 INFO:teuthology.run_tasks:Running task kclient... 2022-01-24T07:01:09.384 INFO:tasks.kclient:Mounting kernel clients... 2022-01-24T07:01:09.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:01:09.496 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.496+0000 7f0d01fb6700 1 Processor -- start 2022-01-24T07:01:09.496 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.497+0000 7f0d01fb6700 1 -- start start 2022-01-24T07:01:09.502 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.497+0000 7f0d01fb6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc148c70 0x7f0cfc0bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.502 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.497+0000 7f0d01fb6700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0cfc149050 0x7f0cfc15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.502 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.497+0000 7f0d01fb6700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc1607c0 con 0x7f0cfc0d0b30 2022-01-24T07:01:09.503 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.497+0000 7f0d01fb6700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc066db0 con 0x7f0cfc149050 2022-01-24T07:01:09.503 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.497+0000 7f0d01fb6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc067050 con 0x7f0cfc148c70 2022-01-24T07:01:09.503 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfb7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc148c70 0x7f0cfc0bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.503 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfaffd700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0cfc0d0b30 0x7f0cfc067a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48392/0 (socket says 172.21.15.142:48392) 2022-01-24T07:01:09.504 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfaffd700 1 -- 172.21.15.142:0/389621909 learned_addr learned my addr 172.21.15.142:0/389621909 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:09.504 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfb7fe700 1 --2- 172.21.15.142:0/389621909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc148c70 0x7f0cfc0bb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53790/0 (socket says 172.21.15.142:53790) 2022-01-24T07:01:09.504 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfbfff700 1 --2- 172.21.15.142:0/389621909 >> v2:172.21.15.145:3300/0 conn(0x7f0cfc149050 0x7f0cfc15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.504 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfb7fe700 1 -- 172.21.15.142:0/389621909 >> v2:172.21.15.145:3300/0 conn(0x7f0cfc149050 msgr2=0x7f0cfc15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:09.505 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfb7fe700 1 --2- 172.21.15.142:0/389621909 >> v2:172.21.15.145:3300/0 conn(0x7f0cfc149050 0x7f0cfc15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.505 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfa7fc700 1 -- 172.21.15.142:0/389621909 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808669889 0 0) 0x7f0cfc1607c0 con 0x7f0cfc0d0b30 2022-01-24T07:01:09.505 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfb7fe700 1 -- 172.21.15.142:0/389621909 >> v1:172.21.15.142:6789/0 conn(0x7f0cfc0d0b30 legacy=0x7f0cfc067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.505 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfb7fe700 1 -- 172.21.15.142:0/389621909 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0672f0 con 0x7f0cfc148c70 2022-01-24T07:01:09.506 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfb7fe700 1 --2- 172.21.15.142:0/389621909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc148c70 0x7f0cfc0bb670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0cec0032f0 tx=0x7f0cec0091d0).ready entity=mon.2 client_cookie=ef2b7d196399fd56 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.506 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfa7fc700 1 -- 172.21.15.142:0/389621909 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cec00b6c0 con 0x7f0cfc148c70 2022-01-24T07:01:09.506 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfa7fc700 1 -- 172.21.15.142:0/389621909 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00b820 con 0x7f0cfc148c70 2022-01-24T07:01:09.506 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.498+0000 7f0cfa7fc700 1 -- 172.21.15.142:0/389621909 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cec00b990 con 0x7f0cfc148c70 2022-01-24T07:01:09.507 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 -- 172.21.15.142:0/389621909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc148c70 msgr2=0x7f0cfc0bb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.507 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/389621909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc148c70 0x7f0cfc0bb670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0cec0032f0 tx=0x7f0cec0091d0).stop 2022-01-24T07:01:09.507 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 -- 172.21.15.142:0/389621909 shutdown_connections 2022-01-24T07:01:09.507 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/389621909 >> v2:172.21.15.145:3300/0 conn(0x7f0cfc149050 0x7f0cfc15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/389621909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc148c70 0x7f0cfc0bb670 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 -- 172.21.15.142:0/389621909 >> 172.21.15.142:0/389621909 conn(0x7f0cfc05fc90 msgr2=0x7f0cfc0600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 -- 172.21.15.142:0/389621909 shutdown_connections 2022-01-24T07:01:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.499+0000 7f0d01fb6700 1 -- 172.21.15.142:0/389621909 wait complete. 2022-01-24T07:01:09.508 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.500+0000 7f0d01fb6700 1 Processor -- start 2022-01-24T07:01:09.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.500+0000 7f0d01fb6700 1 -- start start 2022-01-24T07:01:09.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0d01fb6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cfc0d0b30 0x7f0cfc16fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0d01fb6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cfc148c70 0x7f0cfc05b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.509 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0d01fb6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc149050 0x7f0cfc0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0d01fb6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc170720 con 0x7f0cfc0d0b30 2022-01-24T07:01:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0d01fb6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0d3160 con 0x7f0cfc148c70 2022-01-24T07:01:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0d01fb6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0d3400 con 0x7f0cfc149050 2022-01-24T07:01:09.510 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cfc0d0b30 0x7f0cfc16fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc149050 0x7f0cfc0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cfc0d0b30 0x7f0cfc16fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51034/0 (socket says 172.21.15.142:51034) 2022-01-24T07:01:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfb7fe700 1 -- 172.21.15.142:0/3806479995 learned_addr learned my addr 172.21.15.142:0/3806479995 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:09.511 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc149050 0x7f0cfc0cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53800/0 (socket says 172.21.15.142:53800) 2022-01-24T07:01:09.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfaffd700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cfc148c70 0x7f0cfc05b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 -- 172.21.15.142:0/3806479995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cfc148c70 msgr2=0x7f0cfc05b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cfc148c70 0x7f0cfc05b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 -- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cfc0d0b30 msgr2=0x7f0cfc16fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.512 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cfc0d0b30 0x7f0cfc16fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 -- 172.21.15.142:0/3806479995 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec009470 con 0x7f0cfc149050 2022-01-24T07:01:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfb7fe700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cfc0d0b30 0x7f0cfc16fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.501+0000 7f0cfbfff700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc149050 0x7f0cfc0cc040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0cfc0ce190 tx=0x7f0cf4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.513 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.502+0000 7f0cf8ff9700 1 -- 172.21.15.142:0/3806479995 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf4016070 con 0x7f0cfc149050 2022-01-24T07:01:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.502+0000 7f0cf8ff9700 1 -- 172.21.15.142:0/3806479995 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4011750 con 0x7f0cfc149050 2022-01-24T07:01:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.502+0000 7f0cf8ff9700 1 -- 172.21.15.142:0/3806479995 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf4011ab0 con 0x7f0cfc149050 2022-01-24T07:01:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.502+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0d36a0 con 0x7f0cfc149050 2022-01-24T07:01:09.514 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.502+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc170130 con 0x7f0cfc149050 2022-01-24T07:01:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.503+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc067590 con 0x7f0cfc149050 2022-01-24T07:01:09.515 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.503+0000 7f0cf8ff9700 1 -- 172.21.15.142:0/3806479995 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f0cf4011c10 con 0x7f0cfc149050 2022-01-24T07:01:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.503+0000 7f0cf8ff9700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0cdc052b40 0x7f0cdc055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.503+0000 7f0cf8ff9700 1 -- 172.21.15.142:0/3806479995 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0cf406a990 con 0x7f0cfc149050 2022-01-24T07:01:09.516 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.503+0000 7f0cfb7fe700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0cdc052b40 0x7f0cdc055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.517 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.504+0000 7f0cfb7fe700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0cdc052b40 0x7f0cdc055000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0cec01b000 tx=0x7f0cec016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.517 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.507+0000 7f0cf8ff9700 1 -- 172.21.15.142:0/3806479995 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f0cf40420b0 con 0x7f0cfc149050 2022-01-24T07:01:09.638 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.639+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cfc057950 con 0x7f0cfc149050 2022-01-24T07:01:09.639 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.639+0000 7f0cf8ff9700 1 -- 172.21.15.142:0/3806479995 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f0cf40456d0 con 0x7f0cfc149050 2022-01-24T07:01:09.639 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:09.639 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:56.271262+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:01:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0cdc052b40 msgr2=0x7f0cdc055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0cdc052b40 0x7f0cdc055000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0cec01b000 tx=0x7f0cec016000).stop 2022-01-24T07:01:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc149050 msgr2=0x7f0cfc0cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc149050 0x7f0cfc0cc040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0cfc0ce190 tx=0x7f0cf4006df0).stop 2022-01-24T07:01:09.642 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 shutdown_connections 2022-01-24T07:01:09.642 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0cdc052b40 0x7f0cdc055000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.642 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cfc149050 0x7f0cfc0cc040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.642 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cfc0d0b30 0x7f0cfc16fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.643 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 --2- 172.21.15.142:0/3806479995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0cfc148c70 0x7f0cfc05b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.643 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 >> 172.21.15.142:0/3806479995 conn(0x7f0cfc05fc90 msgr2=0x7f0cfc15fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:09.643 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 shutdown_connections 2022-01-24T07:01:09.643 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.641+0000 7f0d01fb6700 1 -- 172.21.15.142:0/3806479995 wait complete. 2022-01-24T07:01:09.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-24T07:00:40.161690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-24T07:00:49.517379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-24T07:00:52.172405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-24T07:00:53.230682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-24T07:01:09.652 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-24T07:01:09.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.753+0000 7f1e1759e700 1 Processor -- start 2022-01-24T07:01:09.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.753+0000 7f1e1759e700 1 -- start start 2022-01-24T07:01:09.756 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e1759e700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f1e18159850 0x7f1e18062c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.756 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e1759e700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e1805fc90 0x7f1e180600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.756 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e1759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e18161430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.757 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e1759e700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e18063570 con 0x7f1e1805fc90 2022-01-24T07:01:09.757 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e1759e700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e18063810 con 0x7f1e18159850 2022-01-24T07:01:09.757 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e1759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18063ab0 con 0x7f1e18160fa0 2022-01-24T07:01:09.757 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e16d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e18161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.758 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.754+0000 7f1e15d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e1805fc90 0x7f1e180600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.758 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e16d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e18161430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53808/0 (socket says 172.21.15.142:53808) 2022-01-24T07:01:09.758 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e15d9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e1805fc90 0x7f1e180600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51044/0 (socket says 172.21.15.142:51044) 2022-01-24T07:01:09.758 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e16d9d700 1 -- 172.21.15.142:0/4069355745 learned_addr learned my addr 172.21.15.142:0/4069355745 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:09.759 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e1659c700 1 --2- 172.21.15.142:0/4069355745 >> v2:172.21.15.145:3300/0 conn(0x7f1e18159850 0x7f1e18062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.759 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e15d9b700 1 -- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 msgr2=0x7f1e18161430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:09.759 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e15d9b700 1 --2- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e18161430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.759 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e15d9b700 1 -- 172.21.15.142:0/4069355745 >> v2:172.21.15.145:3300/0 conn(0x7f1e18159850 msgr2=0x7f1e18062c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:09.760 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e15d9b700 1 --2- 172.21.15.142:0/4069355745 >> v2:172.21.15.145:3300/0 conn(0x7f1e18159850 0x7f1e18062c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.760 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e15d9b700 1 -- 172.21.15.142:0/4069355745 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18063d50 con 0x7f1e1805fc90 2022-01-24T07:01:09.760 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e16d9d700 1 --2- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e18161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:09.760 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e15d9b700 1 --2- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e180600f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1e00002f70 tx=0x7f1e00006df0).ready entity=mon.0 client_cookie=cb1331f7862178d6 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.760 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e1559a700 1 -- 172.21.15.142:0/4069355745 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0000d4a0 con 0x7f1e1805fc90 2022-01-24T07:01:09.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e1559a700 1 -- 172.21.15.142:0/4069355745 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e00000e90 con 0x7f1e1805fc90 2022-01-24T07:01:09.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e1559a700 1 -- 172.21.15.142:0/4069355745 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0000d7f0 con 0x7f1e1805fc90 2022-01-24T07:01:09.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e1759e700 1 -- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 msgr2=0x7f1e180600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.761 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.755+0000 7f1e1759e700 1 --2- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e180600f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1e00002f70 tx=0x7f1e00006df0).stop 2022-01-24T07:01:09.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.756+0000 7f1e1759e700 1 -- 172.21.15.142:0/4069355745 shutdown_connections 2022-01-24T07:01:09.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.756+0000 7f1e1759e700 1 --2- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e18161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.756+0000 7f1e1759e700 1 --2- 172.21.15.142:0/4069355745 >> v2:172.21.15.145:3300/0 conn(0x7f1e18159850 0x7f1e18062c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.762 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.756+0000 7f1e1759e700 1 --2- 172.21.15.142:0/4069355745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e180600f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.756+0000 7f1e1759e700 1 -- 172.21.15.142:0/4069355745 >> 172.21.15.142:0/4069355745 conn(0x7f1e180d3c30 msgr2=0x7f1e180d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:09.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.756+0000 7f1e1759e700 1 -- 172.21.15.142:0/4069355745 shutdown_connections 2022-01-24T07:01:09.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.756+0000 7f1e1759e700 1 -- 172.21.15.142:0/4069355745 wait complete. 2022-01-24T07:01:09.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 Processor -- start 2022-01-24T07:01:09.763 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 -- start start 2022-01-24T07:01:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e1815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e18159850 0x7f1e1805bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e180b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1816efe0 con 0x7f1e1805fc90 2022-01-24T07:01:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1816fef0 con 0x7f1e18159850 2022-01-24T07:01:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.757+0000 7f1e1759e700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1816f1d0 con 0x7f1e18160fa0 2022-01-24T07:01:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e1815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e16d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e180b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e1815ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51048/0 (socket says 172.21.15.142:51048) 2022-01-24T07:01:09.769 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 -- 172.21.15.142:0/1631380213 learned_addr learned my addr 172.21.15.142:0/1631380213 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:09.769 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e15d9b700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e18159850 0x7f1e1805bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.769 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 -- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 msgr2=0x7f1e180b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.769 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e180b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.770 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 -- 172.21.15.142:0/1631380213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e18159850 msgr2=0x7f1e1805bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.770 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e18159850 0x7f1e1805bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.770 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 -- 172.21.15.142:0/1631380213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1000b1e0 con 0x7f1e1805fc90 2022-01-24T07:01:09.770 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e16d9d700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e180b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:09.770 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1659c700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e1815ea90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1e180b7460 tx=0x7f1e080091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e0f7fe700 1 -- 172.21.15.142:0/1631380213 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0800c850 con 0x7f1e1805fc90 2022-01-24T07:01:09.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e0f7fe700 1 -- 172.21.15.142:0/1631380213 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800c9b0 con 0x7f1e1805fc90 2022-01-24T07:01:09.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0000b180 con 0x7f1e1805fc90 2022-01-24T07:01:09.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e0f7fe700 1 -- 172.21.15.142:0/1631380213 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e0800cd10 con 0x7f1e1805fc90 2022-01-24T07:01:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.758+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1816f710 con 0x7f1e1805fc90 2022-01-24T07:01:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.759+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e180d1b10 con 0x7f1e1805fc90 2022-01-24T07:01:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.759+0000 7f1e0f7fe700 1 -- 172.21.15.142:0/1631380213 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f1e08022070 con 0x7f1e1805fc90 2022-01-24T07:01:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.759+0000 7f1e0f7fe700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1dfc052ab0 0x7f1dfc054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.760+0000 7f1e0f7fe700 1 -- 172.21.15.142:0/1631380213 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1e0806b1d0 con 0x7f1e1805fc90 2022-01-24T07:01:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.760+0000 7f1e15d9b700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1dfc052ab0 0x7f1dfc054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.760+0000 7f1e15d9b700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1dfc052ab0 0x7f1dfc054f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1e00018000 tx=0x7f1e00014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.763+0000 7f1e0f7fe700 1 -- 172.21.15.142:0/1631380213 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f1e080428f0 con 0x7f1e1805fc90 2022-01-24T07:01:09.892 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.893+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1e18063ff0 con 0x7f1e1805fc90 2022-01-24T07:01:09.893 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.894+0000 7f1e0f7fe700 1 -- 172.21.15.142:0/1631380213 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1e08045f10 con 0x7f1e1805fc90 2022-01-24T07:01:09.893 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2022-01-24T07:01:09.895 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1dfc052ab0 msgr2=0x7f1dfc054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.895 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1dfc052ab0 0x7f1dfc054f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1e00018000 tx=0x7f1e00014000).stop 2022-01-24T07:01:09.895 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 msgr2=0x7f1e1815ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:09.895 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e1815ea90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1e180b7460 tx=0x7f1e080091d0).stop 2022-01-24T07:01:09.895 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 shutdown_connections 2022-01-24T07:01:09.896 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1dfc052ab0 0x7f1dfc054f70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.896 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e18160fa0 0x7f1e180b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.896 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1805fc90 0x7f1e1815ea90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.896 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 --2- 172.21.15.142:0/1631380213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1e18159850 0x7f1e1805bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:09.896 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 >> 172.21.15.142:0/1631380213 conn(0x7f1e180d3c30 msgr2=0x7f1e18165300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:09.897 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 shutdown_connections 2022-01-24T07:01:09.897 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:09.895+0000 7f1e1759e700 1 -- 172.21.15.142:0/1631380213 wait complete. 2022-01-24T07:01:09.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-24T07:01:10.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.008+0000 7f5535291700 1 Processor -- start 2022-01-24T07:01:10.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.008+0000 7f5535291700 1 -- start start 2022-01-24T07:01:10.010 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f5535291700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5530142120 0x7f55300c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f5535291700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530064470 0x7f55300ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f5535291700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f55300d07f0 0x7f55300d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f5535291700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55300632b0 con 0x7f5530142120 2022-01-24T07:01:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f5535291700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5530063550 con 0x7f55300d07f0 2022-01-24T07:01:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f5535291700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55300637f0 con 0x7f5530064470 2022-01-24T07:01:10.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530064470 0x7f55300ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5530142120 0x7f55300c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552effd700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5530142120 0x7f55300c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51056/0 (socket says 172.21.15.142:51056) 2022-01-24T07:01:10.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530064470 0x7f55300ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53820/0 (socket says 172.21.15.142:53820) 2022-01-24T07:01:10.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552effd700 1 -- 172.21.15.142:0/1900570928 learned_addr learned my addr 172.21.15.142:0/1900570928 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552f7fe700 1 --2- 172.21.15.142:0/1900570928 >> v2:172.21.15.145:3300/0 conn(0x7f55300d07f0 0x7f55300d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 -- 172.21.15.142:0/1900570928 >> v2:172.21.15.145:3300/0 conn(0x7f55300d07f0 msgr2=0x7f55300d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:10.013 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 --2- 172.21.15.142:0/1900570928 >> v2:172.21.15.145:3300/0 conn(0x7f55300d07f0 0x7f55300d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 -- 172.21.15.142:0/1900570928 >> v2:172.21.15.142:3300/0 conn(0x7f5530142120 msgr2=0x7f55300c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 --2- 172.21.15.142:0/1900570928 >> v2:172.21.15.142:3300/0 conn(0x7f5530142120 0x7f55300c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 -- 172.21.15.142:0/1900570928 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530063a90 con 0x7f5530064470 2022-01-24T07:01:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552effd700 1 --2- 172.21.15.142:0/1900570928 >> v2:172.21.15.142:3300/0 conn(0x7f5530142120 0x7f55300c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552f7fe700 1 --2- 172.21.15.142:0/1900570928 >> v2:172.21.15.145:3300/0 conn(0x7f55300d07f0 0x7f55300d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552e7fc700 1 --2- 172.21.15.142:0/1900570928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530064470 0x7f55300ce760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f55240032f0 tx=0x7f55240091d0).ready entity=mon.2 client_cookie=e2a1d78754161ca0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552dffb700 1 -- 172.21.15.142:0/1900570928 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f552400b680 con 0x7f5530064470 2022-01-24T07:01:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552dffb700 1 -- 172.21.15.142:0/1900570928 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552400b7e0 con 0x7f5530064470 2022-01-24T07:01:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.009+0000 7f552dffb700 1 -- 172.21.15.142:0/1900570928 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f552400b950 con 0x7f5530064470 2022-01-24T07:01:10.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 -- 172.21.15.142:0/1900570928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530064470 msgr2=0x7f55300ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 --2- 172.21.15.142:0/1900570928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530064470 0x7f55300ce760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f55240032f0 tx=0x7f55240091d0).stop 2022-01-24T07:01:10.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 -- 172.21.15.142:0/1900570928 shutdown_connections 2022-01-24T07:01:10.016 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 --2- 172.21.15.142:0/1900570928 >> v2:172.21.15.145:3300/0 conn(0x7f55300d07f0 0x7f55300d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 --2- 172.21.15.142:0/1900570928 >> v2:172.21.15.142:3300/0 conn(0x7f5530142120 0x7f55300c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 --2- 172.21.15.142:0/1900570928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530064470 0x7f55300ce760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 -- 172.21.15.142:0/1900570928 >> 172.21.15.142:0/1900570928 conn(0x7f5530061ea0 msgr2=0x7f55300622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 -- 172.21.15.142:0/1900570928 shutdown_connections 2022-01-24T07:01:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.010+0000 7f5535291700 1 -- 172.21.15.142:0/1900570928 wait complete. 2022-01-24T07:01:10.018 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.011+0000 7f5535291700 1 Processor -- start 2022-01-24T07:01:10.018 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.011+0000 7f5535291700 1 -- start start 2022-01-24T07:01:10.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f5535291700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5530064470 0x7f5530139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f5535291700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55300d07f0 0x7f55300cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.021 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f5535291700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530142120 0x7f55300cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f5535291700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55300b95e0 con 0x7f55300d07f0 2022-01-24T07:01:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f5535291700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55300b9880 con 0x7f5530064470 2022-01-24T07:01:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f5535291700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55300b9b20 con 0x7f5530142120 2022-01-24T07:01:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55300d07f0 0x7f55300cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530142120 0x7f55300cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55300d07f0 0x7f55300cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51064/0 (socket says 172.21.15.142:51064) 2022-01-24T07:01:10.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552f7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530142120 0x7f55300cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53826/0 (socket says 172.21.15.142:53826) 2022-01-24T07:01:10.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 -- 172.21.15.142:0/4200484820 learned_addr learned my addr 172.21.15.142:0/4200484820 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.023 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552effd700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5530064470 0x7f5530139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 -- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530142120 msgr2=0x7f55300cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530142120 0x7f55300cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 -- 172.21.15.142:0/4200484820 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5530064470 msgr2=0x7f5530139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.024 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5530064470 0x7f5530139080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 -- 172.21.15.142:0/4200484820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552800b1e0 con 0x7f55300d07f0 2022-01-24T07:01:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552f7fe700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530142120 0x7f55300cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.012+0000 7f552e7fc700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55300d07f0 0x7f55300cf340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f55240032f0 tx=0x7f5524016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.013+0000 7f551ffff700 1 -- 172.21.15.142:0/4200484820 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5524006ea0 con 0x7f55300d07f0 2022-01-24T07:01:10.025 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.013+0000 7f551ffff700 1 -- 172.21.15.142:0/4200484820 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524021670 con 0x7f55300d07f0 2022-01-24T07:01:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.013+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5524009470 con 0x7f55300d07f0 2022-01-24T07:01:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.013+0000 7f551ffff700 1 -- 172.21.15.142:0/4200484820 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f552400b680 con 0x7f55300d07f0 2022-01-24T07:01:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.013+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55300cec00 con 0x7f55300d07f0 2022-01-24T07:01:10.026 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.013+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55300cfd20 con 0x7f55300d07f0 2022-01-24T07:01:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.014+0000 7f551ffff700 1 -- 172.21.15.142:0/4200484820 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f552400f070 con 0x7f55300d07f0 2022-01-24T07:01:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.014+0000 7f551ffff700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f550c052b40 0x7f550c055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.014+0000 7f551ffff700 1 -- 172.21.15.142:0/4200484820 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f552406b620 con 0x7f55300d07f0 2022-01-24T07:01:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.014+0000 7f552effd700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f550c052b40 0x7f550c055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.027 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.014+0000 7f552effd700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f550c052b40 0x7f550c055000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f552800b000 tx=0x7f5528006eb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.028 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.017+0000 7f551ffff700 1 -- 172.21.15.142:0/4200484820 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f5524042d40 con 0x7f55300d07f0 2022-01-24T07:01:10.146 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.146+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5530057950 con 0x7f55300d07f0 2022-01-24T07:01:10.146 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.147+0000 7f551ffff700 1 -- 172.21.15.142:0/4200484820 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5524015020 con 0x7f55300d07f0 2022-01-24T07:01:10.146 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:10.148 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f550c052b40 msgr2=0x7f550c055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.148 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f550c052b40 0x7f550c055000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f552800b000 tx=0x7f5528006eb0).stop 2022-01-24T07:01:10.148 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55300d07f0 msgr2=0x7f55300cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.148 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55300d07f0 0x7f55300cf340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f55240032f0 tx=0x7f5524016000).stop 2022-01-24T07:01:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 shutdown_connections 2022-01-24T07:01:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5530064470 0x7f5530139080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f550c052b40 0x7f550c055000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.149 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5530142120 0x7f55300cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 --2- 172.21.15.142:0/4200484820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55300d07f0 0x7f55300cf340 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 >> 172.21.15.142:0/4200484820 conn(0x7f5530061ea0 msgr2=0x7f553015c950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 shutdown_connections 2022-01-24T07:01:10.150 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.148+0000 7f5535291700 1 -- 172.21.15.142:0/4200484820 wait complete. 2022-01-24T07:01:10.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-24T07:01:10.260 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.260+0000 7f64f87f5700 1 Processor -- start 2022-01-24T07:01:10.260 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.260+0000 7f64f87f5700 1 -- start start 2022-01-24T07:01:10.263 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.261+0000 7f64f87f5700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f64f0142120 0x7f64f00c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.264 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.261+0000 7f64f87f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0064470 0x7f64f00ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.264 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f87f5700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64f00d07f0 0x7f64f00d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.264 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f87f5700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f00632b0 con 0x7f64f00d07f0 2022-01-24T07:01:10.264 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f87f5700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f0063550 con 0x7f64f0142120 2022-01-24T07:01:10.265 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f87f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00637f0 con 0x7f64f0064470 2022-01-24T07:01:10.265 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f6d92700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64f00d07f0 0x7f64f00d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.265 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0064470 0x7f64f00ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.265 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0064470 0x7f64f00ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53832/0 (socket says 172.21.15.142:53832) 2022-01-24T07:01:10.266 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f6d92700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f64f00d07f0 0x7f64f00d0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51072/0 (socket says 172.21.15.142:51072) 2022-01-24T07:01:10.266 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 -- 172.21.15.142:0/33121766 learned_addr learned my addr 172.21.15.142:0/33121766 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.266 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f6591700 1 --2- 172.21.15.142:0/33121766 >> v2:172.21.15.145:3300/0 conn(0x7f64f0142120 0x7f64f00c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.266 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 -- 172.21.15.142:0/33121766 >> v2:172.21.15.145:3300/0 conn(0x7f64f0142120 msgr2=0x7f64f00c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 --2- 172.21.15.142:0/33121766 >> v2:172.21.15.145:3300/0 conn(0x7f64f0142120 0x7f64f00c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 -- 172.21.15.142:0/33121766 >> v2:172.21.15.142:3300/0 conn(0x7f64f00d07f0 msgr2=0x7f64f00d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 --2- 172.21.15.142:0/33121766 >> v2:172.21.15.142:3300/0 conn(0x7f64f00d07f0 0x7f64f00d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 -- 172.21.15.142:0/33121766 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0063a90 con 0x7f64f0064470 2022-01-24T07:01:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f6d92700 1 --2- 172.21.15.142:0/33121766 >> v2:172.21.15.142:3300/0 conn(0x7f64f00d07f0 0x7f64f00d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f5d90700 1 --2- 172.21.15.142:0/33121766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0064470 0x7f64f00ce760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f64e4002f70 tx=0x7f64e4006eb0).ready entity=mon.2 client_cookie=970c45c77143a8a6 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f558f700 1 -- 172.21.15.142:0/33121766 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e400d570 con 0x7f64f0064470 2022-01-24T07:01:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f558f700 1 -- 172.21.15.142:0/33121766 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4000e90 con 0x7f64f0064470 2022-01-24T07:01:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.262+0000 7f64f558f700 1 -- 172.21.15.142:0/33121766 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e400d900 con 0x7f64f0064470 2022-01-24T07:01:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 -- 172.21.15.142:0/33121766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0064470 msgr2=0x7f64f00ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 --2- 172.21.15.142:0/33121766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0064470 0x7f64f00ce760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f64e4002f70 tx=0x7f64e4006eb0).stop 2022-01-24T07:01:10.269 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 -- 172.21.15.142:0/33121766 shutdown_connections 2022-01-24T07:01:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 --2- 172.21.15.142:0/33121766 >> v2:172.21.15.142:3300/0 conn(0x7f64f00d07f0 0x7f64f00d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 --2- 172.21.15.142:0/33121766 >> v2:172.21.15.145:3300/0 conn(0x7f64f0142120 0x7f64f00c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 --2- 172.21.15.142:0/33121766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f0064470 0x7f64f00ce760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 -- 172.21.15.142:0/33121766 >> 172.21.15.142:0/33121766 conn(0x7f64f0061ea0 msgr2=0x7f64f00622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 -- 172.21.15.142:0/33121766 shutdown_connections 2022-01-24T07:01:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.263+0000 7f64f87f5700 1 -- 172.21.15.142:0/33121766 wait complete. 2022-01-24T07:01:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.264+0000 7f64f87f5700 1 Processor -- start 2022-01-24T07:01:10.271 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.264+0000 7f64f87f5700 1 -- start start 2022-01-24T07:01:10.274 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64f0064470 0x7f64f016f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.274 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f00d07f0 0x7f64f005cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f0142120 0x7f64f005d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f013d9b0 con 0x7f64f0142120 2022-01-24T07:01:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00616b0 con 0x7f64f0064470 2022-01-24T07:01:10.275 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0061950 con 0x7f64f00d07f0 2022-01-24T07:01:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f6d92700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f0142120 0x7f64f005d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f5d90700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f00d07f0 0x7f64f005cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f6d92700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f0142120 0x7f64f005d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51078/0 (socket says 172.21.15.142:51078) 2022-01-24T07:01:10.276 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f6d92700 1 -- 172.21.15.142:0/1867560442 learned_addr learned my addr 172.21.15.142:0/1867560442 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f6591700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64f0064470 0x7f64f016f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f5d90700 1 -- 172.21.15.142:0/1867560442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64f0064470 msgr2=0x7f64f016f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f5d90700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64f0064470 0x7f64f016f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.277 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f5d90700 1 -- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f0142120 msgr2=0x7f64f005d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f5d90700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f0142120 0x7f64f005d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f5d90700 1 -- 172.21.15.142:0/1867560442 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e800b180 con 0x7f64f00d07f0 2022-01-24T07:01:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f6d92700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f0142120 0x7f64f005d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:10.278 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f5d90700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f00d07f0 0x7f64f005cd00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f64e4002f70 tx=0x7f64e4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.279 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64ef7fe700 1 -- 172.21.15.142:0/1867560442 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e400de60 con 0x7f64f00d07f0 2022-01-24T07:01:10.279 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64ef7fe700 1 -- 172.21.15.142:0/1867560442 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4011b80 con 0x7f64f00d07f0 2022-01-24T07:01:10.279 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64ef7fe700 1 -- 172.21.15.142:0/1867560442 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e401e460 con 0x7f64f00d07f0 2022-01-24T07:01:10.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e400b1e0 con 0x7f64f00d07f0 2022-01-24T07:01:10.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.265+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f013deb0 con 0x7f64f00d07f0 2022-01-24T07:01:10.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.266+0000 7f64ef7fe700 1 -- 172.21.15.142:0/1867560442 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f64e401a040 con 0x7f64f00d07f0 2022-01-24T07:01:10.280 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.266+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f016f720 con 0x7f64f00d07f0 2022-01-24T07:01:10.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.267+0000 7f64ef7fe700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f64d0052b40 0x7f64d0055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.267+0000 7f64ef7fe700 1 -- 172.21.15.142:0/1867560442 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f64e406b760 con 0x7f64f00d07f0 2022-01-24T07:01:10.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.267+0000 7f64f6591700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f64d0052b40 0x7f64d0055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.267+0000 7f64f6591700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f64d0052b40 0x7f64d0055000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f64e000d000 tx=0x7f64e0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.281 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.270+0000 7f64ef7fe700 1 -- 172.21.15.142:0/1867560442 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f64e4042e80 con 0x7f64f00d07f0 2022-01-24T07:01:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.405+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64f0057950 con 0x7f64f00d07f0 2022-01-24T07:01:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.406+0000 7f64ef7fe700 1 -- 172.21.15.142:0/1867560442 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f64e40464a0 con 0x7f64f00d07f0 2022-01-24T07:01:10.405 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:10.407 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f64d0052b40 msgr2=0x7f64d0055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.407 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f64d0052b40 0x7f64d0055000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f64e000d000 tx=0x7f64e0008040).stop 2022-01-24T07:01:10.407 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f00d07f0 msgr2=0x7f64f005cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.408 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f00d07f0 0x7f64f005cd00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f64e4002f70 tx=0x7f64e4015000).stop 2022-01-24T07:01:10.408 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 shutdown_connections 2022-01-24T07:01:10.408 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64f0064470 0x7f64f016f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.408 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f64d0052b40 0x7f64d0055000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64f0142120 0x7f64f005d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 --2- 172.21.15.142:0/1867560442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64f00d07f0 0x7f64f005cd00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 >> 172.21.15.142:0/1867560442 conn(0x7f64f0061ea0 msgr2=0x7f64f00c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 shutdown_connections 2022-01-24T07:01:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.407+0000 7f64f87f5700 1 -- 172.21.15.142:0/1867560442 wait complete. 2022-01-24T07:01:10.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-24T07:01:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.519+0000 7f28cd0e9700 1 Processor -- start 2022-01-24T07:01:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.519+0000 7f28cd0e9700 1 -- start start 2022-01-24T07:01:10.526 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28cd0e9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28cd0e9700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28c8062fe0 0x7f28c80ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28cd0e9700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f28c80cec50 0x7f28c813f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.527 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28cd0e9700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80634b0 con 0x7f28c8062fe0 2022-01-24T07:01:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28cd0e9700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c8063750 con 0x7f28c80cec50 2022-01-24T07:01:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28cd0e9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80639f0 con 0x7f28c80d0b70 2022-01-24T07:01:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28c6d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.528 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28bffff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28c8062fe0 0x7f28c80ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.529 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28c6d9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53844/0 (socket says 172.21.15.142:53844) 2022-01-24T07:01:10.529 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28c6d9d700 1 -- 172.21.15.142:0/798671877 learned_addr learned my addr 172.21.15.142:0/798671877 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.529 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28c759e700 1 --2- 172.21.15.142:0/798671877 >> v2:172.21.15.145:3300/0 conn(0x7f28c80cec50 0x7f28c813f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.529 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28bffff700 1 -- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 msgr2=0x7f28c8064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:10.529 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28bffff700 1 --2- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.530 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28bffff700 1 -- 172.21.15.142:0/798671877 >> v2:172.21.15.145:3300/0 conn(0x7f28c80cec50 msgr2=0x7f28c813f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:10.530 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28bffff700 1 --2- 172.21.15.142:0/798671877 >> v2:172.21.15.145:3300/0 conn(0x7f28c80cec50 0x7f28c813f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.530 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28bffff700 1 -- 172.21.15.142:0/798671877 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8063c90 con 0x7f28c8062fe0 2022-01-24T07:01:10.530 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28c6d9d700 1 --2- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:10.531 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.520+0000 7f28bffff700 1 --2- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c8062fe0 0x7f28c80ce760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f28b0002f70 tx=0x7f28b0006df0).ready entity=mon.0 client_cookie=3b97699034ca35b2 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.531 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28c659c700 1 -- 172.21.15.142:0/798671877 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b000d570 con 0x7f28c8062fe0 2022-01-24T07:01:10.531 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28c659c700 1 -- 172.21.15.142:0/798671877 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0000e90 con 0x7f28c8062fe0 2022-01-24T07:01:10.531 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28c659c700 1 -- 172.21.15.142:0/798671877 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b000d8c0 con 0x7f28c8062fe0 2022-01-24T07:01:10.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 -- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c8062fe0 msgr2=0x7f28c80ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c8062fe0 0x7f28c80ce760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f28b0002f70 tx=0x7f28b0006df0).stop 2022-01-24T07:01:10.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 -- 172.21.15.142:0/798671877 shutdown_connections 2022-01-24T07:01:10.532 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/798671877 >> v2:172.21.15.145:3300/0 conn(0x7f28c80cec50 0x7f28c813f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/798671877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c8062fe0 0x7f28c80ce760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 -- 172.21.15.142:0/798671877 >> 172.21.15.142:0/798671877 conn(0x7f28c8061ea0 msgr2=0x7f28c80622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 -- 172.21.15.142:0/798671877 shutdown_connections 2022-01-24T07:01:10.533 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.521+0000 7f28cd0e9700 1 -- 172.21.15.142:0/798671877 wait complete. 2022-01-24T07:01:10.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.522+0000 7f28cd0e9700 1 Processor -- start 2022-01-24T07:01:10.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.522+0000 7f28cd0e9700 1 -- start start 2022-01-24T07:01:10.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28cd0e9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28c8062fe0 0x7f28c8138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.534 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28cd0e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80cec50 0x7f28c8170030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28cd0e9700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8170520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28cd0e9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8134970 con 0x7f28c80cec50 2022-01-24T07:01:10.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28cd0e9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80d49e0 con 0x7f28c8062fe0 2022-01-24T07:01:10.535 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28cd0e9700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8170b20 con 0x7f28c80d0b70 2022-01-24T07:01:10.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28bffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80cec50 0x7f28c8170030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8170520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28bffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80cec50 0x7f28c8170030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51086/0 (socket says 172.21.15.142:51086) 2022-01-24T07:01:10.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8170520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53850/0 (socket says 172.21.15.142:53850) 2022-01-24T07:01:10.536 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28bffff700 1 -- 172.21.15.142:0/414661121 learned_addr learned my addr 172.21.15.142:0/414661121 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.537 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c6d9d700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28c8062fe0 0x7f28c8138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.537 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 -- 172.21.15.142:0/414661121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28c8062fe0 msgr2=0x7f28c8138fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.537 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28c8062fe0 0x7f28c8138fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.537 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 -- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80cec50 msgr2=0x7f28c8170030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.538 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80cec50 0x7f28c8170030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.538 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 -- 172.21.15.142:0/414661121 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b800b1e0 con 0x7f28c80d0b70 2022-01-24T07:01:10.538 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28bffff700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80cec50 0x7f28c8170030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:10.538 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.523+0000 7f28c759e700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8170520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f28c000a000 tx=0x7f28c0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.539 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.524+0000 7f28c4d99700 1 -- 172.21.15.142:0/414661121 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c0011780 con 0x7f28c80d0b70 2022-01-24T07:01:10.539 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.524+0000 7f28c4d99700 1 -- 172.21.15.142:0/414661121 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00118e0 con 0x7f28c80d0b70 2022-01-24T07:01:10.539 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.524+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b000b180 con 0x7f28c80d0b70 2022-01-24T07:01:10.539 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.524+0000 7f28c4d99700 1 -- 172.21.15.142:0/414661121 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c0011c40 con 0x7f28c80d0b70 2022-01-24T07:01:10.539 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.524+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c816ca60 con 0x7f28c80d0b70 2022-01-24T07:01:10.540 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.525+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c816d400 con 0x7f28c80d0b70 2022-01-24T07:01:10.540 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.525+0000 7f28c4d99700 1 -- 172.21.15.142:0/414661121 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f28c0012420 con 0x7f28c80d0b70 2022-01-24T07:01:10.540 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.525+0000 7f28c4d99700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f28ac052ae0 0x7f28ac054fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.540 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.525+0000 7f28c4d99700 1 -- 172.21.15.142:0/414661121 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f28c006aa40 con 0x7f28c80d0b70 2022-01-24T07:01:10.541 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.525+0000 7f28c6d9d700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f28ac052ae0 0x7f28ac054fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.541 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.525+0000 7f28c6d9d700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f28ac052ae0 0x7f28ac054fa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f28b800b000 tx=0x7f28b8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.541 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.529+0000 7f28c4d99700 1 -- 172.21.15.142:0/414661121 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f28c0042100 con 0x7f28c80d0b70 2022-01-24T07:01:10.659 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.659+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28c80681c0 con 0x7f28c80d0b70 2022-01-24T07:01:10.659 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.660+0000 7f28c4d99700 1 -- 172.21.15.142:0/414661121 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f28c0045720 con 0x7f28c80d0b70 2022-01-24T07:01:10.660 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:10.661 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f28ac052ae0 msgr2=0x7f28ac054fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.661 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f28ac052ae0 0x7f28ac054fa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f28b800b000 tx=0x7f28b8008040).stop 2022-01-24T07:01:10.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 msgr2=0x7f28c8170520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8170520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f28c000a000 tx=0x7f28c0008040).stop 2022-01-24T07:01:10.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 shutdown_connections 2022-01-24T07:01:10.662 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28c8062fe0 0x7f28c8138fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f28ac052ae0 0x7f28ac054fa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80d0b70 0x7f28c8170520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 --2- 172.21.15.142:0/414661121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80cec50 0x7f28c8170030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.663 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 >> 172.21.15.142:0/414661121 conn(0x7f28c8061ea0 msgr2=0x7f28c813b450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.664 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 shutdown_connections 2022-01-24T07:01:10.664 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.661+0000 7f28cd0e9700 1 -- 172.21.15.142:0/414661121 wait complete. 2022-01-24T07:01:10.671 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-24T07:01:10.672 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-24T07:01:10.770 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.771+0000 7fa05959c700 1 Processor -- start 2022-01-24T07:01:10.771 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.771+0000 7fa05959c700 1 -- start start 2022-01-24T07:01:10.773 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa05959c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0540d2be0 0x7fa054162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.774 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa05959c700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0540d2fc0 0x7fa054145460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.774 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa05959c700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa054163870 con 0x7fa054145950 2022-01-24T07:01:10.774 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa05959c700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0540b9820 con 0x7fa0540d2fc0 2022-01-24T07:01:10.774 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa05959c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054163b10 con 0x7fa0540d2be0 2022-01-24T07:01:10.774 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa0537fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0540d2fc0 0x7fa054145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.775 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0540d2be0 0x7fa054162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.775 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0540d2be0 0x7fa054162fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53856/0 (socket says 172.21.15.142:53856) 2022-01-24T07:01:10.775 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa0537fe700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0540d2fc0 0x7fa054145460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51094/0 (socket says 172.21.15.142:51094) 2022-01-24T07:01:10.775 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 -- 172.21.15.142:0/4218434931 learned_addr learned my addr 172.21.15.142:0/4218434931 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.776 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa058d9b700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa054145950 0x7fa0540d1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48460/0 (socket says 172.21.15.142:48460) 2022-01-24T07:01:10.776 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 -- 172.21.15.142:0/4218434931 >> v2:172.21.15.142:3300/0 conn(0x7fa0540d2fc0 msgr2=0x7fa054145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:10.776 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 --2- 172.21.15.142:0/4218434931 >> v2:172.21.15.142:3300/0 conn(0x7fa0540d2fc0 0x7fa054145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.776 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 -- 172.21.15.142:0/4218434931 >> v1:172.21.15.142:6789/0 conn(0x7fa054145950 legacy=0x7fa0540d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.776 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 -- 172.21.15.142:0/4218434931 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054163db0 con 0x7fa0540d2be0 2022-01-24T07:01:10.777 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa052ffd700 1 -- 172.21.15.142:0/4218434931 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523286186 0 0) 0x7fa054163870 con 0x7fa054145950 2022-01-24T07:01:10.777 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa0537fe700 1 --2- 172.21.15.142:0/4218434931 >> v2:172.21.15.142:3300/0 conn(0x7fa0540d2fc0 0x7fa054145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:10.777 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa053fff700 1 --2- 172.21.15.142:0/4218434931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0540d2be0 0x7fa054162fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa044002f70 tx=0x7fa044006eb0).ready entity=mon.2 client_cookie=f1c11a9cb27390da server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.777 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa052ffd700 1 -- 172.21.15.142:0/4218434931 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400d570 con 0x7fa0540d2be0 2022-01-24T07:01:10.778 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa052ffd700 1 -- 172.21.15.142:0/4218434931 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044000e90 con 0x7fa0540d2be0 2022-01-24T07:01:10.778 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.772+0000 7fa052ffd700 1 -- 172.21.15.142:0/4218434931 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400d8c0 con 0x7fa0540d2be0 2022-01-24T07:01:10.778 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 -- 172.21.15.142:0/4218434931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0540d2be0 msgr2=0x7fa054162fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.778 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 --2- 172.21.15.142:0/4218434931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0540d2be0 0x7fa054162fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa044002f70 tx=0x7fa044006eb0).stop 2022-01-24T07:01:10.779 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 -- 172.21.15.142:0/4218434931 shutdown_connections 2022-01-24T07:01:10.779 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 --2- 172.21.15.142:0/4218434931 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0540d2be0 0x7fa054162fb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.779 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 --2- 172.21.15.142:0/4218434931 >> v2:172.21.15.142:3300/0 conn(0x7fa0540d2fc0 0x7fa054145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.779 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 -- 172.21.15.142:0/4218434931 >> 172.21.15.142:0/4218434931 conn(0x7fa054061970 msgr2=0x7fa05405fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.779 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 -- 172.21.15.142:0/4218434931 shutdown_connections 2022-01-24T07:01:10.780 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.773+0000 7fa05959c700 1 -- 172.21.15.142:0/4218434931 wait complete. 2022-01-24T07:01:10.780 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.774+0000 7fa05959c700 1 Processor -- start 2022-01-24T07:01:10.780 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.774+0000 7fa05959c700 1 -- start start 2022-01-24T07:01:10.783 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa05959c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0540d2be0 0x7fa0540d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.783 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa05959c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0540d2fc0 0x7fa05405b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.783 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa05959c700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa054145950 0x7fa0541461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.783 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa05959c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa054145de0 con 0x7fa0540d2fc0 2022-01-24T07:01:10.784 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa05959c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0540d6bd0 con 0x7fa0540d2be0 2022-01-24T07:01:10.784 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa05959c700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05416f270 con 0x7fa054145950 2022-01-24T07:01:10.784 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0540d2fc0 0x7fa05405b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.784 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0540d2fc0 0x7fa05405b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51100/0 (socket says 172.21.15.142:51100) 2022-01-24T07:01:10.785 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 -- 172.21.15.142:0/2285335591 learned_addr learned my addr 172.21.15.142:0/2285335591 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:10.785 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa058d9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa054145950 0x7fa0541461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.785 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa053fff700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0540d2be0 0x7fa0540d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.785 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 -- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa054145950 msgr2=0x7fa0541461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.785 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa054145950 0x7fa0541461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 -- 172.21.15.142:0/2285335591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0540d2be0 msgr2=0x7fa0540d66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0540d2be0 0x7fa0540d66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 -- 172.21.15.142:0/2285335591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04800b180 con 0x7fa0540d2fc0 2022-01-24T07:01:10.786 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0537fe700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0540d2fc0 0x7fa05405b6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa0540d6d10 tx=0x7fa048006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0517fa700 1 -- 172.21.15.142:0/2285335591 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04800c7e0 con 0x7fa0540d2fc0 2022-01-24T07:01:10.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0517fa700 1 -- 172.21.15.142:0/2285335591 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04800c940 con 0x7fa0540d2fc0 2022-01-24T07:01:10.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04400b1e0 con 0x7fa0540d2fc0 2022-01-24T07:01:10.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.775+0000 7fa0517fa700 1 -- 172.21.15.142:0/2285335591 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04800cca0 con 0x7fa0540d2fc0 2022-01-24T07:01:10.787 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.776+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05416fa50 con 0x7fa0540d2fc0 2022-01-24T07:01:10.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.776+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0540d0960 con 0x7fa0540d2fc0 2022-01-24T07:01:10.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.777+0000 7fa0517fa700 1 -- 172.21.15.142:0/2285335591 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fa04801c460 con 0x7fa0540d2fc0 2022-01-24T07:01:10.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.777+0000 7fa0517fa700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa034052ab0 0x7fa034054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:10.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.777+0000 7fa053fff700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa034052ab0 0x7fa034054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:10.788 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.777+0000 7fa0517fa700 1 -- 172.21.15.142:0/2285335591 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa04806b0e0 con 0x7fa0540d2fc0 2022-01-24T07:01:10.789 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.777+0000 7fa053fff700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa034052ab0 0x7fa034054f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa04401c000 tx=0x7fa044015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:10.789 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.781+0000 7fa0517fa700 1 -- 172.21.15.142:0/2285335591 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fa048042700 con 0x7fa0540d2fc0 2022-01-24T07:01:10.954 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.954+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa05416fd80 con 0x7fa0540d2fc0 2022-01-24T07:01:10.954 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.955+0000 7fa0517fa700 1 -- 172.21.15.142:0/2285335591 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4817 (secure 0 0 0) 0x7fa04800ce00 con 0x7fa0540d2fc0 2022-01-24T07:01:10.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:10.955 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-24T07:00:54.259086+0000","modified":"2022-01-24T07:01:09.337995+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":9,"in":[0,1,2,3,4,5,6,7,8],"up":{"mds_0":4309,"mds_1":4315,"mds_2":4306,"mds_3":4279,"mds_4":4276,"mds_5":4272,"mds_6":4269,"mds_7":4244,"mds_8":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"h","rank":8,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6833/4266718599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4266718599},{"type":"v1","addr":"172.21.15.145:6833","nonce":4266718599}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4244":{"gid":4244,"name":"g","rank":7,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.145:6836/2250566993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":2250566993},{"type":"v1","addr":"172.21.15.145:6836","nonce":2250566993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4269":{"gid":4269,"name":"c","rank":6,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6839/3496603446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":3496603446},{"type":"v1","addr":"172.21.15.142:6839","nonce":3496603446}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4272":{"gid":4272,"name":"d","rank":5,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3300581089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3300581089},{"type":"v1","addr":"172.21.15.142:6841","nonce":3300581089}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4276":{"gid":4276,"name":"b","rank":4,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6836/2798136120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2798136120},{"type":"v1","addr":"172.21.15.142:6836","nonce":2798136120}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4279":{"gid":4279,"name":"a","rank":3,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2315856698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2315856698},{"type":"v1","addr":"172.21.15.142:6837","nonce":2315856698}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4306":{"gid":4306,"name":"f","rank":2,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3395087110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3395087110},{"type":"v1","addr":"172.21.15.145:6837","nonce":3395087110}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4309":{"gid":4309,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.145:6839/2894168765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":2894168765},{"type":"v1","addr":"172.21.15.145:6839","nonce":2894168765}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4315":{"gid":4315,"name":"i","rank":1,"incarnation":7,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6841/1371026810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6840","nonce":1371026810},{"type":"v1","addr":"172.21.15.145:6841","nonce":1371026810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-24T07:01:10.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.956+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa034052ab0 msgr2=0x7fa034054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.956+0000 7fa05959c700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa034052ab0 0x7fa034054f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa04401c000 tx=0x7fa044015000).stop 2022-01-24T07:01:10.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.956+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0540d2fc0 msgr2=0x7fa05405b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:10.957 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.956+0000 7fa05959c700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0540d2fc0 0x7fa05405b6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa0540d6d10 tx=0x7fa048006df0).stop 2022-01-24T07:01:10.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 shutdown_connections 2022-01-24T07:01:10.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa0540d2be0 0x7fa0540d66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fa034052ab0 0x7fa034054f70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.958 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa054145950 0x7fa0541461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 --2- 172.21.15.142:0/2285335591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0540d2fc0 0x7fa05405b6b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:10.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 >> 172.21.15.142:0/2285335591 conn(0x7fa054061970 msgr2=0x7fa054141650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:10.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 shutdown_connections 2022-01-24T07:01:10.959 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:10.957+0000 7fa05959c700 1 -- 172.21.15.142:0/2285335591 wait complete. 2022-01-24T07:01:10.959 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2022-01-24T07:01:11.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-24T07:00:54.259086+0000', 'modified': '2022-01-24T07:01:09.337995+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 9, 'in': [0, 1, 2, 3, 4, 5, 6, 7, 8], 'up': {'mds_0': 4309, 'mds_1': 4315, 'mds_2': 4306, 'mds_3': 4279, 'mds_4': 4276, 'mds_5': 4272, 'mds_6': 4269, 'mds_7': 4244, 'mds_8': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'h', 'rank': 8, 'incarnation': 21, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.145:6833/4266718599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 4266718599}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 4266718599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4244': {'gid': 4244, 'name': 'g', 'rank': 7, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.145:6836/2250566993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 2250566993}, {'type': 'v1', 'addr': '172.21.15.145:6836', 'nonce': 2250566993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4269': {'gid': 4269, 'name': 'c', 'rank': 6, 'incarnation': 17, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6839/3496603446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6838', 'nonce': 3496603446}, {'type': 'v1', 'addr': '172.21.15.142:6839', 'nonce': 3496603446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4272': {'gid': 4272, 'name': 'd', 'rank': 5, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6841/3300581089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6840', 'nonce': 3300581089}, {'type': 'v1', 'addr': '172.21.15.142:6841', 'nonce': 3300581089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 4, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6836/2798136120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 2798136120}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 2798136120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4279': {'gid': 4279, 'name': 'a', 'rank': 3, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/2315856698', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 2315856698}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2315856698}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4306': {'gid': 4306, 'name': 'f', 'rank': 2, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6837/3395087110', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6835', 'nonce': 3395087110}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 3395087110}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4309': {'gid': 4309, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.145:6839/2894168765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 2894168765}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 2894168765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4315': {'gid': 4315, 'name': 'i', 'rank': 1, 'incarnation': 7, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6841/1371026810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6840', 'nonce': 1371026810}, {'type': 'v1', 'addr': '172.21.15.145:6841', 'nonce': 1371026810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-24T07:01:11.875 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 9/9 2022-01-24T07:01:11.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok --format=json status 2022-01-24T07:01:12.005 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":8,"id":4241,"want_state":"up:active","state":"up:active","rank_uptime":8.6763638390000004,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.043668871000001} 2022-01-24T07:01:12.005 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4241, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 8.676363839, "state": "up:active", "uptime": 21.043668871, "want_state": "up:active", "whoami": 8 } 2022-01-24T07:01:12.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok --format=json status 2022-01-24T07:01:12.123 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":7,"id":4244,"want_state":"up:active","state":"up:active","rank_uptime":9.8041439280000002,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.159559303000002} 2022-01-24T07:01:12.123 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4244, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 9.804143928, "state": "up:active", "uptime": 21.159559303, "want_state": "up:active", "whoami": 7 } 2022-01-24T07:01:12.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-24T07:01:12.254 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":6,"id":4269,"want_state":"up:active","state":"up:active","rank_uptime":10.940870463,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.300754612999999} 2022-01-24T07:01:12.254 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4269, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 10.940870463, "state": "up:active", "uptime": 21.300754613, "want_state": "up:active", "whoami": 6 } 2022-01-24T07:01:12.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2022-01-24T07:01:12.374 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":5,"id":4272,"want_state":"up:active","state":"up:active","rank_uptime":12.067664581000001,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.418325587999998} 2022-01-24T07:01:12.374 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4272, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 12.067664581, "state": "up:active", "uptime": 21.418325588, "want_state": "up:active", "whoami": 5 } 2022-01-24T07:01:12.375 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-24T07:01:12.492 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":4,"id":4276,"want_state":"up:active","state":"up:active","rank_uptime":13.187419662,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.563470805000001} 2022-01-24T07:01:12.492 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4276, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 13.187419662, "state": "up:active", "uptime": 21.563470805, "want_state": "up:active", "whoami": 4 } 2022-01-24T07:01:12.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-24T07:01:12.609 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":3,"id":4279,"want_state":"up:active","state":"up:active","rank_uptime":14.312679787,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.680372686999998} 2022-01-24T07:01:12.609 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4279, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 14.312679787, "state": "up:active", "uptime": 21.680372687, "want_state": "up:active", "whoami": 3 } 2022-01-24T07:01:12.610 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok --format=json status 2022-01-24T07:01:12.729 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":2,"id":4306,"want_state":"up:active","state":"up:active","rank_uptime":15.437380206,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.764557050000001} 2022-01-24T07:01:12.729 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4306, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 15.437380206, "state": "up:active", "uptime": 21.76455705, "want_state": "up:active", "whoami": 2 } 2022-01-24T07:01:12.730 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok --format=json status 2022-01-24T07:01:12.846 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":0,"id":4309,"want_state":"up:active","state":"up:active","rank_uptime":18.577622535,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.879255042} 2022-01-24T07:01:12.847 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4309, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 18.577622535, "state": "up:active", "uptime": 21.879255042, "want_state": "up:active", "whoami": 0 } 2022-01-24T07:01:12.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok --format=json status 2022-01-24T07:01:12.964 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":1,"id":4315,"want_state":"up:active","state":"up:active","rank_uptime":16.681344963000001,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":21.98946308} 2022-01-24T07:01:12.965 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4315, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 16.681344963, "state": "up:active", "uptime": 21.98946308, "want_state": "up:active", "whoami": 1 } 2022-01-24T07:01:12.965 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2022-01-24T07:01:12.966 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.0 at ubuntu@smithi164.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-24T07:01:12.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-24T07:01:12.966 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p /home/ubuntu/cephtest/mnt.0 2022-01-24T07:01:13.015 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-24T07:01:13.015 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2022-01-24T07:01:13.157 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2022-01-24T07:01:13.158 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2022-01-24T07:01:13.643 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,name=0,norequire_active_mds,conf=/etc/ceph/ceph.conf 2022-01-24T07:01:13.643 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2022-01-24T07:01:13.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-24T07:01:13.651 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-01-24T07:01:13.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-24T07:01:13.840 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.841+0000 7fdffcc26700 1 Processor -- start 2022-01-24T07:01:13.840 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.841+0000 7fdffcc26700 1 -- start start 2022-01-24T07:01:13.843 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdffcc26700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fdff8148dc0 0x7fdff805b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:13.843 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdffcc26700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdff80603a0 0x7fdff805b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:13.844 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdffcc26700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff8060890 con 0x7fdff81489e0 2022-01-24T07:01:13.844 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdffcc26700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff8060b30 con 0x7fdff80603a0 2022-01-24T07:01:13.844 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdffcc26700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff8060dd0 con 0x7fdff8148dc0 2022-01-24T07:01:13.844 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff7fff700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdff80603a0 0x7fdff805b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:13.845 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff77fe700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdff81489e0 0x7fdff805fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48528/0 (socket says 172.21.15.142:48528) 2022-01-24T07:01:13.845 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff77fe700 1 -- 172.21.15.142:0/2847029900 learned_addr learned my addr 172.21.15.142:0/2847029900 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:13.845 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff7fff700 1 --2- 172.21.15.142:0/2847029900 >> v2:172.21.15.142:3300/0 conn(0x7fdff80603a0 0x7fdff805b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51168/0 (socket says 172.21.15.142:51168) 2022-01-24T07:01:13.845 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdfeeffd700 1 --2- 172.21.15.142:0/2847029900 >> v2:172.21.15.145:3300/0 conn(0x7fdff8148dc0 0x7fdff805b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:13.845 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff7fff700 1 -- 172.21.15.142:0/2847029900 >> v2:172.21.15.145:3300/0 conn(0x7fdff8148dc0 msgr2=0x7fdff805b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:13.846 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff7fff700 1 --2- 172.21.15.142:0/2847029900 >> v2:172.21.15.145:3300/0 conn(0x7fdff8148dc0 0x7fdff805b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.846 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff7fff700 1 -- 172.21.15.142:0/2847029900 >> v1:172.21.15.142:6789/0 conn(0x7fdff81489e0 legacy=0x7fdff805fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:13.846 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff6ffd700 1 -- 172.21.15.142:0/2847029900 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660373278 0 0) 0x7fdff8060890 con 0x7fdff81489e0 2022-01-24T07:01:13.846 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff7fff700 1 -- 172.21.15.142:0/2847029900 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8061070 con 0x7fdff80603a0 2022-01-24T07:01:13.847 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff7fff700 1 --2- 172.21.15.142:0/2847029900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff80603a0 0x7fdff805b820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdff00032f0 tx=0x7fdff00091d0).ready entity=mon.0 client_cookie=bdb18d0a3081f44e server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:13.847 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff6ffd700 1 -- 172.21.15.142:0/2847029900 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdff000b680 con 0x7fdff80603a0 2022-01-24T07:01:13.847 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff6ffd700 1 -- 172.21.15.142:0/2847029900 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff000b7e0 con 0x7fdff80603a0 2022-01-24T07:01:13.847 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.842+0000 7fdff6ffd700 1 -- 172.21.15.142:0/2847029900 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdff000b950 con 0x7fdff80603a0 2022-01-24T07:01:13.848 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 -- 172.21.15.142:0/2847029900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff80603a0 msgr2=0x7fdff805b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:13.848 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 --2- 172.21.15.142:0/2847029900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff80603a0 0x7fdff805b820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdff00032f0 tx=0x7fdff00091d0).stop 2022-01-24T07:01:13.848 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 -- 172.21.15.142:0/2847029900 shutdown_connections 2022-01-24T07:01:13.848 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 --2- 172.21.15.142:0/2847029900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff80603a0 0x7fdff805b820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.849 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 --2- 172.21.15.142:0/2847029900 >> v2:172.21.15.145:3300/0 conn(0x7fdff8148dc0 0x7fdff805b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.849 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 -- 172.21.15.142:0/2847029900 >> 172.21.15.142:0/2847029900 conn(0x7fdff80677d0 msgr2=0x7fdff8067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:13.849 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 -- 172.21.15.142:0/2847029900 shutdown_connections 2022-01-24T07:01:13.849 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.843+0000 7fdffcc26700 1 -- 172.21.15.142:0/2847029900 wait complete. 2022-01-24T07:01:13.850 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.844+0000 7fdffcc26700 1 Processor -- start 2022-01-24T07:01:13.850 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.844+0000 7fdffcc26700 1 -- start start 2022-01-24T07:01:13.853 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdffcc26700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff80603a0 0x7fdff80cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:13.853 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdffcc26700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff81489e0 0x7fdff816f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:13.853 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdffcc26700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdff8148dc0 0x7fdff816f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:13.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdffcc26700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80ccd40 con 0x7fdff81489e0 2022-01-24T07:01:13.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdffcc26700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff816fbe0 con 0x7fdff80603a0 2022-01-24T07:01:13.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdffcc26700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80cc020 con 0x7fdff8148dc0 2022-01-24T07:01:13.854 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff81489e0 0x7fdff816f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:13.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff81489e0 0x7fdff816f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51172/0 (socket says 172.21.15.142:51172) 2022-01-24T07:01:13.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdff7fff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdff8148dc0 0x7fdff816f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:13.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 -- 172.21.15.142:0/3482310665 learned_addr learned my addr 172.21.15.142:0/3482310665 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:13.855 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdff77fe700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff80603a0 0x7fdff80cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:13.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 -- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdff8148dc0 msgr2=0x7fdff816f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:13.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdff8148dc0 0x7fdff816f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 -- 172.21.15.142:0/3482310665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff80603a0 msgr2=0x7fdff80cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:13.856 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff80603a0 0x7fdff80cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 -- 172.21.15.142:0/3482310665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009470 con 0x7fdff81489e0 2022-01-24T07:01:13.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.845+0000 7fdfeeffd700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff81489e0 0x7fdff816f200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdfe000c000 tx=0x7fdfe0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:13.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.846+0000 7fdff57fa700 1 -- 172.21.15.142:0/3482310665 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe0010780 con 0x7fdff81489e0 2022-01-24T07:01:13.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.846+0000 7fdff57fa700 1 -- 172.21.15.142:0/3482310665 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe00108e0 con 0x7fdff81489e0 2022-01-24T07:01:13.857 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.846+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff80cc2c0 con 0x7fdff81489e0 2022-01-24T07:01:13.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.846+0000 7fdff57fa700 1 -- 172.21.15.142:0/3482310665 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe0010c40 con 0x7fdff81489e0 2022-01-24T07:01:13.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.846+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff80cc800 con 0x7fdff81489e0 2022-01-24T07:01:13.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.847+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff8061310 con 0x7fdff81489e0 2022-01-24T07:01:13.858 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.847+0000 7fdff57fa700 1 -- 172.21.15.142:0/3482310665 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fdfe001b410 con 0x7fdff81489e0 2022-01-24T07:01:13.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.847+0000 7fdff57fa700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fdfdc052c00 0x7fdfdc0550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:13.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.847+0000 7fdff57fa700 1 -- 172.21.15.142:0/3482310665 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdfe006ab40 con 0x7fdff81489e0 2022-01-24T07:01:13.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.847+0000 7fdff77fe700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fdfdc052c00 0x7fdfdc0550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:13.859 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.848+0000 7fdff77fe700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fdfdc052c00 0x7fdfdc0550c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fdfe800d000 tx=0x7fdfe80011a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:13.860 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.851+0000 7fdff57fa700 1 -- 172.21.15.142:0/3482310665 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fdfe0042160 con 0x7fdff81489e0 2022-01-24T07:01:13.981 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.981+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdff8057950 con 0x7fdff81489e0 2022-01-24T07:01:13.981 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.982+0000 7fdff57fa700 1 -- 172.21.15.142:0/3482310665 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16134 (secure 0 0 0) 0x7fdfe0045780 con 0x7fdff81489e0 2022-01-24T07:01:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:13.982 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","created":"2022-01-24T07:00:36.989479+0000","modified":"2022-01-24T07:00:56.271262+0000","last_up_change":"2022-01-24T07:00:45.777534+0000","last_in_change":"2022-01-24T07:00:45.777534+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-24T07:00:40.161690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-24T07:00:49.517379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-24T07:00:52.172405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-24T07:00:53.230682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e16b2f5c-9c86-4748-8627-15c008bbfed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":65050},{"type":"v1","addr":"172.21.15.142:6803","nonce":65050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":65050},{"type":"v1","addr":"172.21.15.142:6805","nonce":65050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":65050},{"type":"v1","addr":"172.21.15.142:6809","nonce":65050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":65050},{"type":"v1","addr":"172.21.15.142:6807","nonce":65050}]},"public_addr":"172.21.15.142:6803/65050","cluster_addr":"172.21.15.142:6805/65050","heartbeat_back_addr":"172.21.15.142:6809/65050","heartbeat_front_addr":"172.21.15.142:6807/65050","state":["exists","up"]},{"osd":1,"uuid":"6fcbaa78-aa8b-475e-b2ae-b63e7641d31b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":65051},{"type":"v1","addr":"172.21.15.142:6811","nonce":65051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":65051},{"type":"v1","addr":"172.21.15.142:6813","nonce":65051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":65051},{"type":"v1","addr":"172.21.15.142:6817","nonce":65051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":65051},{"type":"v1","addr":"172.21.15.142:6815","nonce":65051}]},"public_addr":"172.21.15.142:6811/65051","cluster_addr":"172.21.15.142:6813/65051","heartbeat_back_addr":"172.21.15.142:6817/65051","heartbeat_front_addr":"172.21.15.142:6815/65051","state":["exists","up"]},{"osd":2,"uuid":"3fd2b441-dae7-4882-bcba-00ca52360135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":65052},{"type":"v1","addr":"172.21.15.142:6819","nonce":65052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":65052},{"type":"v1","addr":"172.21.15.142:6824","nonce":65052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6831","nonce":65052},{"type":"v1","addr":"172.21.15.142:6833","nonce":65052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":65052},{"type":"v1","addr":"172.21.15.142:6828","nonce":65052}]},"public_addr":"172.21.15.142:6819/65052","cluster_addr":"172.21.15.142:6824/65052","heartbeat_back_addr":"172.21.15.142:6833/65052","heartbeat_front_addr":"172.21.15.142:6828/65052","state":["exists","up"]},{"osd":3,"uuid":"deacbe82-2885-48a4-9b0d-29bd8ecf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":65053},{"type":"v1","addr":"172.21.15.142:6822","nonce":65053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6823","nonce":65053},{"type":"v1","addr":"172.21.15.142:6825","nonce":65053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":65053},{"type":"v1","addr":"172.21.15.142:6832","nonce":65053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6827","nonce":65053},{"type":"v1","addr":"172.21.15.142:6829","nonce":65053}]},"public_addr":"172.21.15.142:6822/65053","cluster_addr":"172.21.15.142:6825/65053","heartbeat_back_addr":"172.21.15.142:6832/65053","heartbeat_front_addr":"172.21.15.142:6829/65053","state":["exists","up"]},{"osd":4,"uuid":"e048cf98-4a69-4dcc-8c4b-78671d4a6d9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":65085},{"type":"v1","addr":"172.21.15.145:6801","nonce":65085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":65085},{"type":"v1","addr":"172.21.15.145:6803","nonce":65085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":65085},{"type":"v1","addr":"172.21.15.145:6807","nonce":65085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":65085},{"type":"v1","addr":"172.21.15.145:6805","nonce":65085}]},"public_addr":"172.21.15.145:6801/65085","cluster_addr":"172.21.15.145:6803/65085","heartbeat_back_addr":"172.21.15.145:6807/65085","heartbeat_front_addr":"172.21.15.145:6805/65085","state":["exists","up"]},{"osd":5,"uuid":"b38df368-4f6b-4a11-9138-ac98ba45681d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":65086},{"type":"v1","addr":"172.21.15.145:6809","nonce":65086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":65086},{"type":"v1","addr":"172.21.15.145:6811","nonce":65086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":65086},{"type":"v1","addr":"172.21.15.145:6817","nonce":65086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":65086},{"type":"v1","addr":"172.21.15.145:6813","nonce":65086}]},"public_addr":"172.21.15.145:6809/65086","cluster_addr":"172.21.15.145:6811/65086","heartbeat_back_addr":"172.21.15.145:6817/65086","heartbeat_front_addr":"172.21.15.145:6813/65086","state":["exists","up"]},{"osd":6,"uuid":"77268ca3-fb1a-4265-b96f-d348f8ad8048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6815","nonce":65087},{"type":"v1","addr":"172.21.15.145:6818","nonce":65087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":65087},{"type":"v1","addr":"172.21.15.145:6822","nonce":65087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":65087},{"type":"v1","addr":"172.21.15.145:6830","nonce":65087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":65087},{"type":"v1","addr":"172.21.15.145:6826","nonce":65087}]},"public_addr":"172.21.15.145:6818/65087","cluster_addr":"172.21.15.145:6822/65087","heartbeat_back_addr":"172.21.15.145:6830/65087","heartbeat_front_addr":"172.21.15.145:6826/65087","state":["exists","up"]},{"osd":7,"uuid":"5281ba5d-beaa-4023-b892-b2e460eacb5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":65088},{"type":"v1","addr":"172.21.15.145:6819","nonce":65088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6821","nonce":65088},{"type":"v1","addr":"172.21.15.145:6823","nonce":65088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6829","nonce":65088},{"type":"v1","addr":"172.21.15.145:6831","nonce":65088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6825","nonce":65088},{"type":"v1","addr":"172.21.15.145:6827","nonce":65088}]},"public_addr":"172.21.15.145:6819/65088","cluster_addr":"172.21.15.145:6823/65088","heartbeat_back_addr":"172.21.15.145:6831/65088","heartbeat_front_addr":"172.21.15.145:6827/65088","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.699294+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.727349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.742195+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.753769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.793544+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.826922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.773753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-24T07:00:43.832282+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-24T07:01:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fdfdc052c00 msgr2=0x7fdfdc0550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fdfdc052c00 0x7fdfdc0550c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fdfe800d000 tx=0x7fdfe80011a0).stop 2022-01-24T07:01:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff81489e0 msgr2=0x7fdff816f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff81489e0 0x7fdff816f200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdfe000c000 tx=0x7fdfe0006df0).stop 2022-01-24T07:01:13.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 shutdown_connections 2022-01-24T07:01:13.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdff80603a0 0x7fdff80cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fdfdc052c00 0x7fdfdc0550c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.985 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdff8148dc0 0x7fdff816f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 --2- 172.21.15.142:0/3482310665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdff81489e0 0x7fdff816f200 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 >> 172.21.15.142:0/3482310665 conn(0x7fdff80677d0 msgr2=0x7fdff815cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:13.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 shutdown_connections 2022-01-24T07:01:13.987 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:13.984+0000 7fdffcc26700 1 -- 172.21.15.142:0/3482310665 wait complete. 2022-01-24T07:01:13.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-24T07:00:40.161690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-24T07:00:49.517379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-24T07:00:52.172405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-24T07:00:53.230682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-24T07:01:13.995 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-24T07:01:14.096 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.097+0000 7f0e52691700 1 Processor -- start 2022-01-24T07:01:14.096 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.097+0000 7f0e52691700 1 -- start start 2022-01-24T07:01:14.099 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e52691700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.099 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e52691700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7f0e4c0d0f50 0x7f0e4c13f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.100 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e52691700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0634b0 con 0x7f0e4c062fe0 2022-01-24T07:01:14.100 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e52691700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c067b90 con 0x7f0e4c0d0f50 2022-01-24T07:01:14.100 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e52691700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c063750 con 0x7f0e4c0d0b70 2022-01-24T07:01:14.100 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.100 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53940/0 (socket says 172.21.15.142:53940) 2022-01-24T07:01:14.101 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 -- 172.21.15.142:0/4146841156 learned_addr learned my addr 172.21.15.142:0/4146841156 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.101 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e50c2e700 1 --2- 172.21.15.142:0/4146841156 >> v2:172.21.15.145:3300/0 conn(0x7f0e4c0d0f50 0x7f0e4c13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.101 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 -- 172.21.15.142:0/4146841156 >> v2:172.21.15.145:3300/0 conn(0x7f0e4c0d0f50 msgr2=0x7f0e4c13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:14.102 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 --2- 172.21.15.142:0/4146841156 >> v2:172.21.15.145:3300/0 conn(0x7f0e4c0d0f50 0x7f0e4c13f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.102 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 -- 172.21.15.142:0/4146841156 >> v1:172.21.15.145:6789/0 conn(0x7f0e4c062fe0 legacy=0x7f0e4c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.102 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 -- 172.21.15.142:0/4146841156 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0639f0 con 0x7f0e4c0d0b70 2022-01-24T07:01:14.103 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4bfff700 1 --2- 172.21.15.142:0/4146841156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c064670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0e3c002f70 tx=0x7f0e3c006eb0).ready entity=mon.2 client_cookie=7c1445553d5892bc server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.103 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4affd700 1 -- 172.21.15.142:0/4146841156 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3c00d5c0 con 0x7f0e4c0d0b70 2022-01-24T07:01:14.104 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4affd700 1 -- 172.21.15.142:0/4146841156 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c000e90 con 0x7f0e4c0d0b70 2022-01-24T07:01:14.104 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.098+0000 7f0e4affd700 1 -- 172.21.15.142:0/4146841156 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3c00d950 con 0x7f0e4c0d0b70 2022-01-24T07:01:14.105 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 -- 172.21.15.142:0/4146841156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 msgr2=0x7f0e4c064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.105 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 --2- 172.21.15.142:0/4146841156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c064670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0e3c002f70 tx=0x7f0e3c006eb0).stop 2022-01-24T07:01:14.105 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 -- 172.21.15.142:0/4146841156 shutdown_connections 2022-01-24T07:01:14.106 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 --2- 172.21.15.142:0/4146841156 >> v2:172.21.15.145:3300/0 conn(0x7f0e4c0d0f50 0x7f0e4c13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.106 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 --2- 172.21.15.142:0/4146841156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c064670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.106 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 -- 172.21.15.142:0/4146841156 >> 172.21.15.142:0/4146841156 conn(0x7f0e4c061ea0 msgr2=0x7f0e4c0622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:14.107 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 -- 172.21.15.142:0/4146841156 shutdown_connections 2022-01-24T07:01:14.107 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.099+0000 7f0e52691700 1 -- 172.21.15.142:0/4146841156 wait complete. 2022-01-24T07:01:14.107 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.100+0000 7f0e52691700 1 Processor -- start 2022-01-24T07:01:14.108 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.100+0000 7f0e52691700 1 -- start start 2022-01-24T07:01:14.111 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e52691700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4c062fe0 0x7f0e4c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.111 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e52691700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c132f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.111 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e52691700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c0d0f50 0x7f0e4c15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.111 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e52691700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c16db90 con 0x7f0e4c062fe0 2022-01-24T07:01:14.112 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e52691700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c16cbd0 con 0x7f0e4c0d0f50 2022-01-24T07:01:14.112 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e52691700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c16ce70 con 0x7f0e4c0d0b70 2022-01-24T07:01:14.112 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c132f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.112 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4c062fe0 0x7f0e4c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.113 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4b7fe700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c132f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53946/0 (socket says 172.21.15.142:53946) 2022-01-24T07:01:14.113 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4b7fe700 1 -- 172.21.15.142:0/3182069953 learned_addr learned my addr 172.21.15.142:0/3182069953 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.113 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e50c2e700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c0d0f50 0x7f0e4c15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.113 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4bfff700 1 -- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 msgr2=0x7f0e4c132f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.113 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4bfff700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c132f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.114 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4bfff700 1 -- 172.21.15.142:0/3182069953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c0d0f50 msgr2=0x7f0e4c15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.114 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4bfff700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c0d0f50 0x7f0e4c15f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.114 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4bfff700 1 -- 172.21.15.142:0/3182069953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c00b1e0 con 0x7f0e4c062fe0 2022-01-24T07:01:14.114 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4b7fe700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c132f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:14.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e50c2e700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c0d0f50 0x7f0e4c15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:14.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.101+0000 7f0e4bfff700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4c062fe0 0x7f0e4c0cc780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0e3c002f70 tx=0x7f0e3c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.102+0000 7f0e497fa700 1 -- 172.21.15.142:0/3182069953 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3c0117e0 con 0x7f0e4c062fe0 2022-01-24T07:01:14.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.102+0000 7f0e497fa700 1 -- 172.21.15.142:0/3182069953 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c011940 con 0x7f0e4c062fe0 2022-01-24T07:01:14.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.102+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c16d110 con 0x7f0e4c062fe0 2022-01-24T07:01:14.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.102+0000 7f0e497fa700 1 -- 172.21.15.142:0/3182069953 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3c011ca0 con 0x7f0e4c062fe0 2022-01-24T07:01:14.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.102+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c16d650 con 0x7f0e4c062fe0 2022-01-24T07:01:14.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.103+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c063c90 con 0x7f0e4c062fe0 2022-01-24T07:01:14.117 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.103+0000 7f0e497fa700 1 -- 172.21.15.142:0/3182069953 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f0e3c025030 con 0x7f0e4c062fe0 2022-01-24T07:01:14.117 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.103+0000 7f0e497fa700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0e2c052c60 0x7f0e2c055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.117 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.103+0000 7f0e497fa700 1 -- 172.21.15.142:0/3182069953 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0e3c06bbb0 con 0x7f0e4c062fe0 2022-01-24T07:01:14.117 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.103+0000 7f0e4b7fe700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0e2c052c60 0x7f0e2c055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.117 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.103+0000 7f0e4b7fe700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0e2c052c60 0x7f0e2c055120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0e4000d000 tx=0x7f0e40009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.118 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.107+0000 7f0e497fa700 1 -- 172.21.15.142:0/3182069953 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f0e3c072080 con 0x7f0e4c062fe0 2022-01-24T07:01:14.236 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.237+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0e4c057950 con 0x7f0e4c062fe0 2022-01-24T07:01:14.237 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.237+0000 7f0e497fa700 1 -- 172.21.15.142:0/3182069953 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0e3c023020 con 0x7f0e4c062fe0 2022-01-24T07:01:14.237 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2022-01-24T07:01:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0e2c052c60 msgr2=0x7f0e2c055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0e2c052c60 0x7f0e2c055120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0e4000d000 tx=0x7f0e40009040).stop 2022-01-24T07:01:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4c062fe0 msgr2=0x7f0e4c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4c062fe0 0x7f0e4c0cc780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0e3c002f70 tx=0x7f0e3c015000).stop 2022-01-24T07:01:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 shutdown_connections 2022-01-24T07:01:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e4c0d0f50 0x7f0e4c15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0e2c052c60 0x7f0e2c055120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e4c062fe0 0x7f0e4c0cc780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 --2- 172.21.15.142:0/3182069953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4c0d0b70 0x7f0e4c132f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 >> 172.21.15.142:0/3182069953 conn(0x7f0e4c061ea0 msgr2=0x7f0e4c139d60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 shutdown_connections 2022-01-24T07:01:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.239+0000 7f0e52691700 1 -- 172.21.15.142:0/3182069953 wait complete. 2022-01-24T07:01:14.249 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-24T07:01:14.352 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.353+0000 7f0e078a6700 1 Processor -- start 2022-01-24T07:01:14.353 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.353+0000 7f0e078a6700 1 -- start start 2022-01-24T07:01:14.356 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e078a6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e000c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.356 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e078a6700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e00064470 0x7f0e000ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.356 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e078a6700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e000632b0 con 0x7f0e000d07f0 2022-01-24T07:01:14.357 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e078a6700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e00067b90 con 0x7f0e00064470 2022-01-24T07:01:14.357 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e078a6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e00063550 con 0x7f0e00142120 2022-01-24T07:01:14.357 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e05642700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e000c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.357 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e04e41700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e00064470 0x7f0e000ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.358 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e04e41700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e00064470 0x7f0e000ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51194/0 (socket says 172.21.15.142:51194) 2022-01-24T07:01:14.358 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.354+0000 7f0e05642700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e000c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53954/0 (socket says 172.21.15.142:53954) 2022-01-24T07:01:14.358 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e04e41700 1 -- 172.21.15.142:0/3909270485 learned_addr learned my addr 172.21.15.142:0/3909270485 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.358 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e05642700 1 -- 172.21.15.142:0/3909270485 >> v2:172.21.15.142:3300/0 conn(0x7f0e00064470 msgr2=0x7f0e000ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:14.358 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e05642700 1 --2- 172.21.15.142:0/3909270485 >> v2:172.21.15.142:3300/0 conn(0x7f0e00064470 0x7f0e000ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e05642700 1 -- 172.21.15.142:0/3909270485 >> v1:172.21.15.145:6789/0 conn(0x7f0e000d07f0 legacy=0x7f0e000d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e05642700 1 -- 172.21.15.142:0/3909270485 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e000637f0 con 0x7f0e00142120 2022-01-24T07:01:14.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e05642700 1 --2- 172.21.15.142:0/3909270485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e000c95e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc006df0).ready entity=mon.2 client_cookie=7e07f49c807a9442 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.359 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0deffff700 1 -- 172.21.15.142:0/3909270485 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00d570 con 0x7f0e00142120 2022-01-24T07:01:14.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0deffff700 1 -- 172.21.15.142:0/3909270485 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc000e90 con 0x7f0e00142120 2022-01-24T07:01:14.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0deffff700 1 -- 172.21.15.142:0/3909270485 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00d8c0 con 0x7f0e00142120 2022-01-24T07:01:14.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e078a6700 1 -- 172.21.15.142:0/3909270485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 msgr2=0x7f0e000c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.355+0000 7f0e078a6700 1 --2- 172.21.15.142:0/3909270485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e000c95e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc006df0).stop 2022-01-24T07:01:14.360 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.356+0000 7f0e078a6700 1 -- 172.21.15.142:0/3909270485 shutdown_connections 2022-01-24T07:01:14.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.356+0000 7f0e078a6700 1 --2- 172.21.15.142:0/3909270485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e000c95e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.356+0000 7f0e078a6700 1 --2- 172.21.15.142:0/3909270485 >> v2:172.21.15.142:3300/0 conn(0x7f0e00064470 0x7f0e000ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.356+0000 7f0e078a6700 1 -- 172.21.15.142:0/3909270485 >> 172.21.15.142:0/3909270485 conn(0x7f0e00061ea0 msgr2=0x7f0e000622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:14.361 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.356+0000 7f0e078a6700 1 -- 172.21.15.142:0/3909270485 shutdown_connections 2022-01-24T07:01:14.362 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.356+0000 7f0e078a6700 1 -- 172.21.15.142:0/3909270485 wait complete. 2022-01-24T07:01:14.362 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.357+0000 7f0e078a6700 1 Processor -- start 2022-01-24T07:01:14.362 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.357+0000 7f0e078a6700 1 -- start start 2022-01-24T07:01:14.365 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.357+0000 7f0e078a6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e00064470 0x7f0e0016fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.365 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.357+0000 7f0e078a6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000d07f0 0x7f0e000cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.365 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.357+0000 7f0e078a6700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e0013ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.366 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e078a6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e00170300 con 0x7f0e00064470 2022-01-24T07:01:14.366 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e078a6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000cd8c0 con 0x7f0e000d07f0 2022-01-24T07:01:14.366 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e078a6700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000cdb60 con 0x7f0e00142120 2022-01-24T07:01:14.366 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e00064470 0x7f0e0016fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.367 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e00064470 0x7f0e0016fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51198/0 (socket says 172.21.15.142:51198) 2022-01-24T07:01:14.367 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 -- 172.21.15.142:0/2264092580 learned_addr learned my addr 172.21.15.142:0/2264092580 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.367 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05e43700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e0013ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.367 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e04e41700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000d07f0 0x7f0e000cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.368 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 -- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 msgr2=0x7f0e0013ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.368 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e0013ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.368 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 -- 172.21.15.142:0/2264092580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000d07f0 msgr2=0x7f0e000cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.368 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000d07f0 0x7f0e000cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.369 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 -- 172.21.15.142:0/2264092580 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc00b180 con 0x7f0e00064470 2022-01-24T07:01:14.369 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e05642700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e00064470 0x7f0e0016fab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.369 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0dee7fc700 1 -- 172.21.15.142:0/2264092580 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00dea0 con 0x7f0e00064470 2022-01-24T07:01:14.369 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0dee7fc700 1 -- 172.21.15.142:0/2264092580 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc013e90 con 0x7f0e00064470 2022-01-24T07:01:14.369 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e000cde00 con 0x7f0e00064470 2022-01-24T07:01:14.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0dee7fc700 1 -- 172.21.15.142:0/2264092580 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc01e5f0 con 0x7f0e00064470 2022-01-24T07:01:14.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.358+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e000cb620 con 0x7f0e00064470 2022-01-24T07:01:14.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.359+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e00057950 con 0x7f0e00064470 2022-01-24T07:01:14.370 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.359+0000 7f0dee7fc700 1 -- 172.21.15.142:0/2264092580 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f0dfc025030 con 0x7f0e00064470 2022-01-24T07:01:14.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.360+0000 7f0dee7fc700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0de0052c60 0x7f0de0055120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.360+0000 7f0dee7fc700 1 -- 172.21.15.142:0/2264092580 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0dfc06b980 con 0x7f0e00064470 2022-01-24T07:01:14.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.360+0000 7f0e04e41700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0de0052c60 0x7f0de0055120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.360+0000 7f0e04e41700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0de0052c60 0x7f0de0055120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0df0008000 tx=0x7f0df0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.371 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.363+0000 7f0dee7fc700 1 -- 172.21.15.142:0/2264092580 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f0dfc042f90 con 0x7f0e00064470 2022-01-24T07:01:14.492 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.493+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e000ce160 con 0x7f0e00064470 2022-01-24T07:01:14.494 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.494+0000 7f0dee7fc700 1 -- 172.21.15.142:0/2264092580 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0dfc023020 con 0x7f0e00064470 2022-01-24T07:01:14.495 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:14.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0de0052c60 msgr2=0x7f0de0055120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0de0052c60 0x7f0de0055120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0df0008000 tx=0x7f0df0008040).stop 2022-01-24T07:01:14.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e00064470 msgr2=0x7f0e0016fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.497 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e00064470 0x7f0e0016fab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0dfc002f70 tx=0x7f0dfc014000).stop 2022-01-24T07:01:14.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 shutdown_connections 2022-01-24T07:01:14.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f0de0052c60 0x7f0de0055120 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e00142120 0x7f0e0013ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e00064470 0x7f0e0016fab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.498 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 --2- 172.21.15.142:0/2264092580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0e000d07f0 0x7f0e000cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.499 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 >> 172.21.15.142:0/2264092580 conn(0x7f0e00061ea0 msgr2=0x7f0e0013f920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:14.499 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 shutdown_connections 2022-01-24T07:01:14.499 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.495+0000 7f0e078a6700 1 -- 172.21.15.142:0/2264092580 wait complete. 2022-01-24T07:01:14.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-24T07:01:14.607 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.608+0000 7fc601056700 1 Processor -- start 2022-01-24T07:01:14.607 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.608+0000 7fc601056700 1 -- start start 2022-01-24T07:01:14.616 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc601056700 1 --2- >> v2:172.21.15.145:3300/0 conn(0x7fc5fc145230 0x7fc5fc15f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.616 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc601056700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc145610 0x7fc5fc05b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.616 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc601056700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc1600b0 con 0x7fc5fc160c50 2022-01-24T07:01:14.616 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc601056700 1 -- --> v2:172.21.15.145:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc160350 con 0x7fc5fc145230 2022-01-24T07:01:14.617 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc601056700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc1605f0 con 0x7fc5fc145610 2022-01-24T07:01:14.617 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc145610 0x7fc5fc05b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.617 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc145610 0x7fc5fc05b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53970/0 (socket says 172.21.15.142:53970) 2022-01-24T07:01:14.617 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 -- 172.21.15.142:0/3422791890 learned_addr learned my addr 172.21.15.142:0/3422791890 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.617 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fa59c700 1 --1- 172.21.15.142:0/3422791890 >> v1:172.21.15.142:6789/0 conn(0x7fc5fc160c50 0x7fc5fc0cc580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48572/0 (socket says 172.21.15.142:48572) 2022-01-24T07:01:14.618 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fad9d700 1 --2- 172.21.15.142:0/3422791890 >> v2:172.21.15.145:3300/0 conn(0x7fc5fc145230 0x7fc5fc15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.618 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5f9d9b700 1 -- 172.21.15.142:0/3422791890 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775516140 0 0) 0x7fc5fc1600b0 con 0x7fc5fc160c50 2022-01-24T07:01:14.619 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5f9d9b700 1 -- 172.21.15.142:0/3422791890 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5dc003260 con 0x7fc5fc160c50 2022-01-24T07:01:14.619 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 -- 172.21.15.142:0/3422791890 >> v2:172.21.15.145:3300/0 conn(0x7fc5fc145230 msgr2=0x7fc5fc15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:14.619 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 --2- 172.21.15.142:0/3422791890 >> v2:172.21.15.145:3300/0 conn(0x7fc5fc145230 0x7fc5fc15f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.619 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 -- 172.21.15.142:0/3422791890 >> v1:172.21.15.142:6789/0 conn(0x7fc5fc160c50 legacy=0x7fc5fc0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.620 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 -- 172.21.15.142:0/3422791890 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc0cbba0 con 0x7fc5fc145610 2022-01-24T07:01:14.620 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5fb59e700 1 --2- 172.21.15.142:0/3422791890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc145610 0x7fc5fc05b330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc5f4002f70 tx=0x7fc5f4006eb0).ready entity=mon.2 client_cookie=2a7160d6c9547056 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.620 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5f9d9b700 1 -- 172.21.15.142:0/3422791890 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f400d5c0 con 0x7fc5fc145610 2022-01-24T07:01:14.620 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5f9d9b700 1 -- 172.21.15.142:0/3422791890 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f4000e90 con 0x7fc5fc145610 2022-01-24T07:01:14.621 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.609+0000 7fc5f9d9b700 1 -- 172.21.15.142:0/3422791890 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f400d950 con 0x7fc5fc145610 2022-01-24T07:01:14.621 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 -- 172.21.15.142:0/3422791890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc145610 msgr2=0x7fc5fc05b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.621 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 --2- 172.21.15.142:0/3422791890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc145610 0x7fc5fc05b330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc5f4002f70 tx=0x7fc5f4006eb0).stop 2022-01-24T07:01:14.621 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 -- 172.21.15.142:0/3422791890 shutdown_connections 2022-01-24T07:01:14.622 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 --2- 172.21.15.142:0/3422791890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc145610 0x7fc5fc05b330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.622 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 --2- 172.21.15.142:0/3422791890 >> v2:172.21.15.145:3300/0 conn(0x7fc5fc145230 0x7fc5fc15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.622 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 -- 172.21.15.142:0/3422791890 >> 172.21.15.142:0/3422791890 conn(0x7fc5fc0d5fc0 msgr2=0x7fc5fc0d63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:14.623 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 -- 172.21.15.142:0/3422791890 shutdown_connections 2022-01-24T07:01:14.623 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.610+0000 7fc601056700 1 -- 172.21.15.142:0/3422791890 wait complete. 2022-01-24T07:01:14.623 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.611+0000 7fc601056700 1 Processor -- start 2022-01-24T07:01:14.623 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.611+0000 7fc601056700 1 -- start start 2022-01-24T07:01:14.624 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc601056700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc145230 0x7fc5fc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.624 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc601056700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5fc145610 0x7fc5fc143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.624 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc601056700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc160c50 0x7fc5fc05b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.624 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc601056700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0d1e20 con 0x7fc5fc145610 2022-01-24T07:01:14.625 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc601056700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0d2080 con 0x7fc5fc145230 2022-01-24T07:01:14.625 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc601056700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0d2320 con 0x7fc5fc160c50 2022-01-24T07:01:14.625 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5fc145610 0x7fc5fc143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.625 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fb59e700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc160c50 0x7fc5fc05b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.625 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5fc145610 0x7fc5fc143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51212/0 (socket says 172.21.15.142:51212) 2022-01-24T07:01:14.626 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fa59c700 1 -- 172.21.15.142:0/3303556102 learned_addr learned my addr 172.21.15.142:0/3303556102 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.626 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fad9d700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc145230 0x7fc5fc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.626 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fb59e700 1 -- 172.21.15.142:0/3303556102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc145230 msgr2=0x7fc5fc0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.626 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fb59e700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc145230 0x7fc5fc0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.627 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fb59e700 1 -- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5fc145610 msgr2=0x7fc5fc143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.627 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fb59e700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5fc145610 0x7fc5fc143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.627 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fb59e700 1 -- 172.21.15.142:0/3303556102 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f400b1e0 con 0x7fc5fc160c50 2022-01-24T07:01:14.627 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fad9d700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc145230 0x7fc5fc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-24T07:01:14.628 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.612+0000 7fc5fb59e700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc160c50 0x7fc5fc05b6b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc5f4002f70 tx=0x7fc5f4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.628 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.613+0000 7fc5f3fff700 1 -- 172.21.15.142:0/3303556102 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f400de20 con 0x7fc5fc160c50 2022-01-24T07:01:14.628 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.613+0000 7fc5f3fff700 1 -- 172.21.15.142:0/3303556102 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f4011bf0 con 0x7fc5fc160c50 2022-01-24T07:01:14.628 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.613+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc0d25c0 con 0x7fc5fc160c50 2022-01-24T07:01:14.629 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.613+0000 7fc5f3fff700 1 -- 172.21.15.142:0/3303556102 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f401e460 con 0x7fc5fc160c50 2022-01-24T07:01:14.629 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.613+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc0d2b00 con 0x7fc5fc160c50 2022-01-24T07:01:14.629 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.613+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc0d2d00 con 0x7fc5fc160c50 2022-01-24T07:01:14.629 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.614+0000 7fc5f3fff700 1 -- 172.21.15.142:0/3303556102 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7fc5f401a040 con 0x7fc5fc160c50 2022-01-24T07:01:14.629 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.614+0000 7fc5f3fff700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc5e0052ab0 0x7fc5e0054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.630 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.614+0000 7fc5f3fff700 1 -- 172.21.15.142:0/3303556102 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc5f406b900 con 0x7fc5fc160c50 2022-01-24T07:01:14.630 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.614+0000 7fc5fad9d700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc5e0052ab0 0x7fc5e0054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.630 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.614+0000 7fc5fad9d700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc5e0052ab0 0x7fc5e0054f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc5ec00b000 tx=0x7fc5ec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.631 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.617+0000 7fc5f3fff700 1 -- 172.21.15.142:0/3303556102 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7fc5fc0d2d00 con 0x7fc5fc160c50 2022-01-24T07:01:14.747 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.747+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5fc0d2d00 con 0x7fc5fc160c50 2022-01-24T07:01:14.747 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.748+0000 7fc5f3fff700 1 -- 172.21.15.142:0/3303556102 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc5f4023020 con 0x7fc5fc160c50 2022-01-24T07:01:14.748 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:14.751 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc5e0052ab0 msgr2=0x7fc5e0054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.751 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc5e0052ab0 0x7fc5e0054f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc5ec00b000 tx=0x7fc5ec008040).stop 2022-01-24T07:01:14.751 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc160c50 msgr2=0x7fc5fc05b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.752 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc160c50 0x7fc5fc05b6b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc5f4002f70 tx=0x7fc5f4015000).stop 2022-01-24T07:01:14.752 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 shutdown_connections 2022-01-24T07:01:14.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5fc145230 0x7fc5fc0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.753 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7fc5e0052ab0 0x7fc5e0054f70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.754 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5fc160c50 0x7fc5fc05b6b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.754 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 --2- 172.21.15.142:0/3303556102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5fc145610 0x7fc5fc143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.755 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 >> 172.21.15.142:0/3303556102 conn(0x7fc5fc0d5fc0 msgr2=0x7fc5fc15e310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:14.755 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 shutdown_connections 2022-01-24T07:01:14.755 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.749+0000 7fc601056700 1 -- 172.21.15.142:0/3303556102 wait complete. 2022-01-24T07:01:14.759 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-24T07:01:14.862 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.863+0000 7f66a3057700 1 Processor -- start 2022-01-24T07:01:14.863 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.863+0000 7f66a3057700 1 -- start start 2022-01-24T07:01:14.874 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a3057700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f669c145610 0x7f669c05b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.874 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a3057700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c1600b0 con 0x7f669c145230 2022-01-24T07:01:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a3057700 1 -- --> v1:172.21.15.145:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c160350 con 0x7f669c160c50 2022-01-24T07:01:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a3057700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c15fe90 con 0x7f669c145610 2022-01-24T07:01:14.876 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a15f4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f669c145610 0x7f669c05b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.876 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a15f4700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f669c145610 0x7f669c05b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51222/0 (socket says 172.21.15.142:51222) 2022-01-24T07:01:14.876 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a0df3700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f669c145230 0x7f669c15f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48582/0 (socket says 172.21.15.142:48582) 2022-01-24T07:01:14.877 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.864+0000 7f66a15f4700 1 -- 172.21.15.142:0/1832526508 learned_addr learned my addr 172.21.15.142:0/1832526508 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.877 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a15f4700 1 -- 172.21.15.142:0/1832526508 >> v1:172.21.15.145:6789/0 conn(0x7f669c160c50 legacy=0x7f669c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.878 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a15f4700 1 -- 172.21.15.142:0/1832526508 >> v1:172.21.15.142:6789/0 conn(0x7f669c145230 legacy=0x7f669c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.878 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a15f4700 1 -- 172.21.15.142:0/1832526508 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c1605f0 con 0x7f669c145610 2022-01-24T07:01:14.878 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a15f4700 1 --2- 172.21.15.142:0/1832526508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c05b330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f669c05fde0 tx=0x7f6694009290).ready entity=mon.0 client_cookie=97ad917da9a1ef8d server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.879 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66937fe700 1 -- 172.21.15.142:0/1832526508 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669400b860 con 0x7f669c145610 2022-01-24T07:01:14.879 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66937fe700 1 -- 172.21.15.142:0/1832526508 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b9c0 con 0x7f669c145610 2022-01-24T07:01:14.880 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66937fe700 1 -- 172.21.15.142:0/1832526508 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669400bb30 con 0x7f669c145610 2022-01-24T07:01:14.880 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a3057700 1 -- 172.21.15.142:0/1832526508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 msgr2=0x7f669c05b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.881 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a3057700 1 --2- 172.21.15.142:0/1832526508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c05b330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f669c05fde0 tx=0x7f6694009290).stop 2022-01-24T07:01:14.881 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a3057700 1 -- 172.21.15.142:0/1832526508 shutdown_connections 2022-01-24T07:01:14.882 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a3057700 1 --2- 172.21.15.142:0/1832526508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c05b330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.882 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a3057700 1 -- 172.21.15.142:0/1832526508 >> 172.21.15.142:0/1832526508 conn(0x7f669c0d5fc0 msgr2=0x7f669c0d63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:14.882 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a3057700 1 -- 172.21.15.142:0/1832526508 shutdown_connections 2022-01-24T07:01:14.883 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.865+0000 7f66a3057700 1 -- 172.21.15.142:0/1832526508 wait complete. 2022-01-24T07:01:14.883 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.866+0000 7f66a3057700 1 Processor -- start 2022-01-24T07:01:14.884 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.866+0000 7f66a3057700 1 -- start start 2022-01-24T07:01:14.884 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.867+0000 7f66a3057700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c145230 0x7f669c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.885 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.867+0000 7f66a3057700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.885 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.867+0000 7f66a3057700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f669c160c50 0x7f669c1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.885 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.867+0000 7f66a3057700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0d5780 con 0x7f669c145610 2022-01-24T07:01:14.886 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.867+0000 7f66a3057700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0d5a20 con 0x7f669c160c50 2022-01-24T07:01:14.886 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.867+0000 7f66a3057700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0d5cc0 con 0x7f669c145230 2022-01-24T07:01:14.887 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.887 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f66a0df3700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c145230 0x7f669c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.887 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51226/0 (socket says 172.21.15.142:51226) 2022-01-24T07:01:14.888 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 -- 172.21.15.142:0/470388864 learned_addr learned my addr 172.21.15.142:0/470388864 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:14.888 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f66a15f4700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f669c160c50 0x7f669c1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.889 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 -- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c145230 msgr2=0x7f669c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.889 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c145230 0x7f669c15bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.889 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 -- 172.21.15.142:0/470388864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f669c160c50 msgr2=0x7f669c1433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:14.890 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f669c160c50 0x7f669c1433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:14.890 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 -- 172.21.15.142:0/470388864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009530 con 0x7f669c145610 2022-01-24T07:01:14.891 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f66a0df3700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c145230 0x7f669c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:14.891 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6693fff700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c15c480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f669c163d60 tx=0x7f668c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.892 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6691ffb700 1 -- 172.21.15.142:0/470388864 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f668c007e40 con 0x7f669c145610 2022-01-24T07:01:14.892 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6691ffb700 1 -- 172.21.15.142:0/470388864 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c007030 con 0x7f669c145610 2022-01-24T07:01:14.892 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c142a00 con 0x7f669c145610 2022-01-24T07:01:14.893 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f6691ffb700 1 -- 172.21.15.142:0/470388864 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f668c007390 con 0x7f669c145610 2022-01-24T07:01:14.893 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.868+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c142f40 con 0x7f669c145610 2022-01-24T07:01:14.894 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.869+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c143100 con 0x7f669c145610 2022-01-24T07:01:14.894 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.869+0000 7f6691ffb700 1 -- 172.21.15.142:0/470388864 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f668c010030 con 0x7f669c145610 2022-01-24T07:01:14.894 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.869+0000 7f6691ffb700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f667c052ab0 0x7f667c054f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:14.895 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.870+0000 7f6691ffb700 1 -- 172.21.15.142:0/470388864 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f668c06a590 con 0x7f669c145610 2022-01-24T07:01:14.895 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.870+0000 7f66a0df3700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f667c052ab0 0x7f667c054f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:14.896 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.870+0000 7f66a0df3700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f667c052ab0 0x7f667c054f70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f669800d000 tx=0x7f6698007b40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:14.896 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:14.873+0000 7f6691ffb700 1 -- 172.21.15.142:0/470388864 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f668c041c50 con 0x7f669c145610 2022-01-24T07:01:15.004 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.004+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f669c057950 con 0x7f669c145610 2022-01-24T07:01:15.004 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.004+0000 7f6691ffb700 1 -- 172.21.15.142:0/470388864 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f668c045270 con 0x7f669c145610 2022-01-24T07:01:15.005 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 8 2022-01-24T07:01:15.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.005+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f667c052ab0 msgr2=0x7f667c054f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.007 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.005+0000 7f66a3057700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f667c052ab0 0x7f667c054f70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f669800d000 tx=0x7f6698007b40).stop 2022-01-24T07:01:15.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.005+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 msgr2=0x7f669c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.008 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.005+0000 7f66a3057700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c15c480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f669c163d60 tx=0x7f668c007bd0).stop 2022-01-24T07:01:15.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 shutdown_connections 2022-01-24T07:01:15.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f669c160c50 0x7f669c1433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.009 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f667c052ab0 0x7f667c054f70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.010 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c145230 0x7f669c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.010 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 --2- 172.21.15.142:0/470388864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c145610 0x7f669c15c480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 >> 172.21.15.142:0/470388864 conn(0x7f669c0d5fc0 msgr2=0x7f669c0cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:15.011 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 shutdown_connections 2022-01-24T07:01:15.012 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.006+0000 7f66a3057700 1 -- 172.21.15.142:0/470388864 wait complete. 2022-01-24T07:01:15.016 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-24T07:01:15.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-24T07:01:15.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.115+0000 7f1ba4a56700 1 Processor -- start 2022-01-24T07:01:15.116 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.115+0000 7f1ba4a56700 1 -- start start 2022-01-24T07:01:15.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1ba4a56700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ba015d2b0 0x7f1ba0064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:15.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1ba4a56700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba00c8cf0 0x7f1ba00b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:15.119 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1ba4a56700 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba00c91a0 con 0x7f1ba015ced0 2022-01-24T07:01:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1ba4a56700 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba005cca0 con 0x7f1ba015d2b0 2022-01-24T07:01:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1ba4a56700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba005b3d0 con 0x7f1ba00c8cf0 2022-01-24T07:01:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1b9dd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ba015d2b0 0x7f1ba0064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:15.120 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1b9ed9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba00c8cf0 0x7f1ba00b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:15.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1b9e59c700 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1ba015ced0 0x7f1ba005c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:48596/0 (socket says 172.21.15.142:48596) 2022-01-24T07:01:15.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1b9ed9d700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba00c8cf0 0x7f1ba00b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53998/0 (socket says 172.21.15.142:53998) 2022-01-24T07:01:15.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1b9dd9b700 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ba015d2b0 0x7f1ba0064520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51234/0 (socket says 172.21.15.142:51234) 2022-01-24T07:01:15.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.116+0000 7f1b9e59c700 1 -- 172.21.15.142:0/1955286704 learned_addr learned my addr 172.21.15.142:0/1955286704 (peer_addr_for_me v1:172.21.15.142:0/0) 2022-01-24T07:01:15.121 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9ed9d700 1 -- 172.21.15.142:0/1955286704 >> v2:172.21.15.142:3300/0 conn(0x7f1ba015d2b0 msgr2=0x7f1ba0064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-24T07:01:15.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9ed9d700 1 --2- 172.21.15.142:0/1955286704 >> v2:172.21.15.142:3300/0 conn(0x7f1ba015d2b0 0x7f1ba0064520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9ed9d700 1 -- 172.21.15.142:0/1955286704 >> v1:172.21.15.142:6789/0 conn(0x7f1ba015ced0 legacy=0x7f1ba005c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9d59a700 1 -- 172.21.15.142:0/1955286704 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841824694 0 0) 0x7f1ba00c91a0 con 0x7f1ba015ced0 2022-01-24T07:01:15.122 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9ed9d700 1 -- 172.21.15.142:0/1955286704 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba005b670 con 0x7f1ba00c8cf0 2022-01-24T07:01:15.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9dd9b700 1 --2- 172.21.15.142:0/1955286704 >> v2:172.21.15.142:3300/0 conn(0x7f1ba015d2b0 0x7f1ba0064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:15.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9ed9d700 1 --2- 172.21.15.142:0/1955286704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba00c8cf0 0x7f1ba00b2ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1b98002f70 tx=0x7f1b98006df0).ready entity=mon.2 client_cookie=dff99e857a499952 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:15.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9d59a700 1 -- 172.21.15.142:0/1955286704 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9800d570 con 0x7f1ba00c8cf0 2022-01-24T07:01:15.123 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9d59a700 1 -- 172.21.15.142:0/1955286704 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b98000e90 con 0x7f1ba00c8cf0 2022-01-24T07:01:15.124 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1b9d59a700 1 -- 172.21.15.142:0/1955286704 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b9800d8c0 con 0x7f1ba00c8cf0 2022-01-24T07:01:15.124 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 -- 172.21.15.142:0/1955286704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba00c8cf0 msgr2=0x7f1ba00b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.125 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/1955286704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba00c8cf0 0x7f1ba00b2ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f1b98002f70 tx=0x7f1b98006df0).stop 2022-01-24T07:01:15.125 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 -- 172.21.15.142:0/1955286704 shutdown_connections 2022-01-24T07:01:15.126 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/1955286704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba00c8cf0 0x7f1ba00b2ba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.126 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/1955286704 >> v2:172.21.15.142:3300/0 conn(0x7f1ba015d2b0 0x7f1ba0064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 -- 172.21.15.142:0/1955286704 >> 172.21.15.142:0/1955286704 conn(0x7f1ba00d4830 msgr2=0x7f1ba00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:15.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 -- 172.21.15.142:0/1955286704 shutdown_connections 2022-01-24T07:01:15.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.117+0000 7f1ba4a56700 1 -- 172.21.15.142:0/1955286704 wait complete. 2022-01-24T07:01:15.127 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 Processor -- start 2022-01-24T07:01:15.128 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 -- start start 2022-01-24T07:01:15.131 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ba00c8cf0 0x7f1ba015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:15.131 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba015ced0 0x7f1ba00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:15.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ba015d2b0 0x7f1ba0151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:15.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00b12e0 con 0x7f1ba00c8cf0 2022-01-24T07:01:15.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00b1580 con 0x7f1ba015d2b0 2022-01-24T07:01:15.132 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1ba4a56700 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00b1820 con 0x7f1ba015ced0 2022-01-24T07:01:15.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1b9e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ba00c8cf0 0x7f1ba015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:15.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1b9dd9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba015ced0 0x7f1ba00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:15.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1b9e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ba00c8cf0 0x7f1ba015b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51238/0 (socket says 172.21.15.142:51238) 2022-01-24T07:01:15.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1b9dd9b700 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba015ced0 0x7f1ba00b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:54002/0 (socket says 172.21.15.142:54002) 2022-01-24T07:01:15.133 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.119+0000 7f1b9e59c700 1 -- 172.21.15.142:0/3490744831 learned_addr learned my addr 172.21.15.142:0/3490744831 (peer_addr_for_me v2:172.21.15.142:0/0) 2022-01-24T07:01:15.134 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b9dd9b700 1 -- 172.21.15.142:0/3490744831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ba015d2b0 msgr2=0x7f1ba0151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.134 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b9dd9b700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ba015d2b0 0x7f1ba0151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-24T07:01:15.134 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b9dd9b700 1 -- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ba00c8cf0 msgr2=0x7f1ba015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.134 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b9dd9b700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ba00c8cf0 0x7f1ba015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.135 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b9dd9b700 1 -- 172.21.15.142:0/3490744831 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8800b180 con 0x7f1ba015ced0 2022-01-24T07:01:15.135 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b9e59c700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ba00c8cf0 0x7f1ba015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-24T07:01:15.135 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b9dd9b700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba015ced0 0x7f1ba00b08f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1b8800c000 tx=0x7f1b88006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:15.135 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b977fe700 1 -- 172.21.15.142:0/3490744831 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b88010780 con 0x7f1ba015ced0 2022-01-24T07:01:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b977fe700 1 -- 172.21.15.142:0/3490744831 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b880108e0 con 0x7f1ba015ced0 2022-01-24T07:01:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9800b180 con 0x7f1ba015ced0 2022-01-24T07:01:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1b977fe700 1 -- 172.21.15.142:0/3490744831 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b88010c40 con 0x7f1ba015ced0 2022-01-24T07:01:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.120+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba00d1a30 con 0x7f1ba015ced0 2022-01-24T07:01:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.121+0000 7f1b977fe700 1 -- 172.21.15.142:0/3490744831 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 4) v1 ==== 64690+0+0 (secure 0 0 0) 0x7f1b8801c460 con 0x7f1ba015ced0 2022-01-24T07:01:15.137 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.121+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba01700c0 con 0x7f1ba015ced0 2022-01-24T07:01:15.137 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.121+0000 7f1b977fe700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1b84052b40 0x7f1b84055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-24T07:01:15.137 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.121+0000 7f1b977fe700 1 -- 172.21.15.142:0/3490744831 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b8806b090 con 0x7f1ba015ced0 2022-01-24T07:01:15.137 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.121+0000 7f1b9e59c700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1b84052b40 0x7f1b84055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-24T07:01:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.122+0000 7f1b9e59c700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1b84052b40 0x7f1b84055000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1b9000d000 tx=0x7f1b90007e40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-24T07:01:15.138 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.125+0000 7f1b977fe700 1 -- 172.21.15.142:0/3490744831 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+137977 (secure 0 0 0) 0x7f1ba01700c0 con 0x7f1ba015ced0 2022-01-24T07:01:15.299 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.299+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ba01700c0 con 0x7f1ba015ced0 2022-01-24T07:01:15.300 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.300+0000 7f1b977fe700 1 -- 172.21.15.142:0/3490744831 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4817 (secure 0 0 0) 0x7f1ba01700c0 con 0x7f1ba015ced0 2022-01-24T07:01:15.301 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-01-24T07:01:15.301 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-24T07:00:54.259086+0000","modified":"2022-01-24T07:01:09.337995+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":9,"in":[0,1,2,3,4,5,6,7,8],"up":{"mds_0":4309,"mds_1":4315,"mds_2":4306,"mds_3":4279,"mds_4":4276,"mds_5":4272,"mds_6":4269,"mds_7":4244,"mds_8":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"h","rank":8,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6833/4266718599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":4266718599},{"type":"v1","addr":"172.21.15.145:6833","nonce":4266718599}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4244":{"gid":4244,"name":"g","rank":7,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.145:6836/2250566993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":2250566993},{"type":"v1","addr":"172.21.15.145:6836","nonce":2250566993}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4269":{"gid":4269,"name":"c","rank":6,"incarnation":17,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6839/3496603446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":3496603446},{"type":"v1","addr":"172.21.15.142:6839","nonce":3496603446}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4272":{"gid":4272,"name":"d","rank":5,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3300581089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3300581089},{"type":"v1","addr":"172.21.15.142:6841","nonce":3300581089}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4276":{"gid":4276,"name":"b","rank":4,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6836/2798136120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2798136120},{"type":"v1","addr":"172.21.15.142:6836","nonce":2798136120}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4279":{"gid":4279,"name":"a","rank":3,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6837/2315856698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6835","nonce":2315856698},{"type":"v1","addr":"172.21.15.142:6837","nonce":2315856698}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4306":{"gid":4306,"name":"f","rank":2,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6837/3395087110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6835","nonce":3395087110},{"type":"v1","addr":"172.21.15.145:6837","nonce":3395087110}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4309":{"gid":4309,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.145:6839/2894168765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":2894168765},{"type":"v1","addr":"172.21.15.145:6839","nonce":2894168765}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4315":{"gid":4315,"name":"i","rank":1,"incarnation":7,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6841/1371026810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6840","nonce":1371026810},{"type":"v1","addr":"172.21.15.145:6841","nonce":1371026810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-24T07:01:15.302 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1b84052b40 msgr2=0x7f1b84055000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.303 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1b84052b40 0x7f1b84055000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1b9000d000 tx=0x7f1b90007e40).stop 2022-01-24T07:01:15.303 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba015ced0 msgr2=0x7f1ba00b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-24T07:01:15.303 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba015ced0 0x7f1ba00b08f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1b8800c000 tx=0x7f1b88006df0).stop 2022-01-24T07:01:15.303 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 shutdown_connections 2022-01-24T07:01:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1ba015d2b0 0x7f1ba0151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-24T07:01:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:6800/64452,v1:172.21.15.142:6801/64452] conn(0x7f1b84052b40 0x7f1b84055000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ba00c8cf0 0x7f1ba015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.304 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.301+0000 7f1ba4a56700 1 --2- 172.21.15.142:0/3490744831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ba015ced0 0x7f1ba00b08f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-24T07:01:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.302+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 >> 172.21.15.142:0/3490744831 conn(0x7f1ba00d4830 msgr2=0x7f1ba005d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-24T07:01:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.302+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 shutdown_connections 2022-01-24T07:01:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:2022-01-24T07:01:15.302+0000 7f1ba4a56700 1 -- 172.21.15.142:0/3490744831 wait complete. 2022-01-24T07:01:15.305 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2022-01-24T07:01:16.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-24T07:00:54.259086+0000', 'modified': '2022-01-24T07:01:09.337995+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 9, 'in': [0, 1, 2, 3, 4, 5, 6, 7, 8], 'up': {'mds_0': 4309, 'mds_1': 4315, 'mds_2': 4306, 'mds_3': 4279, 'mds_4': 4276, 'mds_5': 4272, 'mds_6': 4269, 'mds_7': 4244, 'mds_8': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'h', 'rank': 8, 'incarnation': 21, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.145:6833/4266718599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 4266718599}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 4266718599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4244': {'gid': 4244, 'name': 'g', 'rank': 7, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.145:6836/2250566993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 2250566993}, {'type': 'v1', 'addr': '172.21.15.145:6836', 'nonce': 2250566993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4269': {'gid': 4269, 'name': 'c', 'rank': 6, 'incarnation': 17, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6839/3496603446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6838', 'nonce': 3496603446}, {'type': 'v1', 'addr': '172.21.15.142:6839', 'nonce': 3496603446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4272': {'gid': 4272, 'name': 'd', 'rank': 5, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6841/3300581089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6840', 'nonce': 3300581089}, {'type': 'v1', 'addr': '172.21.15.142:6841', 'nonce': 3300581089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 4, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6836/2798136120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6834', 'nonce': 2798136120}, {'type': 'v1', 'addr': '172.21.15.142:6836', 'nonce': 2798136120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4279': {'gid': 4279, 'name': 'a', 'rank': 3, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6837/2315856698', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6835', 'nonce': 2315856698}, {'type': 'v1', 'addr': '172.21.15.142:6837', 'nonce': 2315856698}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4306': {'gid': 4306, 'name': 'f', 'rank': 2, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6837/3395087110', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6835', 'nonce': 3395087110}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 3395087110}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4309': {'gid': 4309, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.145:6839/2894168765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 2894168765}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 2894168765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4315': {'gid': 4315, 'name': 'i', 'rank': 1, 'incarnation': 7, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6841/1371026810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6840', 'nonce': 1371026810}, {'type': 'v1', 'addr': '172.21.15.145:6841', 'nonce': 1371026810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-24T07:01:16.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 9/9 2022-01-24T07:01:16.221 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok --format=json status 2022-01-24T07:01:16.351 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":8,"id":4241,"want_state":"up:active","state":"up:active","rank_uptime":13.022290826000001,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":25.389591730999999} 2022-01-24T07:01:16.351 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4241, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 13.022290826, "state": "up:active", "uptime": 25.389591731, "want_state": "up:active", "whoami": 8 } 2022-01-24T07:01:16.352 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok --format=json status 2022-01-24T07:01:16.469 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":7,"id":4244,"want_state":"up:active","state":"up:active","rank_uptime":14.150441175999999,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":25.505857442} 2022-01-24T07:01:16.470 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4244, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 14.150441176, "state": "up:active", "uptime": 25.505857442, "want_state": "up:active", "whoami": 7 } 2022-01-24T07:01:16.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-24T07:01:16.600 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":6,"id":4269,"want_state":"up:active","state":"up:active","rank_uptime":15.286916849000001,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":25.646799037000001} 2022-01-24T07:01:16.600 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4269, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 15.286916849, "state": "up:active", "uptime": 25.646799037, "want_state": "up:active", "whoami": 6 } 2022-01-24T07:01:16.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2022-01-24T07:01:16.718 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":5,"id":4272,"want_state":"up:active","state":"up:active","rank_uptime":16.412000277000001,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":25.762660489999998} 2022-01-24T07:01:16.719 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4272, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 16.412000277, "state": "up:active", "uptime": 25.76266049, "want_state": "up:active", "whoami": 5 } 2022-01-24T07:01:16.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-24T07:01:16.836 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":4,"id":4276,"want_state":"up:active","state":"up:active","rank_uptime":17.532252420999999,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":25.90830527} 2022-01-24T07:01:16.837 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4276, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 17.532252421, "state": "up:active", "uptime": 25.90830527, "want_state": "up:active", "whoami": 4 } 2022-01-24T07:01:16.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-24T07:01:16.954 INFO:teuthology.orchestra.run.smithi142.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":3,"id":4279,"want_state":"up:active","state":"up:active","rank_uptime":18.657575666,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":26.025270458000001} 2022-01-24T07:01:16.954 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4279, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 18.657575666, "state": "up:active", "uptime": 26.025270458, "want_state": "up:active", "whoami": 3 } 2022-01-24T07:01:16.955 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok --format=json status 2022-01-24T07:01:17.074 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":2,"id":4306,"want_state":"up:active","state":"up:active","rank_uptime":19.783012039999999,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":26.110190022000001} 2022-01-24T07:01:17.075 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4306, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 19.78301204, "state": "up:active", "uptime": 26.110190022, "want_state": "up:active", "whoami": 2 } 2022-01-24T07:01:17.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok --format=json status 2022-01-24T07:01:17.192 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":0,"id":4309,"want_state":"up:active","state":"up:active","rank_uptime":22.923773144999998,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":26.225407300000001} 2022-01-24T07:01:17.193 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4309, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 22.923773145, "state": "up:active", "uptime": 26.2254073, "want_state": "up:active", "whoami": 0 } 2022-01-24T07:01:17.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok --format=json status 2022-01-24T07:01:17.310 INFO:teuthology.orchestra.run.smithi145.stdout:{"cluster_fsid":"5daa98c7-3c1a-4e96-84f4-135ece391de4","whoami":1,"id":4315,"want_state":"up:active","state":"up:active","rank_uptime":21.026933613000001,"mdsmap_epoch":23,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":26.335051482000001} 2022-01-24T07:01:17.311 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5daa98c7-3c1a-4e96-84f4-135ece391de4", "id": 4315, "mdsmap_epoch": 23, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 21.026933613, "state": "up:active", "uptime": 26.335051482, "want_state": "up:active", "whoami": 1 } 2022-01-24T07:01:17.311 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2022-01-24T07:01:17.311 INFO:tasks.cephfs.kernel_mount:Mounting kclient client.1 at ubuntu@smithi164.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-24T07:01:17.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-24T07:01:17.312 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p /home/ubuntu/cephtest/mnt.1 2022-01-24T07:01:17.359 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-24T07:01:17.360 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2022-01-24T07:01:17.461 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2022-01-24T07:01:17.462 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2022-01-24T07:01:17.492 INFO:teuthology.orchestra.run.smithi164.stdout:parsing options: rw,name=1,norequire_active_mds,conf=/etc/ceph/ceph.conf 2022-01-24T07:01:17.492 INFO:teuthology.orchestra.run.smithi164.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2022-01-24T07:01:17.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-24T07:01:17.500 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2022-01-24T07:01:17.569 INFO:teuthology.run_tasks:Running task check-counter... 2022-01-24T07:01:17.582 INFO:teuthology.run_tasks:Running task check-counter... 2022-01-24T07:01:17.616 INFO:teuthology.run_tasks:Running task workunit... 2022-01-24T07:01:17.646 INFO:tasks.workunit:Pulling workunits from ref 4d29e4caec1870b870492d17110d34996b9335e6 2022-01-24T07:01:17.648 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-01-24T07:01:17.648 INFO:tasks.workunit:timeout=3h 2022-01-24T07:01:17.648 INFO:tasks.workunit:cleanup=True 2022-01-24T07:01:17.649 DEBUG:teuthology.orchestra.run.smithi164:> stat -- /home/ubuntu/cephtest/mnt.0 2022-01-24T07:01:17.695 INFO:teuthology.orchestra.run.smithi164.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-01-24T07:01:17.695 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-01-24T07:01:17.695 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 2bh/43d Inode: 1 Links: 2 2022-01-24T07:01:17.696 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T07:01:17.696 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:cephfs_t:s0 2022-01-24T07:01:17.696 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-01-24T07:01:17.696 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2022-01-24 07:00:54.262118248 +0000 2022-01-24T07:01:17.696 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2022-01-24 07:01:13.719020903 +0000 2022-01-24T07:01:17.697 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2022-01-24T07:01:17.697 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-01-24T07:01:17.697 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-01-24T07:01:17.811 DEBUG:teuthology.orchestra.run.smithi164:> stat -- /home/ubuntu/cephtest/mnt.1 2022-01-24T07:01:17.857 INFO:teuthology.orchestra.run.smithi164.stdout: File: /home/ubuntu/cephtest/mnt.1 2022-01-24T07:01:17.858 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2022-01-24T07:01:17.858 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 2ch/44d Inode: 1 Links: 3 2022-01-24T07:01:17.858 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-24T07:01:17.859 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:cephfs_t:s0 2022-01-24T07:01:17.859 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-01-24T07:01:17.859 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2022-01-24 07:01:17.801948052 +0000 2022-01-24T07:01:17.859 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2022-01-24 07:01:17.801948052 +0000 2022-01-24T07:01:17.859 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2022-01-24T07:01:17.860 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2022-01-24T07:01:17.860 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2022-01-24T07:01:17.979 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4d29e4caec1870b870492d17110d34996b9335e6 2022-01-24T07:01:17.979 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 4d29e4caec1870b870492d17110d34996b9335e6 2022-01-24T07:01:18.027 INFO:tasks.workunit.client.0.smithi164.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-01-24T07:01:18.029 INFO:tasks.workunit.client.1.smithi164.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2022-01-24T07:01:25.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:01:25.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:01:25.853 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:01:55.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:01:55.974 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:01:55.977 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:02:20.220 INFO:tasks.workunit.client.0.smithi164.stderr:Updating files: 62% (6958/11117) Updating files: 63% (7004/11117) Updating files: 64% (7115/11117) Updating files: 65% (7227/11117) Updating files: 66% (7338/11117) Updating files: 67% (7449/11117) Updating files: 68% (7560/11117) Updating files: 69% (7671/11117) Updating files: 70% (7782/11117) Updating files: 71% (7894/11117) Updating files: 72% (8005/11117) Updating files: 73% (8116/11117) Updating files: 74% (8227/11117) Updating files: 75% (8338/11117) Updating files: 76% (8449/11117) Updating files: 77% (8561/11117) Updating files: 78% (8672/11117) Updating files: 79% (8783/11117) Updating files: 80% (8894/11117) Updating files: 81% (9005/11117) Updating files: 82% (9116/11117) Updating files: 83% (9228/11117) Updating files: 84% (9339/11117) Updating files: 85% (9450/11117) Updating files: 86% (9561/11117) Updating files: 87% (9672/11117) Updating files: 88% (9783/11117) Updating files: 89% (9895/11117) Updating files: 90% (10006/11117) Updating files: 91% (10117/11117) Updating files: 91% (10155/11117) Updating files: 92% (10228/11117) Updating files: 93% (10339/11117) Updating files: 94% (10450/11117) Updating files: 95% (10562/11117) Updating files: 96% (10673/11117) Updating files: 97% (10784/11117) Updating files: 98% (10895/11117) Updating files: 99% (11006/11117) Updating files: 100% (11117/11117) Updating files: 100% (11117/11117), done. 2022-01-24T07:02:21.829 INFO:tasks.workunit.client.0.smithi164.stderr:Note: switching to '4d29e4caec1870b870492d17110d34996b9335e6'. 2022-01-24T07:02:21.829 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:21.829 INFO:tasks.workunit.client.0.smithi164.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-01-24T07:02:21.830 INFO:tasks.workunit.client.0.smithi164.stderr:changes and commit them, and you can discard any commits you make in this 2022-01-24T07:02:21.830 INFO:tasks.workunit.client.0.smithi164.stderr:state without impacting any branches by switching back to a branch. 2022-01-24T07:02:21.830 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:21.830 INFO:tasks.workunit.client.0.smithi164.stderr:If you want to create a new branch to retain commits you create, you may 2022-01-24T07:02:21.831 INFO:tasks.workunit.client.0.smithi164.stderr:do so (now or later) by using -c with the switch command. Example: 2022-01-24T07:02:21.831 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:21.831 INFO:tasks.workunit.client.0.smithi164.stderr: git switch -c 2022-01-24T07:02:21.831 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:21.832 INFO:tasks.workunit.client.0.smithi164.stderr:Or undo this operation with: 2022-01-24T07:02:21.832 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:21.832 INFO:tasks.workunit.client.0.smithi164.stderr: git switch - 2022-01-24T07:02:21.832 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:21.832 INFO:tasks.workunit.client.0.smithi164.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-01-24T07:02:21.833 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:21.833 INFO:tasks.workunit.client.0.smithi164.stderr:HEAD is now at 4d29e4caec1 Merge pull request #44689 from MrFreezeex/wip-53937-octopus 2022-01-24T07:02:21.871 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-01-24T07:02:21.922 INFO:tasks.workunit.client.0.smithi164.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-01-24T07:02:21.928 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-01-24T07:02:21.928 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-01-24T07:02:22.169 INFO:tasks.workunit.client.1.smithi164.stderr:Updating files: 56% (6291/11117) Updating files: 57% (6337/11117) Updating files: 58% (6448/11117) Updating files: 59% (6560/11117) Updating files: 60% (6671/11117) Updating files: 61% (6782/11117) Updating files: 62% (6893/11117) Updating files: 63% (7004/11117) Updating files: 64% (7115/11117) Updating files: 65% (7227/11117) Updating files: 66% (7338/11117) Updating files: 67% (7449/11117) Updating files: 68% (7560/11117) Updating files: 69% (7671/11117) Updating files: 70% (7782/11117) Updating files: 71% (7894/11117) Updating files: 72% (8005/11117) Updating files: 73% (8116/11117) Updating files: 74% (8227/11117) Updating files: 75% (8338/11117) Updating files: 76% (8449/11117) Updating files: 77% (8561/11117) Updating files: 78% (8672/11117) Updating files: 79% (8783/11117) Updating files: 80% (8894/11117) Updating files: 81% (9005/11117) Updating files: 82% (9116/11117) Updating files: 83% (9228/11117) Updating files: 84% (9339/11117) Updating files: 85% (9450/11117) Updating files: 86% (9561/11117) Updating files: 86% (9588/11117) Updating files: 87% (9672/11117) Updating files: 88% (9783/11117) Updating files: 89% (9895/11117) Updating files: 90% (10006/11117) Updating files: 91% (10117/11117) Updating files: 92% (10228/11117) Updating files: 93% (10339/11117) Updating files: 94% (10450/11117) Updating files: 95% (10562/11117) Updating files: 96% (10673/11117) Updating files: 97% (10784/11117) Updating files: 98% (10895/11117) Updating files: 99% (11006/11117) Updating files: 100% (11117/11117) Updating files: 100% (11117/11117), done. 2022-01-24T07:02:22.550 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-01-24T07:02:22.646 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-01-24T07:02:22.724 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-01-24T07:02:22.728 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-01-24T07:02:22.728 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-01-24T07:02:22.805 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-01-24T07:02:22.903 DEBUG:teuthology.orchestra.remote:smithi164:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2022-01-24T07:02:22.953 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2022-01-24T07:02:22.953 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2022-01-24T07:02:22.954 DEBUG:teuthology.orchestra.run.smithi164:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4d29e4caec1870b870492d17110d34996b9335e6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2022-01-24T07:02:23.016 INFO:tasks.workunit.client.0.smithi164.stdout:getting blogbench 2022-01-24T07:02:23.059 INFO:tasks.workunit.client.0.smithi164.stderr:--2022-01-24 07:02:23-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2022-01-24T07:02:23.061 INFO:tasks.workunit.client.0.smithi164.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2022-01-24T07:02:23.136 INFO:tasks.workunit.client.0.smithi164.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2022-01-24T07:02:23.218 INFO:tasks.workunit.client.0.smithi164.stderr:HTTP request sent, awaiting response... 200 OK 2022-01-24T07:02:23.219 INFO:tasks.workunit.client.0.smithi164.stderr:Length: 103355 (101K) [application/octet-stream] 2022-01-24T07:02:23.220 INFO:tasks.workunit.client.0.smithi164.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2022-01-24T07:02:23.224 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:23.372 INFO:tasks.workunit.client.0.smithi164.stderr: 0K .......... .......... .......... .......... .......... 49% 336K 0s 2022-01-24T07:02:23.450 INFO:tasks.workunit.client.0.smithi164.stderr: 50K .......... .......... .......... .......... .......... 99% 625K 0s 2022-01-24T07:02:23.451 INFO:tasks.workunit.client.0.smithi164.stderr: 100K 100% 2.11M=0.2s 2022-01-24T07:02:23.451 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:23.451 INFO:tasks.workunit.client.0.smithi164.stderr:2022-01-24 07:02:23 (440 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2022-01-24T07:02:23.451 INFO:tasks.workunit.client.0.smithi164.stderr: 2022-01-24T07:02:23.491 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/ 2022-01-24T07:02:23.492 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/m4/ 2022-01-24T07:02:23.493 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/m4/acx_pthread.m4 2022-01-24T07:02:23.494 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/man/ 2022-01-24T07:02:23.495 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/man/blogbench.8 2022-01-24T07:02:23.496 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/man/Makefile.am 2022-01-24T07:02:23.497 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/man/Makefile.in 2022-01-24T07:02:23.498 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/ 2022-01-24T07:02:23.499 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/mysnprintf.c 2022-01-24T07:02:23.501 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/mysnprintf.h 2022-01-24T07:02:23.501 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/blogbench.c 2022-01-24T07:02:23.502 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/blogbench.h 2022-01-24T07:02:23.502 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/fakesnprintf.c 2022-01-24T07:02:23.502 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/fakesnprintf.h 2022-01-24T07:02:23.502 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/blogbench_p.h 2022-01-24T07:02:23.503 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/bsd-getopt_long.c 2022-01-24T07:02:23.503 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/bsd-getopt_long.h 2022-01-24T07:02:23.503 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/Makefile.am 2022-01-24T07:02:23.503 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/Makefile.in 2022-01-24T07:02:23.505 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/process.c 2022-01-24T07:02:23.505 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/globals.h 2022-01-24T07:02:23.505 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/commenter.c 2022-01-24T07:02:23.505 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/rewriter.c 2022-01-24T07:02:23.506 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/reader.c 2022-01-24T07:02:23.506 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/writer.c 2022-01-24T07:02:23.506 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/src/helpers.c 2022-01-24T07:02:23.506 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/NEWS 2022-01-24T07:02:23.511 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/compile 2022-01-24T07:02:23.511 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/depcomp 2022-01-24T07:02:23.512 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/aclocal.m4 2022-01-24T07:02:23.512 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/README 2022-01-24T07:02:23.512 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/configure 2022-01-24T07:02:23.515 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/configure.ac 2022-01-24T07:02:23.515 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/config.guess 2022-01-24T07:02:23.517 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/install-sh 2022-01-24T07:02:23.517 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/config.sub 2022-01-24T07:02:23.517 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/missing 2022-01-24T07:02:23.518 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/mkinstalldirs 2022-01-24T07:02:23.518 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/Makefile.am 2022-01-24T07:02:23.518 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/Makefile.in 2022-01-24T07:02:23.518 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/config.h.in 2022-01-24T07:02:23.518 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/AUTHORS 2022-01-24T07:02:23.519 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/INSTALL 2022-01-24T07:02:23.519 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/ChangeLog 2022-01-24T07:02:23.519 INFO:tasks.workunit.client.0.smithi164.stdout:blogbench-1.0/COPYING 2022-01-24T07:02:23.520 INFO:tasks.workunit.client.0.smithi164.stdout:making blogbench 2022-01-24T07:02:23.748 INFO:tasks.workunit.client.1.smithi164.stderr:Note: switching to '4d29e4caec1870b870492d17110d34996b9335e6'. 2022-01-24T07:02:23.749 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:23.749 INFO:tasks.workunit.client.1.smithi164.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-01-24T07:02:23.749 INFO:tasks.workunit.client.1.smithi164.stderr:changes and commit them, and you can discard any commits you make in this 2022-01-24T07:02:23.750 INFO:tasks.workunit.client.1.smithi164.stderr:state without impacting any branches by switching back to a branch. 2022-01-24T07:02:23.750 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:23.750 INFO:tasks.workunit.client.1.smithi164.stderr:If you want to create a new branch to retain commits you create, you may 2022-01-24T07:02:23.750 INFO:tasks.workunit.client.1.smithi164.stderr:do so (now or later) by using -c with the switch command. Example: 2022-01-24T07:02:23.751 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:23.751 INFO:tasks.workunit.client.1.smithi164.stderr: git switch -c 2022-01-24T07:02:23.751 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:23.751 INFO:tasks.workunit.client.1.smithi164.stderr:Or undo this operation with: 2022-01-24T07:02:23.752 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:23.752 INFO:tasks.workunit.client.1.smithi164.stderr: git switch - 2022-01-24T07:02:23.752 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:23.752 INFO:tasks.workunit.client.1.smithi164.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-01-24T07:02:23.753 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:23.753 INFO:tasks.workunit.client.1.smithi164.stderr:HEAD is now at 4d29e4caec1 Merge pull request #44689 from MrFreezeex/wip-53937-octopus 2022-01-24T07:02:23.792 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2022-01-24T07:02:23.801 INFO:tasks.workunit.client.0.smithi164.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-01-24T07:02:23.835 INFO:tasks.workunit.client.1.smithi164.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-01-24T07:02:23.841 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2022-01-24T07:02:23.841 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-01-24T07:02:23.930 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-01-24T07:02:24.018 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-01-24T07:02:24.095 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2022-01-24T07:02:24.099 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2022-01-24T07:02:24.099 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-01-24T07:02:24.175 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2022-01-24T07:02:24.271 DEBUG:teuthology.orchestra.remote:smithi164:/home/ubuntu/cephtest/workunits.list.client.1 is 4KB 2022-01-24T07:02:24.321 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.1... 2022-01-24T07:02:24.322 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2022-01-24T07:02:24.322 DEBUG:teuthology.orchestra.run.smithi164:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4d29e4caec1870b870492d17110d34996b9335e6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/blogbench.sh 2022-01-24T07:02:24.388 INFO:tasks.workunit.client.1.smithi164.stdout:getting blogbench 2022-01-24T07:02:24.395 INFO:tasks.workunit.client.1.smithi164.stderr:--2022-01-24 07:02:24-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2022-01-24T07:02:24.396 INFO:tasks.workunit.client.1.smithi164.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2022-01-24T07:02:24.482 INFO:tasks.workunit.client.1.smithi164.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2022-01-24T07:02:24.565 INFO:tasks.workunit.client.1.smithi164.stderr:HTTP request sent, awaiting response... 200 OK 2022-01-24T07:02:24.565 INFO:tasks.workunit.client.1.smithi164.stderr:Length: 103355 (101K) [application/octet-stream] 2022-01-24T07:02:24.566 INFO:tasks.workunit.client.1.smithi164.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2022-01-24T07:02:24.569 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:24.734 INFO:tasks.workunit.client.1.smithi164.stderr: 0K .......... .......... .......... .......... .......... 49% 301K 0s 2022-01-24T07:02:24.814 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether build environment is sane... yes 2022-01-24T07:02:24.816 INFO:tasks.workunit.client.1.smithi164.stderr: 50K .......... .......... .......... .......... .......... 99% 605K 0s 2022-01-24T07:02:24.816 INFO:tasks.workunit.client.1.smithi164.stderr: 100K 100% 1779G=0.2s 2022-01-24T07:02:24.816 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:24.816 INFO:tasks.workunit.client.1.smithi164.stderr:2022-01-24 07:02:24 (406 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2022-01-24T07:02:24.817 INFO:tasks.workunit.client.1.smithi164.stderr: 2022-01-24T07:02:24.832 INFO:tasks.workunit.client.0.smithi164.stdout:checking for gawk... gawk 2022-01-24T07:02:24.833 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/ 2022-01-24T07:02:24.834 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/m4/ 2022-01-24T07:02:24.835 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/m4/acx_pthread.m4 2022-01-24T07:02:24.837 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/man/ 2022-01-24T07:02:24.838 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/man/blogbench.8 2022-01-24T07:02:24.839 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/man/Makefile.am 2022-01-24T07:02:24.840 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/man/Makefile.in 2022-01-24T07:02:24.840 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/ 2022-01-24T07:02:24.841 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/mysnprintf.c 2022-01-24T07:02:24.843 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/mysnprintf.h 2022-01-24T07:02:24.843 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/blogbench.c 2022-01-24T07:02:24.843 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/blogbench.h 2022-01-24T07:02:24.844 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/fakesnprintf.c 2022-01-24T07:02:24.846 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/fakesnprintf.h 2022-01-24T07:02:24.846 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/blogbench_p.h 2022-01-24T07:02:24.846 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/bsd-getopt_long.c 2022-01-24T07:02:24.846 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/bsd-getopt_long.h 2022-01-24T07:02:24.847 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/Makefile.am 2022-01-24T07:02:24.847 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/Makefile.in 2022-01-24T07:02:24.847 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/process.c 2022-01-24T07:02:24.847 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/globals.h 2022-01-24T07:02:24.848 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/commenter.c 2022-01-24T07:02:24.848 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/rewriter.c 2022-01-24T07:02:24.848 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/reader.c 2022-01-24T07:02:24.848 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/writer.c 2022-01-24T07:02:24.849 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/src/helpers.c 2022-01-24T07:02:24.849 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/NEWS 2022-01-24T07:02:24.861 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/compile 2022-01-24T07:02:24.861 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/depcomp 2022-01-24T07:02:24.861 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/aclocal.m4 2022-01-24T07:02:24.862 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/README 2022-01-24T07:02:24.862 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/configure 2022-01-24T07:02:24.866 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/configure.ac 2022-01-24T07:02:24.866 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/config.guess 2022-01-24T07:02:24.867 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/install-sh 2022-01-24T07:02:24.867 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/config.sub 2022-01-24T07:02:24.868 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/missing 2022-01-24T07:02:24.868 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/mkinstalldirs 2022-01-24T07:02:24.868 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/Makefile.am 2022-01-24T07:02:24.868 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/Makefile.in 2022-01-24T07:02:24.869 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/config.h.in 2022-01-24T07:02:24.870 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/AUTHORS 2022-01-24T07:02:24.870 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/INSTALL 2022-01-24T07:02:24.870 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/ChangeLog 2022-01-24T07:02:24.871 INFO:tasks.workunit.client.1.smithi164.stdout:blogbench-1.0/COPYING 2022-01-24T07:02:24.871 INFO:tasks.workunit.client.1.smithi164.stdout:making blogbench 2022-01-24T07:02:24.874 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether make sets $(MAKE)... yes 2022-01-24T07:02:24.906 INFO:tasks.workunit.client.0.smithi164.stdout:checking for gcc... gcc 2022-01-24T07:02:25.029 INFO:tasks.workunit.client.0.smithi164.stdout:checking for C compiler default output file name... a.out 2022-01-24T07:02:25.035 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether the C compiler works... yes 2022-01-24T07:02:25.040 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether we are cross compiling... no 2022-01-24T07:02:25.106 INFO:tasks.workunit.client.1.smithi164.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-01-24T07:02:25.110 INFO:tasks.workunit.client.0.smithi164.stdout:checking for suffix of executables... 2022-01-24T07:02:25.182 INFO:tasks.workunit.client.0.smithi164.stdout:checking for suffix of object files... o 2022-01-24T07:02:25.249 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether we are using the GNU C compiler... yes 2022-01-24T07:02:25.317 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether gcc accepts -g... yes 2022-01-24T07:02:25.402 INFO:tasks.workunit.client.0.smithi164.stdout:checking for gcc option to accept ANSI C... none needed 2022-01-24T07:02:25.475 INFO:tasks.workunit.client.0.smithi164.stdout:checking for style of include used by make... GNU 2022-01-24T07:02:25.606 INFO:tasks.workunit.client.0.smithi164.stdout:checking dependency style of gcc... gcc3 2022-01-24T07:02:25.606 INFO:tasks.workunit.client.0.smithi164.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-01-24T07:02:25.707 INFO:tasks.workunit.client.0.smithi164.stdout:checking how to run the C preprocessor... gcc -E 2022-01-24T07:02:25.783 INFO:tasks.workunit.client.0.smithi164.stdout:checking for egrep... grep -E 2022-01-24T07:02:25.805 INFO:tasks.workunit.client.0.smithi164.stdout:checking for AIX... no 2022-01-24T07:02:25.988 INFO:tasks.workunit.client.0.smithi164.stdout:checking for library containing strerror... none required 2022-01-24T07:02:26.118 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether build environment is sane... yes 2022-01-24T07:02:26.136 INFO:tasks.workunit.client.1.smithi164.stdout:checking for gawk... gawk 2022-01-24T07:02:26.159 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether make sets $(MAKE)... yes 2022-01-24T07:02:26.183 INFO:tasks.workunit.client.1.smithi164.stdout:checking for gcc... gcc 2022-01-24T07:02:26.260 INFO:tasks.workunit.client.0.smithi164.stdout:checking for ANSI C header files... yes 2022-01-24T07:02:26.291 INFO:tasks.workunit.client.1.smithi164.stdout:checking for C compiler default output file name... a.out 2022-01-24T07:02:26.296 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether the C compiler works... yes 2022-01-24T07:02:26.300 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether we are cross compiling... no 2022-01-24T07:02:26.342 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether time.h and sys/time.h may both be included... yes 2022-01-24T07:02:26.371 INFO:tasks.workunit.client.1.smithi164.stdout:checking for suffix of executables... 2022-01-24T07:02:26.438 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sys/types.h... yes 2022-01-24T07:02:26.444 INFO:tasks.workunit.client.1.smithi164.stdout:checking for suffix of object files... o 2022-01-24T07:02:26.512 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether we are using the GNU C compiler... yes 2022-01-24T07:02:26.540 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sys/stat.h... yes 2022-01-24T07:02:26.583 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether gcc accepts -g... yes 2022-01-24T07:02:26.651 INFO:tasks.workunit.client.0.smithi164.stdout:checking for stdlib.h... yes 2022-01-24T07:02:26.669 INFO:tasks.workunit.client.1.smithi164.stdout:checking for gcc option to accept ANSI C... none needed 2022-01-24T07:02:26.726 INFO:tasks.workunit.client.1.smithi164.stdout:checking for style of include used by make... GNU 2022-01-24T07:02:26.761 INFO:tasks.workunit.client.0.smithi164.stdout:checking for string.h... yes 2022-01-24T07:02:26.858 INFO:tasks.workunit.client.1.smithi164.stdout:checking dependency style of gcc... gcc3 2022-01-24T07:02:26.858 INFO:tasks.workunit.client.1.smithi164.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2022-01-24T07:02:26.878 INFO:tasks.workunit.client.0.smithi164.stdout:checking for memory.h... yes 2022-01-24T07:02:26.932 INFO:tasks.workunit.client.1.smithi164.stdout:checking how to run the C preprocessor... gcc -E 2022-01-24T07:02:26.984 INFO:tasks.workunit.client.0.smithi164.stdout:checking for strings.h... yes 2022-01-24T07:02:27.010 INFO:tasks.workunit.client.1.smithi164.stdout:checking for egrep... grep -E 2022-01-24T07:02:27.033 INFO:tasks.workunit.client.1.smithi164.stdout:checking for AIX... no 2022-01-24T07:02:27.099 INFO:tasks.workunit.client.0.smithi164.stdout:checking for inttypes.h... yes 2022-01-24T07:02:27.136 INFO:tasks.workunit.client.1.smithi164.stdout:checking for library containing strerror... none required 2022-01-24T07:02:27.208 INFO:tasks.workunit.client.0.smithi164.stdout:checking for stdint.h... yes 2022-01-24T07:02:27.327 INFO:tasks.workunit.client.0.smithi164.stdout:checking for unistd.h... yes 2022-01-24T07:02:27.358 INFO:tasks.workunit.client.0.smithi164.stdout:checking for memory.h... (cached) yes 2022-01-24T07:02:27.379 INFO:tasks.workunit.client.0.smithi164.stdout:checking for strings.h... (cached) yes 2022-01-24T07:02:27.389 INFO:tasks.workunit.client.1.smithi164.stdout:checking for ANSI C header files... yes 2022-01-24T07:02:27.399 INFO:tasks.workunit.client.0.smithi164.stdout:checking for unistd.h... (cached) yes 2022-01-24T07:02:27.468 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether time.h and sys/time.h may both be included... yes 2022-01-24T07:02:27.499 INFO:tasks.workunit.client.0.smithi164.stdout:checking locale.h usability... yes 2022-01-24T07:02:27.533 INFO:tasks.workunit.client.0.smithi164.stdout:checking locale.h presence... yes 2022-01-24T07:02:27.537 INFO:tasks.workunit.client.0.smithi164.stdout:checking for locale.h... yes 2022-01-24T07:02:27.565 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sys/types.h... yes 2022-01-24T07:02:27.569 INFO:tasks.workunit.client.0.smithi164.stdout:checking for stdlib.h... (cached) yes 2022-01-24T07:02:27.589 INFO:tasks.workunit.client.0.smithi164.stdout:checking for string.h... (cached) yes 2022-01-24T07:02:27.666 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sys/stat.h... yes 2022-01-24T07:02:27.699 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/socket.h usability... yes 2022-01-24T07:02:27.739 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/socket.h presence... yes 2022-01-24T07:02:27.742 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sys/socket.h... yes 2022-01-24T07:02:27.776 INFO:tasks.workunit.client.1.smithi164.stdout:checking for stdlib.h... yes 2022-01-24T07:02:27.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:02:27.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:02:27.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:02:27.850 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/time.h usability... yes 2022-01-24T07:02:27.881 INFO:tasks.workunit.client.1.smithi164.stdout:checking for string.h... yes 2022-01-24T07:02:27.888 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/time.h presence... yes 2022-01-24T07:02:27.891 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sys/time.h... yes 2022-01-24T07:02:27.997 INFO:tasks.workunit.client.1.smithi164.stdout:checking for memory.h... yes 2022-01-24T07:02:27.999 INFO:tasks.workunit.client.0.smithi164.stdout:checking fcntl.h usability... yes 2022-01-24T07:02:28.037 INFO:tasks.workunit.client.0.smithi164.stdout:checking fcntl.h presence... yes 2022-01-24T07:02:28.040 INFO:tasks.workunit.client.0.smithi164.stdout:checking for fcntl.h... yes 2022-01-24T07:02:28.108 INFO:tasks.workunit.client.1.smithi164.stdout:checking for strings.h... yes 2022-01-24T07:02:28.145 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/fcntl.h usability... yes 2022-01-24T07:02:28.182 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/fcntl.h presence... yes 2022-01-24T07:02:28.185 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sys/fcntl.h... yes 2022-01-24T07:02:28.218 INFO:tasks.workunit.client.1.smithi164.stdout:checking for inttypes.h... yes 2022-01-24T07:02:28.326 INFO:tasks.workunit.client.1.smithi164.stdout:checking for stdint.h... yes 2022-01-24T07:02:28.335 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/param.h usability... yes 2022-01-24T07:02:28.379 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/param.h presence... yes 2022-01-24T07:02:28.382 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sys/param.h... yes 2022-01-24T07:02:28.465 INFO:tasks.workunit.client.1.smithi164.stdout:checking for unistd.h... yes 2022-01-24T07:02:28.475 INFO:tasks.workunit.client.0.smithi164.stdout:checking ioctl.h usability... no 2022-01-24T07:02:28.493 INFO:tasks.workunit.client.1.smithi164.stdout:checking for memory.h... (cached) yes 2022-01-24T07:02:28.513 INFO:tasks.workunit.client.0.smithi164.stdout:checking ioctl.h presence... no 2022-01-24T07:02:28.513 INFO:tasks.workunit.client.1.smithi164.stdout:checking for strings.h... (cached) yes 2022-01-24T07:02:28.516 INFO:tasks.workunit.client.0.smithi164.stdout:checking for ioctl.h... no 2022-01-24T07:02:28.533 INFO:tasks.workunit.client.1.smithi164.stdout:checking for unistd.h... (cached) yes 2022-01-24T07:02:28.616 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/ioctl.h usability... yes 2022-01-24T07:02:28.631 INFO:tasks.workunit.client.1.smithi164.stdout:checking locale.h usability... yes 2022-01-24T07:02:28.653 INFO:tasks.workunit.client.0.smithi164.stdout:checking sys/ioctl.h presence... yes 2022-01-24T07:02:28.656 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sys/ioctl.h... yes 2022-01-24T07:02:28.667 INFO:tasks.workunit.client.1.smithi164.stdout:checking locale.h presence... yes 2022-01-24T07:02:28.670 INFO:tasks.workunit.client.1.smithi164.stdout:checking for locale.h... yes 2022-01-24T07:02:28.697 INFO:tasks.workunit.client.1.smithi164.stdout:checking for stdlib.h... (cached) yes 2022-01-24T07:02:28.717 INFO:tasks.workunit.client.1.smithi164.stdout:checking for string.h... (cached) yes 2022-01-24T07:02:28.766 INFO:tasks.workunit.client.0.smithi164.stdout:checking return type of signal handlers... void 2022-01-24T07:02:28.815 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/socket.h usability... yes 2022-01-24T07:02:28.855 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/socket.h presence... yes 2022-01-24T07:02:28.857 INFO:tasks.workunit.client.0.smithi164.stdout:checking for size_t... yes 2022-01-24T07:02:28.858 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sys/socket.h... yes 2022-01-24T07:02:28.939 INFO:tasks.workunit.client.0.smithi164.stdout:checking for dev_t... yes 2022-01-24T07:02:28.975 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/time.h usability... yes 2022-01-24T07:02:29.011 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/time.h presence... yes 2022-01-24T07:02:29.014 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sys/time.h... yes 2022-01-24T07:02:29.026 INFO:tasks.workunit.client.0.smithi164.stdout:checking for short... yes 2022-01-24T07:02:29.124 INFO:tasks.workunit.client.1.smithi164.stdout:checking fcntl.h usability... yes 2022-01-24T07:02:29.149 INFO:tasks.workunit.client.0.smithi164.stdout:checking size of short... 2 2022-01-24T07:02:29.162 INFO:tasks.workunit.client.1.smithi164.stdout:checking fcntl.h presence... yes 2022-01-24T07:02:29.165 INFO:tasks.workunit.client.1.smithi164.stdout:checking for fcntl.h... yes 2022-01-24T07:02:29.241 INFO:tasks.workunit.client.0.smithi164.stdout:checking for int... yes 2022-01-24T07:02:29.273 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/fcntl.h usability... yes 2022-01-24T07:02:29.308 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/fcntl.h presence... yes 2022-01-24T07:02:29.311 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sys/fcntl.h... yes 2022-01-24T07:02:29.355 INFO:tasks.workunit.client.0.smithi164.stdout:checking size of int... 4 2022-01-24T07:02:29.432 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/param.h usability... yes 2022-01-24T07:02:29.450 INFO:tasks.workunit.client.0.smithi164.stdout:checking for long... yes 2022-01-24T07:02:29.474 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/param.h presence... yes 2022-01-24T07:02:29.477 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sys/param.h... yes 2022-01-24T07:02:29.564 INFO:tasks.workunit.client.0.smithi164.stdout:checking size of long... 8 2022-01-24T07:02:29.570 INFO:tasks.workunit.client.1.smithi164.stdout:checking ioctl.h usability... no 2022-01-24T07:02:29.607 INFO:tasks.workunit.client.1.smithi164.stdout:checking ioctl.h presence... no 2022-01-24T07:02:29.610 INFO:tasks.workunit.client.1.smithi164.stdout:checking for ioctl.h... no 2022-01-24T07:02:29.655 INFO:tasks.workunit.client.0.smithi164.stdout:checking for long long... yes 2022-01-24T07:02:29.710 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/ioctl.h usability... yes 2022-01-24T07:02:29.746 INFO:tasks.workunit.client.1.smithi164.stdout:checking sys/ioctl.h presence... yes 2022-01-24T07:02:29.750 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sys/ioctl.h... yes 2022-01-24T07:02:29.774 INFO:tasks.workunit.client.0.smithi164.stdout:checking size of long long... 8 2022-01-24T07:02:29.865 INFO:tasks.workunit.client.0.smithi164.stdout:checking for ssize_t... yes 2022-01-24T07:02:29.888 INFO:tasks.workunit.client.1.smithi164.stdout:checking return type of signal handlers... void 2022-01-24T07:02:29.946 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sig_atomic_t... yes 2022-01-24T07:02:29.977 INFO:tasks.workunit.client.1.smithi164.stdout:checking for size_t... yes 2022-01-24T07:02:30.060 INFO:tasks.workunit.client.1.smithi164.stdout:checking for dev_t... yes 2022-01-24T07:02:30.071 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether gcc needs -traditional... no 2022-01-24T07:02:30.142 INFO:tasks.workunit.client.0.smithi164.stdout:checking for an ANSI C-conforming const... yes 2022-01-24T07:02:30.146 INFO:tasks.workunit.client.1.smithi164.stdout:checking for short... yes 2022-01-24T07:02:30.203 INFO:tasks.workunit.client.0.smithi164.stdout:checking for inline... inline 2022-01-24T07:02:30.262 INFO:tasks.workunit.client.1.smithi164.stdout:checking size of short... 2 2022-01-24T07:02:30.315 INFO:tasks.workunit.client.0.smithi164.stdout:checking for working alloca.h... yes 2022-01-24T07:02:30.353 INFO:tasks.workunit.client.1.smithi164.stdout:checking for int... yes 2022-01-24T07:02:30.410 INFO:tasks.workunit.client.0.smithi164.stdout:checking for alloca... yes 2022-01-24T07:02:30.477 INFO:tasks.workunit.client.1.smithi164.stdout:checking size of int... 4 2022-01-24T07:02:30.527 INFO:tasks.workunit.client.0.smithi164.stdout:checking for working memcmp... yes 2022-01-24T07:02:30.569 INFO:tasks.workunit.client.1.smithi164.stdout:checking for long... yes 2022-01-24T07:02:30.640 INFO:tasks.workunit.client.0.smithi164.stdout:checking for strftime... yes 2022-01-24T07:02:30.683 INFO:tasks.workunit.client.1.smithi164.stdout:checking size of long... 8 2022-01-24T07:02:30.774 INFO:tasks.workunit.client.1.smithi164.stdout:checking for long long... yes 2022-01-24T07:02:30.778 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2022-01-24T07:02:30.890 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether stat accepts an empty string... no 2022-01-24T07:02:30.891 INFO:tasks.workunit.client.1.smithi164.stdout:checking size of long long... 8 2022-01-24T07:02:30.989 INFO:tasks.workunit.client.1.smithi164.stdout:checking for ssize_t... yes 2022-01-24T07:02:31.004 INFO:tasks.workunit.client.0.smithi164.stdout:checking for vprintf... yes 2022-01-24T07:02:31.074 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sig_atomic_t... yes 2022-01-24T07:02:31.116 INFO:tasks.workunit.client.0.smithi164.stdout:checking for _doprnt... no 2022-01-24T07:02:31.149 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether gcc needs -traditional... no 2022-01-24T07:02:31.187 INFO:tasks.workunit.client.0.smithi164.stdout:checking build system type... x86_64-unknown-linux-gnu 2022-01-24T07:02:31.223 INFO:tasks.workunit.client.1.smithi164.stdout:checking for an ANSI C-conforming const... yes 2022-01-24T07:02:31.228 INFO:tasks.workunit.client.0.smithi164.stdout:checking host system type... x86_64-unknown-linux-gnu 2022-01-24T07:02:31.283 INFO:tasks.workunit.client.1.smithi164.stdout:checking for inline... inline 2022-01-24T07:02:31.343 INFO:tasks.workunit.client.0.smithi164.stdout:checking for the pthreads library -lpthreads... no 2022-01-24T07:02:31.394 INFO:tasks.workunit.client.1.smithi164.stdout:checking for working alloca.h... yes 2022-01-24T07:02:31.447 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether pthreads work without any flags... no 2022-01-24T07:02:31.479 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether pthreads work with -Kthread... no 2022-01-24T07:02:31.491 INFO:tasks.workunit.client.1.smithi164.stdout:checking for alloca... yes 2022-01-24T07:02:31.511 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether pthreads work with -kthread... no 2022-01-24T07:02:31.593 INFO:tasks.workunit.client.0.smithi164.stdout:checking for the pthreads library -llthread... no 2022-01-24T07:02:31.621 INFO:tasks.workunit.client.1.smithi164.stdout:checking for working memcmp... yes 2022-01-24T07:02:31.706 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether pthreads work with -pthread... yes 2022-01-24T07:02:31.732 INFO:tasks.workunit.client.1.smithi164.stdout:checking for strftime... yes 2022-01-24T07:02:31.808 INFO:tasks.workunit.client.0.smithi164.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2022-01-24T07:02:31.808 INFO:tasks.workunit.client.0.smithi164.stdout:checking if more special flags are required for pthreads... no 2022-01-24T07:02:31.808 INFO:tasks.workunit.client.0.smithi164.stdout:checking for cc_r... gcc 2022-01-24T07:02:31.872 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2022-01-24T07:02:31.933 INFO:tasks.workunit.client.0.smithi164.stdout:checking for setrlimit... yes 2022-01-24T07:02:31.988 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether stat accepts an empty string... no 2022-01-24T07:02:32.049 INFO:tasks.workunit.client.0.smithi164.stdout:checking for setproctitle... no 2022-01-24T07:02:32.103 INFO:tasks.workunit.client.1.smithi164.stdout:checking for vprintf... yes 2022-01-24T07:02:32.172 INFO:tasks.workunit.client.0.smithi164.stdout:checking for getopt_long... yes 2022-01-24T07:02:32.213 INFO:tasks.workunit.client.1.smithi164.stdout:checking for _doprnt... no 2022-01-24T07:02:32.283 INFO:tasks.workunit.client.1.smithi164.stdout:checking build system type... x86_64-unknown-linux-gnu 2022-01-24T07:02:32.299 INFO:tasks.workunit.client.0.smithi164.stdout:checking for strtoull... yes 2022-01-24T07:02:32.325 INFO:tasks.workunit.client.1.smithi164.stdout:checking host system type... x86_64-unknown-linux-gnu 2022-01-24T07:02:32.425 INFO:tasks.workunit.client.1.smithi164.stdout:checking for the pthreads library -lpthreads... no 2022-01-24T07:02:32.479 INFO:tasks.workunit.client.0.smithi164.stdout:checking for strtoq... yes 2022-01-24T07:02:32.530 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether pthreads work without any flags... no 2022-01-24T07:02:32.561 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether pthreads work with -Kthread... no 2022-01-24T07:02:32.593 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether pthreads work with -kthread... no 2022-01-24T07:02:32.626 INFO:tasks.workunit.client.0.smithi164.stdout:checking for snprintf... yes 2022-01-24T07:02:32.678 INFO:tasks.workunit.client.1.smithi164.stdout:checking for the pthreads library -llthread... no 2022-01-24T07:02:32.761 INFO:tasks.workunit.client.0.smithi164.stdout:checking for vsnprintf... yes 2022-01-24T07:02:32.782 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether pthreads work with -pthread... yes 2022-01-24T07:02:32.880 INFO:tasks.workunit.client.1.smithi164.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2022-01-24T07:02:32.881 INFO:tasks.workunit.client.1.smithi164.stdout:checking if more special flags are required for pthreads... no 2022-01-24T07:02:32.881 INFO:tasks.workunit.client.1.smithi164.stdout:checking for cc_r... gcc 2022-01-24T07:02:32.888 INFO:tasks.workunit.client.0.smithi164.stdout:checking for vfprintf... yes 2022-01-24T07:02:33.008 INFO:tasks.workunit.client.1.smithi164.stdout:checking for setrlimit... yes 2022-01-24T07:02:33.012 INFO:tasks.workunit.client.0.smithi164.stdout:checking for gethostname... yes 2022-01-24T07:02:33.132 INFO:tasks.workunit.client.1.smithi164.stdout:checking for setproctitle... no 2022-01-24T07:02:33.138 INFO:tasks.workunit.client.0.smithi164.stdout:checking for setlocale... yes 2022-01-24T07:02:33.250 INFO:tasks.workunit.client.1.smithi164.stdout:checking for getopt_long... yes 2022-01-24T07:02:33.259 INFO:tasks.workunit.client.0.smithi164.stdout:checking for sync... yes 2022-01-24T07:02:33.380 INFO:tasks.workunit.client.1.smithi164.stdout:checking for strtoull... yes 2022-01-24T07:02:33.407 INFO:tasks.workunit.client.0.smithi164.stdout:checking whether snprintf is C99 conformant... done 2022-01-24T07:02:33.430 INFO:tasks.workunit.client.0.smithi164.stdout:configure: creating ./config.status 2022-01-24T07:02:33.514 INFO:tasks.workunit.client.1.smithi164.stdout:checking for strtoq... yes 2022-01-24T07:02:33.654 INFO:tasks.workunit.client.1.smithi164.stdout:checking for snprintf... yes 2022-01-24T07:02:33.769 INFO:tasks.workunit.client.0.smithi164.stdout:config.status: creating Makefile 2022-01-24T07:02:33.781 INFO:tasks.workunit.client.1.smithi164.stdout:checking for vsnprintf... yes 2022-01-24T07:02:33.823 INFO:tasks.workunit.client.0.smithi164.stdout:config.status: creating src/Makefile 2022-01-24T07:02:33.908 INFO:tasks.workunit.client.1.smithi164.stdout:checking for vfprintf... yes 2022-01-24T07:02:34.031 INFO:tasks.workunit.client.1.smithi164.stdout:checking for gethostname... yes 2022-01-24T07:02:34.079 INFO:tasks.workunit.client.0.smithi164.stdout:config.status: creating man/Makefile 2022-01-24T07:02:34.156 INFO:tasks.workunit.client.1.smithi164.stdout:checking for setlocale... yes 2022-01-24T07:02:34.279 INFO:tasks.workunit.client.1.smithi164.stdout:checking for sync... yes 2022-01-24T07:02:34.299 INFO:tasks.workunit.client.0.smithi164.stdout:config.status: creating config.h 2022-01-24T07:02:34.399 INFO:tasks.workunit.client.0.smithi164.stdout:config.status: executing depfiles commands 2022-01-24T07:02:34.460 INFO:tasks.workunit.client.1.smithi164.stdout:checking whether snprintf is C99 conformant... done 2022-01-24T07:02:34.488 INFO:tasks.workunit.client.1.smithi164.stdout:configure: creating ./config.status 2022-01-24T07:02:34.790 INFO:tasks.workunit.client.0.smithi164.stdout:make all-recursive 2022-01-24T07:02:34.792 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-01-24T07:02:34.799 INFO:tasks.workunit.client.0.smithi164.stdout:Making all in src 2022-01-24T07:02:34.815 INFO:tasks.workunit.client.0.smithi164.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2022-01-24T07:02:34.815 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2022-01-24T07:02:34.815 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2022-01-24T07:02:34.942 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2022-01-24T07:02:34.942 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2022-01-24T07:02:34.998 INFO:tasks.workunit.client.1.smithi164.stdout:config.status: creating Makefile 2022-01-24T07:02:35.047 INFO:tasks.workunit.client.1.smithi164.stdout:config.status: creating src/Makefile 2022-01-24T07:02:35.083 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2022-01-24T07:02:35.083 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2022-01-24T07:02:35.097 INFO:tasks.workunit.client.1.smithi164.stdout:config.status: creating man/Makefile 2022-01-24T07:02:35.121 INFO:tasks.workunit.client.1.smithi164.stdout:config.status: creating config.h 2022-01-24T07:02:35.206 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2022-01-24T07:02:35.206 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2022-01-24T07:02:35.216 INFO:tasks.workunit.client.1.smithi164.stdout:config.status: executing depfiles commands 2022-01-24T07:02:35.333 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2022-01-24T07:02:35.333 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2022-01-24T07:02:35.449 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2022-01-24T07:02:35.450 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2022-01-24T07:02:35.558 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2022-01-24T07:02:35.558 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2022-01-24T07:02:35.613 INFO:tasks.workunit.client.1.smithi164.stdout:make all-recursive 2022-01-24T07:02:35.616 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0' 2022-01-24T07:02:35.623 INFO:tasks.workunit.client.1.smithi164.stdout:Making all in src 2022-01-24T07:02:35.631 INFO:tasks.workunit.client.1.smithi164.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0/src' 2022-01-24T07:02:35.631 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2022-01-24T07:02:35.631 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2022-01-24T07:02:35.698 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2022-01-24T07:02:35.698 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2022-01-24T07:02:35.742 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2022-01-24T07:02:35.742 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2022-01-24T07:02:35.792 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2022-01-24T07:02:35.792 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2022-01-24T07:02:35.867 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2022-01-24T07:02:35.867 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2022-01-24T07:02:35.889 INFO:tasks.workunit.client.0.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2022-01-24T07:02:35.890 INFO:tasks.workunit.client.0.smithi164.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2022-01-24T07:02:35.983 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2022-01-24T07:02:35.984 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2022-01-24T07:02:35.984 INFO:tasks.workunit.client.0.smithi164.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2022-01-24T07:02:36.026 INFO:tasks.workunit.client.0.smithi164.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2022-01-24T07:02:36.027 INFO:tasks.workunit.client.0.smithi164.stdout:Making all in man 2022-01-24T07:02:36.035 INFO:tasks.workunit.client.0.smithi164.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2022-01-24T07:02:36.035 INFO:tasks.workunit.client.0.smithi164.stdout:make[2]: Nothing to be done for 'all'. 2022-01-24T07:02:36.036 INFO:tasks.workunit.client.0.smithi164.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2022-01-24T07:02:36.040 INFO:tasks.workunit.client.0.smithi164.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-01-24T07:02:36.042 INFO:tasks.workunit.client.0.smithi164.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-01-24T07:02:36.044 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2022-01-24T07:02:36.050 INFO:tasks.workunit.client.0.smithi164.stdout:running blogbench 2022-01-24T07:02:36.052 INFO:tasks.workunit.client.0.smithi164.stdout: 2022-01-24T07:02:36.052 INFO:tasks.workunit.client.0.smithi164.stdout:Frequency = 10 secs 2022-01-24T07:02:36.052 INFO:tasks.workunit.client.0.smithi164.stdout:Scratch dir = [blogtest_in] 2022-01-24T07:02:36.186 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2022-01-24T07:02:36.186 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2022-01-24T07:02:36.574 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2022-01-24T07:02:36.574 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2022-01-24T07:02:36.955 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2022-01-24T07:02:36.955 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2022-01-24T07:02:37.362 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2022-01-24T07:02:37.362 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2022-01-24T07:02:37.707 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2022-01-24T07:02:37.707 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2022-01-24T07:02:37.855 INFO:tasks.workunit.client.1.smithi164.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2022-01-24T07:02:37.855 INFO:tasks.workunit.client.1.smithi164.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2022-01-24T07:02:38.068 INFO:tasks.workunit.client.1.smithi164.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2022-01-24T07:02:38.110 INFO:tasks.workunit.client.1.smithi164.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0/src' 2022-01-24T07:02:38.111 INFO:tasks.workunit.client.1.smithi164.stdout:Making all in man 2022-01-24T07:02:38.122 INFO:tasks.workunit.client.1.smithi164.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0/man' 2022-01-24T07:02:38.122 INFO:tasks.workunit.client.1.smithi164.stdout:make[2]: Nothing to be done for 'all'. 2022-01-24T07:02:38.123 INFO:tasks.workunit.client.1.smithi164.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0/man' 2022-01-24T07:02:38.126 INFO:tasks.workunit.client.1.smithi164.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0' 2022-01-24T07:02:38.129 INFO:tasks.workunit.client.1.smithi164.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0' 2022-01-24T07:02:38.130 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/blogbench-1.0' 2022-01-24T07:02:38.136 INFO:tasks.workunit.client.1.smithi164.stdout:running blogbench 2022-01-24T07:02:38.137 INFO:tasks.workunit.client.1.smithi164.stdout: 2022-01-24T07:02:38.138 INFO:tasks.workunit.client.1.smithi164.stdout:Frequency = 10 secs 2022-01-24T07:02:38.138 INFO:tasks.workunit.client.1.smithi164.stdout:Scratch dir = [blogtest_in] 2022-01-24T07:02:38.802 INFO:tasks.workunit.client.0.smithi164.stdout:Spawning 3 writers... 2022-01-24T07:02:38.803 INFO:tasks.workunit.client.1.smithi164.stdout:Spawning 3 writers... 2022-01-24T07:02:38.803 INFO:tasks.workunit.client.1.smithi164.stdout:Spawning 1 rewriters... 2022-01-24T07:02:38.803 INFO:tasks.workunit.client.1.smithi164.stdout:Spawning 5 commenters... 2022-01-24T07:02:38.804 INFO:tasks.workunit.client.0.smithi164.stdout:Spawning 1 rewriters... 2022-01-24T07:02:38.804 INFO:tasks.workunit.client.0.smithi164.stdout:Spawning 5 commenters... 2022-01-24T07:02:38.805 INFO:tasks.workunit.client.1.smithi164.stdout:Spawning 100 readers... 2022-01-24T07:02:38.805 INFO:tasks.workunit.client.0.smithi164.stdout:Spawning 100 readers... 2022-01-24T07:02:38.809 INFO:tasks.workunit.client.0.smithi164.stdout:Benchmarking for 30 iterations. 2022-01-24T07:02:38.809 INFO:tasks.workunit.client.0.smithi164.stdout:The test will run during 5 minutes. 2022-01-24T07:02:38.810 INFO:tasks.workunit.client.0.smithi164.stdout: 2022-01-24T07:02:38.810 INFO:tasks.workunit.client.0.smithi164.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2022-01-24T07:02:38.810 INFO:tasks.workunit.client.1.smithi164.stdout:Benchmarking for 30 iterations. 2022-01-24T07:02:38.810 INFO:tasks.workunit.client.1.smithi164.stdout:The test will run during 5 minutes. 2022-01-24T07:02:38.811 INFO:tasks.workunit.client.1.smithi164.stdout: 2022-01-24T07:02:38.811 INFO:tasks.workunit.client.1.smithi164.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2022-01-24T07:02:48.810 INFO:tasks.workunit.client.0.smithi164.stdout: 11 138975 545 108389 566 80767 1306 2022-01-24T07:02:48.810 INFO:tasks.workunit.client.1.smithi164.stdout: 9 205939 749 120935 459 64141 1221 2022-01-24T07:02:57.957 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:02:57.961 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:02:57.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:02:58.810 INFO:tasks.workunit.client.1.smithi164.stdout: 17 291784 500 159443 367 119797 1318 2022-01-24T07:02:58.812 INFO:tasks.workunit.client.0.smithi164.stdout: 19 243911 442 160099 483 161662 1372 2022-01-24T07:03:08.810 INFO:tasks.workunit.client.1.smithi164.stdout: 27 182857 620 98652 392 67022 348 2022-01-24T07:03:08.811 INFO:tasks.workunit.client.0.smithi164.stdout: 30 221440 546 158125 544 116125 274 2022-01-24T07:03:18.810 INFO:tasks.workunit.client.1.smithi164.stdout: 45 294613 957 176308 1069 65448 41 2022-01-24T07:03:18.811 INFO:tasks.workunit.client.0.smithi164.stdout: 43 197808 845 129478 528 59480 34 2022-01-24T07:03:28.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:03:28.346 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:03:28.348 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:03:28.810 INFO:tasks.workunit.client.0.smithi164.stdout: 66 210764 1117 138816 1066 47862 38 2022-01-24T07:03:28.812 INFO:tasks.workunit.client.1.smithi164.stdout: 67 246311 977 156721 932 40507 184 2022-01-24T07:03:38.811 INFO:tasks.workunit.client.0.smithi164.stdout: 92 325032 1211 210606 1178 48844 160 2022-01-24T07:03:38.815 INFO:tasks.workunit.client.1.smithi164.stdout: 90 368467 1346 233646 996 53174 77 2022-01-24T07:03:48.811 INFO:tasks.workunit.client.0.smithi164.stdout: 102 341654 655 227500 636 57092 861 2022-01-24T07:03:48.817 INFO:tasks.workunit.client.1.smithi164.stdout: 107 354492 714 221923 930 46647 344 2022-01-24T07:03:58.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:03:58.703 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:03:58.706 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:03:58.815 INFO:tasks.workunit.client.0.smithi164.stdout: 110 354186 391 236405 554 68986 448 2022-01-24T07:03:58.817 INFO:tasks.workunit.client.1.smithi164.stdout: 126 330936 902 208274 985 42678 72 2022-01-24T07:04:08.815 INFO:tasks.workunit.client.0.smithi164.stdout: 127 404312 908 277887 944 82965 649 2022-01-24T07:04:08.817 INFO:tasks.workunit.client.1.smithi164.stdout: 146 293332 1167 188612 881 31740 129 2022-01-24T07:04:18.816 INFO:tasks.workunit.client.0.smithi164.stdout: 153 325494 1611 228547 1376 66221 276 2022-01-24T07:04:18.817 INFO:tasks.workunit.client.1.smithi164.stdout: 169 349896 1241 224956 972 36823 626 2022-01-24T07:04:28.818 INFO:tasks.workunit.client.1.smithi164.stdout: 197 353499 1361 228661 1619 43018 27 2022-01-24T07:04:28.820 INFO:tasks.workunit.client.0.smithi164.stdout: 182 333362 1602 228449 1290 55879 308 2022-01-24T07:04:28.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:04:28.883 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:04:28.885 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:04:38.818 INFO:tasks.workunit.client.1.smithi164.stdout: 225 354711 1573 225467 1292 33018 33 2022-01-24T07:04:38.826 INFO:tasks.workunit.client.0.smithi164.stdout: 203 326663 1147 224341 1251 65807 1528 2022-01-24T07:04:48.820 INFO:tasks.workunit.client.1.smithi164.stdout: 250 354958 1749 224559 1146 33803 38 2022-01-24T07:04:48.827 INFO:tasks.workunit.client.0.smithi164.stdout: 221 327711 955 229360 1243 71806 1607 2022-01-24T07:04:58.820 INFO:tasks.workunit.client.1.smithi164.stdout: 272 357949 1293 226887 983 29951 172 2022-01-24T07:04:58.827 INFO:tasks.workunit.client.0.smithi164.stdout: 241 321603 1285 228372 1042 79689 1570 2022-01-24T07:04:59.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:04:59.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:04:59.431 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:05:08.820 INFO:tasks.workunit.client.1.smithi164.stdout: 288 357440 1051 224999 839 32011 745 2022-01-24T07:05:08.828 INFO:tasks.workunit.client.0.smithi164.stdout: 263 319440 1095 223851 1076 88391 1031 2022-01-24T07:05:18.820 INFO:tasks.workunit.client.1.smithi164.stdout: 304 350445 786 217056 944 39271 1041 2022-01-24T07:05:18.834 INFO:tasks.workunit.client.0.smithi164.stdout: 283 320480 1049 221636 871 88353 1318 2022-01-24T07:05:28.824 INFO:tasks.workunit.client.1.smithi164.stdout: 321 352912 986 221482 880 44525 831 2022-01-24T07:05:28.833 INFO:tasks.workunit.client.0.smithi164.stdout: 301 325179 893 225321 1094 94216 833 2022-01-24T07:05:29.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:05:29.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:05:29.843 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:05:38.824 INFO:tasks.workunit.client.1.smithi164.stdout: 341 348747 1080 221571 1094 48008 1059 2022-01-24T07:05:38.834 INFO:tasks.workunit.client.0.smithi164.stdout: 332 328618 1144 232088 1249 90940 72 2022-01-24T07:05:48.825 INFO:tasks.workunit.client.1.smithi164.stdout: 364 353645 947 226869 1127 50352 758 2022-01-24T07:05:48.834 INFO:tasks.workunit.client.0.smithi164.stdout: 352 331541 1274 227635 962 86533 62 2022-01-24T07:05:58.825 INFO:tasks.workunit.client.1.smithi164.stdout: 376 352696 869 220512 803 55402 800 2022-01-24T07:05:58.837 INFO:tasks.workunit.client.0.smithi164.stdout: 373 332273 955 226487 1118 86095 488 2022-01-24T07:06:00.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:06:00.306 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:06:00.309 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:06:08.830 INFO:tasks.workunit.client.1.smithi164.stdout: 393 344919 1048 220221 872 59591 1330 2022-01-24T07:06:08.835 INFO:tasks.workunit.client.0.smithi164.stdout: 393 329523 1005 227551 1073 79162 713 2022-01-24T07:06:18.830 INFO:tasks.workunit.client.1.smithi164.stdout: 411 335587 992 216164 1016 64303 1208 2022-01-24T07:06:18.840 INFO:tasks.workunit.client.0.smithi164.stdout: 413 328671 947 227904 1093 82246 1183 2022-01-24T07:06:28.832 INFO:tasks.workunit.client.1.smithi164.stdout: 435 334491 1204 213556 1152 67368 675 2022-01-24T07:06:28.842 INFO:tasks.workunit.client.0.smithi164.stdout: 428 323472 1038 224889 958 86715 1437 2022-01-24T07:06:30.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:06:30.677 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:06:30.689 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:06:38.832 INFO:tasks.workunit.client.1.smithi164.stdout: 456 342600 1152 223008 930 68510 658 2022-01-24T07:06:38.843 INFO:tasks.workunit.client.0.smithi164.stdout: 444 330545 945 229156 781 81232 1103 2022-01-24T07:06:48.836 INFO:tasks.workunit.client.1.smithi164.stdout: 472 343608 860 221746 785 68648 570 2022-01-24T07:06:48.844 INFO:tasks.workunit.client.0.smithi164.stdout: 456 328694 611 231595 580 89594 1243 2022-01-24T07:06:58.837 INFO:tasks.workunit.client.1.smithi164.stdout: 487 337902 953 217831 825 70140 583 2022-01-24T07:06:58.844 INFO:tasks.workunit.client.0.smithi164.stdout: 468 320821 954 221308 461 91390 1074 2022-01-24T07:07:01.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:07:01.131 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:07:01.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:07:08.837 INFO:tasks.workunit.client.1.smithi164.stdout: 508 338996 1206 218727 1146 71042 388 2022-01-24T07:07:08.845 INFO:tasks.workunit.client.0.smithi164.stdout: 484 324818 822 222855 1051 93593 1187 2022-01-24T07:07:18.838 INFO:tasks.workunit.client.1.smithi164.stdout: 523 340028 780 220136 934 66885 1134 2022-01-24T07:07:18.845 INFO:tasks.workunit.client.0.smithi164.stdout: 501 328562 803 225950 819 93927 970 2022-01-24T07:07:28.838 INFO:tasks.workunit.client.1.smithi164.stdout: 540 337595 830 218870 917 67916 1321 2022-01-24T07:07:28.845 INFO:tasks.workunit.client.0.smithi164.stdout: 525 322217 1154 222632 1057 93044 928 2022-01-24T07:07:32.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:07:32.447 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:07:32.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:07:38.838 INFO:tasks.workunit.client.1.smithi164.stdout: 554 332435 789 217129 733 77046 1447 2022-01-24T07:07:38.848 INFO:tasks.workunit.client.0.smithi164.stdout: 546 323319 1282 221649 752 89685 939 2022-01-24T07:07:46.600 INFO:tasks.workunit.client.1.smithi164.stdout: 2022-01-24T07:07:46.601 INFO:tasks.workunit.client.1.smithi164.stdout:Final score for writes: 554 2022-01-24T07:07:46.601 INFO:tasks.workunit.client.1.smithi164.stdout:Final score for reads : 189890 2022-01-24T07:07:46.601 INFO:tasks.workunit.client.1.smithi164.stdout: 2022-01-24T07:07:46.603 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-01-24T07:07:46.603 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2022-01-24T07:08:02.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:08:02.701 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:08:02.736 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:08:33.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:08:33.170 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:08:33.173 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:09:03.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:09:03.368 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:09:03.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:09:12.267 INFO:tasks.workunit.client.0.smithi164.stdout: 2022-01-24T07:09:12.267 INFO:tasks.workunit.client.0.smithi164.stdout:Final score for writes: 546 2022-01-24T07:09:12.267 INFO:tasks.workunit.client.0.smithi164.stdout:Final score for reads : 195287 2022-01-24T07:09:12.268 INFO:tasks.workunit.client.0.smithi164.stdout: 2022-01-24T07:09:12.269 INFO:teuthology.orchestra.run:Running command with timeout 3600 2022-01-24T07:09:12.269 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2022-01-24T07:09:33.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:09:33.548 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:09:33.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:09:33.622 INFO:tasks.ceph.mds.i.smithi145.stderr:2022-01-24T07:09:33.622+0000 7fcce75dd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66681) UID: 0 2022-01-24T07:09:33.623 INFO:tasks.ceph.mds.e.smithi145.stderr:2022-01-24T07:09:33.623+0000 7f168dffa700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66681) UID: 0 2022-01-24T07:09:33.623 INFO:tasks.ceph.mds.h.smithi145.stderr:2022-01-24T07:09:33.623+0000 7f48df8de700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66681) UID: 0 2022-01-24T07:09:33.624 INFO:tasks.ceph.mds.g.smithi145.stderr:2022-01-24T07:09:33.622+0000 7f85d3a9b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66681) UID: 0 2022-01-24T07:09:33.624 INFO:tasks.ceph.mds.f.smithi145.stderr:2022-01-24T07:09:33.623+0000 7f600af19700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66681) UID: 0 2022-01-24T07:12:49.723 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.1... 2022-01-24T07:12:49.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2022-01-24T07:12:50.852 DEBUG:teuthology.parallel:result is None 2022-01-24T07:13:28.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:13:28.259 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:13:28.272 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:13:28.583 INFO:tasks.ceph.mds.e.smithi145.stderr:2022-01-24T07:13:28.583+0000 7f168dffa700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66735) UID: 0 2022-01-24T07:13:28.583 INFO:tasks.ceph.mds.h.smithi145.stderr:2022-01-24T07:13:28.583+0000 7f48df8de700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66735) UID: 0 2022-01-24T07:13:28.584 INFO:tasks.ceph.mds.g.smithi145.stderr:2022-01-24T07:13:28.583+0000 7f85d3a9b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66735) UID: 0 2022-01-24T07:13:28.584 INFO:tasks.ceph.mds.i.smithi145.stderr:2022-01-24T07:13:28.583+0000 7fcce75dd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66735) UID: 0 2022-01-24T07:13:28.585 INFO:tasks.ceph.mds.f.smithi145.stderr:2022-01-24T07:13:28.583+0000 7f600af19700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 66735) UID: 0 2022-01-24T07:13:38.757 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2022-01-24T07:13:38.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2022-01-24T07:13:39.811 DEBUG:teuthology.parallel:result is None 2022-01-24T07:13:39.812 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2022-01-24T07:13:39.891 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2022-01-24T07:13:39.891 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2022-01-24T07:13:39.966 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2022-01-24T07:13:39.966 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2022-01-24T07:13:39.980 DEBUG:tasks.check_counter:Getting stats from a 2022-01-24T07:13:39.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2022-01-24T07:13:40.297 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:40.297 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:40.298 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 127364, 2022-01-24T07:13:40.298 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 212786, 2022-01-24T07:13:40.298 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 50157752, 2022-01-24T07:13:40.298 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 111600025, 2022-01-24T07:13:40.299 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 13, 2022-01-24T07:13:40.299 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2022-01-24T07:13:40.299 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 5.620250331, 2022-01-24T07:13:40.299 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 2.703797116, 2022-01-24T07:13:40.300 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 5.451603550, 2022-01-24T07:13:40.300 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.034209227, 2022-01-24T07:13:40.300 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.300 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 212786, 2022-01-24T07:13:40.300 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 103.975251578, 2022-01-24T07:13:40.301 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000488637 2022-01-24T07:13:40.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.301 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.301 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 147524, 2022-01-24T07:13:40.302 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.049045937, 2022-01-24T07:13:40.302 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000332 2022-01-24T07:13:40.302 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.303 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:40.303 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 27071, 2022-01-24T07:13:40.303 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 28964, 2022-01-24T07:13:40.303 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 9513949, 2022-01-24T07:13:40.303 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 110622472, 2022-01-24T07:13:40.304 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:40.304 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:40.304 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 2.313687627, 2022-01-24T07:13:40.304 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.850334337, 2022-01-24T07:13:40.305 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.809116582, 2022-01-24T07:13:40.305 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.691298192, 2022-01-24T07:13:40.305 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.305 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 28963, 2022-01-24T07:13:40.306 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.277346570, 2022-01-24T07:13:40.306 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000216736 2022-01-24T07:13:40.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.306 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.306 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 22905, 2022-01-24T07:13:40.307 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.003924446, 2022-01-24T07:13:40.307 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000171 2022-01-24T07:13:40.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.308 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:40.308 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 20964, 2022-01-24T07:13:40.308 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 21982, 2022-01-24T07:13:40.308 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 10573329, 2022-01-24T07:13:40.309 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 95767919, 2022-01-24T07:13:40.309 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:40.309 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:40.309 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.740212500, 2022-01-24T07:13:40.309 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.685988427, 2022-01-24T07:13:40.310 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.673124472, 2022-01-24T07:13:40.310 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.435563290, 2022-01-24T07:13:40.310 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.310 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 21980, 2022-01-24T07:13:40.311 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.006468023, 2022-01-24T07:13:40.311 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000318765 2022-01-24T07:13:40.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.311 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.311 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 19293, 2022-01-24T07:13:40.312 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.003570910, 2022-01-24T07:13:40.312 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000185 2022-01-24T07:13:40.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.313 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:40.313 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:40.313 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:40.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.314 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:40.314 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:40.314 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:40.314 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4897, 2022-01-24T07:13:40.315 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 42.818679453, 2022-01-24T07:13:40.315 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.008743859 2022-01-24T07:13:40.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.315 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:40.316 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:40.316 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:40.316 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 23049, 2022-01-24T07:13:40.316 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 3.420750596, 2022-01-24T07:13:40.317 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000148412 2022-01-24T07:13:40.317 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.317 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:40.318 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 67558, 2022-01-24T07:13:40.318 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 66720, 2022-01-24T07:13:40.318 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:40.318 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 66720, 2022-01-24T07:13:40.319 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1754.256505529, 2022-01-24T07:13:40.319 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.026292813 2022-01-24T07:13:40.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.319 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 834, 2022-01-24T07:13:40.320 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:40.320 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 479, 2022-01-24T07:13:40.320 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 52, 2022-01-24T07:13:40.320 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:40.320 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 17, 2022-01-24T07:13:40.321 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 0, 2022-01-24T07:13:40.321 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 6, 2022-01-24T07:13:40.321 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 11, 2022-01-24T07:13:40.321 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 16, 2022-01-24T07:13:40.322 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 11745, 2022-01-24T07:13:40.322 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 3, 2022-01-24T07:13:40.322 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 3, 2022-01-24T07:13:40.322 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 4, 2022-01-24T07:13:40.323 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 106393, 2022-01-24T07:13:40.323 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 96734, 2022-01-24T07:13:40.323 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 692, 2022-01-24T07:13:40.323 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 445, 2022-01-24T07:13:40.323 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:40.324 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:40.324 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 288, 2022-01-24T07:13:40.324 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 0, 2022-01-24T07:13:40.324 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:40.325 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 197, 2022-01-24T07:13:40.325 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 1899, 2022-01-24T07:13:40.325 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 307, 2022-01-24T07:13:40.325 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:40.326 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:40.326 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:40.326 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:40.326 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:40.326 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:40.327 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:40.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.327 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:40.327 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:40.328 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:40.328 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:40.328 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 21621, 2022-01-24T07:13:40.328 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 21621, 2022-01-24T07:13:40.329 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:40.329 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:40.329 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:40.329 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:40.329 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:40.330 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:40.330 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:40.330 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:40.330 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 197, 2022-01-24T07:13:40.331 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:40.331 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 52, 2022-01-24T07:13:40.331 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:40.331 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:40.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.332 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:40.332 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 92679, 2022-01-24T07:13:40.332 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:40.332 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:40.333 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 92679, 2022-01-24T07:13:40.333 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:40.333 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:40.333 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 115, 2022-01-24T07:13:40.334 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:40.334 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:40.334 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 115, 2022-01-24T07:13:40.334 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:40.335 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:40.335 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:40.335 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 205137124, 2022-01-24T07:13:40.335 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:40.335 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:40.336 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2395, 2022-01-24T07:13:40.336 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 106.863681156, 2022-01-24T07:13:40.336 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.044619491 2022-01-24T07:13:40.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.337 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:40.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.337 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:40.337 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 27, 2022-01-24T07:13:40.338 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 22801, 2022-01-24T07:13:40.338 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 22774, 2022-01-24T07:13:40.338 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 26, 2022-01-24T07:13:40.338 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 1278, 2022-01-24T07:13:40.338 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 1252, 2022-01-24T07:13:40.339 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 16, 2022-01-24T07:13:40.339 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 60758, 2022-01-24T07:13:40.339 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 60742, 2022-01-24T07:13:40.339 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 2, 2022-01-24T07:13:40.340 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 28366, 2022-01-24T07:13:40.340 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 28364, 2022-01-24T07:13:40.340 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 101932, 2022-01-24T07:13:40.340 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:40.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.341 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:40.341 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 79589, 2022-01-24T07:13:40.341 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 3667, 2022-01-24T07:13:40.341 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 67558, 2022-01-24T07:13:40.342 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 248, 2022-01-24T07:13:40.342 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 5573, 2022-01-24T07:13:40.342 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:40.342 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9238, 2022-01-24T07:13:40.343 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 30.521100274, 2022-01-24T07:13:40.343 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003303864 2022-01-24T07:13:40.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.343 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:40.343 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 96, 2022-01-24T07:13:40.344 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.331251760, 2022-01-24T07:13:40.344 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.024283872 2022-01-24T07:13:40.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.344 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:40.345 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.345 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.345 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.346 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:40.346 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.346 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.346 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 24500, 2022-01-24T07:13:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 255.095576086, 2022-01-24T07:13:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.010412064 2022-01-24T07:13:40.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.348 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:40.348 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.348 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.348 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.349 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:40.349 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.349 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.350 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.350 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:40.350 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.351 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.351 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.351 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:40.351 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.352 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.352 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.352 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:40.353 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.353 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.353 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.353 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:40.354 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.354 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.354 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.355 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:40.355 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 55, 2022-01-24T07:13:40.355 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.863603259, 2022-01-24T07:13:40.355 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.015701877 2022-01-24T07:13:40.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.356 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:40.356 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.356 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.356 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.357 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:40.358 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2585, 2022-01-24T07:13:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.625668664, 2022-01-24T07:13:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002949968 2022-01-24T07:13:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:40.359 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 870, 2022-01-24T07:13:40.360 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.215690230, 2022-01-24T07:13:40.360 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002546770 2022-01-24T07:13:40.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.360 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9203, 2022-01-24T07:13:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 297.051720129, 2022-01-24T07:13:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.032277705 2022-01-24T07:13:40.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.362 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:40.362 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.362 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.362 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.363 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:40.363 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 145, 2022-01-24T07:13:40.363 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 43.884868943, 2022-01-24T07:13:40.364 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.302654268 2022-01-24T07:13:40.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.364 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:40.364 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.365 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.365 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.365 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:40.365 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.366 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.366 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.366 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:40.367 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.367 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.367 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.368 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:40.368 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.368 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.368 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.369 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:40.369 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.369 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.369 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.370 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:40.370 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.370 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.371 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.371 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:40.371 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.371 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.372 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.372 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:40.372 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.373 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.373 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.373 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:40.374 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 20028, 2022-01-24T07:13:40.374 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1114.667026184, 2022-01-24T07:13:40.374 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.055655433 2022-01-24T07:13:40.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.374 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:40.375 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:40.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.375 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:40.375 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:40.376 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:40.376 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:40.376 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:40.376 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:40.376 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 12939, 2022-01-24T07:13:40.377 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 6469, 2022-01-24T07:13:40.377 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 738 2022-01-24T07:13:40.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.377 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:40.378 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:40.378 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:40.378 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:40.378 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:40.379 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:40.379 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:40.379 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:40.379 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:40.379 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:40.380 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:40.380 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:40.380 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:40.380 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:40.381 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:40.381 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:40.381 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:40.381 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:40.381 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:40.382 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:40.382 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:40.382 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:40.382 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:40.383 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:40.383 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:40.383 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:40.383 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:40.383 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:40.384 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:40.384 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:40.384 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:40.384 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:40.385 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:40.385 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:40.385 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:40.385 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:40.385 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:40.386 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 223991, 2022-01-24T07:13:40.386 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 130, 2022-01-24T07:13:40.386 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 88, 2022-01-24T07:13:40.386 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 1, 2022-01-24T07:13:40.387 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:40.387 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:40.387 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:40.387 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:40.388 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:40.388 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:40.388 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:40.388 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:40.388 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:40.389 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:40.389 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:40.389 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:40.389 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 103166, 2022-01-24T07:13:40.390 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 612, 2022-01-24T07:13:40.390 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:40.390 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:40.390 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:40.390 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:40.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.391 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:40.391 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2022-01-24T07:13:40.391 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:40.392 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 26601, 2022-01-24T07:13:40.392 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 212396300, 2022-01-24T07:13:40.392 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 27, 2022-01-24T07:13:40.392 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 26601, 2022-01-24T07:13:40.393 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 26601, 2022-01-24T07:13:40.393 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 464, 2022-01-24T07:13:40.393 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 26137, 2022-01-24T07:13:40.393 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:40.393 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:40.394 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:40.394 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:40.394 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 464, 2022-01-24T07:13:40.394 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 2862, 2022-01-24T07:13:40.395 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 181, 2022-01-24T07:13:40.395 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:40.395 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:40.395 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:40.395 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 52, 2022-01-24T07:13:40.396 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 22440, 2022-01-24T07:13:40.396 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:40.396 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:40.396 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:40.397 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:40.397 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:40.397 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:40.397 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:40.397 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:40.398 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:40.398 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:40.398 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:40.398 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:40.399 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:40.399 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:40.399 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:40.399 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:40.400 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:40.400 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:40.400 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:40.400 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:40.400 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:40.401 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:40.401 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:40.401 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:40.401 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:40.402 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:40.402 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:40.402 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:40.402 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:40.402 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:40.403 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:40.403 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:40.403 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:40.403 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:40.404 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:40.404 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:40.404 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:40.404 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:40.404 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1164, 2022-01-24T07:13:40.405 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:40.405 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 154 2022-01-24T07:13:40.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.405 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:40.406 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:40.406 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:40.406 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:40.406 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:40.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.407 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:40.407 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:40.407 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:40.407 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2022-01-24T07:13:40.408 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:40.408 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 21621, 2022-01-24T07:13:40.408 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:40.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.409 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:40.409 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.409 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:40.409 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.409 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 175395, 2022-01-24T07:13:40.410 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 56369914, 2022-01-24T07:13:40.410 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.410 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 175395, 2022-01-24T07:13:40.410 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.411 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.411 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 175395, 2022-01-24T07:13:40.411 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 56369914, 2022-01-24T07:13:40.411 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.412 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.412 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.412 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.412 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.413 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:40.413 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.413 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:40.413 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.414 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:40.414 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:40.414 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.414 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:40.414 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 26601, 2022-01-24T07:13:40.415 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 214580781, 2022-01-24T07:13:40.415 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 4109, 2022-01-24T07:13:40.415 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 214580781, 2022-01-24T07:13:40.415 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.416 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.416 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.416 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.417 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:40.417 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.417 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:40.417 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.418 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:40.418 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:40.418 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.418 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:40.419 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 26601, 2022-01-24T07:13:40.419 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 26601, 2022-01-24T07:13:40.419 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 26601, 2022-01-24T07:13:40.419 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 26601, 2022-01-24T07:13:40.419 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.420 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.420 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.420 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 21621, 2022-01-24T07:13:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 2184481, 2022-01-24T07:13:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 21621, 2022-01-24T07:13:40.423 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.423 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.423 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 467, 2022-01-24T07:13:40.423 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 2184481, 2022-01-24T07:13:40.424 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.424 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.424 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.424 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.425 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x563c437cbae0": { 2022-01-24T07:13:40.425 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.425 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:40.426 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.426 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 92679, 2022-01-24T07:13:40.426 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 200942820, 2022-01-24T07:13:40.426 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.426 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 92679, 2022-01-24T07:13:40.427 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.427 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.427 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2395, 2022-01-24T07:13:40.427 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 200942820, 2022-01-24T07:13:40.428 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.428 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.428 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.428 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.429 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:40.431 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=52 2022-01-24T07:13:40.431 DEBUG:tasks.check_counter:Getting stats from b 2022-01-24T07:13:40.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2022-01-24T07:13:40.555 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:40.555 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:40.555 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 20206, 2022-01-24T07:13:40.556 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 20336, 2022-01-24T07:13:40.556 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 15151770, 2022-01-24T07:13:40.556 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 31950186, 2022-01-24T07:13:40.556 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:40.557 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 2, 2022-01-24T07:13:40.557 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.190944900, 2022-01-24T07:13:40.557 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.488166477, 2022-01-24T07:13:40.557 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.815007060, 2022-01-24T07:13:40.558 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.118527424, 2022-01-24T07:13:40.558 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.558 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 20338, 2022-01-24T07:13:40.558 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 8.603515961, 2022-01-24T07:13:40.559 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000423026 2022-01-24T07:13:40.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.559 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.559 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 32828, 2022-01-24T07:13:40.560 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.006208046, 2022-01-24T07:13:40.560 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000189 2022-01-24T07:13:40.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.560 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:40.561 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 98801, 2022-01-24T07:13:40.561 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 180585, 2022-01-24T07:13:40.561 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 32701380, 2022-01-24T07:13:40.562 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 127637930, 2022-01-24T07:13:40.562 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:40.562 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:40.562 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 5.023610605, 2022-01-24T07:13:40.563 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 2.399046174, 2022-01-24T07:13:40.563 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 3.497752968, 2022-01-24T07:13:40.563 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.254136961, 2022-01-24T07:13:40.563 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.564 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 180581, 2022-01-24T07:13:40.564 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 142.756565592, 2022-01-24T07:13:40.564 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000790540 2022-01-24T07:13:40.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.564 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.565 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 114441, 2022-01-24T07:13:40.565 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.035511307, 2022-01-24T07:13:40.565 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000310 2022-01-24T07:13:40.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.567 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:40.567 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 36616, 2022-01-24T07:13:40.568 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 60053, 2022-01-24T07:13:40.568 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 18353246, 2022-01-24T07:13:40.568 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 156142799, 2022-01-24T07:13:40.569 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:40.569 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:40.570 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 2.536658674, 2022-01-24T07:13:40.570 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 1.171450260, 2022-01-24T07:13:40.570 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 1.315337127, 2022-01-24T07:13:40.571 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.462133083, 2022-01-24T07:13:40.571 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.572 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 60052, 2022-01-24T07:13:40.572 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 18.385426677, 2022-01-24T07:13:40.572 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000306158 2022-01-24T07:13:40.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.573 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.573 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 40762, 2022-01-24T07:13:40.573 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.011925241, 2022-01-24T07:13:40.573 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000292 2022-01-24T07:13:40.574 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.574 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:40.574 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:40.575 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:40.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.575 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:40.575 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:40.576 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:40.576 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4585, 2022-01-24T07:13:40.576 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 51.271287129, 2022-01-24T07:13:40.576 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011182396 2022-01-24T07:13:40.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.577 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:40.577 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:40.578 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:40.578 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12167, 2022-01-24T07:13:40.578 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.537357339, 2022-01-24T07:13:40.579 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000208544 2022-01-24T07:13:40.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.579 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:40.579 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 61250, 2022-01-24T07:13:40.580 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 60301, 2022-01-24T07:13:40.580 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:40.580 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 60301, 2022-01-24T07:13:40.580 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1002.660028679, 2022-01-24T07:13:40.581 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.016627585 2022-01-24T07:13:40.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.581 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 946, 2022-01-24T07:13:40.581 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:40.582 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 668, 2022-01-24T07:13:40.582 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 73, 2022-01-24T07:13:40.582 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:40.582 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 25, 2022-01-24T07:13:40.582 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 7, 2022-01-24T07:13:40.583 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 5, 2022-01-24T07:13:40.583 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 13, 2022-01-24T07:13:40.583 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 15, 2022-01-24T07:13:40.583 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 42159, 2022-01-24T07:13:40.584 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 1, 2022-01-24T07:13:40.584 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 1, 2022-01-24T07:13:40.584 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 8, 2022-01-24T07:13:40.584 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 96102, 2022-01-24T07:13:40.585 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 88062, 2022-01-24T07:13:40.585 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 671, 2022-01-24T07:13:40.585 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 358, 2022-01-24T07:13:40.585 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:40.585 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:40.586 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 216, 2022-01-24T07:13:40.586 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 40, 2022-01-24T07:13:40.586 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:40.586 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 314, 2022-01-24T07:13:40.587 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 29508, 2022-01-24T07:13:40.587 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 295, 2022-01-24T07:13:40.587 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:40.587 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:40.588 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:40.588 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:40.588 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:40.588 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:40.588 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:40.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.589 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:40.589 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:40.589 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:40.590 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:40.590 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 10997, 2022-01-24T07:13:40.590 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 10997, 2022-01-24T07:13:40.590 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:40.591 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:40.591 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:40.591 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:40.591 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:40.591 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:40.592 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:40.592 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:40.592 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 314, 2022-01-24T07:13:40.592 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:40.593 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 73, 2022-01-24T07:13:40.593 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:40.593 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:40.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.593 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:40.594 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 84357, 2022-01-24T07:13:40.594 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:40.594 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:40.594 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 84357, 2022-01-24T07:13:40.595 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:40.595 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:40.595 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 99, 2022-01-24T07:13:40.595 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:40.595 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:40.596 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 99, 2022-01-24T07:13:40.596 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:40.596 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:40.596 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:40.597 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 196531731, 2022-01-24T07:13:40.597 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:40.597 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:40.597 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2253, 2022-01-24T07:13:40.597 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 162.893994157, 2022-01-24T07:13:40.598 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.072300929 2022-01-24T07:13:40.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.598 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:40.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.599 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:40.599 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 34, 2022-01-24T07:13:40.599 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 31283, 2022-01-24T07:13:40.599 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 31249, 2022-01-24T07:13:40.600 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 30, 2022-01-24T07:13:40.600 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 1591, 2022-01-24T07:13:40.600 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 1561, 2022-01-24T07:13:40.600 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 23, 2022-01-24T07:13:40.600 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 63167, 2022-01-24T07:13:40.601 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 63144, 2022-01-24T07:13:40.601 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 0, 2022-01-24T07:13:40.601 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 34787, 2022-01-24T07:13:40.601 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 34787, 2022-01-24T07:13:40.602 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 109164, 2022-01-24T07:13:40.602 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:40.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.602 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:40.602 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 77636, 2022-01-24T07:13:40.603 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 1950, 2022-01-24T07:13:40.603 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 61250, 2022-01-24T07:13:40.603 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 265, 2022-01-24T07:13:40.603 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 3859, 2022-01-24T07:13:40.604 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:40.604 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 16361, 2022-01-24T07:13:40.604 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 71.124186816, 2022-01-24T07:13:40.604 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004347178 2022-01-24T07:13:40.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.605 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:40.605 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 61, 2022-01-24T07:13:40.605 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.337104123, 2022-01-24T07:13:40.605 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.038313182 2022-01-24T07:13:40.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.606 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:40.606 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.606 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.607 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.607 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:40.607 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.608 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.608 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.608 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:40.608 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 15036, 2022-01-24T07:13:40.609 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 242.337028084, 2022-01-24T07:13:40.609 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.016117120 2022-01-24T07:13:40.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.609 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:40.610 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.610 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.610 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.611 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:40.611 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.611 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.611 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.612 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:40.612 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.612 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.612 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.613 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:40.613 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.613 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.614 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.614 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:40.614 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.614 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.615 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.615 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:40.615 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.616 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.616 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.617 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:40.617 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 107, 2022-01-24T07:13:40.617 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1.177058927, 2022-01-24T07:13:40.617 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011000550 2022-01-24T07:13:40.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.618 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:40.618 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.618 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.619 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.619 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:40.619 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.619 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.620 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.620 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:40.620 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 3727, 2022-01-24T07:13:40.620 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 17.550714186, 2022-01-24T07:13:40.621 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004709072 2022-01-24T07:13:40.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.621 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:40.621 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 387, 2022-01-24T07:13:40.622 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.875446610, 2022-01-24T07:13:40.622 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002262135 2022-01-24T07:13:40.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.622 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:40.622 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 16379, 2022-01-24T07:13:40.623 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 424.592337803, 2022-01-24T07:13:40.623 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.025922970 2022-01-24T07:13:40.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.623 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:40.624 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.624 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.624 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.624 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:40.625 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 46, 2022-01-24T07:13:40.625 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 10.737655530, 2022-01-24T07:13:40.625 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.233427294 2022-01-24T07:13:40.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.626 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:40.626 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.626 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.626 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.627 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:40.627 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.627 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.627 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.628 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:40.628 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.628 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.628 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.629 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:40.629 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.629 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.630 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.630 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:40.630 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.631 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.631 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.631 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:40.631 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.632 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.632 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.632 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:40.633 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.633 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.633 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.633 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:40.634 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.634 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.634 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.635 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:40.635 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 8197, 2022-01-24T07:13:40.635 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 231.928496600, 2022-01-24T07:13:40.635 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.028294314 2022-01-24T07:13:40.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.636 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:40.636 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:40.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.636 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:40.636 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:40.637 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:40.637 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:40.637 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:40.637 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:40.638 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 6208, 2022-01-24T07:13:40.638 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 3104, 2022-01-24T07:13:40.638 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 3782 2022-01-24T07:13:40.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.639 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:40.639 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:40.639 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:40.639 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:40.639 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:40.640 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:40.640 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:40.640 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:40.640 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:40.641 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:40.641 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:40.641 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:40.641 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:40.641 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:40.642 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:40.642 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:40.642 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:40.642 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:40.642 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:40.643 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:40.643 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:40.643 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:40.643 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:40.644 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:40.644 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:40.644 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:40.644 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:40.645 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:40.645 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:40.645 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:40.645 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:40.645 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:40.646 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:40.646 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:40.646 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:40.646 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:40.647 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:40.647 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 204193, 2022-01-24T07:13:40.647 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 123, 2022-01-24T07:13:40.647 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2022-01-24T07:13:40.648 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2022-01-24T07:13:40.648 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:40.648 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:40.648 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:40.648 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:40.649 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:40.649 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:40.649 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:40.649 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:40.650 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:40.650 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:40.650 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:40.650 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:40.651 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 141502, 2022-01-24T07:13:40.651 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 755, 2022-01-24T07:13:40.652 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:40.652 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:40.652 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:40.653 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:40.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.653 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:40.653 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2022-01-24T07:13:40.654 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:40.654 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 15287, 2022-01-24T07:13:40.654 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 206618788, 2022-01-24T07:13:40.654 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 27, 2022-01-24T07:13:40.655 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 15287, 2022-01-24T07:13:40.655 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 15287, 2022-01-24T07:13:40.655 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 350, 2022-01-24T07:13:40.655 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 14937, 2022-01-24T07:13:40.655 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:40.656 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:40.656 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:40.656 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:40.657 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 350, 2022-01-24T07:13:40.657 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 2607, 2022-01-24T07:13:40.657 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 172, 2022-01-24T07:13:40.657 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:40.657 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:40.658 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:40.658 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 73, 2022-01-24T07:13:40.658 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 11294, 2022-01-24T07:13:40.658 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:40.659 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:40.659 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:40.659 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:40.659 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:40.659 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:40.660 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:40.660 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:40.660 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:40.660 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:40.661 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:40.661 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:40.661 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:40.661 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:40.661 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:40.662 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:40.662 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:40.662 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:40.662 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:40.663 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:40.663 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:40.663 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:40.663 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:40.663 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:40.664 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:40.664 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:40.664 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:40.664 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:40.665 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:40.665 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:40.665 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:40.665 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:40.665 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:40.666 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:40.666 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:40.666 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:40.667 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:40.667 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:40.667 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1541, 2022-01-24T07:13:40.668 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:40.668 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 170 2022-01-24T07:13:40.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.669 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:40.670 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:40.670 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:40.670 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:40.671 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:40.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.672 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:40.672 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:40.673 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:40.673 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2022-01-24T07:13:40.673 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:40.674 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 10997, 2022-01-24T07:13:40.674 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:40.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.675 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:40.675 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.676 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:40.676 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.677 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 155620, 2022-01-24T07:13:40.677 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 53947605, 2022-01-24T07:13:40.678 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.678 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 155620, 2022-01-24T07:13:40.678 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.679 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.679 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 155620, 2022-01-24T07:13:40.680 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 53947605, 2022-01-24T07:13:40.680 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.681 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.681 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.682 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.683 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:40.683 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.684 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:40.684 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.685 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:40.685 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:40.686 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.686 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:40.686 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15287, 2022-01-24T07:13:40.687 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 207729725, 2022-01-24T07:13:40.687 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 3920, 2022-01-24T07:13:40.688 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 207729725, 2022-01-24T07:13:40.688 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.689 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.689 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.689 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.691 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:40.691 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.692 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:40.692 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.692 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:40.693 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:40.693 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.694 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:40.694 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15287, 2022-01-24T07:13:40.695 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 15287, 2022-01-24T07:13:40.695 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 15287, 2022-01-24T07:13:40.696 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 15287, 2022-01-24T07:13:40.696 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.696 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.697 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.697 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.698 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.698 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:40.699 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.699 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:40.699 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.700 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 10997, 2022-01-24T07:13:40.700 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1110937, 2022-01-24T07:13:40.700 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.701 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 10997, 2022-01-24T07:13:40.701 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.701 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.702 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 354, 2022-01-24T07:13:40.702 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1110937, 2022-01-24T07:13:40.702 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.703 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.703 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.703 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.704 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.704 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x55abd969bae0": { 2022-01-24T07:13:40.704 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.705 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:40.705 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.705 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 84357, 2022-01-24T07:13:40.705 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 192337427, 2022-01-24T07:13:40.706 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.706 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 84357, 2022-01-24T07:13:40.706 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.706 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.707 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2253, 2022-01-24T07:13:40.707 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 192337427, 2022-01-24T07:13:40.707 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.707 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.707 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.708 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.708 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:40.710 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=73 2022-01-24T07:13:40.710 DEBUG:tasks.check_counter:Getting stats from c 2022-01-24T07:13:40.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok perf dump 2022-01-24T07:13:40.837 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:40.838 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:40.838 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 51500, 2022-01-24T07:13:40.839 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 62024, 2022-01-24T07:13:40.839 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 21939009, 2022-01-24T07:13:40.840 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 104838390, 2022-01-24T07:13:40.840 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 13, 2022-01-24T07:13:40.841 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 2, 2022-01-24T07:13:40.841 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 2.524311295, 2022-01-24T07:13:40.842 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 1.109570515, 2022-01-24T07:13:40.842 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 2.989649213, 2022-01-24T07:13:40.842 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.305693890, 2022-01-24T07:13:40.843 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.843 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 62023, 2022-01-24T07:13:40.844 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 27.043539876, 2022-01-24T07:13:40.844 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000436024 2022-01-24T07:13:40.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.845 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.845 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 54169, 2022-01-24T07:13:40.846 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.013836746, 2022-01-24T07:13:40.846 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000255 2022-01-24T07:13:40.847 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.848 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:40.848 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 113996, 2022-01-24T07:13:40.849 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 194460, 2022-01-24T07:13:40.849 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 39661489, 2022-01-24T07:13:40.849 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 154586641, 2022-01-24T07:13:40.850 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 9, 2022-01-24T07:13:40.850 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:40.851 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 5.848926269, 2022-01-24T07:13:40.851 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 2.734379724, 2022-01-24T07:13:40.852 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 12.089883413, 2022-01-24T07:13:40.852 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.435247691, 2022-01-24T07:13:40.852 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.853 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 194460, 2022-01-24T07:13:40.853 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 119.992701406, 2022-01-24T07:13:40.854 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000617055 2022-01-24T07:13:40.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.855 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.855 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 146235, 2022-01-24T07:13:40.855 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.040744399, 2022-01-24T07:13:40.856 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000278 2022-01-24T07:13:40.856 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.857 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:40.857 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 19996, 2022-01-24T07:13:40.857 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 17017, 2022-01-24T07:13:40.858 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 12653182, 2022-01-24T07:13:40.858 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 97292645, 2022-01-24T07:13:40.859 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:40.859 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 3, 2022-01-24T07:13:40.859 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.489657454, 2022-01-24T07:13:40.860 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.602396472, 2022-01-24T07:13:40.860 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.873978769, 2022-01-24T07:13:40.860 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.391233808, 2022-01-24T07:13:40.860 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:40.861 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 17016, 2022-01-24T07:13:40.861 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.054004993, 2022-01-24T07:13:40.861 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000414551 2022-01-24T07:13:40.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.862 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:40.862 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 25755, 2022-01-24T07:13:40.862 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.004069330, 2022-01-24T07:13:40.863 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000158 2022-01-24T07:13:40.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.863 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:40.864 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:40.864 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:40.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.865 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:40.865 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:40.865 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:40.865 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4807, 2022-01-24T07:13:40.866 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 55.994001563, 2022-01-24T07:13:40.866 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011648429 2022-01-24T07:13:40.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.867 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:40.867 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:40.867 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:40.868 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 11731, 2022-01-24T07:13:40.868 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 3.473782182, 2022-01-24T07:13:40.868 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000296119 2022-01-24T07:13:40.868 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.869 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:40.869 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 65030, 2022-01-24T07:13:40.869 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 62916, 2022-01-24T07:13:40.870 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:40.870 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 62916, 2022-01-24T07:13:40.870 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1779.196236685, 2022-01-24T07:13:40.871 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.028278915 2022-01-24T07:13:40.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.871 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 2111, 2022-01-24T07:13:40.871 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:40.872 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 722, 2022-01-24T07:13:40.872 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 79, 2022-01-24T07:13:40.872 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:40.872 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 16, 2022-01-24T07:13:40.873 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 0, 2022-01-24T07:13:40.873 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 3, 2022-01-24T07:13:40.873 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 13, 2022-01-24T07:13:40.873 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 15, 2022-01-24T07:13:40.874 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 47393, 2022-01-24T07:13:40.874 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 1, 2022-01-24T07:13:40.874 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 1, 2022-01-24T07:13:40.874 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 6, 2022-01-24T07:13:40.875 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 100904, 2022-01-24T07:13:40.875 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 86426, 2022-01-24T07:13:40.875 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 1855, 2022-01-24T07:13:40.876 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 718, 2022-01-24T07:13:40.876 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:40.876 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:40.876 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 328, 2022-01-24T07:13:40.877 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 0, 2022-01-24T07:13:40.877 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:40.877 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 320, 2022-01-24T07:13:40.877 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 31148, 2022-01-24T07:13:40.878 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 395, 2022-01-24T07:13:40.878 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:40.878 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:40.879 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:40.879 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:40.879 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:40.879 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:40.880 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:40.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.880 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:40.881 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:40.881 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:40.881 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:40.881 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 10754, 2022-01-24T07:13:40.881 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 10754, 2022-01-24T07:13:40.882 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:40.882 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:40.882 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:40.883 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:40.883 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:40.883 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:40.883 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:40.884 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:40.884 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 322, 2022-01-24T07:13:40.884 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:40.885 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 80, 2022-01-24T07:13:40.885 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:40.885 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:40.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.886 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:40.886 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 97382, 2022-01-24T07:13:40.886 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 97382, 2022-01-24T07:13:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 118, 2022-01-24T07:13:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 118, 2022-01-24T07:13:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:40.890 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 231630380, 2022-01-24T07:13:40.890 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:40.890 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:40.890 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2743, 2022-01-24T07:13:40.891 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 280.034387594, 2022-01-24T07:13:40.891 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.102090553 2022-01-24T07:13:40.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.891 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:40.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.892 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:40.892 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 25, 2022-01-24T07:13:40.893 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 32615, 2022-01-24T07:13:40.893 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 32590, 2022-01-24T07:13:40.893 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 18, 2022-01-24T07:13:40.893 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 1696, 2022-01-24T07:13:40.894 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 1678, 2022-01-24T07:13:40.894 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 14, 2022-01-24T07:13:40.894 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 70024, 2022-01-24T07:13:40.895 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 70010, 2022-01-24T07:13:40.895 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 0, 2022-01-24T07:13:40.895 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 33048, 2022-01-24T07:13:40.895 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 33048, 2022-01-24T07:13:40.896 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 112472, 2022-01-24T07:13:40.896 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:40.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.896 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:40.897 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 84293, 2022-01-24T07:13:40.897 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 3219, 2022-01-24T07:13:40.897 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 65030, 2022-01-24T07:13:40.898 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 406, 2022-01-24T07:13:40.898 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 4946, 2022-01-24T07:13:40.898 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:40.898 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 18155, 2022-01-24T07:13:40.899 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 75.518984290, 2022-01-24T07:13:40.899 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004159679 2022-01-24T07:13:40.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.899 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:40.900 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 140, 2022-01-24T07:13:40.900 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.852683429, 2022-01-24T07:13:40.900 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.048947738 2022-01-24T07:13:40.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.901 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:40.901 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.901 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.901 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.902 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:40.902 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.902 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.903 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.903 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:40.904 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12335, 2022-01-24T07:13:40.904 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 458.448160536, 2022-01-24T07:13:40.904 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.037166449 2022-01-24T07:13:40.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.905 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:40.905 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.905 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.905 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.906 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:40.906 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.906 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.907 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.907 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:40.907 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.908 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.908 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.908 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:40.909 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.909 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.909 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.910 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:40.910 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.910 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.911 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.911 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:40.911 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.912 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.912 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.912 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:40.913 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 126, 2022-01-24T07:13:40.913 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.512129637, 2022-01-24T07:13:40.913 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.051683568 2022-01-24T07:13:40.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.914 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.915 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.915 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:40.916 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.916 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.916 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.917 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:40.917 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 5137, 2022-01-24T07:13:40.917 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 25.400985293, 2022-01-24T07:13:40.917 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004944711 2022-01-24T07:13:40.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.918 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:40.918 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 361, 2022-01-24T07:13:40.918 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.778396747, 2022-01-24T07:13:40.918 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002156223 2022-01-24T07:13:40.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.919 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:40.919 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 18173, 2022-01-24T07:13:40.919 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 509.615582022, 2022-01-24T07:13:40.920 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.028042457 2022-01-24T07:13:40.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.920 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:40.920 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.920 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.921 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.921 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:40.921 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 74, 2022-01-24T07:13:40.922 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 17.280198802, 2022-01-24T07:13:40.922 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.233516200 2022-01-24T07:13:40.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.922 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:40.923 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.923 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.923 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.924 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:40.924 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.924 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.924 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.925 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:40.925 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.925 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.925 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.926 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:40.926 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.926 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.927 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.927 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:40.927 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.928 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.928 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.928 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:40.928 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.929 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.929 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.929 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:40.930 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.930 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.930 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.931 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:40.931 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.931 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.931 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.932 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:40.932 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 8415, 2022-01-24T07:13:40.932 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 678.789115929, 2022-01-24T07:13:40.932 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.080664184 2022-01-24T07:13:40.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.933 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:40.933 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:40.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.934 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:40.934 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:40.934 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:40.934 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:40.934 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:40.935 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:40.935 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 10148, 2022-01-24T07:13:40.935 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 5074, 2022-01-24T07:13:40.935 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 3782 2022-01-24T07:13:40.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.936 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:40.936 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 240, 2022-01-24T07:13:40.936 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 240, 2022-01-24T07:13:40.937 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:40.937 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:40.937 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:40.937 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:40.937 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:40.938 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:40.938 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:40.938 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:40.938 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:40.939 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:40.939 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:40.939 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:40.939 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:40.940 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:40.940 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:40.940 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:40.940 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:40.941 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:40.941 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:40.941 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:40.941 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:40.941 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:40.942 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:40.942 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:40.942 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:40.943 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:40.943 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:40.943 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:40.943 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:40.944 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:40.944 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:40.944 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:40.944 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:40.944 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:40.945 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 215106, 2022-01-24T07:13:40.945 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 124, 2022-01-24T07:13:40.945 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 88, 2022-01-24T07:13:40.945 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 1, 2022-01-24T07:13:40.946 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:40.946 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:40.946 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:40.947 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:40.947 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:40.947 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:40.947 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:40.947 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:40.948 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:40.948 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:40.948 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:40.948 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:40.949 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 119182, 2022-01-24T07:13:40.949 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 600, 2022-01-24T07:13:40.949 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:40.949 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:40.950 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:40.950 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:40.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.950 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:40.951 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2022-01-24T07:13:40.951 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:40.951 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 15630, 2022-01-24T07:13:40.951 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 242751487, 2022-01-24T07:13:40.951 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 32, 2022-01-24T07:13:40.952 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 15630, 2022-01-24T07:13:40.952 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 15630, 2022-01-24T07:13:40.952 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 299, 2022-01-24T07:13:40.952 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 15331, 2022-01-24T07:13:40.953 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:40.953 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:40.953 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:40.953 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:40.953 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 299, 2022-01-24T07:13:40.954 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 3048, 2022-01-24T07:13:40.954 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 164, 2022-01-24T07:13:40.954 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:40.954 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:40.955 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:40.955 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 79, 2022-01-24T07:13:40.955 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 11196, 2022-01-24T07:13:40.955 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:40.956 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:40.956 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:40.956 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:40.956 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:40.956 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:40.957 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:40.957 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:40.957 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:40.957 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:40.958 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:40.958 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:40.958 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:40.958 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:40.959 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:40.959 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:40.959 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:40.959 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:40.959 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:40.960 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:40.960 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:40.960 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:40.960 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:40.961 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:40.961 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:40.961 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:40.961 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:40.962 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:40.962 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:40.962 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:40.962 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:40.963 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:40.963 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:40.963 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:40.963 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:40.963 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:40.964 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:40.964 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:40.964 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1644, 2022-01-24T07:13:40.964 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:40.965 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 178 2022-01-24T07:13:40.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.965 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:40.965 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:40.966 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:40.966 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:40.966 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:40.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.967 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:40.967 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:40.967 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:40.967 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2022-01-24T07:13:40.967 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:40.968 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 10754, 2022-01-24T07:13:40.968 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:40.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.968 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:40.969 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.969 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:40.969 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.969 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 185487, 2022-01-24T07:13:40.970 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 59523815, 2022-01-24T07:13:40.970 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.970 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 185487, 2022-01-24T07:13:40.970 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.971 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.971 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 185487, 2022-01-24T07:13:40.971 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 59523815, 2022-01-24T07:13:40.971 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.972 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.972 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.972 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.972 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.973 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:40.973 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.973 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:40.973 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.973 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:40.974 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:40.974 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.974 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:40.974 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15630, 2022-01-24T07:13:40.975 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 243838017, 2022-01-24T07:13:40.975 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 4355, 2022-01-24T07:13:40.975 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 243838017, 2022-01-24T07:13:40.975 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.976 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.976 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.976 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.977 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:40.977 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.977 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:40.977 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.978 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:40.978 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:40.978 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.978 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:40.979 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15630, 2022-01-24T07:13:40.979 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 15630, 2022-01-24T07:13:40.979 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 15630, 2022-01-24T07:13:40.979 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 15630, 2022-01-24T07:13:40.979 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.980 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.980 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.980 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.981 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:40.981 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.981 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:40.981 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.982 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 10754, 2022-01-24T07:13:40.982 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1086530, 2022-01-24T07:13:40.982 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.982 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 10754, 2022-01-24T07:13:40.983 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.983 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.983 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 305, 2022-01-24T07:13:40.983 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1086530, 2022-01-24T07:13:40.984 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.984 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.984 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.984 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.985 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:40.985 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x55adca2bbae0": { 2022-01-24T07:13:40.985 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:40.985 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:40.986 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:40.986 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 97382, 2022-01-24T07:13:40.986 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 227436076, 2022-01-24T07:13:40.986 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:40.986 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 97382, 2022-01-24T07:13:40.987 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:40.987 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:40.987 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2743, 2022-01-24T07:13:40.987 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 227436076, 2022-01-24T07:13:40.988 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:40.988 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:40.988 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:40.988 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:40.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:40.989 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:40.991 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=79 2022-01-24T07:13:40.991 DEBUG:tasks.check_counter:Getting stats from d 2022-01-24T07:13:40.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok perf dump 2022-01-24T07:13:41.113 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:41.113 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:41.113 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 31795, 2022-01-24T07:13:41.114 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 39026, 2022-01-24T07:13:41.114 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 12383757, 2022-01-24T07:13:41.114 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 43803438, 2022-01-24T07:13:41.114 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:41.115 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:41.115 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.578905425, 2022-01-24T07:13:41.115 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.685900262, 2022-01-24T07:13:41.115 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 1.417630177, 2022-01-24T07:13:41.116 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.093173981, 2022-01-24T07:13:41.116 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:41.116 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 39027, 2022-01-24T07:13:41.116 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 20.034418257, 2022-01-24T07:13:41.116 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000513347 2022-01-24T07:13:41.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.117 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:41.117 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 32753, 2022-01-24T07:13:41.117 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.008913326, 2022-01-24T07:13:41.118 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000272 2022-01-24T07:13:41.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.118 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:41.119 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 22561, 2022-01-24T07:13:41.119 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 23289, 2022-01-24T07:13:41.119 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 10848438, 2022-01-24T07:13:41.119 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 104483262, 2022-01-24T07:13:41.119 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:41.120 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 7, 2022-01-24T07:13:41.120 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.889311100, 2022-01-24T07:13:41.120 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.714265571, 2022-01-24T07:13:41.120 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.725945611, 2022-01-24T07:13:41.121 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.536186607, 2022-01-24T07:13:41.121 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:41.121 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 23290, 2022-01-24T07:13:41.121 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.380084679, 2022-01-24T07:13:41.122 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000273940 2022-01-24T07:13:41.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.122 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:41.122 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 23841, 2022-01-24T07:13:41.123 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.003986730, 2022-01-24T07:13:41.123 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000167 2022-01-24T07:13:41.123 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.123 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:41.124 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 87597, 2022-01-24T07:13:41.124 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 140941, 2022-01-24T07:13:41.124 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 30532416, 2022-01-24T07:13:41.124 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 94708714, 2022-01-24T07:13:41.125 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:41.125 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 10, 2022-01-24T07:13:41.125 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 4.323251859, 2022-01-24T07:13:41.125 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 1.923244716, 2022-01-24T07:13:41.125 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 23.703580688, 2022-01-24T07:13:41.126 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.283176826, 2022-01-24T07:13:41.126 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:41.126 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 140936, 2022-01-24T07:13:41.126 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 99.036165489, 2022-01-24T07:13:41.127 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000702703 2022-01-24T07:13:41.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.127 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:41.127 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 91968, 2022-01-24T07:13:41.127 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.042915748, 2022-01-24T07:13:41.128 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000466 2022-01-24T07:13:41.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.128 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:41.129 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:41.129 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:41.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.129 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:41.129 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:41.130 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:41.130 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4094, 2022-01-24T07:13:41.130 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 37.524937716, 2022-01-24T07:13:41.130 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.009165837 2022-01-24T07:13:41.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.131 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:41.131 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:41.131 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:41.132 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 14016, 2022-01-24T07:13:41.132 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.125861909, 2022-01-24T07:13:41.132 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000151673 2022-01-24T07:13:41.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.133 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:41.133 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 48099, 2022-01-24T07:13:41.133 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 47827, 2022-01-24T07:13:41.133 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:41.134 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 47827, 2022-01-24T07:13:41.134 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1149.465106991, 2022-01-24T07:13:41.134 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.024033811 2022-01-24T07:13:41.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.135 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 272, 2022-01-24T07:13:41.135 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:41.135 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 497, 2022-01-24T07:13:41.135 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 54, 2022-01-24T07:13:41.136 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:41.136 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 16, 2022-01-24T07:13:41.136 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 0, 2022-01-24T07:13:41.136 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 3, 2022-01-24T07:13:41.136 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 13, 2022-01-24T07:13:41.137 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 15, 2022-01-24T07:13:41.137 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 11071, 2022-01-24T07:13:41.137 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 2, 2022-01-24T07:13:41.137 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 2, 2022-01-24T07:13:41.137 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 3, 2022-01-24T07:13:41.138 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 74032, 2022-01-24T07:13:41.138 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 67475, 2022-01-24T07:13:41.138 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 246, 2022-01-24T07:13:41.138 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 356, 2022-01-24T07:13:41.139 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:41.139 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:41.139 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 213, 2022-01-24T07:13:41.139 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 0, 2022-01-24T07:13:41.139 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:41.140 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 172, 2022-01-24T07:13:41.140 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 1341, 2022-01-24T07:13:41.140 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 126, 2022-01-24T07:13:41.140 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:41.141 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:41.141 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:41.141 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:41.141 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:41.141 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:41.142 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:41.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.142 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:41.142 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:41.143 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:41.143 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:41.143 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 14766, 2022-01-24T07:13:41.143 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 14766, 2022-01-24T07:13:41.143 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:41.144 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:41.144 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:41.144 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:41.144 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:41.145 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:41.145 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:41.145 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:41.145 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 175, 2022-01-24T07:13:41.146 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:41.146 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 54, 2022-01-24T07:13:41.146 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:41.146 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:41.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.147 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:41.147 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 79906, 2022-01-24T07:13:41.147 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:41.147 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:41.147 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 79906, 2022-01-24T07:13:41.148 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:41.148 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:41.148 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 96, 2022-01-24T07:13:41.148 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:41.149 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:41.149 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 96, 2022-01-24T07:13:41.149 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:41.149 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:41.149 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:41.150 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 162795263, 2022-01-24T07:13:41.150 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:41.150 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:41.150 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 1847, 2022-01-24T07:13:41.151 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 88.518603492, 2022-01-24T07:13:41.151 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.047925610 2022-01-24T07:13:41.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.151 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:41.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.152 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:41.152 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 26, 2022-01-24T07:13:41.152 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 15854, 2022-01-24T07:13:41.152 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 15828, 2022-01-24T07:13:41.152 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 25, 2022-01-24T07:13:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 818, 2022-01-24T07:13:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 793, 2022-01-24T07:13:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 15, 2022-01-24T07:13:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 43419, 2022-01-24T07:13:41.154 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 43404, 2022-01-24T07:13:41.154 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 1, 2022-01-24T07:13:41.154 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 19846, 2022-01-24T07:13:41.154 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 19845, 2022-01-24T07:13:41.154 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 94516, 2022-01-24T07:13:41.155 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:41.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.155 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:41.155 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 58711, 2022-01-24T07:13:41.156 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 2757, 2022-01-24T07:13:41.156 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 48099, 2022-01-24T07:13:41.156 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 219, 2022-01-24T07:13:41.156 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 4129, 2022-01-24T07:13:41.156 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:41.157 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9490, 2022-01-24T07:13:41.157 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 31.721967895, 2022-01-24T07:13:41.157 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003342673 2022-01-24T07:13:41.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.157 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:41.158 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 48, 2022-01-24T07:13:41.158 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 4.788594462, 2022-01-24T07:13:41.158 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.099762384 2022-01-24T07:13:41.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.159 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:41.159 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.159 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.159 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.160 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:41.160 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.160 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.160 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.161 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:41.161 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12566, 2022-01-24T07:13:41.161 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 146.997855907, 2022-01-24T07:13:41.161 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011698062 2022-01-24T07:13:41.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.162 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:41.162 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.162 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.163 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.163 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:41.163 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.163 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.164 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.164 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:41.164 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.165 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.165 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.165 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:41.165 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.166 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.166 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.166 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:41.167 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.167 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.167 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.167 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 53, 2022-01-24T07:13:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1.970629514, 2022-01-24T07:13:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.037181688 2022-01-24T07:13:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.172 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:41.172 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2835, 2022-01-24T07:13:41.172 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.079188906, 2022-01-24T07:13:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002497068 2022-01-24T07:13:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 578, 2022-01-24T07:13:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.890346699, 2022-01-24T07:13:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.001540392 2022-01-24T07:13:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9453, 2022-01-24T07:13:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 317.750082767, 2022-01-24T07:13:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.033613676 2022-01-24T07:13:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 72, 2022-01-24T07:13:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 16.286822734, 2022-01-24T07:13:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.226205871 2022-01-24T07:13:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12732, 2022-01-24T07:13:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 621.979618107, 2022-01-24T07:13:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.048851682 2022-01-24T07:13:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 13678, 2022-01-24T07:13:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 6839, 2022-01-24T07:13:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 742 2022-01-24T07:13:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 354367, 2022-01-24T07:13:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 126, 2022-01-24T07:13:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 1496, 2022-01-24T07:13:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 17, 2022-01-24T07:13:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 82433, 2022-01-24T07:13:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 413, 2022-01-24T07:13:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 1, 2022-01-24T07:13:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 16612, 2022-01-24T07:13:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 169403193, 2022-01-24T07:13:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 27, 2022-01-24T07:13:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 16611, 2022-01-24T07:13:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 16612, 2022-01-24T07:13:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 362, 2022-01-24T07:13:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 16250, 2022-01-24T07:13:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 362, 2022-01-24T07:13:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 2209, 2022-01-24T07:13:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 174, 2022-01-24T07:13:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 54, 2022-01-24T07:13:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 13201, 2022-01-24T07:13:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1185, 2022-01-24T07:13:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 143 2022-01-24T07:13:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 1, 2022-01-24T07:13:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 1, 2022-01-24T07:13:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 12839, 2022-01-24T07:13:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 1927 2022-01-24T07:13:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 141949, 2022-01-24T07:13:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 42546605, 2022-01-24T07:13:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 141949, 2022-01-24T07:13:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 141949, 2022-01-24T07:13:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 42546605, 2022-01-24T07:13:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 16612, 2022-01-24T07:13:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 170894967, 2022-01-24T07:13:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 3357, 2022-01-24T07:13:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 170894967, 2022-01-24T07:13:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 1, 2022-01-24T07:13:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 16612, 2022-01-24T07:13:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 16612, 2022-01-24T07:13:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 16611, 2022-01-24T07:13:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 16611, 2022-01-24T07:13:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 14766, 2022-01-24T07:13:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1491774, 2022-01-24T07:13:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 14766, 2022-01-24T07:13:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 362, 2022-01-24T07:13:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1491774, 2022-01-24T07:13:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x55e7b2f1dae0": { 2022-01-24T07:13:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 79906, 2022-01-24T07:13:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 158600959, 2022-01-24T07:13:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 79906, 2022-01-24T07:13:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 1847, 2022-01-24T07:13:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 158600959, 2022-01-24T07:13:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:41.241 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:41.242 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=54 2022-01-24T07:13:41.243 DEBUG:tasks.check_counter:Getting stats from e 2022-01-24T07:13:41.243 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok perf dump 2022-01-24T07:13:42.107 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:42.108 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:42.108 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 27859, 2022-01-24T07:13:42.108 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 52100, 2022-01-24T07:13:42.108 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 17356793, 2022-01-24T07:13:42.109 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 55168404, 2022-01-24T07:13:42.109 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:42.109 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:42.109 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.197232661, 2022-01-24T07:13:42.110 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.832581466, 2022-01-24T07:13:42.110 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.000279091, 2022-01-24T07:13:42.110 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.635602481, 2022-01-24T07:13:42.110 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 52102, 2022-01-24T07:13:42.111 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 21.540521808, 2022-01-24T07:13:42.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000413429 2022-01-24T07:13:42.111 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.111 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.112 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 30388, 2022-01-24T07:13:42.112 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.008985702, 2022-01-24T07:13:42.112 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000295 2022-01-24T07:13:42.112 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.113 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.113 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:42.113 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 19016, 2022-01-24T07:13:42.113 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 25096, 2022-01-24T07:13:42.113 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 15680963, 2022-01-24T07:13:42.114 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 92532584, 2022-01-24T07:13:42.114 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 8, 2022-01-24T07:13:42.114 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:42.114 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.588930030, 2022-01-24T07:13:42.115 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.679713634, 2022-01-24T07:13:42.115 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.686958976, 2022-01-24T07:13:42.115 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.324506348, 2022-01-24T07:13:42.115 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.116 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25099, 2022-01-24T07:13:42.116 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 9.821757286, 2022-01-24T07:13:42.116 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000391320 2022-01-24T07:13:42.116 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.116 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.117 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25739, 2022-01-24T07:13:42.117 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.005782398, 2022-01-24T07:13:42.117 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000224 2022-01-24T07:13:42.117 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.118 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.118 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:42.118 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 140938, 2022-01-24T07:13:42.118 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 237221, 2022-01-24T07:13:42.119 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 47944016, 2022-01-24T07:13:42.119 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 204188415, 2022-01-24T07:13:42.119 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 14, 2022-01-24T07:13:42.119 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 10, 2022-01-24T07:13:42.120 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 6.939503458, 2022-01-24T07:13:42.120 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 3.227124181, 2022-01-24T07:13:42.120 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 6.410029376, 2022-01-24T07:13:42.120 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.433728009, 2022-01-24T07:13:42.120 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.121 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 237213, 2022-01-24T07:13:42.121 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 152.592592755, 2022-01-24T07:13:42.121 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000643272 2022-01-24T07:13:42.121 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.122 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.122 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 150410, 2022-01-24T07:13:42.122 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.051403744, 2022-01-24T07:13:42.122 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000341 2022-01-24T07:13:42.123 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.123 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.123 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:42.123 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:42.124 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:42.124 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.124 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:42.124 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.125 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.125 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 5073, 2022-01-24T07:13:42.125 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 52.458534529, 2022-01-24T07:13:42.125 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.010340732 2022-01-24T07:13:42.125 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.126 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.126 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:42.126 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.126 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.127 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 22739, 2022-01-24T07:13:42.127 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.484087690, 2022-01-24T07:13:42.127 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000153220 2022-01-24T07:13:42.127 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.128 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.128 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:42.128 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 73157, 2022-01-24T07:13:42.128 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 72367, 2022-01-24T07:13:42.128 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:42.129 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 72367, 2022-01-24T07:13:42.129 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1713.912673316, 2022-01-24T07:13:42.129 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.023683622 2022-01-24T07:13:42.129 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.130 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 790, 2022-01-24T07:13:42.130 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 1, 2022-01-24T07:13:42.130 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 714, 2022-01-24T07:13:42.130 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 78, 2022-01-24T07:13:42.131 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2022-01-24T07:13:42.131 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 17, 2022-01-24T07:13:42.131 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 2, 2022-01-24T07:13:42.131 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 5, 2022-01-24T07:13:42.131 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:42.132 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 14, 2022-01-24T07:13:42.132 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 29292, 2022-01-24T07:13:42.132 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 3, 2022-01-24T07:13:42.132 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 4, 2022-01-24T07:13:42.133 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 3, 2022-01-24T07:13:42.133 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 109963, 2022-01-24T07:13:42.133 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 98403, 2022-01-24T07:13:42.133 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 550, 2022-01-24T07:13:42.134 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 310, 2022-01-24T07:13:42.134 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:42.134 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:42.134 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 179, 2022-01-24T07:13:42.135 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 2, 2022-01-24T07:13:42.135 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2022-01-24T07:13:42.135 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 394, 2022-01-24T07:13:42.135 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 15687, 2022-01-24T07:13:42.135 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 307, 2022-01-24T07:13:42.136 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:42.136 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:42.136 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:42.136 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:42.137 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:42.137 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:42.137 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:42.137 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.137 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:42.138 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 2, 2022-01-24T07:13:42.138 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:42.138 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:42.138 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 21503, 2022-01-24T07:13:42.139 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 21501, 2022-01-24T07:13:42.139 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:42.139 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:42.139 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:42.140 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:42.140 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:42.140 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:42.140 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:42.140 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:42.141 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 394, 2022-01-24T07:13:42.141 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:42.141 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 78, 2022-01-24T07:13:42.141 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:42.142 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:42.142 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.142 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:42.142 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 98087, 2022-01-24T07:13:42.143 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2022-01-24T07:13:42.143 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2022-01-24T07:13:42.143 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 98087, 2022-01-24T07:13:42.143 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:42.143 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2022-01-24T07:13:42.144 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 119, 2022-01-24T07:13:42.144 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2022-01-24T07:13:42.144 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2022-01-24T07:13:42.144 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 119, 2022-01-24T07:13:42.145 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:42.145 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2022-01-24T07:13:42.145 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2022-01-24T07:13:42.145 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 213899116, 2022-01-24T07:13:42.145 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:42.146 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:42.146 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2596, 2022-01-24T07:13:42.146 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 314.444824002, 2022-01-24T07:13:42.146 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.121126665 2022-01-24T07:13:42.147 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.147 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:42.147 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.147 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:42.148 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 27, 2022-01-24T07:13:42.148 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 32051, 2022-01-24T07:13:42.148 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 32024, 2022-01-24T07:13:42.148 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 18, 2022-01-24T07:13:42.148 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 1624, 2022-01-24T07:13:42.149 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1606, 2022-01-24T07:13:42.149 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 18, 2022-01-24T07:13:42.149 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 76473, 2022-01-24T07:13:42.149 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 76455, 2022-01-24T07:13:42.150 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 3, 2022-01-24T07:13:42.150 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 35310, 2022-01-24T07:13:42.150 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 35307, 2022-01-24T07:13:42.150 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 102124, 2022-01-24T07:13:42.151 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:42.151 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.151 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:42.151 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 87352, 2022-01-24T07:13:42.151 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 983, 2022-01-24T07:13:42.152 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 73157, 2022-01-24T07:13:42.152 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 233, 2022-01-24T07:13:42.152 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 2280, 2022-01-24T07:13:42.152 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:42.153 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 13043, 2022-01-24T07:13:42.153 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 44.406837227, 2022-01-24T07:13:42.153 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003404649 2022-01-24T07:13:42.153 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.154 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:42.154 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 559, 2022-01-24T07:13:42.154 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 10.191921546, 2022-01-24T07:13:42.154 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.018232417 2022-01-24T07:13:42.155 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.155 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:42.155 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.155 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.155 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.156 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.156 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:42.156 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.156 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.156 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.157 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.157 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:42.157 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 21239, 2022-01-24T07:13:42.157 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 176.651440933, 2022-01-24T07:13:42.158 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.008317314 2022-01-24T07:13:42.158 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.158 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:42.158 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.159 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.159 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.159 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.159 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:42.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.160 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.160 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.160 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:42.161 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.161 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.161 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.161 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.162 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:42.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.162 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.163 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.163 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:42.163 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.163 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.163 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.164 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.164 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:42.164 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.164 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.165 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.165 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.165 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:42.165 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 94, 2022-01-24T07:13:42.166 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.403561201, 2022-01-24T07:13:42.166 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.014931502 2022-01-24T07:13:42.166 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.166 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:42.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.167 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.167 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.167 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:42.168 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.168 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.168 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.168 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.169 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:42.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3882, 2022-01-24T07:13:42.169 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 13.919676352, 2022-01-24T07:13:42.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003585697 2022-01-24T07:13:42.170 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.170 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:42.170 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 961, 2022-01-24T07:13:42.170 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.682701365, 2022-01-24T07:13:42.171 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002791572 2022-01-24T07:13:42.171 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.171 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:42.171 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 12306, 2022-01-24T07:13:42.171 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 247.087846538, 2022-01-24T07:13:42.172 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.020078648 2022-01-24T07:13:42.172 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.172 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:42.172 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.173 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.173 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.173 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.173 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:42.173 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 138, 2022-01-24T07:13:42.174 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 33.303956663, 2022-01-24T07:13:42.174 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.241333019 2022-01-24T07:13:42.174 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.175 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:42.175 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.175 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.175 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.175 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.176 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:42.176 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.176 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.176 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.177 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.177 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:42.177 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11, 2022-01-24T07:13:42.177 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.057888314, 2022-01-24T07:13:42.177 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.005262574 2022-01-24T07:13:42.178 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.178 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:42.178 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.178 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.179 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.179 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.179 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:42.179 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.180 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.180 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.180 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.180 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:42.181 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.181 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.181 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.181 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.181 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:42.182 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.182 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.182 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.182 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.183 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:42.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6, 2022-01-24T07:13:42.183 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.004500055, 2022-01-24T07:13:42.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000750009 2022-01-24T07:13:42.184 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.184 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:42.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20128, 2022-01-24T07:13:42.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1184.202343122, 2022-01-24T07:13:42.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.058833582 2022-01-24T07:13:42.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.185 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:42.185 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:42.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.186 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:42.186 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:42.186 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:42.186 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:42.187 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:42.187 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:42.187 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 3378, 2022-01-24T07:13:42.187 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 1689, 2022-01-24T07:13:42.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 745 2022-01-24T07:13:42.188 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.188 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:42.188 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:42.188 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:42.189 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:42.189 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:42.189 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:42.189 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:42.190 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:42.190 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:42.190 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:42.190 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:42.191 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:42.191 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:42.191 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:42.191 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:42.192 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:42.192 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:42.192 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:42.192 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:42.192 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:42.193 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:42.193 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:42.193 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:42.193 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:42.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:42.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:42.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:42.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:42.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:42.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:42.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:42.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:42.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:42.196 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:42.196 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:42.196 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:42.196 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:42.197 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 172587, 2022-01-24T07:13:42.197 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 148, 2022-01-24T07:13:42.197 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2022-01-24T07:13:42.197 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2022-01-24T07:13:42.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:42.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:42.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:42.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:42.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:42.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:42.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:42.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:42.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:42.200 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:42.200 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:42.200 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:42.200 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 216728, 2022-01-24T07:13:42.201 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 1970, 2022-01-24T07:13:42.201 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:42.201 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:42.201 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:42.201 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:42.202 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.202 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:42.202 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:42.202 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:42.203 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 26783, 2022-01-24T07:13:42.203 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 225487340, 2022-01-24T07:13:42.203 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 32, 2022-01-24T07:13:42.203 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 26783, 2022-01-24T07:13:42.203 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 26783, 2022-01-24T07:13:42.204 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 418, 2022-01-24T07:13:42.204 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 26365, 2022-01-24T07:13:42.204 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:42.204 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:42.205 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 0, 2022-01-24T07:13:42.205 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 11, 2022-01-24T07:13:42.205 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 417, 2022-01-24T07:13:42.205 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 3013, 2022-01-24T07:13:42.206 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 177, 2022-01-24T07:13:42.206 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:42.206 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:42.206 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:42.206 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 78, 2022-01-24T07:13:42.207 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 22234, 2022-01-24T07:13:42.207 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:42.207 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:42.207 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:42.208 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:42.208 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 22, 2022-01-24T07:13:42.208 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:42.208 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:42.208 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:42.209 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:42.209 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:42.209 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:42.209 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:42.210 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:42.210 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:42.210 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 10, 2022-01-24T07:13:42.210 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:42.211 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:42.211 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:42.211 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:42.211 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:42.211 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:42.212 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:42.212 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:42.212 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:42.212 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:42.213 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:42.213 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:42.213 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:42.213 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:42.213 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:42.214 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:42.214 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 24, 2022-01-24T07:13:42.214 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:42.214 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 2, 2022-01-24T07:13:42.215 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:42.215 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:42.215 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:42.215 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:42.216 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 1660, 2022-01-24T07:13:42.216 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2022-01-24T07:13:42.216 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 182 2022-01-24T07:13:42.216 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.216 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:42.217 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:42.217 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:42.217 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:42.217 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:42.218 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.218 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:42.218 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:42.218 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:42.219 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:42.219 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:42.219 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 21501, 2022-01-24T07:13:42.219 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:42.219 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.220 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:42.220 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.220 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.220 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.221 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 187809, 2022-01-24T07:13:42.221 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 66216473, 2022-01-24T07:13:42.221 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.221 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 187809, 2022-01-24T07:13:42.222 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.222 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.222 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 187809, 2022-01-24T07:13:42.222 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 66216473, 2022-01-24T07:13:42.223 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.223 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.223 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.224 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.224 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:42.224 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.224 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.226 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:42.226 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 26783, 2022-01-24T07:13:42.226 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 227659597, 2022-01-24T07:13:42.226 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4460, 2022-01-24T07:13:42.226 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 227659597, 2022-01-24T07:13:42.227 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.227 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.227 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.227 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.228 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.228 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.228 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:42.228 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.228 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:42.229 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.229 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.229 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.229 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.230 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:42.230 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 26783, 2022-01-24T07:13:42.230 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 26783, 2022-01-24T07:13:42.230 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 26783, 2022-01-24T07:13:42.231 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 26783, 2022-01-24T07:13:42.231 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.231 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.231 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.231 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.232 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.232 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.232 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:42.232 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.233 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:42.233 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.233 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 21501, 2022-01-24T07:13:42.233 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 2172273, 2022-01-24T07:13:42.233 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.234 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 21501, 2022-01-24T07:13:42.234 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.234 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.234 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 417, 2022-01-24T07:13:42.235 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 2172273, 2022-01-24T07:13:42.235 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.235 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.235 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.235 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.236 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.236 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.236 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x56551f9a9ae0": { 2022-01-24T07:13:42.236 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 599, 2022-01-24T07:13:42.237 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:42.237 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.237 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 98087, 2022-01-24T07:13:42.237 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 209704812, 2022-01-24T07:13:42.237 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.238 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 98087, 2022-01-24T07:13:42.238 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.238 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.238 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2596, 2022-01-24T07:13:42.239 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 209704213, 2022-01-24T07:13:42.239 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.239 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.239 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.239 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.240 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.240 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.240 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:42.242 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=78 2022-01-24T07:13:42.242 DEBUG:tasks.check_counter:Getting stats from f 2022-01-24T07:13:42.243 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok perf dump 2022-01-24T07:13:42.361 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:42.361 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:42.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 17358, 2022-01-24T07:13:42.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 21388, 2022-01-24T07:13:42.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 14234070, 2022-01-24T07:13:42.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 52438373, 2022-01-24T07:13:42.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 13, 2022-01-24T07:13:42.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 2, 2022-01-24T07:13:42.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.289073570, 2022-01-24T07:13:42.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.535707726, 2022-01-24T07:13:42.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.762110373, 2022-01-24T07:13:42.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.226379246, 2022-01-24T07:13:42.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 21387, 2022-01-24T07:13:42.364 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 9.389039412, 2022-01-24T07:13:42.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000439006 2022-01-24T07:13:42.364 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.365 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25591, 2022-01-24T07:13:42.365 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.004852470, 2022-01-24T07:13:42.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000189 2022-01-24T07:13:42.366 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.366 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.366 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:42.366 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 239000, 2022-01-24T07:13:42.367 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 422080, 2022-01-24T07:13:42.367 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 74298156, 2022-01-24T07:13:42.367 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 297946735, 2022-01-24T07:13:42.367 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:42.367 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2022-01-24T07:13:42.368 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 11.199687582, 2022-01-24T07:13:42.368 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 5.484041404, 2022-01-24T07:13:42.368 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 9.063354051, 2022-01-24T07:13:42.368 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.647777022, 2022-01-24T07:13:42.369 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.369 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 422078, 2022-01-24T07:13:42.369 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 173.924005973, 2022-01-24T07:13:42.369 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000412066 2022-01-24T07:13:42.369 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.370 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.370 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 314359, 2022-01-24T07:13:42.370 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.089938170, 2022-01-24T07:13:42.370 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000286 2022-01-24T07:13:42.371 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.371 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.371 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:42.371 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 34656, 2022-01-24T07:13:42.372 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 33547, 2022-01-24T07:13:42.372 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 17833376, 2022-01-24T07:13:42.372 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 249461923, 2022-01-24T07:13:42.372 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:42.372 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:42.373 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.998890566, 2022-01-24T07:13:42.373 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 1.264023639, 2022-01-24T07:13:42.373 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.021893848, 2022-01-24T07:13:42.373 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.883225500, 2022-01-24T07:13:42.374 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.374 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 33544, 2022-01-24T07:13:42.374 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 9.664999160, 2022-01-24T07:13:42.374 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000288128 2022-01-24T07:13:42.375 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.375 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.375 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 32038, 2022-01-24T07:13:42.375 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.005214321, 2022-01-24T07:13:42.375 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000162 2022-01-24T07:13:42.376 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.376 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.376 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:42.376 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:42.377 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:42.377 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.377 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:42.377 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.377 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6396, 2022-01-24T07:13:42.378 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 88.901150740, 2022-01-24T07:13:42.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.013899491 2022-01-24T07:13:42.378 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.379 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.379 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:42.379 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.379 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.379 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25633, 2022-01-24T07:13:42.380 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.212572929, 2022-01-24T07:13:42.380 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000164341 2022-01-24T07:13:42.380 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.380 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.381 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:42.381 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 132050, 2022-01-24T07:13:42.381 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 127309, 2022-01-24T07:13:42.381 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:42.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 127309, 2022-01-24T07:13:42.382 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2998.641493067, 2022-01-24T07:13:42.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.023554041 2022-01-24T07:13:42.382 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.383 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 4740, 2022-01-24T07:13:42.383 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 1, 2022-01-24T07:13:42.383 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 1163, 2022-01-24T07:13:42.383 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 127, 2022-01-24T07:13:42.383 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 1, 2022-01-24T07:13:42.384 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 18, 2022-01-24T07:13:42.384 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 0, 2022-01-24T07:13:42.384 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 2, 2022-01-24T07:13:42.384 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 16, 2022-01-24T07:13:42.385 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 16, 2022-01-24T07:13:42.385 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 58302, 2022-01-24T07:13:42.385 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 6, 2022-01-24T07:13:42.385 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 6, 2022-01-24T07:13:42.385 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 3, 2022-01-24T07:13:42.386 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 201991, 2022-01-24T07:13:42.386 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 180265, 2022-01-24T07:13:42.386 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 4476, 2022-01-24T07:13:42.386 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 609, 2022-01-24T07:13:42.387 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 1, 2022-01-24T07:13:42.387 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:42.387 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 439, 2022-01-24T07:13:42.387 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 2000, 2022-01-24T07:13:42.387 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 2, 2022-01-24T07:13:42.388 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 340, 2022-01-24T07:13:42.388 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 33031, 2022-01-24T07:13:42.388 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 396, 2022-01-24T07:13:42.388 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:42.389 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:42.389 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:42.389 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:42.389 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:42.389 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:42.390 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:42.390 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.390 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:42.390 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 6, 2022-01-24T07:13:42.390 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:42.391 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:42.391 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 24131, 2022-01-24T07:13:42.391 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 24125, 2022-01-24T07:13:42.391 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:42.392 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:42.392 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:42.392 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:42.392 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:42.392 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:42.393 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:42.393 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:42.393 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 342, 2022-01-24T07:13:42.393 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:42.393 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 129, 2022-01-24T07:13:42.394 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:42.394 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:42.394 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.394 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:42.395 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 170860, 2022-01-24T07:13:42.395 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 68000, 2022-01-24T07:13:42.395 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 68000, 2022-01-24T07:13:42.395 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 102860, 2022-01-24T07:13:42.395 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:42.396 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 550, 2022-01-24T07:13:42.396 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 207, 2022-01-24T07:13:42.396 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 79, 2022-01-24T07:13:42.396 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 79, 2022-01-24T07:13:42.396 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 129, 2022-01-24T07:13:42.397 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:42.397 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 1, 2022-01-24T07:13:42.397 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 167774661, 2022-01-24T07:13:42.397 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 380188749, 2022-01-24T07:13:42.398 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:42.398 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:42.398 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3528, 2022-01-24T07:13:42.398 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 278.387116017, 2022-01-24T07:13:42.399 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.078907912 2022-01-24T07:13:42.399 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.399 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:42.399 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.400 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:42.400 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 30, 2022-01-24T07:13:42.400 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 45734, 2022-01-24T07:13:42.400 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 45704, 2022-01-24T07:13:42.400 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 17, 2022-01-24T07:13:42.401 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2369, 2022-01-24T07:13:42.401 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 2352, 2022-01-24T07:13:42.401 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 20, 2022-01-24T07:13:42.401 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 110352, 2022-01-24T07:13:42.401 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 110332, 2022-01-24T07:13:42.402 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 6, 2022-01-24T07:13:42.402 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 47954, 2022-01-24T07:13:42.402 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 47948, 2022-01-24T07:13:42.402 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 118424, 2022-01-24T07:13:42.403 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:42.403 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.403 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:42.403 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 165726, 2022-01-24T07:13:42.404 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 2706, 2022-01-24T07:13:42.404 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 132050, 2022-01-24T07:13:42.404 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 423, 2022-01-24T07:13:42.404 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 4919, 2022-01-24T07:13:42.405 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:42.405 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31342, 2022-01-24T07:13:42.405 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 188.340625367, 2022-01-24T07:13:42.405 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006009208 2022-01-24T07:13:42.405 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.406 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:42.406 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1249, 2022-01-24T07:13:42.406 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 131.188246377, 2022-01-24T07:13:42.406 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.105034624 2022-01-24T07:13:42.407 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.407 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:42.407 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.407 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.408 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.408 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.408 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:42.408 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.408 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.409 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.409 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.409 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:42.409 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 32711, 2022-01-24T07:13:42.410 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1214.600191844, 2022-01-24T07:13:42.410 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.037131246 2022-01-24T07:13:42.410 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.410 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:42.410 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.411 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.411 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.411 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.411 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:42.412 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.412 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.412 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.412 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.413 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:42.413 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.413 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.413 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.413 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.414 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:42.414 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.414 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.414 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.415 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.415 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:42.415 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.415 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.415 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.416 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.416 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:42.416 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.416 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.417 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.417 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.417 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:42.417 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 242, 2022-01-24T07:13:42.418 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.284551492, 2022-01-24T07:13:42.418 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.013572526 2022-01-24T07:13:42.418 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.418 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:42.419 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.419 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.419 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.419 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.420 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:42.420 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.420 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.420 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.420 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.421 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:42.421 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 8653, 2022-01-24T07:13:42.421 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 56.843065921, 2022-01-24T07:13:42.421 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006569174 2022-01-24T07:13:42.422 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.422 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:42.422 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 959, 2022-01-24T07:13:42.422 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.267935817, 2022-01-24T07:13:42.422 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001322143 2022-01-24T07:13:42.423 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.423 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:42.423 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31372, 2022-01-24T07:13:42.423 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 674.230388059, 2022-01-24T07:13:42.424 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.021491469 2022-01-24T07:13:42.424 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.424 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:42.424 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.424 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.425 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.425 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.425 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:42.425 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 218, 2022-01-24T07:13:42.425 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 33.170426379, 2022-01-24T07:13:42.426 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.152157919 2022-01-24T07:13:42.426 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.426 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:42.426 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.427 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.427 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.427 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.427 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:42.427 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.428 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.428 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.428 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.428 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:42.429 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2022-01-24T07:13:42.429 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.047113909, 2022-01-24T07:13:42.429 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.047113909 2022-01-24T07:13:42.429 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.429 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:42.430 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.430 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.430 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.430 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.431 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:42.431 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.431 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.431 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.432 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.432 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:42.432 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.432 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.432 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.433 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.433 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:42.433 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.433 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.434 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.434 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.434 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:42.434 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.435 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.435 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.435 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.435 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:42.435 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20562, 2022-01-24T07:13:42.436 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 695.668947902, 2022-01-24T07:13:42.436 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.033832747 2022-01-24T07:13:42.436 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.436 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:42.437 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:42.437 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.437 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:42.437 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:42.437 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:42.438 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:42.438 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:42.438 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:42.438 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 9882, 2022-01-24T07:13:42.439 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 4941, 2022-01-24T07:13:42.439 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3793 2022-01-24T07:13:42.439 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.439 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:42.439 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 338, 2022-01-24T07:13:42.440 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 338, 2022-01-24T07:13:42.440 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:42.440 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:42.440 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:42.441 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:42.441 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:42.441 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:42.441 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:42.441 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:42.442 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:42.442 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:42.442 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:42.442 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:42.443 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:42.443 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:42.443 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:42.443 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:42.444 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:42.444 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:42.444 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:42.444 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:42.444 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:42.445 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:42.445 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:42.445 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:42.445 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:42.446 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:42.446 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:42.446 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:42.446 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:42.447 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:42.447 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:42.447 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:42.447 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:42.447 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:42.448 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 215212, 2022-01-24T07:13:42.448 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 127, 2022-01-24T07:13:42.448 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 264, 2022-01-24T07:13:42.448 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 3, 2022-01-24T07:13:42.449 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:42.449 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:42.449 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:42.449 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:42.449 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:42.450 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:42.450 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:42.450 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:42.450 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:42.451 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:42.451 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:42.451 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:42.451 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 97027, 2022-01-24T07:13:42.451 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 1049, 2022-01-24T07:13:42.452 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:42.452 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:42.452 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:42.452 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:42.453 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.453 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:42.453 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:42.453 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:42.453 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 31755, 2022-01-24T07:13:42.454 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 401288360, 2022-01-24T07:13:42.454 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 27, 2022-01-24T07:13:42.454 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 31755, 2022-01-24T07:13:42.454 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 31755, 2022-01-24T07:13:42.455 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 524, 2022-01-24T07:13:42.455 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 31231, 2022-01-24T07:13:42.455 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:42.455 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:42.456 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 7, 2022-01-24T07:13:42.456 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 152, 2022-01-24T07:13:42.456 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 523, 2022-01-24T07:13:42.456 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 4051, 2022-01-24T07:13:42.456 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 198, 2022-01-24T07:13:42.457 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:42.457 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:42.457 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:42.457 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 127, 2022-01-24T07:13:42.458 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 25418, 2022-01-24T07:13:42.458 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:42.458 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:42.458 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:42.459 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 1, 2022-01-24T07:13:42.459 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 304, 2022-01-24T07:13:42.459 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:42.459 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:42.459 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:42.460 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:42.460 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:42.460 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:42.460 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:42.461 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:42.461 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:42.461 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 1, 2022-01-24T07:13:42.461 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:42.461 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:42.462 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:42.462 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:42.462 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:42.462 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:42.463 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:42.463 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:42.463 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:42.463 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:42.464 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:42.464 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:42.464 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:42.464 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:42.465 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:42.465 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:42.465 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:42.465 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:42.465 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:42.466 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:42.466 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:42.466 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:42.466 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:42.467 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 2547, 2022-01-24T07:13:42.467 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2022-01-24T07:13:42.467 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 240 2022-01-24T07:13:42.467 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.467 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:42.468 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:42.468 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:42.468 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:42.469 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:42.469 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.469 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:42.469 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:42.469 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:42.470 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:42.470 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:42.470 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 24125, 2022-01-24T07:13:42.470 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:42.470 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.471 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:42.471 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.471 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.471 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.472 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 291007, 2022-01-24T07:13:42.472 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 83597986, 2022-01-24T07:13:42.472 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.472 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 291007, 2022-01-24T07:13:42.473 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.473 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.473 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 291007, 2022-01-24T07:13:42.473 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 83597986, 2022-01-24T07:13:42.473 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.474 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.474 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.474 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.474 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.475 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.475 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:42.475 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.475 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.475 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.476 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.476 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.476 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.476 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:42.476 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 31755, 2022-01-24T07:13:42.477 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 403726145, 2022-01-24T07:13:42.477 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 6209, 2022-01-24T07:13:42.477 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 403726145, 2022-01-24T07:13:42.477 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.478 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.478 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.478 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.478 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.478 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.479 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:42.479 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.479 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:42.479 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.480 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.480 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.480 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.480 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:42.480 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 31755, 2022-01-24T07:13:42.481 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 31755, 2022-01-24T07:13:42.481 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 31755, 2022-01-24T07:13:42.481 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 31755, 2022-01-24T07:13:42.481 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.482 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.482 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.482 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.482 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.483 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.483 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:42.483 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.483 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:42.483 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.484 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 24125, 2022-01-24T07:13:42.484 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 2437801, 2022-01-24T07:13:42.484 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.484 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 24125, 2022-01-24T07:13:42.485 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.485 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.485 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 523, 2022-01-24T07:13:42.485 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 2437801, 2022-01-24T07:13:42.485 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.486 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.486 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.486 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.486 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.487 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.487 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55e3eef85ae0": { 2022-01-24T07:13:42.487 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.487 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:42.488 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.488 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 170860, 2022-01-24T07:13:42.488 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 375994445, 2022-01-24T07:13:42.488 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.489 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 170860, 2022-01-24T07:13:42.489 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.489 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.489 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 3528, 2022-01-24T07:13:42.489 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 375994445, 2022-01-24T07:13:42.490 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.490 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.490 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.490 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.491 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.491 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.491 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:42.493 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=127 2022-01-24T07:13:42.493 DEBUG:tasks.check_counter:Getting stats from g 2022-01-24T07:13:42.493 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok perf dump 2022-01-24T07:13:42.619 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:42.620 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:42.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 31698, 2022-01-24T07:13:42.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 29982, 2022-01-24T07:13:42.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 21868638, 2022-01-24T07:13:42.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 111141895, 2022-01-24T07:13:42.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:42.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:42.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.180777437, 2022-01-24T07:13:42.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.868216668, 2022-01-24T07:13:42.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.520431464, 2022-01-24T07:13:42.623 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.487843129, 2022-01-24T07:13:42.623 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.623 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 29982, 2022-01-24T07:13:42.623 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 15.716426262, 2022-01-24T07:13:42.623 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000524195 2022-01-24T07:13:42.624 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.624 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.624 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 40282, 2022-01-24T07:13:42.624 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.018895424, 2022-01-24T07:13:42.625 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000469 2022-01-24T07:13:42.625 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.625 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.625 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:42.626 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 21644, 2022-01-24T07:13:42.626 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 28077, 2022-01-24T07:13:42.626 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 9106553, 2022-01-24T07:13:42.626 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 66838497, 2022-01-24T07:13:42.626 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:42.627 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:42.627 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.167150081, 2022-01-24T07:13:42.627 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.574350073, 2022-01-24T07:13:42.627 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.760139211, 2022-01-24T07:13:42.628 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.138112474, 2022-01-24T07:13:42.628 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.628 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 28074, 2022-01-24T07:13:42.628 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 18.416398215, 2022-01-24T07:13:42.629 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000655994 2022-01-24T07:13:42.629 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.629 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.629 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 14768, 2022-01-24T07:13:42.630 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.006011799, 2022-01-24T07:13:42.630 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000407 2022-01-24T07:13:42.630 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.630 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.631 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:42.631 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 103983, 2022-01-24T07:13:42.631 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 189179, 2022-01-24T07:13:42.631 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 38862436, 2022-01-24T07:13:42.631 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 142228937, 2022-01-24T07:13:42.632 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:42.632 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 7, 2022-01-24T07:13:42.632 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 5.437387432, 2022-01-24T07:13:42.632 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 2.615759781, 2022-01-24T07:13:42.633 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 5.100653097, 2022-01-24T07:13:42.633 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.209142617, 2022-01-24T07:13:42.633 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.633 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 189178, 2022-01-24T07:13:42.633 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 124.321037022, 2022-01-24T07:13:42.634 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000657164 2022-01-24T07:13:42.634 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.634 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.634 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 137181, 2022-01-24T07:13:42.635 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.069266534, 2022-01-24T07:13:42.635 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000504 2022-01-24T07:13:42.635 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.635 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.636 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:42.636 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:42.636 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:42.637 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.637 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:42.637 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.637 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.638 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4642, 2022-01-24T07:13:42.638 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 49.694687210, 2022-01-24T07:13:42.638 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.010705447 2022-01-24T07:13:42.638 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.639 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.639 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:42.639 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.639 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.640 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 9972, 2022-01-24T07:13:42.640 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.298928608, 2022-01-24T07:13:42.640 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000230538 2022-01-24T07:13:42.640 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.640 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.641 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:42.641 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 55123, 2022-01-24T07:13:42.641 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 53782, 2022-01-24T07:13:42.641 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:42.642 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 53782, 2022-01-24T07:13:42.642 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 725.402741920, 2022-01-24T07:13:42.642 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.013487834 2022-01-24T07:13:42.642 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.643 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 1341, 2022-01-24T07:13:42.643 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 0, 2022-01-24T07:13:42.643 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 686, 2022-01-24T07:13:42.643 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 75, 2022-01-24T07:13:42.644 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2022-01-24T07:13:42.644 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 13, 2022-01-24T07:13:42.644 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 2, 2022-01-24T07:13:42.644 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 1, 2022-01-24T07:13:42.644 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:42.645 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 10, 2022-01-24T07:13:42.645 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 49872, 2022-01-24T07:13:42.645 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:42.645 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2022-01-24T07:13:42.646 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 4, 2022-01-24T07:13:42.646 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 85271, 2022-01-24T07:13:42.646 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 76981, 2022-01-24T07:13:42.646 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 1089, 2022-01-24T07:13:42.647 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 440, 2022-01-24T07:13:42.647 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:42.647 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:42.647 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 187, 2022-01-24T07:13:42.648 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2022-01-24T07:13:42.648 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2022-01-24T07:13:42.648 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 426, 2022-01-24T07:13:42.648 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 35977, 2022-01-24T07:13:42.649 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 497, 2022-01-24T07:13:42.649 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:42.649 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:42.649 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:42.649 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:42.650 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:42.650 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:42.650 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:42.650 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.651 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:42.651 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2022-01-24T07:13:42.651 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:42.651 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:42.652 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 8973, 2022-01-24T07:13:42.652 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 8973, 2022-01-24T07:13:42.652 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:42.652 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:42.653 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:42.653 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:42.653 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:42.653 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:42.653 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:42.654 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:42.654 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 426, 2022-01-24T07:13:42.654 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:42.654 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 75, 2022-01-24T07:13:42.655 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:42.655 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:42.655 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.655 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:42.656 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 87272, 2022-01-24T07:13:42.656 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2022-01-24T07:13:42.656 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2022-01-24T07:13:42.656 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 87272, 2022-01-24T07:13:42.657 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:42.657 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2022-01-24T07:13:42.657 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 101, 2022-01-24T07:13:42.657 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2022-01-24T07:13:42.657 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2022-01-24T07:13:42.658 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 101, 2022-01-24T07:13:42.658 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:42.658 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2022-01-24T07:13:42.658 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2022-01-24T07:13:42.659 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 208796110, 2022-01-24T07:13:42.659 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:42.659 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:42.659 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2600, 2022-01-24T07:13:42.660 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 234.534370822, 2022-01-24T07:13:42.660 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.090205527 2022-01-24T07:13:42.660 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.660 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:42.660 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.661 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:42.661 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 22, 2022-01-24T07:13:42.661 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 34269, 2022-01-24T07:13:42.661 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 34247, 2022-01-24T07:13:42.662 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 15, 2022-01-24T07:13:42.662 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 1673, 2022-01-24T07:13:42.662 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1658, 2022-01-24T07:13:42.662 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 12, 2022-01-24T07:13:42.662 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 68492, 2022-01-24T07:13:42.663 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 68480, 2022-01-24T07:13:42.663 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2022-01-24T07:13:42.663 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 34380, 2022-01-24T07:13:42.663 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 34380, 2022-01-24T07:13:42.664 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 120776, 2022-01-24T07:13:42.664 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:42.664 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.664 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:42.665 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 71104, 2022-01-24T07:13:42.665 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 2727, 2022-01-24T07:13:42.665 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 55123, 2022-01-24T07:13:42.665 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 457, 2022-01-24T07:13:42.665 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 3847, 2022-01-24T07:13:42.666 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:42.666 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 15447, 2022-01-24T07:13:42.666 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 50.553988765, 2022-01-24T07:13:42.666 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003272738 2022-01-24T07:13:42.667 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.667 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:42.667 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 44, 2022-01-24T07:13:42.667 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 6.749269081, 2022-01-24T07:13:42.667 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.153392479 2022-01-24T07:13:42.668 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.668 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:42.668 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.668 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.669 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.669 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.669 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:42.669 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.670 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.670 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.670 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.670 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:42.671 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11114, 2022-01-24T07:13:42.671 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 164.553682867, 2022-01-24T07:13:42.671 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.014805981 2022-01-24T07:13:42.671 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.671 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:42.672 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.672 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.672 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.672 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.673 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:42.673 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.673 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.673 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.674 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.674 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:42.674 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.674 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.674 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.675 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.675 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:42.675 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.675 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.676 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.676 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.676 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:42.676 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.676 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.677 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.677 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.677 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:42.677 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.678 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.678 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.678 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.678 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:42.678 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 107, 2022-01-24T07:13:42.679 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.707498810, 2022-01-24T07:13:42.679 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.043995315 2022-01-24T07:13:42.679 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.679 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:42.680 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.680 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.680 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.680 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.680 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:42.681 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.681 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.681 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.681 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.682 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:42.682 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3823, 2022-01-24T07:13:42.682 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 14.553511735, 2022-01-24T07:13:42.682 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003806830 2022-01-24T07:13:42.683 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.683 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:42.683 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 376, 2022-01-24T07:13:42.683 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.565515996, 2022-01-24T07:13:42.683 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001504031 2022-01-24T07:13:42.684 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.684 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:42.684 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 15401, 2022-01-24T07:13:42.684 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 308.837670662, 2022-01-24T07:13:42.685 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.020053092 2022-01-24T07:13:42.685 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.685 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:42.685 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.685 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.686 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.686 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.686 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:42.686 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 74, 2022-01-24T07:13:42.687 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 12.293655241, 2022-01-24T07:13:42.687 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.166130476 2022-01-24T07:13:42.687 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.687 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:42.688 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.688 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.688 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.688 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.689 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:42.689 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.689 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.689 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.690 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.690 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:42.690 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2022-01-24T07:13:42.690 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.016275324, 2022-01-24T07:13:42.690 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.016275324 2022-01-24T07:13:42.691 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.691 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:42.691 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.691 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.692 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.692 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.692 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:42.692 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.692 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.693 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.693 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.693 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:42.693 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.694 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.694 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.694 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.694 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:42.694 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.695 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.695 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.695 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.695 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:42.696 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.696 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.696 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.696 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.696 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:42.697 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7395, 2022-01-24T07:13:42.697 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 162.571673439, 2022-01-24T07:13:42.697 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.021983999 2022-01-24T07:13:42.697 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.698 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:42.698 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:42.698 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.698 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:42.699 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:42.699 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:42.699 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:42.699 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:42.699 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:42.700 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 6108, 2022-01-24T07:13:42.700 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 3054, 2022-01-24T07:13:42.700 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3792 2022-01-24T07:13:42.700 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.701 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:42.701 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:42.701 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:42.701 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:42.702 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:42.702 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:42.702 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:42.702 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:42.703 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:42.703 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:42.703 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:42.703 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:42.703 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:42.704 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:42.704 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:42.704 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:42.704 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:42.705 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:42.705 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:42.705 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:42.705 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:42.705 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:42.706 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:42.706 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:42.706 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:42.706 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:42.707 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:42.707 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:42.707 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:42.707 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:42.708 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:42.708 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:42.708 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:42.708 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:42.708 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:42.709 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:42.709 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:42.709 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 184921, 2022-01-24T07:13:42.709 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 129, 2022-01-24T07:13:42.710 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 352, 2022-01-24T07:13:42.710 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 4, 2022-01-24T07:13:42.710 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:42.710 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:42.711 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:42.711 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:42.711 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:42.711 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:42.711 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:42.712 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:42.712 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:42.712 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:42.712 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:42.713 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:42.713 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 89877, 2022-01-24T07:13:42.713 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 513, 2022-01-24T07:13:42.713 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:42.713 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:42.714 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:42.714 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:42.714 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.714 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:42.715 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:42.715 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:42.715 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 13734, 2022-01-24T07:13:42.715 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 218760326, 2022-01-24T07:13:42.716 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 27, 2022-01-24T07:13:42.716 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 13734, 2022-01-24T07:13:42.716 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 13734, 2022-01-24T07:13:42.716 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 306, 2022-01-24T07:13:42.716 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 13428, 2022-01-24T07:13:42.717 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:42.717 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:42.717 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 0, 2022-01-24T07:13:42.717 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 10, 2022-01-24T07:13:42.718 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 306, 2022-01-24T07:13:42.718 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 2907, 2022-01-24T07:13:42.718 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 158, 2022-01-24T07:13:42.718 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:42.719 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:42.719 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:42.719 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 75, 2022-01-24T07:13:42.719 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 9481, 2022-01-24T07:13:42.719 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:42.720 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:42.720 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:42.720 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:42.720 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:42.721 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:42.721 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:42.721 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:42.721 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:42.722 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:42.722 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:42.722 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:42.722 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:42.722 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:42.723 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 1, 2022-01-24T07:13:42.723 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:42.723 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:42.723 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:42.724 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:42.724 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:42.724 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:42.724 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:42.725 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:42.725 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:42.725 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:42.725 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:42.725 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:42.726 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:42.726 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:42.726 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:42.726 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:42.727 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:42.727 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:42.727 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:42.727 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:42.728 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:42.728 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:42.728 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:42.728 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 1568, 2022-01-24T07:13:42.728 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 0, 2022-01-24T07:13:42.729 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 173 2022-01-24T07:13:42.729 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.729 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:42.729 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:42.730 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:42.730 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:42.730 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:42.730 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.734 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:42.734 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:42.735 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:42.735 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:42.735 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:42.735 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 8973, 2022-01-24T07:13:42.736 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:42.736 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.736 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:42.736 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.737 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.737 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.737 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 157321, 2022-01-24T07:13:42.737 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 57362703, 2022-01-24T07:13:42.737 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.738 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 157321, 2022-01-24T07:13:42.738 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.738 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.738 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 157321, 2022-01-24T07:13:42.739 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 57362703, 2022-01-24T07:13:42.739 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.739 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.739 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.739 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.740 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.740 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.740 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:42.740 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.741 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.741 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.741 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.741 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.741 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.742 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:42.742 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 13734, 2022-01-24T07:13:42.742 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 219667047, 2022-01-24T07:13:42.742 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4177, 2022-01-24T07:13:42.743 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 219667047, 2022-01-24T07:13:42.743 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.743 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.743 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.744 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.744 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.744 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.744 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:42.744 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.745 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:42.745 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.745 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.745 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.746 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.746 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:42.746 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 13734, 2022-01-24T07:13:42.746 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 13734, 2022-01-24T07:13:42.747 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 13734, 2022-01-24T07:13:42.747 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 13734, 2022-01-24T07:13:42.747 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.747 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.748 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.748 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.748 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.748 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.748 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:42.749 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.749 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:42.749 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.749 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 8973, 2022-01-24T07:13:42.750 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 906721, 2022-01-24T07:13:42.750 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.750 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 8973, 2022-01-24T07:13:42.750 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.750 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.751 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 307, 2022-01-24T07:13:42.751 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 906721, 2022-01-24T07:13:42.751 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.751 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.752 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.752 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.752 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.752 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.753 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55cfad4d1ae0": { 2022-01-24T07:13:42.753 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.753 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:42.753 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.753 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 87272, 2022-01-24T07:13:42.754 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 204601806, 2022-01-24T07:13:42.754 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.754 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 87272, 2022-01-24T07:13:42.754 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.755 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.755 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2600, 2022-01-24T07:13:42.755 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 204601806, 2022-01-24T07:13:42.755 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.756 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.756 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.756 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.756 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.756 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.757 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:42.758 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=75 2022-01-24T07:13:42.759 DEBUG:tasks.check_counter:Getting stats from h 2022-01-24T07:13:42.759 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok perf dump 2022-01-24T07:13:42.880 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:42.880 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:42.880 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 115649, 2022-01-24T07:13:42.880 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 196956, 2022-01-24T07:13:42.881 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 54430007, 2022-01-24T07:13:42.881 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 181787764, 2022-01-24T07:13:42.881 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 14, 2022-01-24T07:13:42.881 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:42.882 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 6.215925270, 2022-01-24T07:13:42.882 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 2.828949884, 2022-01-24T07:13:42.882 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 5.431826924, 2022-01-24T07:13:42.882 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.729763122, 2022-01-24T07:13:42.883 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.883 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 196953, 2022-01-24T07:13:42.883 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 122.372678865, 2022-01-24T07:13:42.883 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000621329 2022-01-24T07:13:42.884 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.884 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.884 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 139963, 2022-01-24T07:13:42.884 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.058366320, 2022-01-24T07:13:42.884 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000417 2022-01-24T07:13:42.885 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.885 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.885 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:42.885 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 16456, 2022-01-24T07:13:42.886 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 20449, 2022-01-24T07:13:42.886 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 11748169, 2022-01-24T07:13:42.886 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 125995801, 2022-01-24T07:13:42.886 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 9, 2022-01-24T07:13:42.887 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:42.887 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.787641391, 2022-01-24T07:13:42.887 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.706992122, 2022-01-24T07:13:42.887 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.532985380, 2022-01-24T07:13:42.887 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.571149683, 2022-01-24T07:13:42.888 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.888 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20450, 2022-01-24T07:13:42.888 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 8.200831684, 2022-01-24T07:13:42.888 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000401018 2022-01-24T07:13:42.889 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.889 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.889 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 15066, 2022-01-24T07:13:42.889 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.003342289, 2022-01-24T07:13:42.889 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000221 2022-01-24T07:13:42.890 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.890 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.890 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:42.890 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 60375, 2022-01-24T07:13:42.891 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 95384, 2022-01-24T07:13:42.891 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 20129143, 2022-01-24T07:13:42.891 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 104157852, 2022-01-24T07:13:42.891 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:42.892 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:42.892 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.767699985, 2022-01-24T07:13:42.892 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 1.351952962, 2022-01-24T07:13:42.892 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 2.318424380, 2022-01-24T07:13:42.892 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.210439928, 2022-01-24T07:13:42.893 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:42.893 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 95382, 2022-01-24T07:13:42.893 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 42.380613779, 2022-01-24T07:13:42.893 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000444325 2022-01-24T07:13:42.894 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.894 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:42.894 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 66070, 2022-01-24T07:13:42.894 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.023810676, 2022-01-24T07:13:42.894 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000360 2022-01-24T07:13:42.895 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.895 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.895 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:42.895 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:42.896 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:42.896 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.896 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:42.896 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.896 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.897 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4144, 2022-01-24T07:13:42.897 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 69.022024910, 2022-01-24T07:13:42.897 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.016655894 2022-01-24T07:13:42.897 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.898 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.898 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:42.898 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:42.898 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:42.899 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20163, 2022-01-24T07:13:42.899 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.246050395, 2022-01-24T07:13:42.899 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000160990 2022-01-24T07:13:42.899 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.899 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.900 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:42.900 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 75838, 2022-01-24T07:13:42.900 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 74877, 2022-01-24T07:13:42.900 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:42.901 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 74877, 2022-01-24T07:13:42.901 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1966.576363848, 2022-01-24T07:13:42.901 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.026264091 2022-01-24T07:13:42.901 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.901 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 935, 2022-01-24T07:13:42.902 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 0, 2022-01-24T07:13:42.902 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 754, 2022-01-24T07:13:42.902 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 82, 2022-01-24T07:13:42.902 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2022-01-24T07:13:42.903 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 30, 2022-01-24T07:13:42.903 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 13, 2022-01-24T07:13:42.903 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 7, 2022-01-24T07:13:42.903 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:42.904 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 11, 2022-01-24T07:13:42.904 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 46888, 2022-01-24T07:13:42.904 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:42.904 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2022-01-24T07:13:42.904 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 8, 2022-01-24T07:13:42.905 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 113074, 2022-01-24T07:13:42.905 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 101987, 2022-01-24T07:13:42.905 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 771, 2022-01-24T07:13:42.905 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 401, 2022-01-24T07:13:42.906 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:42.906 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:42.906 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 90, 2022-01-24T07:13:42.906 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2022-01-24T07:13:42.906 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2022-01-24T07:13:42.907 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 345, 2022-01-24T07:13:42.907 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 31621, 2022-01-24T07:13:42.907 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 191, 2022-01-24T07:13:42.907 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:42.908 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:42.908 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:42.908 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:42.908 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:42.908 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:42.909 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:42.909 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.909 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:42.909 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2022-01-24T07:13:42.910 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:42.910 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:42.910 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 19170, 2022-01-24T07:13:42.910 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 19170, 2022-01-24T07:13:42.910 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:42.911 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:42.911 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:42.911 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:42.911 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:42.912 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:42.912 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:42.912 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:42.912 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 345, 2022-01-24T07:13:42.912 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:42.913 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 82, 2022-01-24T07:13:42.913 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:42.913 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:42.913 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.914 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:42.914 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 120338, 2022-01-24T07:13:42.914 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 18140, 2022-01-24T07:13:42.914 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 18140, 2022-01-24T07:13:42.915 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 102198, 2022-01-24T07:13:42.915 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:42.915 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 6505, 2022-01-24T07:13:42.915 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 149, 2022-01-24T07:13:42.915 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 21, 2022-01-24T07:13:42.916 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 21, 2022-01-24T07:13:42.916 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 135, 2022-01-24T07:13:42.916 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:42.916 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 7, 2022-01-24T07:13:42.917 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 48687880, 2022-01-24T07:13:42.917 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 269874532, 2022-01-24T07:13:42.917 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:42.917 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:42.918 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1926, 2022-01-24T07:13:42.918 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 150.152483157, 2022-01-24T07:13:42.918 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.077960790 2022-01-24T07:13:42.918 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.918 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:42.919 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.919 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:42.919 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 41, 2022-01-24T07:13:42.919 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 41052, 2022-01-24T07:13:42.920 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 41011, 2022-01-24T07:13:42.920 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 37, 2022-01-24T07:13:42.920 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2041, 2022-01-24T07:13:42.920 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 2004, 2022-01-24T07:13:42.920 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 30, 2022-01-24T07:13:42.921 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 89965, 2022-01-24T07:13:42.921 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 89935, 2022-01-24T07:13:42.921 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2022-01-24T07:13:42.921 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 40820, 2022-01-24T07:13:42.922 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 40820, 2022-01-24T07:13:42.922 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 122500, 2022-01-24T07:13:42.922 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:42.922 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.923 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:42.923 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 93809, 2022-01-24T07:13:42.923 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 1552, 2022-01-24T07:13:42.923 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 75838, 2022-01-24T07:13:42.923 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 406, 2022-01-24T07:13:42.924 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 2502, 2022-01-24T07:13:42.924 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:42.924 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17267, 2022-01-24T07:13:42.924 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 64.276802423, 2022-01-24T07:13:42.925 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003722522 2022-01-24T07:13:42.925 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.925 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:42.925 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 41, 2022-01-24T07:13:42.925 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 7.220589774, 2022-01-24T07:13:42.926 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.176111945 2022-01-24T07:13:42.926 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.926 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:42.926 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.927 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.927 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.927 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.927 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:42.927 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.928 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.928 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.928 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.928 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:42.929 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17039, 2022-01-24T07:13:42.929 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 150.161595117, 2022-01-24T07:13:42.929 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.008812817 2022-01-24T07:13:42.929 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.929 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:42.930 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.930 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.930 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.930 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.931 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:42.931 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.931 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.931 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.932 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.932 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:42.932 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.932 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.932 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.933 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.933 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:42.933 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.933 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.934 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.934 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.934 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:42.934 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.934 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.935 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.935 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.935 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:42.935 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.936 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.936 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.936 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.936 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:42.936 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 123, 2022-01-24T07:13:42.937 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.317530764, 2022-01-24T07:13:42.937 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.010711632 2022-01-24T07:13:42.937 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.937 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:42.938 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.938 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.938 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.938 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.938 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:42.939 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.939 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.939 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.939 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.940 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:42.940 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4318, 2022-01-24T07:13:42.940 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 18.648836491, 2022-01-24T07:13:42.940 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004318859 2022-01-24T07:13:42.940 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.941 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:42.941 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 807, 2022-01-24T07:13:42.941 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.597632522, 2022-01-24T07:13:42.941 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003218875 2022-01-24T07:13:42.942 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.942 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:42.942 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17277, 2022-01-24T07:13:42.942 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 303.299335874, 2022-01-24T07:13:42.943 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.017555092 2022-01-24T07:13:42.943 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.943 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:42.943 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.943 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.944 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.944 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.944 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:42.944 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 147, 2022-01-24T07:13:42.945 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 41.766263165, 2022-01-24T07:13:42.945 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.284124239 2022-01-24T07:13:42.945 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.945 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:42.945 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.946 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.946 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.946 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.946 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:42.947 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.947 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.947 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.947 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.948 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:42.948 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.948 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.948 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.949 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.949 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:42.949 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.949 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.949 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.950 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.950 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:42.950 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.950 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.951 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.951 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.951 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:42.951 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.952 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.952 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.952 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.952 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:42.953 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.953 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.953 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.953 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.953 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:42.954 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.954 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.954 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.954 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.955 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:42.955 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17858, 2022-01-24T07:13:42.955 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1377.287777718, 2022-01-24T07:13:42.955 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.077124413 2022-01-24T07:13:42.955 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.956 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:42.956 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:42.956 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.956 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:42.957 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:42.957 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:42.957 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:42.957 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:42.957 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:42.958 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 22729, 2022-01-24T07:13:42.958 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 11364, 2022-01-24T07:13:42.958 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3793 2022-01-24T07:13:42.958 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.959 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:42.959 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:42.959 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:42.959 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:42.959 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:42.960 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:42.960 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:42.960 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:42.960 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:42.961 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:42.961 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:42.961 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:42.961 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:42.961 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:42.962 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:42.962 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:42.962 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:42.962 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:42.963 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:42.963 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:42.963 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:42.963 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:42.963 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:42.964 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:42.964 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:42.964 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:42.964 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:42.965 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:42.965 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:42.965 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:42.965 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:42.966 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:42.966 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:42.966 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:42.966 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:42.966 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:42.967 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:42.967 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 183432, 2022-01-24T07:13:42.967 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 121, 2022-01-24T07:13:42.967 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 176, 2022-01-24T07:13:42.968 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 2, 2022-01-24T07:13:42.968 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:42.968 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:42.968 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:42.969 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:42.969 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:42.969 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:42.969 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:42.969 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:42.970 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:42.970 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:42.970 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:42.970 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:42.971 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 180342, 2022-01-24T07:13:42.971 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 755, 2022-01-24T07:13:42.971 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:42.971 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:42.971 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:42.972 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:42.972 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.972 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:42.972 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:42.973 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:42.973 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 24122, 2022-01-24T07:13:42.973 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 283477404, 2022-01-24T07:13:42.973 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 27, 2022-01-24T07:13:42.973 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 24122, 2022-01-24T07:13:42.974 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 24122, 2022-01-24T07:13:42.974 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 330, 2022-01-24T07:13:42.974 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 23792, 2022-01-24T07:13:42.974 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:42.975 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:42.975 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 5, 2022-01-24T07:13:42.975 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 396, 2022-01-24T07:13:42.975 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 330, 2022-01-24T07:13:42.976 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 2256, 2022-01-24T07:13:42.976 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 154, 2022-01-24T07:13:42.976 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:42.976 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:42.976 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:42.977 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 82, 2022-01-24T07:13:42.977 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 20039, 2022-01-24T07:13:42.977 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:42.977 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:42.978 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:42.978 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:42.978 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 792, 2022-01-24T07:13:42.978 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:42.978 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:42.979 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:42.979 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:42.979 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:42.979 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:42.980 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:42.980 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:42.980 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:42.980 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2022-01-24T07:13:42.980 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:42.981 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:42.981 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:42.981 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:42.981 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:42.982 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:42.982 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:42.982 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:42.982 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:42.982 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:42.983 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:42.983 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:42.983 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:42.983 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:42.984 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:42.984 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:42.984 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:42.984 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:42.984 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:42.985 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:42.985 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:42.985 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:42.985 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:42.986 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 1707, 2022-01-24T07:13:42.986 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 0, 2022-01-24T07:13:42.986 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 183 2022-01-24T07:13:42.986 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.987 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:42.987 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:42.987 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:42.987 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:42.987 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:42.988 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.988 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:42.988 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:42.988 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:42.989 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:42.989 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:42.989 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 19170, 2022-01-24T07:13:42.989 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:42.989 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.990 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:42.990 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.990 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.990 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.991 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 192476, 2022-01-24T07:13:42.991 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 71164639, 2022-01-24T07:13:42.991 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.991 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 192476, 2022-01-24T07:13:42.991 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:42.992 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:42.992 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 192476, 2022-01-24T07:13:42.992 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 71164639, 2022-01-24T07:13:42.992 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.993 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.993 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.993 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.993 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.993 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.994 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:42.994 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.994 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:42.994 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.995 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.995 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.995 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:42.995 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:42.995 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 24122, 2022-01-24T07:13:42.996 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 285414358, 2022-01-24T07:13:42.996 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4001, 2022-01-24T07:13:42.996 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 285414358, 2022-01-24T07:13:42.996 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:42.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:42.997 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:42.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:42.997 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:42.998 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:42.998 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:42.998 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:42.998 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:42.999 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:42.999 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:42.999 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:42.999 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.000 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:43.000 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 24122, 2022-01-24T07:13:43.000 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 24122, 2022-01-24T07:13:43.000 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 24122, 2022-01-24T07:13:43.000 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 24122, 2022-01-24T07:13:43.001 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.001 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.002 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.002 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.002 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:43.002 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:43.003 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:43.003 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:43.003 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 19170, 2022-01-24T07:13:43.003 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 1936954, 2022-01-24T07:13:43.003 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.004 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 19170, 2022-01-24T07:13:43.004 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:43.004 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:43.004 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 330, 2022-01-24T07:13:43.005 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 1936954, 2022-01-24T07:13:43.005 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.005 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.005 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.005 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.006 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.006 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.006 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x556d9d9e9ae0": { 2022-01-24T07:13:43.006 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:43.007 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:43.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:43.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 120338, 2022-01-24T07:13:43.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 265680228, 2022-01-24T07:13:43.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.008 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 120338, 2022-01-24T07:13:43.008 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:43.008 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:43.008 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 1926, 2022-01-24T07:13:43.009 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 265680228, 2022-01-24T07:13:43.009 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.009 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.009 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.009 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.010 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.010 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.010 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:43.012 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=82 2022-01-24T07:13:43.012 DEBUG:tasks.check_counter:Getting stats from i 2022-01-24T07:13:43.013 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok perf dump 2022-01-24T07:13:43.138 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:43.139 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:43.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 32112, 2022-01-24T07:13:43.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 29801, 2022-01-24T07:13:43.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 40216011, 2022-01-24T07:13:43.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 88972160, 2022-01-24T07:13:43.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:43.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:43.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.870086954, 2022-01-24T07:13:43.141 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.750321149, 2022-01-24T07:13:43.141 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.412828307, 2022-01-24T07:13:43.141 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.294163665, 2022-01-24T07:13:43.141 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.141 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 29803, 2022-01-24T07:13:43.142 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 11.205565833, 2022-01-24T07:13:43.142 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000375987 2022-01-24T07:13:43.142 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.142 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.143 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 48798, 2022-01-24T07:13:43.143 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.008268797, 2022-01-24T07:13:43.143 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000169 2022-01-24T07:13:43.143 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.144 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.144 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:43.144 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 17577, 2022-01-24T07:13:43.144 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 17469, 2022-01-24T07:13:43.144 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 9718195, 2022-01-24T07:13:43.145 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 175260575, 2022-01-24T07:13:43.145 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:43.145 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:43.145 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.910141704, 2022-01-24T07:13:43.146 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.796262872, 2022-01-24T07:13:43.146 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.431023989, 2022-01-24T07:13:43.146 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.671320353, 2022-01-24T07:13:43.146 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.147 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17468, 2022-01-24T07:13:43.147 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 8.145562892, 2022-01-24T07:13:43.147 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000466313 2022-01-24T07:13:43.147 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.147 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.148 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 8568, 2022-01-24T07:13:43.148 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.001481118, 2022-01-24T07:13:43.148 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000172 2022-01-24T07:13:43.148 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.149 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.149 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:43.149 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 250623, 2022-01-24T07:13:43.149 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 483870, 2022-01-24T07:13:43.149 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 85801886, 2022-01-24T07:13:43.150 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 434105236, 2022-01-24T07:13:43.150 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:43.150 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:43.150 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 12.623349327, 2022-01-24T07:13:43.151 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 6.333855800, 2022-01-24T07:13:43.151 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 8.753761548, 2022-01-24T07:13:43.151 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.879585031, 2022-01-24T07:13:43.151 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.151 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 483867, 2022-01-24T07:13:43.152 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 197.807639317, 2022-01-24T07:13:43.152 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000408805 2022-01-24T07:13:43.152 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.152 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.153 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 345725, 2022-01-24T07:13:43.153 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.098637749, 2022-01-24T07:13:43.153 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000285 2022-01-24T07:13:43.153 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.154 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.154 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:43.154 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:43.154 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:43.154 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.155 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:43.155 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:43.155 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:43.155 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6606, 2022-01-24T07:13:43.156 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 97.221936749, 2022-01-24T07:13:43.156 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.014717217 2022-01-24T07:13:43.156 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.156 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.156 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:43.157 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:43.157 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:43.157 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 23207, 2022-01-24T07:13:43.157 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.354835441, 2022-01-24T07:13:43.158 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000187651 2022-01-24T07:13:43.158 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.158 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.158 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:43.159 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 143020, 2022-01-24T07:13:43.159 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 139508, 2022-01-24T07:13:43.159 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:43.159 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 139508, 2022-01-24T07:13:43.159 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2957.379328267, 2022-01-24T07:13:43.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.021198636 2022-01-24T07:13:43.160 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.160 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 3494, 2022-01-24T07:13:43.160 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 1, 2022-01-24T07:13:43.161 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 1357, 2022-01-24T07:13:43.161 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 135, 2022-01-24T07:13:43.161 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 1, 2022-01-24T07:13:43.161 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 12, 2022-01-24T07:13:43.162 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 0, 2022-01-24T07:13:43.162 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 2, 2022-01-24T07:13:43.162 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:43.162 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 11, 2022-01-24T07:13:43.162 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 85259, 2022-01-24T07:13:43.163 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:43.163 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2022-01-24T07:13:43.163 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 2, 2022-01-24T07:13:43.163 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 219167, 2022-01-24T07:13:43.164 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 200668, 2022-01-24T07:13:43.164 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 3364, 2022-01-24T07:13:43.164 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 789, 2022-01-24T07:13:43.164 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 1, 2022-01-24T07:13:43.164 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:43.165 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 263, 2022-01-24T07:13:43.165 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 100097, 2022-01-24T07:13:43.165 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 7, 2022-01-24T07:13:43.165 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 283, 2022-01-24T07:13:43.166 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 58285, 2022-01-24T07:13:43.166 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 277, 2022-01-24T07:13:43.166 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:43.166 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:43.167 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:43.167 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:43.167 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:43.167 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:43.167 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:43.168 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.168 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:43.168 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2022-01-24T07:13:43.168 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:43.169 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:43.169 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 30564, 2022-01-24T07:13:43.169 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 30564, 2022-01-24T07:13:43.169 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:43.169 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:43.170 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:43.170 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:43.170 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:43.170 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:43.171 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:43.171 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:43.171 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 286, 2022-01-24T07:13:43.171 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:43.172 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 139, 2022-01-24T07:13:43.172 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:43.172 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:43.172 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.172 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:43.173 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 189670, 2022-01-24T07:13:43.173 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 91588, 2022-01-24T07:13:43.173 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 91588, 2022-01-24T07:13:43.173 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 98082, 2022-01-24T07:13:43.174 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:43.174 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 1560, 2022-01-24T07:13:43.174 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 233, 2022-01-24T07:13:43.174 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 105, 2022-01-24T07:13:43.175 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 105, 2022-01-24T07:13:43.175 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 130, 2022-01-24T07:13:43.175 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:43.175 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 2, 2022-01-24T07:13:43.175 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 222365688, 2022-01-24T07:13:43.176 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 433037786, 2022-01-24T07:13:43.176 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:43.176 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:43.176 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3104, 2022-01-24T07:13:43.177 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 263.143827011, 2022-01-24T07:13:43.177 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.084775717 2022-01-24T07:13:43.177 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.177 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:43.177 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.178 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:43.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 22, 2022-01-24T07:13:43.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 70697, 2022-01-24T07:13:43.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 70675, 2022-01-24T07:13:43.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 13, 2022-01-24T07:13:43.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 3475, 2022-01-24T07:13:43.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 3462, 2022-01-24T07:13:43.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 11, 2022-01-24T07:13:43.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 151031, 2022-01-24T07:13:43.180 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 151020, 2022-01-24T07:13:43.180 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2022-01-24T07:13:43.180 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 70479, 2022-01-24T07:13:43.180 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 70479, 2022-01-24T07:13:43.181 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 124324, 2022-01-24T07:13:43.181 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:43.181 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.181 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:43.181 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 176386, 2022-01-24T07:13:43.182 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 2600, 2022-01-24T07:13:43.182 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 143020, 2022-01-24T07:13:43.182 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 222, 2022-01-24T07:13:43.182 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 4550, 2022-01-24T07:13:43.183 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:43.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31000, 2022-01-24T07:13:43.183 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 192.093648463, 2022-01-24T07:13:43.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006196569 2022-01-24T07:13:43.184 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.184 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:43.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2023, 2022-01-24T07:13:43.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 185.880803589, 2022-01-24T07:13:43.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.091883738 2022-01-24T07:13:43.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.185 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:43.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.185 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.186 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:43.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.186 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.187 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.187 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:43.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 39248, 2022-01-24T07:13:43.188 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 786.515779081, 2022-01-24T07:13:43.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.020039639 2022-01-24T07:13:43.188 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.188 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:43.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.189 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.189 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.189 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.189 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:43.190 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.190 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.190 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.190 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.191 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:43.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.191 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.191 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.192 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:43.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.192 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.193 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.193 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:43.193 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.193 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.194 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.194 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.194 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:43.194 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.194 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.195 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.195 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.195 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:43.195 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 223, 2022-01-24T07:13:43.196 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.391312077, 2022-01-24T07:13:43.196 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.019691982 2022-01-24T07:13:43.196 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.196 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:43.196 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.197 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.197 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.197 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.197 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:43.198 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.198 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.198 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.198 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.198 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:43.199 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7738, 2022-01-24T07:13:43.199 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 49.402679274, 2022-01-24T07:13:43.199 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006384424 2022-01-24T07:13:43.199 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.200 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:43.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1239, 2022-01-24T07:13:43.200 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.679114895, 2022-01-24T07:13:43.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001355217 2022-01-24T07:13:43.200 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.201 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:43.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 30999, 2022-01-24T07:13:43.201 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 585.767477470, 2022-01-24T07:13:43.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.018896334 2022-01-24T07:13:43.202 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.202 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:43.202 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.202 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.203 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.203 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.203 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:43.203 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 216, 2022-01-24T07:13:43.203 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 39.013389904, 2022-01-24T07:13:43.204 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.180617545 2022-01-24T07:13:43.204 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.204 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:43.204 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.205 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.205 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.205 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.205 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:43.205 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.206 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.206 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.206 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:43.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2, 2022-01-24T07:13:43.207 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.117070400, 2022-01-24T07:13:43.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.058535200 2022-01-24T07:13:43.207 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.207 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:43.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.208 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.208 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.209 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:43.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.209 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.210 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.210 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:43.210 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.210 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.210 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.211 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.211 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:43.211 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.211 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.212 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.212 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.212 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:43.212 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.212 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.213 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.213 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.213 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:43.213 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 26820, 2022-01-24T07:13:43.214 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1112.518053114, 2022-01-24T07:13:43.214 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.041480911 2022-01-24T07:13:43.214 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.214 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:43.214 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:43.215 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.215 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:43.215 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:43.215 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:43.216 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:43.216 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:43.216 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:43.216 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 24012, 2022-01-24T07:13:43.216 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 12006, 2022-01-24T07:13:43.217 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3793 2022-01-24T07:13:43.217 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.217 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:43.217 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 3960, 2022-01-24T07:13:43.218 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 3960, 2022-01-24T07:13:43.218 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:43.218 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:43.218 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:43.218 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:43.219 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:43.219 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:43.219 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:43.219 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:43.220 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:43.220 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:43.220 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:43.220 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:43.221 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:43.221 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:43.221 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:43.221 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:43.222 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:43.222 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:43.222 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:43.222 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:43.222 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:43.223 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:43.223 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:43.223 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:43.223 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:43.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:43.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:43.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:43.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:43.224 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:43.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:43.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:43.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:43.225 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:43.226 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 1228090, 2022-01-24T07:13:43.226 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 814, 2022-01-24T07:13:43.226 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 5896, 2022-01-24T07:13:43.226 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 67, 2022-01-24T07:13:43.226 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:43.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:43.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:43.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:43.227 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:43.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:43.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:43.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:43.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:43.228 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:43.229 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:43.229 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:43.229 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 2074865, 2022-01-24T07:13:43.229 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 64651, 2022-01-24T07:13:43.230 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:43.230 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:43.230 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:43.230 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:43.230 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.231 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:43.231 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 1, 2022-01-24T07:13:43.231 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:43.231 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 32836, 2022-01-24T07:13:43.232 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 460252477, 2022-01-24T07:13:43.232 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 33, 2022-01-24T07:13:43.232 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 32835, 2022-01-24T07:13:43.232 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 32836, 2022-01-24T07:13:43.232 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 477, 2022-01-24T07:13:43.233 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 32359, 2022-01-24T07:13:43.233 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:43.233 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:43.233 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 121, 2022-01-24T07:13:43.234 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 4150, 2022-01-24T07:13:43.234 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 476, 2022-01-24T07:13:43.234 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 3585, 2022-01-24T07:13:43.234 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 217, 2022-01-24T07:13:43.234 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:43.235 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:43.235 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:43.235 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 135, 2022-01-24T07:13:43.235 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 22783, 2022-01-24T07:13:43.236 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:43.236 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:43.236 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:43.236 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 1, 2022-01-24T07:13:43.236 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 8300, 2022-01-24T07:13:43.237 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:43.237 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:43.237 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:43.237 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:43.238 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:43.238 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:43.238 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:43.238 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:43.238 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:43.239 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 2, 2022-01-24T07:13:43.239 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:43.239 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:43.239 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:43.240 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:43.240 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:43.240 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:43.240 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:43.240 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:43.241 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:43.241 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:43.241 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:43.241 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:43.242 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:43.242 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:43.242 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:43.242 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:43.242 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:43.243 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:43.243 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:43.243 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:43.243 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:43.244 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:43.244 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:43.244 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 2952, 2022-01-24T07:13:43.244 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2022-01-24T07:13:43.245 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 373 2022-01-24T07:13:43.245 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.245 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:43.245 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:43.245 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:43.246 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:43.246 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:43.246 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.246 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:43.247 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 1, 2022-01-24T07:13:43.247 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:43.247 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 1, 2022-01-24T07:13:43.247 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:43.248 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 21814, 2022-01-24T07:13:43.248 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 8754 2022-01-24T07:13:43.248 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.248 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:43.248 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:43.249 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:43.249 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:43.249 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 300306, 2022-01-24T07:13:43.249 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 112228530, 2022-01-24T07:13:43.250 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.250 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 300306, 2022-01-24T07:13:43.250 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:43.250 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:43.250 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 300306, 2022-01-24T07:13:43.251 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 112228530, 2022-01-24T07:13:43.251 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.251 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.251 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.252 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.252 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.252 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.252 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:43.252 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:43.253 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:43.253 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:43.253 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:43.253 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:43.254 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.254 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:43.254 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 32836, 2022-01-24T07:13:43.254 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 463340649, 2022-01-24T07:13:43.254 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 9916, 2022-01-24T07:13:43.255 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 463340649, 2022-01-24T07:13:43.255 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.255 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.255 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.256 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.256 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.256 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.256 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:43.256 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 1, 2022-01-24T07:13:43.257 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:43.257 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:43.257 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:43.257 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:43.258 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.258 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:43.258 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 32836, 2022-01-24T07:13:43.258 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 32836, 2022-01-24T07:13:43.258 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 32835, 2022-01-24T07:13:43.259 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 32835, 2022-01-24T07:13:43.259 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.259 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.259 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.260 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.260 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.260 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.260 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:43.260 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:43.261 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:43.261 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:43.261 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 30564, 2022-01-24T07:13:43.261 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 3088188, 2022-01-24T07:13:43.261 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.262 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 30564, 2022-01-24T07:13:43.262 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:43.262 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:43.262 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 479, 2022-01-24T07:13:43.263 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 3088188, 2022-01-24T07:13:43.263 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.263 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.263 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.263 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.264 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.264 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:43.264 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55f1adc7fae0": { 2022-01-24T07:13:43.264 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:43.265 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:43.265 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:43.265 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 189670, 2022-01-24T07:13:43.265 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 428843482, 2022-01-24T07:13:43.265 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.266 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 189670, 2022-01-24T07:13:43.266 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:43.266 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:43.266 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 3104, 2022-01-24T07:13:43.267 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 428843482, 2022-01-24T07:13:43.267 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:43.267 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:43.267 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.267 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.268 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.268 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:43.268 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:43.270 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=135 2022-01-24T07:13:43.270 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2022-01-24T07:13:43.283 DEBUG:tasks.check_counter:Getting stats from a 2022-01-24T07:13:43.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2022-01-24T07:13:43.406 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:43.406 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:43.407 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 127371, 2022-01-24T07:13:43.407 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 212790, 2022-01-24T07:13:43.407 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 50163955, 2022-01-24T07:13:43.407 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 111603698, 2022-01-24T07:13:43.408 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 13, 2022-01-24T07:13:43.408 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2022-01-24T07:13:43.408 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 5.620592539, 2022-01-24T07:13:43.409 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 2.703905964, 2022-01-24T07:13:43.409 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 5.451914673, 2022-01-24T07:13:43.409 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.034226517, 2022-01-24T07:13:43.410 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.410 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 212790, 2022-01-24T07:13:43.410 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 103.975317672, 2022-01-24T07:13:43.410 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000488628 2022-01-24T07:13:43.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.411 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.411 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 147530, 2022-01-24T07:13:43.411 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.049047183, 2022-01-24T07:13:43.411 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000332 2022-01-24T07:13:43.412 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.412 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:43.412 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 27071, 2022-01-24T07:13:43.413 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 28965, 2022-01-24T07:13:43.413 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 9513949, 2022-01-24T07:13:43.413 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 110624056, 2022-01-24T07:13:43.413 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:43.413 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:43.414 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 2.313727061, 2022-01-24T07:13:43.414 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.850369122, 2022-01-24T07:13:43.414 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.809116582, 2022-01-24T07:13:43.414 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.691298192, 2022-01-24T07:13:43.415 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.415 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 28964, 2022-01-24T07:13:43.415 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.277364536, 2022-01-24T07:13:43.415 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000216729 2022-01-24T07:13:43.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.416 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.416 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 22905, 2022-01-24T07:13:43.416 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.003924446, 2022-01-24T07:13:43.416 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000171 2022-01-24T07:13:43.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.417 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:43.417 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 20976, 2022-01-24T07:13:43.417 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 21987, 2022-01-24T07:13:43.418 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 10579588, 2022-01-24T07:13:43.418 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 95771770, 2022-01-24T07:13:43.418 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:43.419 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:43.419 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.740593448, 2022-01-24T07:13:43.420 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.686120325, 2022-01-24T07:13:43.420 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.673433241, 2022-01-24T07:13:43.420 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.435594176, 2022-01-24T07:13:43.421 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.421 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 21985, 2022-01-24T07:13:43.421 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.006601456, 2022-01-24T07:13:43.422 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000318699 2022-01-24T07:13:43.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.423 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.423 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 19306, 2022-01-24T07:13:43.423 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.003578443, 2022-01-24T07:13:43.423 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000185 2022-01-24T07:13:43.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.424 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:43.424 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:43.424 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:43.426 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4898, 2022-01-24T07:13:43.426 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 42.818689511, 2022-01-24T07:13:43.427 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.008742076 2022-01-24T07:13:43.427 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.428 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:43.428 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:43.428 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:43.428 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 23049, 2022-01-24T07:13:43.429 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 3.420750596, 2022-01-24T07:13:43.429 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000148412 2022-01-24T07:13:43.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.430 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:43.430 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 67558, 2022-01-24T07:13:43.430 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 66720, 2022-01-24T07:13:43.430 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:43.431 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 66720, 2022-01-24T07:13:43.431 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1754.256505529, 2022-01-24T07:13:43.431 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.026292813 2022-01-24T07:13:43.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.432 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 834, 2022-01-24T07:13:43.432 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:43.432 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 479, 2022-01-24T07:13:43.432 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 52, 2022-01-24T07:13:43.432 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:43.433 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 15, 2022-01-24T07:13:43.433 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 0, 2022-01-24T07:13:43.433 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 4, 2022-01-24T07:13:43.433 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 11, 2022-01-24T07:13:43.434 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 11, 2022-01-24T07:13:43.434 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 11750, 2022-01-24T07:13:43.434 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 2, 2022-01-24T07:13:43.434 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 2, 2022-01-24T07:13:43.435 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 4, 2022-01-24T07:13:43.435 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 106393, 2022-01-24T07:13:43.435 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 96734, 2022-01-24T07:13:43.435 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 692, 2022-01-24T07:13:43.435 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 445, 2022-01-24T07:13:43.436 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:43.436 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:43.436 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 288, 2022-01-24T07:13:43.436 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 0, 2022-01-24T07:13:43.437 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:43.437 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 197, 2022-01-24T07:13:43.437 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 1899, 2022-01-24T07:13:43.437 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 307, 2022-01-24T07:13:43.437 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:43.438 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:43.438 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:43.438 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:43.438 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:43.439 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:43.439 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:43.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.440 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:43.440 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:43.440 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:43.440 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:43.441 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 21621, 2022-01-24T07:13:43.441 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 21621, 2022-01-24T07:13:43.441 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:43.441 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:43.441 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:43.442 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:43.442 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:43.442 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:43.442 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:43.443 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:43.443 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 197, 2022-01-24T07:13:43.443 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:43.443 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 52, 2022-01-24T07:13:43.443 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:43.444 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:43.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.444 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:43.444 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 92679, 2022-01-24T07:13:43.445 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:43.445 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:43.445 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 92679, 2022-01-24T07:13:43.445 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:43.445 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:43.446 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 115, 2022-01-24T07:13:43.446 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:43.446 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:43.446 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 115, 2022-01-24T07:13:43.447 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:43.447 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:43.447 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:43.447 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 205137124, 2022-01-24T07:13:43.447 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:43.448 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:43.448 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2395, 2022-01-24T07:13:43.448 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 106.863681156, 2022-01-24T07:13:43.448 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.044619491 2022-01-24T07:13:43.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.449 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:43.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.449 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:43.449 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 24, 2022-01-24T07:13:43.450 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 22801, 2022-01-24T07:13:43.450 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 22777, 2022-01-24T07:13:43.450 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 17, 2022-01-24T07:13:43.450 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 1278, 2022-01-24T07:13:43.450 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 1261, 2022-01-24T07:13:43.451 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 13, 2022-01-24T07:13:43.451 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 60760, 2022-01-24T07:13:43.451 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 60747, 2022-01-24T07:13:43.451 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 1, 2022-01-24T07:13:43.452 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 28366, 2022-01-24T07:13:43.452 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 28365, 2022-01-24T07:13:43.452 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 101932, 2022-01-24T07:13:43.452 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:43.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.453 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:43.453 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 79589, 2022-01-24T07:13:43.453 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 3667, 2022-01-24T07:13:43.453 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 67558, 2022-01-24T07:13:43.453 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 248, 2022-01-24T07:13:43.454 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 5573, 2022-01-24T07:13:43.454 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:43.454 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9238, 2022-01-24T07:13:43.454 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 30.521100274, 2022-01-24T07:13:43.455 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003303864 2022-01-24T07:13:43.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.455 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:43.455 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 96, 2022-01-24T07:13:43.456 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.331251760, 2022-01-24T07:13:43.456 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.024283872 2022-01-24T07:13:43.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.456 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:43.456 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.457 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.457 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.457 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:43.457 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.458 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.458 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.458 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:43.459 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 24500, 2022-01-24T07:13:43.459 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 255.095576086, 2022-01-24T07:13:43.459 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.010412064 2022-01-24T07:13:43.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.460 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:43.460 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.460 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.460 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.461 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:43.461 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.461 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.461 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.462 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:43.462 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.462 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.463 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.463 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:43.463 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.464 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.464 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.464 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:43.465 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.465 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.465 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.465 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:43.466 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.466 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.466 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.467 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:43.467 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 55, 2022-01-24T07:13:43.467 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.863603259, 2022-01-24T07:13:43.467 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.015701877 2022-01-24T07:13:43.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.468 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:43.468 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.468 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.468 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.469 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:43.469 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.469 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.469 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.470 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:43.470 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2585, 2022-01-24T07:13:43.470 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.625668664, 2022-01-24T07:13:43.470 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002949968 2022-01-24T07:13:43.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.471 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:43.471 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 870, 2022-01-24T07:13:43.471 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.215690230, 2022-01-24T07:13:43.472 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002546770 2022-01-24T07:13:43.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.472 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:43.472 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9203, 2022-01-24T07:13:43.472 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 297.051720129, 2022-01-24T07:13:43.473 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.032277705 2022-01-24T07:13:43.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.473 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:43.473 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.474 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.474 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.475 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:43.475 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 145, 2022-01-24T07:13:43.475 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 43.884868943, 2022-01-24T07:13:43.475 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.302654268 2022-01-24T07:13:43.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.476 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:43.476 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.476 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.476 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.477 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:43.477 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.477 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.477 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.478 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:43.478 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.478 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.479 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.479 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:43.479 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.480 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.480 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.480 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:43.480 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.481 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.481 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.481 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:43.482 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.482 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.482 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.482 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:43.483 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.483 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.483 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.484 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:43.484 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.484 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.484 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.485 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:43.485 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 20028, 2022-01-24T07:13:43.485 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1114.667026184, 2022-01-24T07:13:43.486 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.055655433 2022-01-24T07:13:43.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.486 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:43.486 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:43.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.487 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:43.487 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:43.487 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:43.487 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:43.488 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:43.488 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:43.488 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 12939, 2022-01-24T07:13:43.488 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 6469, 2022-01-24T07:13:43.488 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 743 2022-01-24T07:13:43.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.489 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:43.489 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:43.489 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:43.490 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:43.490 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:43.490 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:43.490 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:43.490 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:43.491 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:43.491 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:43.491 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:43.491 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:43.492 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:43.492 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:43.492 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:43.492 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:43.492 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:43.493 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:43.493 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:43.493 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:43.493 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:43.494 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:43.494 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:43.494 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:43.494 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:43.494 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:43.495 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:43.495 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:43.495 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:43.495 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:43.496 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:43.496 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:43.496 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:43.496 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:43.496 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:43.497 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:43.497 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:43.497 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 223686, 2022-01-24T07:13:43.497 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 125, 2022-01-24T07:13:43.497 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 88, 2022-01-24T07:13:43.498 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 1, 2022-01-24T07:13:43.498 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:43.498 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:43.498 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:43.499 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:43.499 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:43.499 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:43.499 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:43.499 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:43.500 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:43.500 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:43.500 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:43.500 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:43.501 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 87778, 2022-01-24T07:13:43.501 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 480, 2022-01-24T07:13:43.501 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:43.501 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:43.501 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:43.502 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:43.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.502 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:43.502 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2022-01-24T07:13:43.503 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:43.503 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 26602, 2022-01-24T07:13:43.503 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 212396421, 2022-01-24T07:13:43.503 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 27, 2022-01-24T07:13:43.503 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 26602, 2022-01-24T07:13:43.504 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 26602, 2022-01-24T07:13:43.504 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 464, 2022-01-24T07:13:43.504 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 26138, 2022-01-24T07:13:43.504 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:43.504 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:43.505 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:43.505 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:43.505 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 464, 2022-01-24T07:13:43.505 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 2862, 2022-01-24T07:13:43.506 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 181, 2022-01-24T07:13:43.506 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:43.506 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:43.506 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:43.506 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 52, 2022-01-24T07:13:43.507 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 22440, 2022-01-24T07:13:43.507 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:43.507 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:43.507 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:43.508 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:43.508 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:43.508 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:43.508 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:43.508 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:43.509 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:43.509 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:43.509 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:43.509 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:43.510 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:43.510 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:43.510 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:43.510 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:43.510 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:43.511 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:43.511 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:43.511 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:43.511 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:43.512 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:43.512 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:43.512 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:43.512 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:43.512 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:43.513 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:43.513 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:43.513 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:43.513 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:43.513 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:43.514 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:43.514 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:43.514 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:43.514 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:43.515 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:43.515 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:43.515 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:43.516 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1165, 2022-01-24T07:13:43.516 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:43.516 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 155 2022-01-24T07:13:43.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.517 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:43.517 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:43.517 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:43.517 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:43.517 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:43.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.518 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:43.518 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:43.518 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:43.519 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2022-01-24T07:13:43.519 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:43.519 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 21621, 2022-01-24T07:13:43.519 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:43.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.520 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:43.520 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.520 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:43.521 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.521 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 175414, 2022-01-24T07:13:43.521 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 56380592, 2022-01-24T07:13:43.521 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.521 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 175414, 2022-01-24T07:13:43.522 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:43.522 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:43.523 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 175414, 2022-01-24T07:13:43.523 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 56380592, 2022-01-24T07:13:43.523 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.524 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.524 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.525 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.526 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:43.526 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.527 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:43.527 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.528 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:43.528 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:43.528 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.529 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:43.529 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 26602, 2022-01-24T07:13:43.530 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 214580902, 2022-01-24T07:13:43.530 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 4110, 2022-01-24T07:13:43.530 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 214580902, 2022-01-24T07:13:43.531 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.531 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.532 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.532 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.533 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:43.533 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.533 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:43.533 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.534 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:43.534 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:43.534 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.534 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:43.535 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 26602, 2022-01-24T07:13:43.535 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 26602, 2022-01-24T07:13:43.535 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 26602, 2022-01-24T07:13:43.535 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 26602, 2022-01-24T07:13:43.535 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.536 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.536 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.536 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.536 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.537 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:43.537 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.537 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:43.537 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.538 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 21621, 2022-01-24T07:13:43.538 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 2184481, 2022-01-24T07:13:43.538 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.538 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 21621, 2022-01-24T07:13:43.539 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:43.539 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:43.539 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 467, 2022-01-24T07:13:43.539 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 2184481, 2022-01-24T07:13:43.539 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.540 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.540 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.540 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.540 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.541 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x563c437cbae0": { 2022-01-24T07:13:43.541 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.541 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:43.541 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.542 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 92679, 2022-01-24T07:13:43.542 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 200942820, 2022-01-24T07:13:43.542 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.542 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 92679, 2022-01-24T07:13:43.543 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:43.543 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:43.544 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2395, 2022-01-24T07:13:43.544 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 200942820, 2022-01-24T07:13:43.544 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.545 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.545 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.545 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.546 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:43.547 INFO:tasks.check_counter:Daemon mds.a mds.exported=197 2022-01-24T07:13:43.548 INFO:tasks.check_counter:Daemon mds.a mds.imported=307 2022-01-24T07:13:43.548 DEBUG:tasks.check_counter:Getting stats from b 2022-01-24T07:13:43.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2022-01-24T07:13:43.672 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:43.672 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:43.672 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 20212, 2022-01-24T07:13:43.673 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 20340, 2022-01-24T07:13:43.673 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 15157867, 2022-01-24T07:13:43.673 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 31953738, 2022-01-24T07:13:43.673 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:43.674 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 2, 2022-01-24T07:13:43.674 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.191222730, 2022-01-24T07:13:43.674 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.488268899, 2022-01-24T07:13:43.674 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.815245639, 2022-01-24T07:13:43.674 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.118543997, 2022-01-24T07:13:43.675 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.675 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 20342, 2022-01-24T07:13:43.675 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 8.603593430, 2022-01-24T07:13:43.675 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000422947 2022-01-24T07:13:43.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.676 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.676 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 32833, 2022-01-24T07:13:43.676 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.006208682, 2022-01-24T07:13:43.677 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000189 2022-01-24T07:13:43.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.677 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:43.678 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 98802, 2022-01-24T07:13:43.678 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 180586, 2022-01-24T07:13:43.678 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 32701672, 2022-01-24T07:13:43.678 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 127638409, 2022-01-24T07:13:43.679 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:43.679 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:43.679 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 5.023683218, 2022-01-24T07:13:43.679 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 2.399061681, 2022-01-24T07:13:43.679 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 3.497772598, 2022-01-24T07:13:43.680 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.254169451, 2022-01-24T07:13:43.680 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.680 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 180582, 2022-01-24T07:13:43.680 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 142.756657021, 2022-01-24T07:13:43.681 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000790536 2022-01-24T07:13:43.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.681 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.681 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 114441, 2022-01-24T07:13:43.681 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.035511307, 2022-01-24T07:13:43.682 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000310 2022-01-24T07:13:43.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.682 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:43.683 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 36627, 2022-01-24T07:13:43.683 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 60054, 2022-01-24T07:13:43.683 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 18359213, 2022-01-24T07:13:43.683 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 156143167, 2022-01-24T07:13:43.684 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:43.684 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:43.684 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 2.536935943, 2022-01-24T07:13:43.684 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 1.171547955, 2022-01-24T07:13:43.685 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 1.315609414, 2022-01-24T07:13:43.685 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.462133083, 2022-01-24T07:13:43.685 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.685 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 60053, 2022-01-24T07:13:43.685 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 18.385447506, 2022-01-24T07:13:43.686 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000306153 2022-01-24T07:13:43.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.686 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.687 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 40774, 2022-01-24T07:13:43.687 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.011926155, 2022-01-24T07:13:43.687 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000292 2022-01-24T07:13:43.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.688 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:43.688 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:43.688 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:43.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.689 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:43.689 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:43.689 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:43.690 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4586, 2022-01-24T07:13:43.690 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 51.271300359, 2022-01-24T07:13:43.690 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011179960 2022-01-24T07:13:43.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.691 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:43.691 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:43.691 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:43.691 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12167, 2022-01-24T07:13:43.692 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.537357339, 2022-01-24T07:13:43.692 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000208544 2022-01-24T07:13:43.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.693 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:43.693 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 61250, 2022-01-24T07:13:43.693 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 60301, 2022-01-24T07:13:43.693 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:43.694 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 60301, 2022-01-24T07:13:43.694 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1002.660028679, 2022-01-24T07:13:43.694 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.016627585 2022-01-24T07:13:43.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.695 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 946, 2022-01-24T07:13:43.695 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:43.695 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 668, 2022-01-24T07:13:43.695 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 73, 2022-01-24T07:13:43.695 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:43.696 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 22, 2022-01-24T07:13:43.696 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 7, 2022-01-24T07:13:43.696 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 5, 2022-01-24T07:13:43.696 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:43.697 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 11, 2022-01-24T07:13:43.697 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 42163, 2022-01-24T07:13:43.697 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:43.697 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 0, 2022-01-24T07:13:43.698 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 7, 2022-01-24T07:13:43.698 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 96102, 2022-01-24T07:13:43.698 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 88062, 2022-01-24T07:13:43.698 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 671, 2022-01-24T07:13:43.699 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 358, 2022-01-24T07:13:43.699 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:43.700 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:43.700 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 216, 2022-01-24T07:13:43.700 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 40, 2022-01-24T07:13:43.700 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:43.701 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 314, 2022-01-24T07:13:43.701 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 29508, 2022-01-24T07:13:43.701 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 295, 2022-01-24T07:13:43.701 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:43.702 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:43.702 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:43.702 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:43.702 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:43.702 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:43.703 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:43.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.703 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:43.703 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:43.704 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:43.704 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:43.704 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 10997, 2022-01-24T07:13:43.704 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 10997, 2022-01-24T07:13:43.705 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:43.705 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:43.705 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:43.705 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:43.706 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:43.706 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:43.706 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:43.706 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:43.707 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 314, 2022-01-24T07:13:43.707 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:43.707 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 73, 2022-01-24T07:13:43.707 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:43.708 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:43.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.708 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:43.709 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 84357, 2022-01-24T07:13:43.709 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:43.709 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:43.709 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 84357, 2022-01-24T07:13:43.710 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:43.710 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:43.710 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 99, 2022-01-24T07:13:43.710 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:43.710 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:43.711 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 99, 2022-01-24T07:13:43.711 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:43.711 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:43.711 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:43.712 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 196531731, 2022-01-24T07:13:43.712 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:43.712 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:43.712 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2253, 2022-01-24T07:13:43.713 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 162.893994157, 2022-01-24T07:13:43.713 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.072300929 2022-01-24T07:13:43.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.713 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:43.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:43.714 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 32, 2022-01-24T07:13:43.714 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 31283, 2022-01-24T07:13:43.714 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 31251, 2022-01-24T07:13:43.715 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 27, 2022-01-24T07:13:43.715 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 1591, 2022-01-24T07:13:43.715 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 1564, 2022-01-24T07:13:43.715 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 21, 2022-01-24T07:13:43.716 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 63169, 2022-01-24T07:13:43.716 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 63148, 2022-01-24T07:13:43.716 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 0, 2022-01-24T07:13:43.716 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 34787, 2022-01-24T07:13:43.717 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 34787, 2022-01-24T07:13:43.717 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 109164, 2022-01-24T07:13:43.717 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:43.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.717 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:43.718 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 77636, 2022-01-24T07:13:43.718 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 1950, 2022-01-24T07:13:43.718 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 61250, 2022-01-24T07:13:43.718 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 265, 2022-01-24T07:13:43.719 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 3859, 2022-01-24T07:13:43.719 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:43.719 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 16361, 2022-01-24T07:13:43.719 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 71.124186816, 2022-01-24T07:13:43.719 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004347178 2022-01-24T07:13:43.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.720 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:43.720 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 61, 2022-01-24T07:13:43.720 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.337104123, 2022-01-24T07:13:43.721 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.038313182 2022-01-24T07:13:43.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.721 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:43.721 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.722 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.722 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.722 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:43.723 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.723 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.723 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.723 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:43.724 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 15036, 2022-01-24T07:13:43.724 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 242.337028084, 2022-01-24T07:13:43.724 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.016117120 2022-01-24T07:13:43.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.725 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:43.725 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.725 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.725 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.726 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:43.726 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.726 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.726 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.727 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:43.727 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.727 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.728 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.728 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:43.728 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.728 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.729 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.729 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:43.729 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.730 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.730 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.730 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:43.731 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.731 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.731 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.732 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:43.732 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 107, 2022-01-24T07:13:43.732 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1.177058927, 2022-01-24T07:13:43.732 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011000550 2022-01-24T07:13:43.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.733 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:43.733 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.733 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.733 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.734 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:43.734 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.734 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.735 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.735 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:43.735 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 3727, 2022-01-24T07:13:43.735 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 17.550714186, 2022-01-24T07:13:43.736 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004709072 2022-01-24T07:13:43.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.736 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:43.736 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 387, 2022-01-24T07:13:43.737 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.875446610, 2022-01-24T07:13:43.737 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002262135 2022-01-24T07:13:43.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.737 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:43.738 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 16379, 2022-01-24T07:13:43.738 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 424.592337803, 2022-01-24T07:13:43.738 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.025922970 2022-01-24T07:13:43.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.739 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:43.739 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.739 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.740 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.740 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:43.740 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 46, 2022-01-24T07:13:43.740 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 10.737655530, 2022-01-24T07:13:43.741 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.233427294 2022-01-24T07:13:43.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.741 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:43.741 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.742 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.742 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.742 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:43.743 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.743 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.743 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.744 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:43.744 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.744 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.744 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.745 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:43.745 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.745 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.745 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.746 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:43.746 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.746 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.746 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.747 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:43.747 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.747 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.748 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.748 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:43.748 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.749 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.749 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.749 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:43.749 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.750 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.750 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.750 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:43.751 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 8197, 2022-01-24T07:13:43.751 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 231.928496600, 2022-01-24T07:13:43.751 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.028294314 2022-01-24T07:13:43.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.752 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:43.752 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:43.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:43.752 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:43.753 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:43.753 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:43.753 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:43.753 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:43.754 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 6208, 2022-01-24T07:13:43.754 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 3104, 2022-01-24T07:13:43.754 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 3787 2022-01-24T07:13:43.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.755 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:43.755 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:43.755 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:43.755 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:43.755 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:43.756 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:43.756 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:43.756 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:43.756 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:43.757 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:43.757 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:43.757 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:43.757 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:43.758 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:43.758 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:43.758 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:43.758 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:43.758 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:43.759 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:43.759 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:43.759 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:43.759 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:43.760 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:43.760 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:43.760 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:43.760 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:43.761 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:43.761 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:43.761 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:43.761 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:43.762 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:43.762 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:43.762 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:43.762 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:43.763 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:43.763 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:43.763 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:43.763 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 207869, 2022-01-24T07:13:43.763 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 119, 2022-01-24T07:13:43.764 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2022-01-24T07:13:43.764 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2022-01-24T07:13:43.764 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:43.764 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:43.765 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:43.765 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:43.765 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:43.765 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:43.766 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:43.766 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:43.766 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:43.766 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:43.767 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:43.767 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:43.767 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 120314, 2022-01-24T07:13:43.767 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 532, 2022-01-24T07:13:43.767 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:43.768 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:43.768 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:43.768 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:43.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.769 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:43.769 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2022-01-24T07:13:43.769 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:43.769 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 15288, 2022-01-24T07:13:43.769 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 206618914, 2022-01-24T07:13:43.770 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 27, 2022-01-24T07:13:43.770 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 15288, 2022-01-24T07:13:43.770 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 15288, 2022-01-24T07:13:43.770 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 350, 2022-01-24T07:13:43.771 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 14938, 2022-01-24T07:13:43.771 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:43.771 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:43.771 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:43.772 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:43.772 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 350, 2022-01-24T07:13:43.772 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 2607, 2022-01-24T07:13:43.772 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 172, 2022-01-24T07:13:43.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:43.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:43.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:43.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 73, 2022-01-24T07:13:43.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 11294, 2022-01-24T07:13:43.774 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:43.774 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:43.774 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:43.774 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:43.775 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:43.775 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:43.775 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:43.775 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:43.776 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:43.776 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:43.776 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:43.776 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:43.777 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:43.777 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:43.777 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:43.777 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:43.777 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:43.778 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:43.778 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:43.778 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:43.778 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1542, 2022-01-24T07:13:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 171 2022-01-24T07:13:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2022-01-24T07:13:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 10997, 2022-01-24T07:13:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 155638, 2022-01-24T07:13:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 53958251, 2022-01-24T07:13:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 155638, 2022-01-24T07:13:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 155638, 2022-01-24T07:13:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 53958251, 2022-01-24T07:13:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15288, 2022-01-24T07:13:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 207729851, 2022-01-24T07:13:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 3921, 2022-01-24T07:13:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 207729851, 2022-01-24T07:13:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15288, 2022-01-24T07:13:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 15288, 2022-01-24T07:13:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 15288, 2022-01-24T07:13:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 15288, 2022-01-24T07:13:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 10997, 2022-01-24T07:13:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1110937, 2022-01-24T07:13:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 10997, 2022-01-24T07:13:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 354, 2022-01-24T07:13:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1110937, 2022-01-24T07:13:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x55abd969bae0": { 2022-01-24T07:13:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 84357, 2022-01-24T07:13:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 192337427, 2022-01-24T07:13:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 84357, 2022-01-24T07:13:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2253, 2022-01-24T07:13:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 192337427, 2022-01-24T07:13:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.807 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:43.809 INFO:tasks.check_counter:Daemon mds.b mds.exported=314 2022-01-24T07:13:43.810 INFO:tasks.check_counter:Daemon mds.b mds.imported=295 2022-01-24T07:13:43.810 DEBUG:tasks.check_counter:Getting stats from c 2022-01-24T07:13:43.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok perf dump 2022-01-24T07:13:43.927 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:43.927 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:43.927 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 51504, 2022-01-24T07:13:43.928 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 62026, 2022-01-24T07:13:43.928 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 21942258, 2022-01-24T07:13:43.928 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 104841174, 2022-01-24T07:13:43.928 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 13, 2022-01-24T07:13:43.928 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 2, 2022-01-24T07:13:43.929 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 2.524490495, 2022-01-24T07:13:43.929 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 1.109635221, 2022-01-24T07:13:43.929 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 2.989831679, 2022-01-24T07:13:43.929 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.305693890, 2022-01-24T07:13:43.930 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.930 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 62025, 2022-01-24T07:13:43.930 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 27.043567189, 2022-01-24T07:13:43.931 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000436010 2022-01-24T07:13:43.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.931 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.931 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 54174, 2022-01-24T07:13:43.932 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.013837553, 2022-01-24T07:13:43.932 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000255 2022-01-24T07:13:43.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.933 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:43.933 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 113998, 2022-01-24T07:13:43.933 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 194461, 2022-01-24T07:13:43.933 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 39664337, 2022-01-24T07:13:43.934 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 154587233, 2022-01-24T07:13:43.934 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 9, 2022-01-24T07:13:43.934 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:43.934 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 5.849022827, 2022-01-24T07:13:43.934 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 2.734407788, 2022-01-24T07:13:43.935 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 12.089948057, 2022-01-24T07:13:43.935 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.435263370, 2022-01-24T07:13:43.935 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.935 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 194461, 2022-01-24T07:13:43.936 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 119.992742606, 2022-01-24T07:13:43.936 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000617052 2022-01-24T07:13:43.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.936 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.936 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 146235, 2022-01-24T07:13:43.937 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.040744399, 2022-01-24T07:13:43.937 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000278 2022-01-24T07:13:43.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.938 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:43.938 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 20003, 2022-01-24T07:13:43.938 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 17020, 2022-01-24T07:13:43.938 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 12656646, 2022-01-24T07:13:43.939 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 97294989, 2022-01-24T07:13:43.939 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:43.939 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 3, 2022-01-24T07:13:43.939 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.489979904, 2022-01-24T07:13:43.939 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.602534582, 2022-01-24T07:13:43.940 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.874162124, 2022-01-24T07:13:43.940 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.391267368, 2022-01-24T07:13:43.940 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:43.940 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 17019, 2022-01-24T07:13:43.941 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.054060669, 2022-01-24T07:13:43.941 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000414481 2022-01-24T07:13:43.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.941 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:43.941 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 25762, 2022-01-24T07:13:43.942 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.004070216, 2022-01-24T07:13:43.942 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000157 2022-01-24T07:13:43.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.943 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:43.943 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:43.943 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:43.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.943 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:43.944 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:43.944 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:43.944 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4808, 2022-01-24T07:13:43.944 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 55.994012835, 2022-01-24T07:13:43.945 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011646009 2022-01-24T07:13:43.945 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.945 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:43.945 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:43.946 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:43.946 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 11731, 2022-01-24T07:13:43.946 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 3.473782182, 2022-01-24T07:13:43.946 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000296119 2022-01-24T07:13:43.947 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:43.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.947 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:43.947 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 65030, 2022-01-24T07:13:43.947 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 62916, 2022-01-24T07:13:43.948 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:43.948 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 62916, 2022-01-24T07:13:43.948 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1779.196236685, 2022-01-24T07:13:43.948 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.028278915 2022-01-24T07:13:43.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.949 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 2111, 2022-01-24T07:13:43.949 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:43.949 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 722, 2022-01-24T07:13:43.950 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 79, 2022-01-24T07:13:43.950 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:43.950 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 13, 2022-01-24T07:13:43.950 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 1, 2022-01-24T07:13:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 2, 2022-01-24T07:13:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 11, 2022-01-24T07:13:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 47395, 2022-01-24T07:13:43.951 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 0, 2022-01-24T07:13:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 4, 2022-01-24T07:13:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 100904, 2022-01-24T07:13:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 86426, 2022-01-24T07:13:43.952 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 1855, 2022-01-24T07:13:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 718, 2022-01-24T07:13:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:43.953 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 328, 2022-01-24T07:13:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 0, 2022-01-24T07:13:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 320, 2022-01-24T07:13:43.954 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 31148, 2022-01-24T07:13:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 395, 2022-01-24T07:13:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:43.955 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:43.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:43.957 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 10754, 2022-01-24T07:13:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 10754, 2022-01-24T07:13:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:43.958 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:43.959 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 322, 2022-01-24T07:13:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 80, 2022-01-24T07:13:43.960 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:43.961 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 97382, 2022-01-24T07:13:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 97382, 2022-01-24T07:13:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:43.962 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:43.963 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 118, 2022-01-24T07:13:43.963 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:43.963 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:43.963 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 118, 2022-01-24T07:13:43.964 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:43.964 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:43.964 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:43.964 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 231630380, 2022-01-24T07:13:43.964 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:43.965 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:43.965 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2743, 2022-01-24T07:13:43.965 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 280.034387594, 2022-01-24T07:13:43.965 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.102090553 2022-01-24T07:13:43.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.966 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:43.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.966 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:43.967 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 24, 2022-01-24T07:13:43.967 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 32615, 2022-01-24T07:13:43.967 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 32591, 2022-01-24T07:13:43.967 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 16, 2022-01-24T07:13:43.967 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 1696, 2022-01-24T07:13:43.968 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 1680, 2022-01-24T07:13:43.968 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 13, 2022-01-24T07:13:43.968 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 70025, 2022-01-24T07:13:43.968 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 70012, 2022-01-24T07:13:43.969 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 0, 2022-01-24T07:13:43.969 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 33048, 2022-01-24T07:13:43.969 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 33048, 2022-01-24T07:13:43.969 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 112320, 2022-01-24T07:13:43.970 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:43.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.970 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:43.970 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 84293, 2022-01-24T07:13:43.971 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 3219, 2022-01-24T07:13:43.971 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 65030, 2022-01-24T07:13:43.971 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 406, 2022-01-24T07:13:43.971 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 4946, 2022-01-24T07:13:43.972 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:43.972 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 18155, 2022-01-24T07:13:43.972 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 75.518984290, 2022-01-24T07:13:43.972 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004159679 2022-01-24T07:13:43.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.973 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:43.973 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 140, 2022-01-24T07:13:43.973 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.852683429, 2022-01-24T07:13:43.973 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.048947738 2022-01-24T07:13:43.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.974 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:43.974 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.974 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.975 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.975 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:43.975 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.975 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.976 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.976 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:43.976 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12335, 2022-01-24T07:13:43.977 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 458.448160536, 2022-01-24T07:13:43.977 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.037166449 2022-01-24T07:13:43.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.977 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:43.977 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.978 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.978 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.978 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:43.978 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.979 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.979 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.979 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:43.980 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.980 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.980 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.981 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:43.981 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.981 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.981 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.982 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:43.982 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.982 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.982 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.983 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:43.983 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.983 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.984 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.984 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:43.984 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 126, 2022-01-24T07:13:43.984 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.512129637, 2022-01-24T07:13:43.985 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.051683568 2022-01-24T07:13:43.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.985 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:43.985 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.986 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.986 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.986 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:43.986 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.987 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.987 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.987 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:43.988 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 5137, 2022-01-24T07:13:43.988 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 25.400985293, 2022-01-24T07:13:43.988 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004944711 2022-01-24T07:13:43.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.989 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:43.989 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 361, 2022-01-24T07:13:43.989 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.778396747, 2022-01-24T07:13:43.989 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002156223 2022-01-24T07:13:43.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.990 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:43.990 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 18173, 2022-01-24T07:13:43.990 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 509.615582022, 2022-01-24T07:13:43.990 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.028042457 2022-01-24T07:13:43.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.991 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:43.991 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.991 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.991 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.992 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:43.992 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 74, 2022-01-24T07:13:43.992 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 17.280198802, 2022-01-24T07:13:43.993 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.233516200 2022-01-24T07:13:43.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.993 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:43.993 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.993 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.994 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.994 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:43.994 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.995 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.995 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.995 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:43.997 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.997 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.998 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.998 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:43.998 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:43.999 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:43.999 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:43.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:43.999 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:44.000 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.000 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.000 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.000 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:44.001 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.001 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.001 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.002 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:44.002 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.002 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.002 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.003 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:44.003 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.003 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.003 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.004 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:44.004 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 8415, 2022-01-24T07:13:44.004 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 678.789115929, 2022-01-24T07:13:44.005 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.080664184 2022-01-24T07:13:44.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.005 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:44.005 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:44.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.006 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:44.006 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:44.006 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:44.006 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:44.007 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:44.007 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:44.007 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 10148, 2022-01-24T07:13:44.007 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 5074, 2022-01-24T07:13:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 3787 2022-01-24T07:13:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 240, 2022-01-24T07:13:44.008 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 240, 2022-01-24T07:13:44.009 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:44.009 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:44.009 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:44.009 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:44.010 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:44.010 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:44.010 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:44.010 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:44.011 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:44.011 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:44.011 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:44.011 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:44.011 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:44.012 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:44.012 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:44.012 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:44.012 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:44.013 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:44.013 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:44.013 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:44.013 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:44.013 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:44.014 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:44.014 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:44.014 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:44.014 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:44.015 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:44.015 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:44.015 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:44.015 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:44.015 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:44.016 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:44.016 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:44.016 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:44.016 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 213196, 2022-01-24T07:13:44.017 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 111, 2022-01-24T07:13:44.017 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2022-01-24T07:13:44.017 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2022-01-24T07:13:44.017 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:44.018 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:44.018 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:44.018 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:44.018 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:44.018 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:44.019 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:44.019 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:44.019 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:44.019 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:44.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:44.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:44.020 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 81953, 2022-01-24T07:13:44.020 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 409, 2022-01-24T07:13:44.020 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:44.021 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:44.021 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:44.021 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:44.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.022 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:44.022 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2022-01-24T07:13:44.022 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:44.022 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 15631, 2022-01-24T07:13:44.023 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 242751613, 2022-01-24T07:13:44.023 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 32, 2022-01-24T07:13:44.023 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 15631, 2022-01-24T07:13:44.023 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 15631, 2022-01-24T07:13:44.023 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 299, 2022-01-24T07:13:44.024 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 15332, 2022-01-24T07:13:44.024 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:44.024 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:44.024 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:44.025 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:44.025 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 299, 2022-01-24T07:13:44.025 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 3048, 2022-01-24T07:13:44.025 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 164, 2022-01-24T07:13:44.025 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:44.026 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:44.026 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:44.026 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 79, 2022-01-24T07:13:44.026 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 11196, 2022-01-24T07:13:44.027 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:44.027 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:44.027 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:44.027 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:44.027 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:44.028 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:44.028 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:44.028 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:44.028 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:44.029 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:44.029 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:44.029 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:44.029 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:44.030 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:44.030 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:44.030 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:44.030 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:44.030 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:44.031 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:44.031 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:44.031 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:44.031 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:44.032 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:44.032 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:44.032 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:44.032 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:44.032 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:44.033 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:44.033 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:44.033 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:44.033 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:44.034 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:44.034 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:44.034 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:44.034 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:44.034 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:44.035 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:44.035 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:44.035 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1645, 2022-01-24T07:13:44.035 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:44.036 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 179 2022-01-24T07:13:44.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.036 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:44.036 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:44.036 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:44.037 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:44.037 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:44.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.037 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:44.038 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:44.038 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:44.038 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2022-01-24T07:13:44.038 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:44.039 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 10754, 2022-01-24T07:13:44.039 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:44.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.039 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:44.039 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.040 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:44.040 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.040 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 185500, 2022-01-24T07:13:44.040 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 59532116, 2022-01-24T07:13:44.041 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.041 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 185500, 2022-01-24T07:13:44.041 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:44.041 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:44.042 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 185500, 2022-01-24T07:13:44.042 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 59532116, 2022-01-24T07:13:44.042 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.042 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.043 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.043 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.044 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:44.044 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.044 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:44.044 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.044 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:44.045 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:44.045 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.045 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.045 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15631, 2022-01-24T07:13:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 243838143, 2022-01-24T07:13:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 4356, 2022-01-24T07:13:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 243838143, 2022-01-24T07:13:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.048 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:44.048 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.048 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:44.048 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:44.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:44.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.049 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 15631, 2022-01-24T07:13:44.050 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 15631, 2022-01-24T07:13:44.050 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 15631, 2022-01-24T07:13:44.050 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 15631, 2022-01-24T07:13:44.050 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.050 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.051 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.051 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.051 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.052 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:44.052 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.052 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:44.052 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.052 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 10754, 2022-01-24T07:13:44.053 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1086530, 2022-01-24T07:13:44.053 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.053 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 10754, 2022-01-24T07:13:44.053 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:44.054 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:44.054 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 305, 2022-01-24T07:13:44.054 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1086530, 2022-01-24T07:13:44.054 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.055 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.055 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.055 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.055 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.056 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x55adca2bbae0": { 2022-01-24T07:13:44.056 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.056 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:44.056 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.057 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 97382, 2022-01-24T07:13:44.057 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 227436076, 2022-01-24T07:13:44.057 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.057 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 97382, 2022-01-24T07:13:44.057 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:44.058 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:44.058 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2743, 2022-01-24T07:13:44.058 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 227436076, 2022-01-24T07:13:44.058 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.059 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.059 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.059 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.060 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:44.062 INFO:tasks.check_counter:Daemon mds.c mds.exported=320 2022-01-24T07:13:44.062 INFO:tasks.check_counter:Daemon mds.c mds.imported=395 2022-01-24T07:13:44.062 DEBUG:tasks.check_counter:Getting stats from d 2022-01-24T07:13:44.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok perf dump 2022-01-24T07:13:44.186 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2022-01-24T07:13:44.187 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:44.187 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 31867, 2022-01-24T07:13:44.187 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 39093, 2022-01-24T07:13:44.187 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 12403693, 2022-01-24T07:13:44.188 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 43824757, 2022-01-24T07:13:44.188 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:44.188 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:44.188 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.583782613, 2022-01-24T07:13:44.189 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.687136764, 2022-01-24T07:13:44.189 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 1.419189021, 2022-01-24T07:13:44.189 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.094905986, 2022-01-24T07:13:44.189 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.189 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 39094, 2022-01-24T07:13:44.190 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 20.035648354, 2022-01-24T07:13:44.190 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000512499 2022-01-24T07:13:44.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.190 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.191 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 32760, 2022-01-24T07:13:44.191 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.008914173, 2022-01-24T07:13:44.191 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000272 2022-01-24T07:13:44.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.192 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:44.192 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 22902, 2022-01-24T07:13:44.192 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 23629, 2022-01-24T07:13:44.193 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 10937323, 2022-01-24T07:13:44.193 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 104595288, 2022-01-24T07:13:44.193 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:44.193 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 7, 2022-01-24T07:13:44.194 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 1.913527478, 2022-01-24T07:13:44.194 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.721710995, 2022-01-24T07:13:44.194 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.732671517, 2022-01-24T07:13:44.194 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.544492483, 2022-01-24T07:13:44.194 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.195 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 23630, 2022-01-24T07:13:44.195 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.385706576, 2022-01-24T07:13:44.195 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000270237 2022-01-24T07:13:44.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.196 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.196 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 23846, 2022-01-24T07:13:44.196 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.003987377, 2022-01-24T07:13:44.196 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000167 2022-01-24T07:13:44.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.197 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:44.197 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 87739, 2022-01-24T07:13:44.198 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 141082, 2022-01-24T07:13:44.198 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 30570806, 2022-01-24T07:13:44.198 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 94753693, 2022-01-24T07:13:44.198 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:44.198 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 10, 2022-01-24T07:13:44.199 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 4.333381855, 2022-01-24T07:13:44.199 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 1.926161260, 2022-01-24T07:13:44.199 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 23.706538160, 2022-01-24T07:13:44.199 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.286610150, 2022-01-24T07:13:44.200 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.200 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 141077, 2022-01-24T07:13:44.200 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 99.038598581, 2022-01-24T07:13:44.200 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000702018 2022-01-24T07:13:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 91968, 2022-01-24T07:13:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.042915748, 2022-01-24T07:13:44.201 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000466 2022-01-24T07:13:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2022-01-24T07:13:44.202 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2022-01-24T07:13:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2022-01-24T07:13:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2022-01-24T07:13:44.203 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4095, 2022-01-24T07:13:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 37.524949203, 2022-01-24T07:13:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.009163601 2022-01-24T07:13:44.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2022-01-24T07:13:44.205 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2022-01-24T07:13:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 14535, 2022-01-24T07:13:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2.157537582, 2022-01-24T07:13:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000148437 2022-01-24T07:13:44.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2022-01-24T07:13:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 48099, 2022-01-24T07:13:44.207 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 47827, 2022-01-24T07:13:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2022-01-24T07:13:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 47827, 2022-01-24T07:13:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1149.465106991, 2022-01-24T07:13:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.024033811 2022-01-24T07:13:44.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 272, 2022-01-24T07:13:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch": 0, 2022-01-24T07:13:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 497, 2022-01-24T07:13:44.209 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 54, 2022-01-24T07:13:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2022-01-24T07:13:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 14, 2022-01-24T07:13:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 2, 2022-01-24T07:13:44.210 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 2, 2022-01-24T07:13:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 10, 2022-01-24T07:13:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 11073, 2022-01-24T07:13:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 1, 2022-01-24T07:13:44.211 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 1, 2022-01-24T07:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 4, 2022-01-24T07:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 74032, 2022-01-24T07:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 67475, 2022-01-24T07:13:44.212 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 246, 2022-01-24T07:13:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 356, 2022-01-24T07:13:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 213, 2022-01-24T07:13:44.213 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 0, 2022-01-24T07:13:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2022-01-24T07:13:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 172, 2022-01-24T07:13:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 1341, 2022-01-24T07:13:44.214 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 126, 2022-01-24T07:13:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2022-01-24T07:13:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:44.215 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 14562, 2022-01-24T07:13:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 0 2022-01-24T07:13:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.216 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2022-01-24T07:13:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2022-01-24T07:13:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 14766, 2022-01-24T07:13:44.217 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 14766, 2022-01-24T07:13:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2022-01-24T07:13:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:44.218 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2022-01-24T07:13:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2022-01-24T07:13:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:44.219 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 175, 2022-01-24T07:13:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2022-01-24T07:13:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 54, 2022-01-24T07:13:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:44.220 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2022-01-24T07:13:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2022-01-24T07:13:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 79906, 2022-01-24T07:13:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2022-01-24T07:13:44.221 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2022-01-24T07:13:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 79906, 2022-01-24T07:13:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2022-01-24T07:13:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2022-01-24T07:13:44.222 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 96, 2022-01-24T07:13:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2022-01-24T07:13:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2022-01-24T07:13:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 96, 2022-01-24T07:13:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2022-01-24T07:13:44.223 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2022-01-24T07:13:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2022-01-24T07:13:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 162795263, 2022-01-24T07:13:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2022-01-24T07:13:44.224 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2022-01-24T07:13:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 1847, 2022-01-24T07:13:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 88.518603492, 2022-01-24T07:13:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.047925610 2022-01-24T07:13:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.225 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2022-01-24T07:13:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2022-01-24T07:13:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 24, 2022-01-24T07:13:44.226 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 15854, 2022-01-24T07:13:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 15830, 2022-01-24T07:13:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 17, 2022-01-24T07:13:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 818, 2022-01-24T07:13:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 801, 2022-01-24T07:13:44.227 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 13, 2022-01-24T07:13:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 43420, 2022-01-24T07:13:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 43407, 2022-01-24T07:13:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 1, 2022-01-24T07:13:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 19846, 2022-01-24T07:13:44.228 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 19845, 2022-01-24T07:13:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 94516, 2022-01-24T07:13:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 315596 2022-01-24T07:13:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2022-01-24T07:13:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 58711, 2022-01-24T07:13:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 2757, 2022-01-24T07:13:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 48099, 2022-01-24T07:13:44.230 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 219, 2022-01-24T07:13:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_slave_request": 4129, 2022-01-24T07:13:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2022-01-24T07:13:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9490, 2022-01-24T07:13:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 31.721967895, 2022-01-24T07:13:44.231 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003342673 2022-01-24T07:13:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2022-01-24T07:13:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 48, 2022-01-24T07:13:44.232 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 4.788594462, 2022-01-24T07:13:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.099762384 2022-01-24T07:13:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2022-01-24T07:13:44.234 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2022-01-24T07:13:44.235 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12566, 2022-01-24T07:13:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 146.997855907, 2022-01-24T07:13:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.011698062 2022-01-24T07:13:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.236 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.237 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2022-01-24T07:13:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2022-01-24T07:13:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.240 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.241 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2022-01-24T07:13:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.242 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2022-01-24T07:13:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 53, 2022-01-24T07:13:44.243 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1.970629514, 2022-01-24T07:13:44.244 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.037181688 2022-01-24T07:13:44.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.244 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2022-01-24T07:13:44.244 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2022-01-24T07:13:44.245 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.246 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2022-01-24T07:13:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2835, 2022-01-24T07:13:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 7.079188906, 2022-01-24T07:13:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002497068 2022-01-24T07:13:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.247 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2022-01-24T07:13:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 578, 2022-01-24T07:13:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.890346699, 2022-01-24T07:13:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.001540392 2022-01-24T07:13:44.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2022-01-24T07:13:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 9453, 2022-01-24T07:13:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 317.750082767, 2022-01-24T07:13:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.033613676 2022-01-24T07:13:44.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.250 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2022-01-24T07:13:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 72, 2022-01-24T07:13:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 16.286822734, 2022-01-24T07:13:44.251 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.226205871 2022-01-24T07:13:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.252 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.253 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2022-01-24T07:13:44.254 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:44.255 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.256 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2022-01-24T07:13:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2022-01-24T07:13:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.259 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2022-01-24T07:13:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.260 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2022-01-24T07:13:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 12732, 2022-01-24T07:13:44.261 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 621.979618107, 2022-01-24T07:13:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.048851682 2022-01-24T07:13:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:44.262 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2022-01-24T07:13:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2022-01-24T07:13:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 2, 2022-01-24T07:13:44.263 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 0, 2022-01-24T07:13:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2022-01-24T07:13:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2022-01-24T07:13:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 13678, 2022-01-24T07:13:44.264 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 6839, 2022-01-24T07:13:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 747 2022-01-24T07:13:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2022-01-24T07:13:44.265 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:44.266 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:44.267 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:44.268 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:44.269 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:44.270 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:44.271 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:44.272 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2022-01-24T07:13:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:44.273 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 354367, 2022-01-24T07:13:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 126, 2022-01-24T07:13:44.274 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 1496, 2022-01-24T07:13:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 17, 2022-01-24T07:13:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2022-01-24T07:13:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2022-01-24T07:13:44.275 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:44.276 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 78, 2022-01-24T07:13:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:44.277 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2022-01-24T07:13:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 82433, 2022-01-24T07:13:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 413, 2022-01-24T07:13:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:44.278 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2022-01-24T07:13:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2022-01-24T07:13:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2022-01-24T07:13:44.279 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 1, 2022-01-24T07:13:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2022-01-24T07:13:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 17156, 2022-01-24T07:13:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 169403314, 2022-01-24T07:13:44.280 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 27, 2022-01-24T07:13:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 17155, 2022-01-24T07:13:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 17156, 2022-01-24T07:13:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 362, 2022-01-24T07:13:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 16794, 2022-01-24T07:13:44.281 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2022-01-24T07:13:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2022-01-24T07:13:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 0, 2022-01-24T07:13:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 10, 2022-01-24T07:13:44.282 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 362, 2022-01-24T07:13:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 2209, 2022-01-24T07:13:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 174, 2022-01-24T07:13:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2022-01-24T07:13:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2022-01-24T07:13:44.283 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2022-01-24T07:13:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 54, 2022-01-24T07:13:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 13744, 2022-01-24T07:13:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2022-01-24T07:13:44.284 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:44.285 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2022-01-24T07:13:44.286 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2022-01-24T07:13:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2022-01-24T07:13:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2022-01-24T07:13:44.287 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2022-01-24T07:13:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2022-01-24T07:13:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2022-01-24T07:13:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2022-01-24T07:13:44.288 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2022-01-24T07:13:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2022-01-24T07:13:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2022-01-24T07:13:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2022-01-24T07:13:44.289 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2022-01-24T07:13:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2022-01-24T07:13:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2022-01-24T07:13:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2022-01-24T07:13:44.290 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2022-01-24T07:13:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2022-01-24T07:13:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2022-01-24T07:13:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2022-01-24T07:13:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2022-01-24T07:13:44.291 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 0, 2022-01-24T07:13:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2022-01-24T07:13:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 0, 2022-01-24T07:13:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 6, 2022-01-24T07:13:44.292 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 6, 2022-01-24T07:13:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2022-01-24T07:13:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2022-01-24T07:13:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 1186, 2022-01-24T07:13:44.293 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 0, 2022-01-24T07:13:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 144 2022-01-24T07:13:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2022-01-24T07:13:44.294 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2022-01-24T07:13:44.295 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:44.295 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2022-01-24T07:13:44.295 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2022-01-24T07:13:44.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.295 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2022-01-24T07:13:44.296 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 1, 2022-01-24T07:13:44.296 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:44.296 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 1, 2022-01-24T07:13:44.296 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:44.297 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 13358, 2022-01-24T07:13:44.297 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 1408 2022-01-24T07:13:44.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.297 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:44.298 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.298 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:44.298 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.298 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 142504, 2022-01-24T07:13:44.298 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 42643828, 2022-01-24T07:13:44.299 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.299 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 142504, 2022-01-24T07:13:44.299 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:44.299 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:44.300 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 142504, 2022-01-24T07:13:44.300 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 42643828, 2022-01-24T07:13:44.300 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.300 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.301 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.301 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.302 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:44.302 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.302 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2022-01-24T07:13:44.302 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.302 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:44.303 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:44.303 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.303 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.303 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 17156, 2022-01-24T07:13:44.304 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 170895088, 2022-01-24T07:13:44.304 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 3358, 2022-01-24T07:13:44.304 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 170895088, 2022-01-24T07:13:44.304 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.305 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.305 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.305 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 1, 2022-01-24T07:13:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2022-01-24T07:13:44.306 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.307 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2022-01-24T07:13:44.307 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2022-01-24T07:13:44.307 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.307 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.308 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 17156, 2022-01-24T07:13:44.308 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 17156, 2022-01-24T07:13:44.308 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 17155, 2022-01-24T07:13:44.308 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 17155, 2022-01-24T07:13:44.308 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.309 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.309 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.309 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.310 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:44.310 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.310 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:44.311 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.311 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 14766, 2022-01-24T07:13:44.311 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1491774, 2022-01-24T07:13:44.311 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 14766, 2022-01-24T07:13:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 362, 2022-01-24T07:13:44.312 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1491774, 2022-01-24T07:13:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.313 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2022-01-24T07:13:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x55e7b2f1dae0": { 2022-01-24T07:13:44.314 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2022-01-24T07:13:44.315 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2022-01-24T07:13:44.315 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2022-01-24T07:13:44.315 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 79906, 2022-01-24T07:13:44.315 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 158600959, 2022-01-24T07:13:44.315 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.316 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 79906, 2022-01-24T07:13:44.316 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2022-01-24T07:13:44.316 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2022-01-24T07:13:44.316 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 1847, 2022-01-24T07:13:44.317 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 158600959, 2022-01-24T07:13:44.317 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2022-01-24T07:13:44.317 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2022-01-24T07:13:44.317 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.317 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.318 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.318 INFO:teuthology.orchestra.run.smithi142.stdout: } 2022-01-24T07:13:44.318 INFO:teuthology.orchestra.run.smithi142.stdout:} 2022-01-24T07:13:44.320 INFO:tasks.check_counter:Daemon mds.d mds.exported=172 2022-01-24T07:13:44.320 INFO:tasks.check_counter:Daemon mds.d mds.imported=126 2022-01-24T07:13:44.320 DEBUG:tasks.check_counter:Getting stats from e 2022-01-24T07:13:44.321 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok perf dump 2022-01-24T07:13:44.445 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:44.446 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:44.446 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 27867, 2022-01-24T07:13:44.446 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 52105, 2022-01-24T07:13:44.447 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 17363483, 2022-01-24T07:13:44.447 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 55172503, 2022-01-24T07:13:44.447 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:44.447 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:44.447 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.197713205, 2022-01-24T07:13:44.448 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.832746730, 2022-01-24T07:13:44.448 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.000586907, 2022-01-24T07:13:44.448 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.635672343, 2022-01-24T07:13:44.448 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.449 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 52107, 2022-01-24T07:13:44.449 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 21.540599915, 2022-01-24T07:13:44.449 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000413391 2022-01-24T07:13:44.449 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.450 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.450 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 30393, 2022-01-24T07:13:44.450 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.008986400, 2022-01-24T07:13:44.450 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000295 2022-01-24T07:13:44.450 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.451 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.451 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:44.451 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 19017, 2022-01-24T07:13:44.451 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 25096, 2022-01-24T07:13:44.452 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 15681228, 2022-01-24T07:13:44.452 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 92532584, 2022-01-24T07:13:44.452 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 8, 2022-01-24T07:13:44.452 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:44.452 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.588980196, 2022-01-24T07:13:44.453 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.679724107, 2022-01-24T07:13:44.453 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.687022758, 2022-01-24T07:13:44.453 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.324506348, 2022-01-24T07:13:44.453 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.454 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25099, 2022-01-24T07:13:44.454 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 9.821757286, 2022-01-24T07:13:44.454 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000391320 2022-01-24T07:13:44.454 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.454 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.455 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25740, 2022-01-24T07:13:44.455 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.005782527, 2022-01-24T07:13:44.455 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000224 2022-01-24T07:13:44.455 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.456 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.456 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:44.456 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 140942, 2022-01-24T07:13:44.456 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 237223, 2022-01-24T07:13:44.456 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 47947406, 2022-01-24T07:13:44.457 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 204189135, 2022-01-24T07:13:44.457 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 14, 2022-01-24T07:13:44.457 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 10, 2022-01-24T07:13:44.457 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 6.939747783, 2022-01-24T07:13:44.457 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 3.227177327, 2022-01-24T07:13:44.458 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 6.410205483, 2022-01-24T07:13:44.458 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.433802729, 2022-01-24T07:13:44.458 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.458 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 237215, 2022-01-24T07:13:44.459 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 152.592621488, 2022-01-24T07:13:44.459 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000643267 2022-01-24T07:13:44.459 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.459 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.460 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 150412, 2022-01-24T07:13:44.460 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.051403996, 2022-01-24T07:13:44.460 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000341 2022-01-24T07:13:44.460 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.460 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.461 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:44.461 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:44.461 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:44.461 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.462 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:44.462 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:44.462 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:44.462 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 5073, 2022-01-24T07:13:44.462 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 52.458534529, 2022-01-24T07:13:44.463 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.010340732 2022-01-24T07:13:44.463 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.463 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.463 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:44.464 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:44.464 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:44.464 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 22745, 2022-01-24T07:13:44.464 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.484301440, 2022-01-24T07:13:44.465 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000153189 2022-01-24T07:13:44.465 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.465 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.465 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:44.465 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 73157, 2022-01-24T07:13:44.466 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 72367, 2022-01-24T07:13:44.466 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:44.466 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 72367, 2022-01-24T07:13:44.466 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1713.912673316, 2022-01-24T07:13:44.467 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.023683622 2022-01-24T07:13:44.467 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.467 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 790, 2022-01-24T07:13:44.467 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 1, 2022-01-24T07:13:44.467 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 714, 2022-01-24T07:13:44.468 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 78, 2022-01-24T07:13:44.468 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2022-01-24T07:13:44.468 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 17, 2022-01-24T07:13:44.468 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 2, 2022-01-24T07:13:44.468 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 5, 2022-01-24T07:13:44.469 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:44.469 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 14, 2022-01-24T07:13:44.469 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 29292, 2022-01-24T07:13:44.469 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 3, 2022-01-24T07:13:44.470 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 4, 2022-01-24T07:13:44.470 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 3, 2022-01-24T07:13:44.470 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 109963, 2022-01-24T07:13:44.470 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 98403, 2022-01-24T07:13:44.470 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 550, 2022-01-24T07:13:44.471 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 310, 2022-01-24T07:13:44.471 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:44.471 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:44.471 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 179, 2022-01-24T07:13:44.472 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 2, 2022-01-24T07:13:44.472 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2022-01-24T07:13:44.472 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 394, 2022-01-24T07:13:44.472 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 15687, 2022-01-24T07:13:44.473 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 307, 2022-01-24T07:13:44.473 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:44.473 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:44.473 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:44.473 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:44.474 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:44.474 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:44.474 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:44.474 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.475 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:44.475 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 1, 2022-01-24T07:13:44.475 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:44.475 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:44.476 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 21503, 2022-01-24T07:13:44.476 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 21502, 2022-01-24T07:13:44.476 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:44.476 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:44.476 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:44.477 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:44.477 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:44.477 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:44.477 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:44.478 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:44.478 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 394, 2022-01-24T07:13:44.478 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:44.478 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 78, 2022-01-24T07:13:44.478 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:44.479 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:44.479 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.479 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:44.479 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 98088, 2022-01-24T07:13:44.480 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2022-01-24T07:13:44.480 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2022-01-24T07:13:44.480 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 98088, 2022-01-24T07:13:44.480 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:44.481 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2022-01-24T07:13:44.481 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 119, 2022-01-24T07:13:44.481 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2022-01-24T07:13:44.481 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2022-01-24T07:13:44.481 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 119, 2022-01-24T07:13:44.482 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:44.482 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2022-01-24T07:13:44.482 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2022-01-24T07:13:44.482 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 213899715, 2022-01-24T07:13:44.483 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:44.483 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:44.483 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2596, 2022-01-24T07:13:44.483 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 314.444824002, 2022-01-24T07:13:44.483 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.121126665 2022-01-24T07:13:44.484 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.484 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:44.484 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.484 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:44.485 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 27, 2022-01-24T07:13:44.485 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 32051, 2022-01-24T07:13:44.485 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 32024, 2022-01-24T07:13:44.485 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 17, 2022-01-24T07:13:44.485 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 1624, 2022-01-24T07:13:44.486 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1607, 2022-01-24T07:13:44.486 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 18, 2022-01-24T07:13:44.486 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 76473, 2022-01-24T07:13:44.486 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 76455, 2022-01-24T07:13:44.487 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 3, 2022-01-24T07:13:44.487 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 35310, 2022-01-24T07:13:44.487 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 35307, 2022-01-24T07:13:44.487 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 101892, 2022-01-24T07:13:44.487 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:44.488 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.488 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:44.488 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 87352, 2022-01-24T07:13:44.488 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 983, 2022-01-24T07:13:44.489 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 73157, 2022-01-24T07:13:44.489 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 233, 2022-01-24T07:13:44.489 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 2280, 2022-01-24T07:13:44.489 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:44.489 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 13043, 2022-01-24T07:13:44.490 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 44.406837227, 2022-01-24T07:13:44.490 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003404649 2022-01-24T07:13:44.490 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.490 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:44.491 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 559, 2022-01-24T07:13:44.491 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 10.191921546, 2022-01-24T07:13:44.491 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.018232417 2022-01-24T07:13:44.491 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.492 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:44.492 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.492 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.492 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.492 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.493 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:44.493 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.493 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.493 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.494 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.494 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:44.494 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 21239, 2022-01-24T07:13:44.494 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 176.651440933, 2022-01-24T07:13:44.495 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.008317314 2022-01-24T07:13:44.495 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.495 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:44.496 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.496 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.496 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.496 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.497 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:44.497 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.497 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.497 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.498 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.498 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:44.498 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.498 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.499 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.499 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.499 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:44.499 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.499 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.500 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.500 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.500 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:44.500 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.501 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.501 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.501 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.501 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:44.501 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.502 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.502 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.502 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.502 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:44.503 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 94, 2022-01-24T07:13:44.503 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.403561201, 2022-01-24T07:13:44.503 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.014931502 2022-01-24T07:13:44.503 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.503 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:44.504 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.504 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.504 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.504 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.505 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:44.505 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.505 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.505 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.505 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.506 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:44.506 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3882, 2022-01-24T07:13:44.506 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 13.919676352, 2022-01-24T07:13:44.506 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003585697 2022-01-24T07:13:44.507 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.507 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:44.507 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 961, 2022-01-24T07:13:44.507 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.682701365, 2022-01-24T07:13:44.508 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002791572 2022-01-24T07:13:44.508 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.508 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:44.508 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 12306, 2022-01-24T07:13:44.508 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 247.087846538, 2022-01-24T07:13:44.509 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.020078648 2022-01-24T07:13:44.509 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.509 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:44.509 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.509 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.510 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.510 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.510 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:44.510 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 138, 2022-01-24T07:13:44.511 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 33.303956663, 2022-01-24T07:13:44.511 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.241333019 2022-01-24T07:13:44.511 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.511 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:44.512 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.512 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.512 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.512 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.513 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:44.513 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.513 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.513 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.513 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.514 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:44.514 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11, 2022-01-24T07:13:44.514 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.057888314, 2022-01-24T07:13:44.514 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.005262574 2022-01-24T07:13:44.514 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.515 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:44.515 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.515 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.515 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.516 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.516 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:44.516 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.516 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.516 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.517 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.517 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:44.517 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.517 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.518 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.518 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.518 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:44.518 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.518 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.519 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.519 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.519 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:44.519 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6, 2022-01-24T07:13:44.520 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.004500055, 2022-01-24T07:13:44.520 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000750009 2022-01-24T07:13:44.520 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.520 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:44.520 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20128, 2022-01-24T07:13:44.521 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1184.202343122, 2022-01-24T07:13:44.521 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.058833582 2022-01-24T07:13:44.521 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.521 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:44.522 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:44.522 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.522 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:44.522 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:44.523 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:44.523 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:44.523 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:44.523 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:44.523 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 3378, 2022-01-24T07:13:44.524 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 1689, 2022-01-24T07:13:44.524 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 745 2022-01-24T07:13:44.524 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.524 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:44.524 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:44.525 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:44.525 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:44.525 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:44.525 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:44.526 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:44.527 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:44.527 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:44.527 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:44.527 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:44.527 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:44.528 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:44.528 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:44.528 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:44.528 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:44.529 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:44.529 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:44.529 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:44.529 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:44.529 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:44.530 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:44.530 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:44.530 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:44.530 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:44.531 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:44.531 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:44.531 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:44.531 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:44.532 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:44.532 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:44.532 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:44.532 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:44.532 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 187482, 2022-01-24T07:13:44.533 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 120, 2022-01-24T07:13:44.533 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2022-01-24T07:13:44.533 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2022-01-24T07:13:44.533 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:44.533 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:44.534 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:44.534 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:44.534 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:44.534 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:44.535 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:44.535 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:44.535 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:44.535 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:44.535 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:44.536 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:44.536 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 91138, 2022-01-24T07:13:44.536 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 645, 2022-01-24T07:13:44.536 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:44.536 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:44.537 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:44.537 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:44.537 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.537 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:44.537 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:44.538 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:44.538 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 26787, 2022-01-24T07:13:44.538 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 225487531, 2022-01-24T07:13:44.538 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 32, 2022-01-24T07:13:44.539 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 26787, 2022-01-24T07:13:44.539 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 26787, 2022-01-24T07:13:44.539 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 419, 2022-01-24T07:13:44.539 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 26368, 2022-01-24T07:13:44.540 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:44.540 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:44.540 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 0, 2022-01-24T07:13:44.540 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 11, 2022-01-24T07:13:44.540 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 418, 2022-01-24T07:13:44.541 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 3014, 2022-01-24T07:13:44.541 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 178, 2022-01-24T07:13:44.541 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:44.541 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:44.541 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:44.542 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 78, 2022-01-24T07:13:44.542 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 22235, 2022-01-24T07:13:44.542 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:44.542 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:44.543 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:44.543 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:44.543 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 22, 2022-01-24T07:13:44.543 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:44.543 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:44.544 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:44.544 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:44.544 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:44.544 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:44.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:44.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:44.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:44.545 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 10, 2022-01-24T07:13:44.545 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:44.546 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:44.546 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:44.546 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:44.546 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:44.547 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:44.547 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:44.547 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:44.547 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:44.547 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:44.548 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:44.548 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:44.548 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:44.548 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:44.549 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:44.549 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:44.549 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 24, 2022-01-24T07:13:44.549 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:44.549 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 2, 2022-01-24T07:13:44.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:44.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:44.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:44.550 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:44.551 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 1660, 2022-01-24T07:13:44.551 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2022-01-24T07:13:44.551 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 182 2022-01-24T07:13:44.551 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.551 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:44.552 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:44.552 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:44.552 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:44.552 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:44.553 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.553 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:44.553 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:44.553 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:44.553 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:44.554 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:44.554 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 21502, 2022-01-24T07:13:44.554 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:44.554 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.555 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:44.555 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.555 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:44.555 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.555 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 187822, 2022-01-24T07:13:44.556 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 66225558, 2022-01-24T07:13:44.556 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.556 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 187822, 2022-01-24T07:13:44.556 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:44.556 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:44.557 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 187822, 2022-01-24T07:13:44.557 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 66225558, 2022-01-24T07:13:44.557 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.557 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.558 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.558 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.558 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.558 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.558 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:44.559 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.559 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:44.559 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.559 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:44.560 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:44.560 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.560 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.560 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 26787, 2022-01-24T07:13:44.560 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 227659889, 2022-01-24T07:13:44.561 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4463, 2022-01-24T07:13:44.561 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 227659889, 2022-01-24T07:13:44.561 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.561 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.562 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.562 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.562 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.562 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.562 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:44.563 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.563 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:44.563 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.563 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:44.564 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:44.564 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.564 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.564 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 26787, 2022-01-24T07:13:44.564 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 26787, 2022-01-24T07:13:44.565 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 26787, 2022-01-24T07:13:44.565 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 26787, 2022-01-24T07:13:44.565 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.565 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.565 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.566 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.566 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.566 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.566 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:44.566 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.567 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:44.567 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.567 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 21502, 2022-01-24T07:13:44.567 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 2172374, 2022-01-24T07:13:44.568 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.568 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 21502, 2022-01-24T07:13:44.568 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:44.568 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:44.569 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 418, 2022-01-24T07:13:44.569 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 2172374, 2022-01-24T07:13:44.569 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.569 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.569 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.570 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.570 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.570 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.570 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x56551f9a9ae0": { 2022-01-24T07:13:44.570 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 1198, 2022-01-24T07:13:44.571 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:44.571 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.571 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 98088, 2022-01-24T07:13:44.571 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 209705411, 2022-01-24T07:13:44.572 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.572 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 98088, 2022-01-24T07:13:44.572 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:44.572 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:44.572 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2596, 2022-01-24T07:13:44.573 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 209704213, 2022-01-24T07:13:44.573 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.573 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.573 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.573 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.574 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.574 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.574 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:44.576 INFO:tasks.check_counter:Daemon mds.e mds.exported=394 2022-01-24T07:13:44.576 INFO:tasks.check_counter:Daemon mds.e mds.imported=307 2022-01-24T07:13:44.576 DEBUG:tasks.check_counter:Getting stats from f 2022-01-24T07:13:44.577 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok perf dump 2022-01-24T07:13:44.701 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:44.701 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:44.702 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 17362, 2022-01-24T07:13:44.702 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 21390, 2022-01-24T07:13:44.702 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 14237319, 2022-01-24T07:13:44.703 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 52441157, 2022-01-24T07:13:44.703 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 13, 2022-01-24T07:13:44.703 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 2, 2022-01-24T07:13:44.703 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.289312569, 2022-01-24T07:13:44.704 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.535807199, 2022-01-24T07:13:44.704 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.762314309, 2022-01-24T07:13:44.704 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.226379246, 2022-01-24T07:13:44.704 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.705 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 21389, 2022-01-24T07:13:44.705 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 9.389067250, 2022-01-24T07:13:44.705 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000438967 2022-01-24T07:13:44.705 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.705 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.706 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25596, 2022-01-24T07:13:44.706 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.004853034, 2022-01-24T07:13:44.706 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000189 2022-01-24T07:13:44.706 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.707 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.707 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:44.707 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 239000, 2022-01-24T07:13:44.707 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 422080, 2022-01-24T07:13:44.707 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 74298156, 2022-01-24T07:13:44.708 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 297946735, 2022-01-24T07:13:44.708 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:44.708 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2022-01-24T07:13:44.708 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 11.199687582, 2022-01-24T07:13:44.709 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 5.484041404, 2022-01-24T07:13:44.709 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 9.063354051, 2022-01-24T07:13:44.709 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.647777022, 2022-01-24T07:13:44.709 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.709 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 422078, 2022-01-24T07:13:44.710 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 173.924005973, 2022-01-24T07:13:44.710 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000412066 2022-01-24T07:13:44.710 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.710 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.711 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 314359, 2022-01-24T07:13:44.711 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.089938170, 2022-01-24T07:13:44.711 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000286 2022-01-24T07:13:44.711 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.712 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.712 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:44.712 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 34656, 2022-01-24T07:13:44.712 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 33547, 2022-01-24T07:13:44.713 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 17833376, 2022-01-24T07:13:44.713 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 249461923, 2022-01-24T07:13:44.713 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:44.713 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:44.713 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.998890566, 2022-01-24T07:13:44.714 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 1.264023639, 2022-01-24T07:13:44.714 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.021893848, 2022-01-24T07:13:44.714 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.883225500, 2022-01-24T07:13:44.714 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.715 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 33544, 2022-01-24T07:13:44.715 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 9.664999160, 2022-01-24T07:13:44.715 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000288128 2022-01-24T07:13:44.715 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.715 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.716 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 32038, 2022-01-24T07:13:44.716 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.005214321, 2022-01-24T07:13:44.716 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000162 2022-01-24T07:13:44.716 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.717 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.717 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:44.717 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:44.717 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:44.717 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.718 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:44.718 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:44.718 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:44.718 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6396, 2022-01-24T07:13:44.719 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 88.901150740, 2022-01-24T07:13:44.719 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.013899491 2022-01-24T07:13:44.719 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.719 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.720 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:44.720 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:44.720 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:44.720 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 25633, 2022-01-24T07:13:44.720 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.212572929, 2022-01-24T07:13:44.721 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000164341 2022-01-24T07:13:44.721 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.721 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.721 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:44.722 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 132050, 2022-01-24T07:13:44.722 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 127309, 2022-01-24T07:13:44.722 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:44.722 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 127309, 2022-01-24T07:13:44.722 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2998.641493067, 2022-01-24T07:13:44.723 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.023554041 2022-01-24T07:13:44.723 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.723 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 4740, 2022-01-24T07:13:44.723 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 1, 2022-01-24T07:13:44.724 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 1163, 2022-01-24T07:13:44.724 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 127, 2022-01-24T07:13:44.724 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 1, 2022-01-24T07:13:44.724 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 18, 2022-01-24T07:13:44.725 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 0, 2022-01-24T07:13:44.725 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 2, 2022-01-24T07:13:44.725 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 16, 2022-01-24T07:13:44.725 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 16, 2022-01-24T07:13:44.725 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 58302, 2022-01-24T07:13:44.726 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 6, 2022-01-24T07:13:44.726 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 6, 2022-01-24T07:13:44.726 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 3, 2022-01-24T07:13:44.726 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 201991, 2022-01-24T07:13:44.727 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 180265, 2022-01-24T07:13:44.727 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 4476, 2022-01-24T07:13:44.727 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 609, 2022-01-24T07:13:44.727 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 1, 2022-01-24T07:13:44.728 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:44.728 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 439, 2022-01-24T07:13:44.728 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 2000, 2022-01-24T07:13:44.728 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 2, 2022-01-24T07:13:44.729 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 340, 2022-01-24T07:13:44.729 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 33031, 2022-01-24T07:13:44.729 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 396, 2022-01-24T07:13:44.729 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:44.730 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:44.730 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:44.730 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:44.730 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:44.730 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:44.731 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:44.731 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.731 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:44.731 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 6, 2022-01-24T07:13:44.732 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:44.732 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:44.732 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 24131, 2022-01-24T07:13:44.732 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 24125, 2022-01-24T07:13:44.732 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:44.733 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:44.733 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:44.733 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:44.733 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:44.734 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:44.734 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:44.734 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:44.734 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 342, 2022-01-24T07:13:44.735 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:44.735 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 129, 2022-01-24T07:13:44.735 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:44.735 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:44.735 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.736 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:44.736 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 170860, 2022-01-24T07:13:44.736 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 68000, 2022-01-24T07:13:44.736 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 68000, 2022-01-24T07:13:44.737 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 102860, 2022-01-24T07:13:44.737 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:44.737 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 550, 2022-01-24T07:13:44.737 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 207, 2022-01-24T07:13:44.738 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 79, 2022-01-24T07:13:44.738 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 79, 2022-01-24T07:13:44.738 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 129, 2022-01-24T07:13:44.738 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:44.739 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 1, 2022-01-24T07:13:44.739 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 167774661, 2022-01-24T07:13:44.739 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 380188749, 2022-01-24T07:13:44.739 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:44.739 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:44.740 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3528, 2022-01-24T07:13:44.740 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 278.387116017, 2022-01-24T07:13:44.740 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.078907912 2022-01-24T07:13:44.740 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.741 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:44.741 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.741 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:44.741 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 29, 2022-01-24T07:13:44.741 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 45734, 2022-01-24T07:13:44.742 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 45705, 2022-01-24T07:13:44.742 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 15, 2022-01-24T07:13:44.742 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2369, 2022-01-24T07:13:44.742 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 2354, 2022-01-24T07:13:44.743 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 18, 2022-01-24T07:13:44.743 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 110352, 2022-01-24T07:13:44.743 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 110334, 2022-01-24T07:13:44.743 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 6, 2022-01-24T07:13:44.744 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 47954, 2022-01-24T07:13:44.744 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 47948, 2022-01-24T07:13:44.744 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 118424, 2022-01-24T07:13:44.744 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:44.744 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.745 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:44.745 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 165726, 2022-01-24T07:13:44.745 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 2706, 2022-01-24T07:13:44.745 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 132050, 2022-01-24T07:13:44.746 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 423, 2022-01-24T07:13:44.746 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 4919, 2022-01-24T07:13:44.746 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:44.746 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31342, 2022-01-24T07:13:44.747 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 188.340625367, 2022-01-24T07:13:44.747 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006009208 2022-01-24T07:13:44.747 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.747 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:44.747 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1249, 2022-01-24T07:13:44.748 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 131.188246377, 2022-01-24T07:13:44.748 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.105034624 2022-01-24T07:13:44.751 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.751 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:44.751 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.751 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.752 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.752 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.752 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:44.752 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.753 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.753 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.753 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.753 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:44.754 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 32711, 2022-01-24T07:13:44.754 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1214.600191844, 2022-01-24T07:13:44.754 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.037131246 2022-01-24T07:13:44.754 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.754 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:44.755 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.755 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.755 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.755 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.756 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:44.756 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.756 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.756 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.757 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.757 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:44.757 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.757 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.757 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.758 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.758 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:44.758 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.758 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.759 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.759 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.759 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:44.759 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.759 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.760 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.760 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.760 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:44.760 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.761 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.761 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.761 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.761 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:44.762 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 242, 2022-01-24T07:13:44.762 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.284551492, 2022-01-24T07:13:44.762 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.013572526 2022-01-24T07:13:44.762 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.762 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:44.763 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.763 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.763 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.763 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.764 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:44.764 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.764 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.764 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.764 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.765 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:44.765 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 8653, 2022-01-24T07:13:44.765 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 56.843065921, 2022-01-24T07:13:44.765 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006569174 2022-01-24T07:13:44.766 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.766 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:44.766 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 959, 2022-01-24T07:13:44.766 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.267935817, 2022-01-24T07:13:44.767 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001322143 2022-01-24T07:13:44.767 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.767 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:44.767 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31372, 2022-01-24T07:13:44.768 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 674.230388059, 2022-01-24T07:13:44.768 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.021491469 2022-01-24T07:13:44.768 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.768 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:44.769 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.769 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.769 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.769 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.769 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:44.770 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 218, 2022-01-24T07:13:44.770 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 33.170426379, 2022-01-24T07:13:44.770 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.152157919 2022-01-24T07:13:44.770 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.771 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:44.771 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.771 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.771 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.771 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.772 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:44.772 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.772 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.772 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.773 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.773 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:44.773 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2022-01-24T07:13:44.773 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.047113909, 2022-01-24T07:13:44.773 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.047113909 2022-01-24T07:13:44.774 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.774 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:44.774 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.774 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.775 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.775 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.775 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:44.775 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.776 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.776 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.776 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.776 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:44.776 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.777 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.777 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.777 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.777 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:44.777 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.778 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.778 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.778 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.778 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:44.779 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.779 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.779 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.779 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.780 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:44.780 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20562, 2022-01-24T07:13:44.780 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 695.668947902, 2022-01-24T07:13:44.780 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.033832747 2022-01-24T07:13:44.780 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.781 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:44.781 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:44.781 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.781 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:44.781 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:44.782 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:44.782 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:44.782 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:44.782 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:44.783 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 9882, 2022-01-24T07:13:44.783 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 4941, 2022-01-24T07:13:44.783 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3793 2022-01-24T07:13:44.783 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:44.784 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 338, 2022-01-24T07:13:44.784 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 338, 2022-01-24T07:13:44.784 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:44.784 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:44.785 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:44.785 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:44.785 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:44.785 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:44.786 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:44.786 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:44.786 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:44.786 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:44.786 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:44.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:44.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:44.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:44.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:44.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:44.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:44.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:44.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:44.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:44.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:44.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:44.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:44.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:44.790 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:44.790 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:44.790 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:44.790 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:44.791 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:44.791 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:44.791 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:44.791 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:44.791 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:44.792 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:44.792 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 215178, 2022-01-24T07:13:44.792 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 126, 2022-01-24T07:13:44.792 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 264, 2022-01-24T07:13:44.793 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 3, 2022-01-24T07:13:44.793 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:44.793 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:44.793 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:44.794 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:44.794 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:44.794 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:44.794 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:44.794 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:44.795 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:44.795 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:44.795 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:44.795 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:44.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 91730, 2022-01-24T07:13:44.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 1017, 2022-01-24T07:13:44.796 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:44.796 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:44.796 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:44.797 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:44.797 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.797 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:44.797 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:44.798 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:44.798 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 31755, 2022-01-24T07:13:44.798 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 401288360, 2022-01-24T07:13:44.798 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 27, 2022-01-24T07:13:44.798 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 31755, 2022-01-24T07:13:44.799 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 31755, 2022-01-24T07:13:44.799 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 524, 2022-01-24T07:13:44.799 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 31231, 2022-01-24T07:13:44.799 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:44.800 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:44.800 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 7, 2022-01-24T07:13:44.800 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 152, 2022-01-24T07:13:44.800 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 523, 2022-01-24T07:13:44.800 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 4051, 2022-01-24T07:13:44.801 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 198, 2022-01-24T07:13:44.801 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:44.801 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:44.801 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:44.802 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 127, 2022-01-24T07:13:44.802 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 25418, 2022-01-24T07:13:44.802 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:44.802 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:44.803 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:44.803 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 1, 2022-01-24T07:13:44.803 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 304, 2022-01-24T07:13:44.803 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:44.803 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:44.804 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:44.804 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:44.804 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:44.804 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:44.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:44.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:44.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:44.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 1, 2022-01-24T07:13:44.805 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:44.806 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:44.806 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:44.806 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:44.806 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:44.807 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:44.807 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:44.807 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:44.807 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:44.807 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:44.808 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:44.808 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:44.808 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:44.808 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:44.809 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:44.809 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:44.809 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:44.809 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:44.809 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:44.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:44.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:44.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:44.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:44.811 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 2547, 2022-01-24T07:13:44.811 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2022-01-24T07:13:44.811 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 240 2022-01-24T07:13:44.811 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.811 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:44.812 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:44.812 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:44.812 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:44.812 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:44.813 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.813 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:44.813 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:44.813 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:44.814 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:44.814 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:44.814 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 24125, 2022-01-24T07:13:44.814 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:44.814 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.815 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:44.815 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.815 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:44.815 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 291011, 2022-01-24T07:13:44.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 83600875, 2022-01-24T07:13:44.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 291011, 2022-01-24T07:13:44.817 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:44.817 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:44.817 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 291011, 2022-01-24T07:13:44.817 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 83600875, 2022-01-24T07:13:44.817 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.818 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.818 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.818 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.818 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.819 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.819 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:44.819 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.819 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:44.819 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.820 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:44.820 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:44.820 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.820 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.821 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 31755, 2022-01-24T07:13:44.821 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 403726145, 2022-01-24T07:13:44.821 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 6209, 2022-01-24T07:13:44.821 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 403726145, 2022-01-24T07:13:44.822 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.822 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.822 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.822 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.822 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.823 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.823 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:44.823 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.823 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:44.824 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.824 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:44.824 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:44.824 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.824 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:44.825 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 31755, 2022-01-24T07:13:44.825 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 31755, 2022-01-24T07:13:44.825 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 31755, 2022-01-24T07:13:44.825 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 31755, 2022-01-24T07:13:44.826 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.826 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.826 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.826 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.826 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.827 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.827 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:44.827 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.827 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:44.828 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.828 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 24125, 2022-01-24T07:13:44.828 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 2437801, 2022-01-24T07:13:44.828 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.828 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 24125, 2022-01-24T07:13:44.829 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:44.829 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:44.829 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 523, 2022-01-24T07:13:44.829 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 2437801, 2022-01-24T07:13:44.829 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.830 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.830 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.830 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.830 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.831 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.831 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55e3eef85ae0": { 2022-01-24T07:13:44.831 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:44.831 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:44.832 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:44.832 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 170860, 2022-01-24T07:13:44.832 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 375994445, 2022-01-24T07:13:44.832 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:44.832 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 170860, 2022-01-24T07:13:44.833 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:44.833 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:44.833 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 3528, 2022-01-24T07:13:44.833 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 375994445, 2022-01-24T07:13:44.833 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:44.834 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:44.834 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:44.834 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:44.834 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.835 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.835 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:44.837 INFO:tasks.check_counter:Daemon mds.f mds.exported=340 2022-01-24T07:13:44.837 INFO:tasks.check_counter:Daemon mds.f mds.imported=396 2022-01-24T07:13:44.837 DEBUG:tasks.check_counter:Getting stats from g 2022-01-24T07:13:44.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok perf dump 2022-01-24T07:13:44.964 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:44.964 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:44.964 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 31698, 2022-01-24T07:13:44.965 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 29982, 2022-01-24T07:13:44.965 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 21868638, 2022-01-24T07:13:44.965 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 111141895, 2022-01-24T07:13:44.965 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:44.965 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2022-01-24T07:13:44.966 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.180777437, 2022-01-24T07:13:44.966 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.868216668, 2022-01-24T07:13:44.966 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.520431464, 2022-01-24T07:13:44.966 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.487843129, 2022-01-24T07:13:44.967 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.967 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 29982, 2022-01-24T07:13:44.967 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 15.716426262, 2022-01-24T07:13:44.967 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000524195 2022-01-24T07:13:44.968 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.968 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.968 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 40282, 2022-01-24T07:13:44.968 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.018895424, 2022-01-24T07:13:44.968 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000469 2022-01-24T07:13:44.969 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.969 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.969 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:44.969 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 21644, 2022-01-24T07:13:44.970 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 28077, 2022-01-24T07:13:44.970 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 9106553, 2022-01-24T07:13:44.970 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 66838497, 2022-01-24T07:13:44.970 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:44.971 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:44.971 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.167170696, 2022-01-24T07:13:44.971 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.574357702, 2022-01-24T07:13:44.971 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.760149100, 2022-01-24T07:13:44.971 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.138112474, 2022-01-24T07:13:44.972 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.972 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 28074, 2022-01-24T07:13:44.972 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 18.416398215, 2022-01-24T07:13:44.972 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000655994 2022-01-24T07:13:44.973 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.973 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.973 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 14768, 2022-01-24T07:13:44.973 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.006011799, 2022-01-24T07:13:44.973 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000407 2022-01-24T07:13:44.974 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.974 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.974 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:44.974 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 103983, 2022-01-24T07:13:44.975 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 189179, 2022-01-24T07:13:44.975 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 38862436, 2022-01-24T07:13:44.975 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 142228937, 2022-01-24T07:13:44.975 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:44.976 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 7, 2022-01-24T07:13:44.976 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 5.437430287, 2022-01-24T07:13:44.976 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 2.615769648, 2022-01-24T07:13:44.976 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 5.100668517, 2022-01-24T07:13:44.976 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.209142617, 2022-01-24T07:13:44.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:44.977 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 189178, 2022-01-24T07:13:44.977 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 124.321037022, 2022-01-24T07:13:44.977 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000657164 2022-01-24T07:13:44.978 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.978 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:44.978 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 137181, 2022-01-24T07:13:44.978 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.069266534, 2022-01-24T07:13:44.978 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000504 2022-01-24T07:13:44.979 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.979 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.979 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:44.979 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:44.980 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:44.980 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.980 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:44.980 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:44.981 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:44.981 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4642, 2022-01-24T07:13:44.981 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 49.694687210, 2022-01-24T07:13:44.981 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.010705447 2022-01-24T07:13:44.981 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.982 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.982 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:44.982 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:44.982 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:44.983 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 9972, 2022-01-24T07:13:44.983 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.298928608, 2022-01-24T07:13:44.983 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000230538 2022-01-24T07:13:44.983 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:44.984 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.984 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:44.984 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 55123, 2022-01-24T07:13:44.984 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 53782, 2022-01-24T07:13:44.984 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:44.985 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 53782, 2022-01-24T07:13:44.985 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 725.402741920, 2022-01-24T07:13:44.985 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.013487834 2022-01-24T07:13:44.985 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.985 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 1341, 2022-01-24T07:13:44.986 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 0, 2022-01-24T07:13:44.986 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 686, 2022-01-24T07:13:44.986 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 75, 2022-01-24T07:13:44.986 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2022-01-24T07:13:44.987 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 13, 2022-01-24T07:13:44.987 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 2, 2022-01-24T07:13:44.987 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 1, 2022-01-24T07:13:44.987 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:44.988 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 10, 2022-01-24T07:13:44.988 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 49872, 2022-01-24T07:13:44.988 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:44.988 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2022-01-24T07:13:44.989 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 4, 2022-01-24T07:13:44.989 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 85271, 2022-01-24T07:13:44.989 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 76981, 2022-01-24T07:13:44.989 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 1089, 2022-01-24T07:13:44.990 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 440, 2022-01-24T07:13:44.990 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:44.990 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:44.990 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 187, 2022-01-24T07:13:44.991 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2022-01-24T07:13:44.991 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2022-01-24T07:13:44.991 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 426, 2022-01-24T07:13:44.991 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 35977, 2022-01-24T07:13:44.992 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 497, 2022-01-24T07:13:44.992 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:44.992 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:44.992 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:44.992 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:44.993 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:44.993 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:44.993 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:44.993 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.993 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:44.994 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2022-01-24T07:13:44.994 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:44.994 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:44.994 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 8973, 2022-01-24T07:13:44.995 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 8973, 2022-01-24T07:13:44.995 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:44.995 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:44.995 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:44.996 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:44.996 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:44.996 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:44.996 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:44.996 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:44.997 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 426, 2022-01-24T07:13:44.997 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:44.997 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 75, 2022-01-24T07:13:44.997 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:44.997 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:44.998 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:44.998 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:44.998 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 87272, 2022-01-24T07:13:44.998 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2022-01-24T07:13:44.999 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2022-01-24T07:13:44.999 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 87272, 2022-01-24T07:13:44.999 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:44.999 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2022-01-24T07:13:44.999 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 101, 2022-01-24T07:13:45.000 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2022-01-24T07:13:45.000 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2022-01-24T07:13:45.000 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 101, 2022-01-24T07:13:45.000 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:45.001 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2022-01-24T07:13:45.001 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2022-01-24T07:13:45.001 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 208796110, 2022-01-24T07:13:45.001 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:45.001 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:45.002 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2600, 2022-01-24T07:13:45.002 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 234.534370822, 2022-01-24T07:13:45.002 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.090205527 2022-01-24T07:13:45.002 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.003 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:45.003 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.003 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:45.003 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 22, 2022-01-24T07:13:45.003 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 34269, 2022-01-24T07:13:45.004 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 34247, 2022-01-24T07:13:45.004 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 15, 2022-01-24T07:13:45.004 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 1673, 2022-01-24T07:13:45.004 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1658, 2022-01-24T07:13:45.004 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 12, 2022-01-24T07:13:45.005 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 68492, 2022-01-24T07:13:45.005 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 68480, 2022-01-24T07:13:45.005 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2022-01-24T07:13:45.005 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 34380, 2022-01-24T07:13:45.005 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 34380, 2022-01-24T07:13:45.006 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 120776, 2022-01-24T07:13:45.006 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:45.006 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.006 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:45.007 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 71104, 2022-01-24T07:13:45.007 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 2727, 2022-01-24T07:13:45.007 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 55123, 2022-01-24T07:13:45.007 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 457, 2022-01-24T07:13:45.007 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 3847, 2022-01-24T07:13:45.008 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:45.008 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 15447, 2022-01-24T07:13:45.008 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 50.553988765, 2022-01-24T07:13:45.008 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003272738 2022-01-24T07:13:45.009 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.009 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:45.009 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 44, 2022-01-24T07:13:45.009 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 6.749269081, 2022-01-24T07:13:45.009 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.153392479 2022-01-24T07:13:45.010 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.010 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:45.010 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.010 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.010 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.011 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.011 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:45.011 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.011 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.012 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.012 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.012 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:45.012 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11114, 2022-01-24T07:13:45.013 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 164.553682867, 2022-01-24T07:13:45.013 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.014805981 2022-01-24T07:13:45.013 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.013 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:45.013 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.014 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.014 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.014 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.014 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:45.014 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.015 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.015 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.015 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.015 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:45.016 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.016 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.016 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.016 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.016 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:45.017 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.017 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.017 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.017 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.018 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:45.018 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.018 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.018 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.019 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.019 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:45.019 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.019 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.019 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.020 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.020 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:45.020 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 107, 2022-01-24T07:13:45.020 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.707498810, 2022-01-24T07:13:45.020 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.043995315 2022-01-24T07:13:45.021 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.021 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:45.021 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.021 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.022 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.022 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.022 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:45.022 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.022 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.023 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.023 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.023 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:45.023 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3823, 2022-01-24T07:13:45.023 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 14.553511735, 2022-01-24T07:13:45.024 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003806830 2022-01-24T07:13:45.024 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.024 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:45.024 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 376, 2022-01-24T07:13:45.025 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.565515996, 2022-01-24T07:13:45.025 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001504031 2022-01-24T07:13:45.025 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.025 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:45.025 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 15401, 2022-01-24T07:13:45.026 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 308.837670662, 2022-01-24T07:13:45.026 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.020053092 2022-01-24T07:13:45.026 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.026 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:45.027 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.027 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.027 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.027 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.027 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:45.028 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 74, 2022-01-24T07:13:45.028 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 12.293655241, 2022-01-24T07:13:45.028 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.166130476 2022-01-24T07:13:45.028 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.028 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:45.029 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.029 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.029 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.029 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.030 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:45.030 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.030 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.030 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.031 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.031 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:45.031 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2022-01-24T07:13:45.031 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.016275324, 2022-01-24T07:13:45.031 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.016275324 2022-01-24T07:13:45.032 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.032 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:45.032 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.032 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.033 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.033 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.033 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:45.033 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.033 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.034 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.034 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.034 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:45.034 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.034 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.035 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.035 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.035 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:45.035 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.036 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.036 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.036 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.036 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:45.036 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.037 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.037 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.037 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.037 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:45.038 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7395, 2022-01-24T07:13:45.038 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 162.571673439, 2022-01-24T07:13:45.038 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.021983999 2022-01-24T07:13:45.038 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.038 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:45.039 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:45.039 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.039 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:45.039 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:45.040 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:45.040 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:45.040 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:45.040 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:45.041 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 6108, 2022-01-24T07:13:45.041 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 3054, 2022-01-24T07:13:45.041 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3792 2022-01-24T07:13:45.041 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.041 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:45.042 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:45.042 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:45.042 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:45.042 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:45.043 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:45.043 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:45.043 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:45.043 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:45.044 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:45.044 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:45.044 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:45.044 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:45.044 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:45.045 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:45.045 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:45.045 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:45.045 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:45.046 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:45.046 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:45.046 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:45.046 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:45.046 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:45.047 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:45.047 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:45.047 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:45.047 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:45.048 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:45.048 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:45.048 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:45.048 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:45.048 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:45.049 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:45.049 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:45.049 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:45.049 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:45.049 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:45.050 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 184751, 2022-01-24T07:13:45.050 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 124, 2022-01-24T07:13:45.050 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 352, 2022-01-24T07:13:45.050 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 4, 2022-01-24T07:13:45.051 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:45.051 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:45.051 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:45.051 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:45.052 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:45.052 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:45.052 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:45.052 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:45.052 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:45.053 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:45.053 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:45.053 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:45.053 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 70520, 2022-01-24T07:13:45.053 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 350, 2022-01-24T07:13:45.054 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:45.054 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:45.054 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:45.054 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:45.055 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.055 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:45.055 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:45.055 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:45.056 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 13734, 2022-01-24T07:13:45.056 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 218760326, 2022-01-24T07:13:45.056 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 27, 2022-01-24T07:13:45.056 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 13734, 2022-01-24T07:13:45.057 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 13734, 2022-01-24T07:13:45.057 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 306, 2022-01-24T07:13:45.057 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 13428, 2022-01-24T07:13:45.057 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:45.057 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:45.058 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 0, 2022-01-24T07:13:45.058 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 10, 2022-01-24T07:13:45.058 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 306, 2022-01-24T07:13:45.058 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 2907, 2022-01-24T07:13:45.058 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 158, 2022-01-24T07:13:45.059 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:45.059 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:45.059 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:45.059 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 75, 2022-01-24T07:13:45.060 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 9481, 2022-01-24T07:13:45.060 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:45.060 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:45.060 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:45.060 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:45.061 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 20, 2022-01-24T07:13:45.061 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:45.061 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:45.061 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:45.062 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:45.062 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:45.062 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:45.062 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:45.063 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:45.063 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:45.063 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 1, 2022-01-24T07:13:45.063 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:45.064 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:45.064 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:45.064 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:45.064 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:45.064 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:45.065 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:45.065 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:45.065 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:45.066 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:45.066 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:45.066 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:45.066 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:45.067 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:45.067 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:45.067 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:45.067 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:45.068 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:45.068 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:45.068 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:45.068 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:45.069 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:45.069 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:45.069 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 1568, 2022-01-24T07:13:45.069 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 0, 2022-01-24T07:13:45.069 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 173 2022-01-24T07:13:45.070 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.070 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:45.070 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:45.070 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:45.071 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:45.071 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:45.071 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.071 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:45.072 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:45.072 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:45.072 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:45.072 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:45.072 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 8973, 2022-01-24T07:13:45.073 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:45.073 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.073 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:45.073 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.074 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:45.074 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.074 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 157321, 2022-01-24T07:13:45.074 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 57362703, 2022-01-24T07:13:45.074 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.075 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 157321, 2022-01-24T07:13:45.075 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.075 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.075 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 157321, 2022-01-24T07:13:45.076 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 57362703, 2022-01-24T07:13:45.076 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.076 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.076 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.076 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.077 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.077 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.077 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:45.077 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.078 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:45.078 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.078 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:45.078 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:45.079 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.079 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:45.079 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 13734, 2022-01-24T07:13:45.079 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 219667047, 2022-01-24T07:13:45.080 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4177, 2022-01-24T07:13:45.080 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 219667047, 2022-01-24T07:13:45.080 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.080 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.080 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.081 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.081 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.081 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.081 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:45.081 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.082 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:45.082 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.082 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:45.082 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:45.083 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.083 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:45.083 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 13734, 2022-01-24T07:13:45.083 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 13734, 2022-01-24T07:13:45.084 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 13734, 2022-01-24T07:13:45.084 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 13734, 2022-01-24T07:13:45.084 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.084 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.085 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.085 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.085 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.085 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.085 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:45.086 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.086 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:45.086 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.086 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 8973, 2022-01-24T07:13:45.087 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 906721, 2022-01-24T07:13:45.087 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.087 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 8973, 2022-01-24T07:13:45.087 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.088 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.088 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 307, 2022-01-24T07:13:45.088 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 906721, 2022-01-24T07:13:45.088 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.089 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.089 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.089 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.089 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.089 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.090 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55cfad4d1ae0": { 2022-01-24T07:13:45.090 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.090 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:45.090 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.091 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 87272, 2022-01-24T07:13:45.091 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 204601806, 2022-01-24T07:13:45.091 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.091 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 87272, 2022-01-24T07:13:45.092 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.092 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.092 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2600, 2022-01-24T07:13:45.092 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 204601806, 2022-01-24T07:13:45.092 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.093 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.093 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.093 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.093 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.094 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.094 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:45.095 INFO:tasks.check_counter:Daemon mds.g mds.exported=426 2022-01-24T07:13:45.096 INFO:tasks.check_counter:Daemon mds.g mds.imported=497 2022-01-24T07:13:45.096 DEBUG:tasks.check_counter:Getting stats from h 2022-01-24T07:13:45.096 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok perf dump 2022-01-24T07:13:45.218 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:45.218 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:45.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 115649, 2022-01-24T07:13:45.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 196956, 2022-01-24T07:13:45.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 54430007, 2022-01-24T07:13:45.219 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 181787764, 2022-01-24T07:13:45.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 14, 2022-01-24T07:13:45.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:45.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 6.215925270, 2022-01-24T07:13:45.220 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 2.828949884, 2022-01-24T07:13:45.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 5.431826924, 2022-01-24T07:13:45.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.729763122, 2022-01-24T07:13:45.221 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:45.221 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 196953, 2022-01-24T07:13:45.222 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 122.372678865, 2022-01-24T07:13:45.222 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000621329 2022-01-24T07:13:45.222 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.222 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:45.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 139963, 2022-01-24T07:13:45.223 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.058366320, 2022-01-24T07:13:45.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000417 2022-01-24T07:13:45.223 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.223 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.224 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:45.224 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 16457, 2022-01-24T07:13:45.224 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 20450, 2022-01-24T07:13:45.224 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 11748441, 2022-01-24T07:13:45.225 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 125996393, 2022-01-24T07:13:45.225 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 9, 2022-01-24T07:13:45.225 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:45.225 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.787757925, 2022-01-24T07:13:45.226 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.707027811, 2022-01-24T07:13:45.226 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.533019733, 2022-01-24T07:13:45.226 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.571170211, 2022-01-24T07:13:45.226 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:45.226 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20451, 2022-01-24T07:13:45.227 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 8.200848602, 2022-01-24T07:13:45.227 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000400999 2022-01-24T07:13:45.227 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.227 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:45.228 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 15066, 2022-01-24T07:13:45.228 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.003342289, 2022-01-24T07:13:45.228 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000221 2022-01-24T07:13:45.228 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.229 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.229 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:45.229 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 60375, 2022-01-24T07:13:45.229 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 95384, 2022-01-24T07:13:45.229 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 20129143, 2022-01-24T07:13:45.230 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 104157852, 2022-01-24T07:13:45.230 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:45.230 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:45.230 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.767721325, 2022-01-24T07:13:45.231 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 1.351961617, 2022-01-24T07:13:45.231 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 2.318434260, 2022-01-24T07:13:45.231 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.210439928, 2022-01-24T07:13:45.231 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:45.232 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 95382, 2022-01-24T07:13:45.232 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 42.380613779, 2022-01-24T07:13:45.232 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000444325 2022-01-24T07:13:45.232 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.233 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:45.233 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 66070, 2022-01-24T07:13:45.233 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.023810676, 2022-01-24T07:13:45.233 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000360 2022-01-24T07:13:45.233 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.234 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.234 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:45.234 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:45.234 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:45.235 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.235 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:45.235 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:45.235 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:45.236 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4144, 2022-01-24T07:13:45.236 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 69.022024910, 2022-01-24T07:13:45.236 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.016655894 2022-01-24T07:13:45.236 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.236 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.237 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:45.237 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:45.237 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:45.237 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 20163, 2022-01-24T07:13:45.237 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.246050395, 2022-01-24T07:13:45.238 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000160990 2022-01-24T07:13:45.238 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.238 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.239 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:45.239 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 75838, 2022-01-24T07:13:45.239 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 74877, 2022-01-24T07:13:45.239 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:45.239 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 74877, 2022-01-24T07:13:45.240 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1966.576363848, 2022-01-24T07:13:45.240 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.026264091 2022-01-24T07:13:45.240 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.240 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 935, 2022-01-24T07:13:45.241 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 0, 2022-01-24T07:13:45.241 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 754, 2022-01-24T07:13:45.241 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 82, 2022-01-24T07:13:45.241 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2022-01-24T07:13:45.241 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 30, 2022-01-24T07:13:45.242 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 13, 2022-01-24T07:13:45.242 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 7, 2022-01-24T07:13:45.242 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:45.242 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 11, 2022-01-24T07:13:45.243 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 46888, 2022-01-24T07:13:45.243 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:45.243 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2022-01-24T07:13:45.243 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 8, 2022-01-24T07:13:45.243 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 113074, 2022-01-24T07:13:45.244 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 101987, 2022-01-24T07:13:45.244 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 771, 2022-01-24T07:13:45.244 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 401, 2022-01-24T07:13:45.244 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2022-01-24T07:13:45.245 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:45.245 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 90, 2022-01-24T07:13:45.245 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2022-01-24T07:13:45.245 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2022-01-24T07:13:45.245 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 345, 2022-01-24T07:13:45.246 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 31621, 2022-01-24T07:13:45.246 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 191, 2022-01-24T07:13:45.246 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:45.246 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:45.247 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:45.247 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:45.247 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:45.247 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:45.248 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:45.248 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.248 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:45.248 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2022-01-24T07:13:45.248 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:45.249 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:45.249 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 19170, 2022-01-24T07:13:45.249 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 19170, 2022-01-24T07:13:45.249 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:45.250 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:45.250 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:45.250 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:45.250 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:45.250 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:45.251 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:45.251 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:45.251 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 345, 2022-01-24T07:13:45.251 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:45.252 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 82, 2022-01-24T07:13:45.252 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:45.252 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:45.252 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.252 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:45.253 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 120338, 2022-01-24T07:13:45.253 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 18140, 2022-01-24T07:13:45.253 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 18140, 2022-01-24T07:13:45.253 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 102198, 2022-01-24T07:13:45.254 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:45.254 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 6505, 2022-01-24T07:13:45.254 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 149, 2022-01-24T07:13:45.254 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 21, 2022-01-24T07:13:45.255 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 21, 2022-01-24T07:13:45.255 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 135, 2022-01-24T07:13:45.255 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:45.255 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 7, 2022-01-24T07:13:45.255 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 48687880, 2022-01-24T07:13:45.256 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 269874532, 2022-01-24T07:13:45.256 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:45.256 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:45.256 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1926, 2022-01-24T07:13:45.257 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 150.152483157, 2022-01-24T07:13:45.257 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.077960790 2022-01-24T07:13:45.257 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.257 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:45.257 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.258 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:45.258 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 41, 2022-01-24T07:13:45.258 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 41052, 2022-01-24T07:13:45.258 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 41011, 2022-01-24T07:13:45.259 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 37, 2022-01-24T07:13:45.259 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2041, 2022-01-24T07:13:45.259 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 2004, 2022-01-24T07:13:45.259 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 30, 2022-01-24T07:13:45.259 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 89965, 2022-01-24T07:13:45.260 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 89935, 2022-01-24T07:13:45.260 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2022-01-24T07:13:45.260 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 40820, 2022-01-24T07:13:45.260 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 40820, 2022-01-24T07:13:45.261 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 122420, 2022-01-24T07:13:45.261 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:45.261 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.261 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:45.261 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 93809, 2022-01-24T07:13:45.262 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 1552, 2022-01-24T07:13:45.262 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 75838, 2022-01-24T07:13:45.262 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 406, 2022-01-24T07:13:45.262 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 2502, 2022-01-24T07:13:45.263 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:45.263 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17267, 2022-01-24T07:13:45.263 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 64.276802423, 2022-01-24T07:13:45.263 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003722522 2022-01-24T07:13:45.263 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.264 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:45.264 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 41, 2022-01-24T07:13:45.264 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 7.220589774, 2022-01-24T07:13:45.264 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.176111945 2022-01-24T07:13:45.265 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.265 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:45.265 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.265 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.266 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.266 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.266 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:45.266 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.266 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.267 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.267 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.267 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:45.267 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17039, 2022-01-24T07:13:45.267 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 150.161595117, 2022-01-24T07:13:45.268 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.008812817 2022-01-24T07:13:45.268 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.268 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:45.268 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.269 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.269 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.269 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.269 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:45.269 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.270 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.270 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.270 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.270 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:45.271 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.271 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.271 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.271 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.271 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:45.272 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.272 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.272 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.272 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.273 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:45.273 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.273 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.273 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.274 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.274 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:45.274 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.274 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.274 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.275 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.275 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:45.275 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 123, 2022-01-24T07:13:45.275 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.317530764, 2022-01-24T07:13:45.276 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.010711632 2022-01-24T07:13:45.276 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.276 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:45.276 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.276 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.277 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.277 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.277 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:45.277 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.277 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.278 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.278 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.278 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:45.278 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4318, 2022-01-24T07:13:45.279 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 18.648836491, 2022-01-24T07:13:45.279 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004318859 2022-01-24T07:13:45.279 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.279 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:45.280 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 807, 2022-01-24T07:13:45.280 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.597632522, 2022-01-24T07:13:45.280 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003218875 2022-01-24T07:13:45.280 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.280 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:45.281 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17277, 2022-01-24T07:13:45.281 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 303.299335874, 2022-01-24T07:13:45.281 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.017555092 2022-01-24T07:13:45.281 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.281 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:45.282 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.282 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.282 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.282 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.283 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:45.283 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 147, 2022-01-24T07:13:45.283 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 41.766263165, 2022-01-24T07:13:45.283 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.284124239 2022-01-24T07:13:45.284 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.284 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:45.284 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.284 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.285 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.285 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.285 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:45.285 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.285 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.286 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.286 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.286 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:45.286 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.286 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.287 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.287 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.287 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:45.287 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.288 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.288 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.288 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.288 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:45.288 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.289 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.289 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.289 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.289 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:45.289 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.290 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.290 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.290 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.290 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:45.291 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.291 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.291 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.291 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.292 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:45.292 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.292 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.292 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.292 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.293 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:45.293 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17858, 2022-01-24T07:13:45.293 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1377.287777718, 2022-01-24T07:13:45.293 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.077124413 2022-01-24T07:13:45.294 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.294 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:45.294 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:45.294 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.294 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:45.295 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:45.295 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:45.295 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:45.295 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:45.296 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:45.296 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 22729, 2022-01-24T07:13:45.296 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 11364, 2022-01-24T07:13:45.296 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3793 2022-01-24T07:13:45.296 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.297 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:45.297 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:45.297 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:45.297 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:45.298 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:45.298 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:45.298 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:45.298 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:45.299 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:45.299 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:45.299 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:45.299 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:45.300 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:45.300 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:45.300 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:45.300 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:45.300 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:45.301 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:45.301 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:45.301 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:45.301 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:45.302 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:45.302 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:45.302 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:45.302 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:45.302 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:45.303 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:45.303 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:45.303 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:45.303 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:45.304 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:45.304 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:45.304 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:45.304 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:45.304 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:45.305 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:45.305 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:45.305 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 178401, 2022-01-24T07:13:45.305 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 109, 2022-01-24T07:13:45.306 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 88, 2022-01-24T07:13:45.306 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 1, 2022-01-24T07:13:45.306 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:45.306 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:45.306 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:45.307 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:45.307 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:45.307 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:45.307 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:45.308 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:45.308 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:45.308 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:45.308 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:45.308 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:45.309 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 146576, 2022-01-24T07:13:45.309 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 524, 2022-01-24T07:13:45.309 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:45.309 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:45.309 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:45.310 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:45.310 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.310 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:45.311 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2022-01-24T07:13:45.311 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:45.311 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 24122, 2022-01-24T07:13:45.311 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 283477404, 2022-01-24T07:13:45.312 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 27, 2022-01-24T07:13:45.312 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 24122, 2022-01-24T07:13:45.312 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 24122, 2022-01-24T07:13:45.312 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 330, 2022-01-24T07:13:45.312 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 23792, 2022-01-24T07:13:45.313 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:45.313 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:45.313 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 5, 2022-01-24T07:13:45.313 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 396, 2022-01-24T07:13:45.314 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 330, 2022-01-24T07:13:45.314 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 2256, 2022-01-24T07:13:45.314 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 154, 2022-01-24T07:13:45.314 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:45.314 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:45.315 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:45.315 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 82, 2022-01-24T07:13:45.315 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 20039, 2022-01-24T07:13:45.315 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:45.315 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:45.316 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:45.316 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 0, 2022-01-24T07:13:45.316 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 792, 2022-01-24T07:13:45.316 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:45.316 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:45.317 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:45.317 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:45.317 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:45.317 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:45.318 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:45.318 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:45.318 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:45.318 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2022-01-24T07:13:45.318 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:45.319 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:45.319 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:45.319 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:45.319 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:45.319 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:45.320 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:45.320 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:45.320 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:45.320 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:45.321 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:45.321 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:45.321 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:45.321 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:45.322 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:45.322 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:45.322 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:45.322 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:45.323 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:45.323 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:45.323 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:45.323 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:45.324 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:45.324 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 1707, 2022-01-24T07:13:45.324 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 0, 2022-01-24T07:13:45.324 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 183 2022-01-24T07:13:45.324 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.325 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:45.325 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:45.325 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:45.325 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:45.326 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:45.326 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.326 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:45.326 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2022-01-24T07:13:45.326 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:45.327 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2022-01-24T07:13:45.327 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:45.327 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 19170, 2022-01-24T07:13:45.327 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2022-01-24T07:13:45.327 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.328 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:45.328 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.328 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:45.328 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.329 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 192477, 2022-01-24T07:13:45.329 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 71164769, 2022-01-24T07:13:45.329 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.329 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 192477, 2022-01-24T07:13:45.329 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.330 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.330 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 192477, 2022-01-24T07:13:45.330 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 71164769, 2022-01-24T07:13:45.330 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.331 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.331 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.331 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.331 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.331 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.332 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:45.332 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.332 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:45.332 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.333 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:45.333 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:45.333 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.333 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:45.334 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 24122, 2022-01-24T07:13:45.334 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 285414358, 2022-01-24T07:13:45.334 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4001, 2022-01-24T07:13:45.334 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 285414358, 2022-01-24T07:13:45.334 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.335 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.335 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.335 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.335 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.336 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.336 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:45.336 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.336 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:45.336 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.337 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:45.337 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:45.337 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.337 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:45.337 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 24122, 2022-01-24T07:13:45.338 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 24122, 2022-01-24T07:13:45.338 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 24122, 2022-01-24T07:13:45.338 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 24122, 2022-01-24T07:13:45.338 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.338 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.339 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.339 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.339 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.339 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.340 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:45.340 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.340 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:45.340 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.340 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 19170, 2022-01-24T07:13:45.341 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 1936954, 2022-01-24T07:13:45.341 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.341 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 19170, 2022-01-24T07:13:45.341 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.342 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.342 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 330, 2022-01-24T07:13:45.342 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 1936954, 2022-01-24T07:13:45.342 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.342 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.343 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.343 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.343 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.343 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.344 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x556d9d9e9ae0": { 2022-01-24T07:13:45.344 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.344 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:45.344 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.344 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 120338, 2022-01-24T07:13:45.345 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 265680228, 2022-01-24T07:13:45.345 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.345 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 120338, 2022-01-24T07:13:45.345 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.345 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.346 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 1926, 2022-01-24T07:13:45.346 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 265680228, 2022-01-24T07:13:45.346 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.346 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.346 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.347 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.347 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.347 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.347 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:45.349 INFO:tasks.check_counter:Daemon mds.h mds.exported=345 2022-01-24T07:13:45.349 INFO:tasks.check_counter:Daemon mds.h mds.imported=191 2022-01-24T07:13:45.350 DEBUG:tasks.check_counter:Getting stats from i 2022-01-24T07:13:45.350 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok perf dump 2022-01-24T07:13:45.475 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2022-01-24T07:13:45.475 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2022-01-24T07:13:45.475 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 32171, 2022-01-24T07:13:45.476 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 29860, 2022-01-24T07:13:45.476 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 40231015, 2022-01-24T07:13:45.476 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 88991254, 2022-01-24T07:13:45.476 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2022-01-24T07:13:45.476 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2022-01-24T07:13:45.477 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.874917704, 2022-01-24T07:13:45.477 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.751694678, 2022-01-24T07:13:45.477 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.414258201, 2022-01-24T07:13:45.477 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.295802716, 2022-01-24T07:13:45.478 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:45.478 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 29862, 2022-01-24T07:13:45.478 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 11.206685115, 2022-01-24T07:13:45.478 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000375282 2022-01-24T07:13:45.478 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.479 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:45.479 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 48798, 2022-01-24T07:13:45.479 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.008268797, 2022-01-24T07:13:45.479 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000169 2022-01-24T07:13:45.480 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.480 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.480 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2022-01-24T07:13:45.480 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 17733, 2022-01-24T07:13:45.480 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 17626, 2022-01-24T07:13:45.481 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 9757819, 2022-01-24T07:13:45.481 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 175311923, 2022-01-24T07:13:45.481 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2022-01-24T07:13:45.481 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:45.481 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.921422053, 2022-01-24T07:13:45.482 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.799345574, 2022-01-24T07:13:45.482 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.434251213, 2022-01-24T07:13:45.482 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.675359672, 2022-01-24T07:13:45.482 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:45.483 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17625, 2022-01-24T07:13:45.483 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 8.148375669, 2022-01-24T07:13:45.483 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000462319 2022-01-24T07:13:45.483 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.483 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:45.484 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 8568, 2022-01-24T07:13:45.484 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.001481118, 2022-01-24T07:13:45.484 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000172 2022-01-24T07:13:45.484 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.484 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.485 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2022-01-24T07:13:45.485 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 250813, 2022-01-24T07:13:45.485 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 484060, 2022-01-24T07:13:45.485 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 85850146, 2022-01-24T07:13:45.485 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 434165846, 2022-01-24T07:13:45.486 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 12, 2022-01-24T07:13:45.486 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2022-01-24T07:13:45.486 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 12.635891682, 2022-01-24T07:13:45.486 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 6.337168353, 2022-01-24T07:13:45.487 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 8.757285820, 2022-01-24T07:13:45.487 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.884172093, 2022-01-24T07:13:45.487 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2022-01-24T07:13:45.487 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 484057, 2022-01-24T07:13:45.487 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 197.810618030, 2022-01-24T07:13:45.488 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000408651 2022-01-24T07:13:45.488 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.488 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2022-01-24T07:13:45.488 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 345725, 2022-01-24T07:13:45.488 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.098637749, 2022-01-24T07:13:45.489 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000285 2022-01-24T07:13:45.489 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.489 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.489 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2022-01-24T07:13:45.489 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2022-01-24T07:13:45.490 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2022-01-24T07:13:45.490 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.490 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2022-01-24T07:13:45.490 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:45.491 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:45.491 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6606, 2022-01-24T07:13:45.491 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 97.221936749, 2022-01-24T07:13:45.491 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.014717217 2022-01-24T07:13:45.491 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.492 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.492 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2022-01-24T07:13:45.492 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2022-01-24T07:13:45.492 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2022-01-24T07:13:45.492 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 23595, 2022-01-24T07:13:45.493 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.379074984, 2022-01-24T07:13:45.493 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000185593 2022-01-24T07:13:45.493 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.493 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.494 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2022-01-24T07:13:45.494 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 143020, 2022-01-24T07:13:45.494 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 139508, 2022-01-24T07:13:45.494 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2022-01-24T07:13:45.494 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 139508, 2022-01-24T07:13:45.495 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2957.379328267, 2022-01-24T07:13:45.495 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.021198636 2022-01-24T07:13:45.495 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.495 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 3494, 2022-01-24T07:13:45.496 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch": 1, 2022-01-24T07:13:45.496 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 1357, 2022-01-24T07:13:45.496 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 135, 2022-01-24T07:13:45.496 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 1, 2022-01-24T07:13:45.497 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 12, 2022-01-24T07:13:45.497 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 0, 2022-01-24T07:13:45.497 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 2, 2022-01-24T07:13:45.497 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 10, 2022-01-24T07:13:45.497 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 11, 2022-01-24T07:13:45.498 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 85259, 2022-01-24T07:13:45.498 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2022-01-24T07:13:45.498 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2022-01-24T07:13:45.498 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 2, 2022-01-24T07:13:45.499 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 219167, 2022-01-24T07:13:45.499 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 200668, 2022-01-24T07:13:45.499 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 3364, 2022-01-24T07:13:45.499 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 789, 2022-01-24T07:13:45.499 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 1, 2022-01-24T07:13:45.500 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2022-01-24T07:13:45.500 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 263, 2022-01-24T07:13:45.500 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 100097, 2022-01-24T07:13:45.500 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 7, 2022-01-24T07:13:45.500 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 283, 2022-01-24T07:13:45.501 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 58285, 2022-01-24T07:13:45.501 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 277, 2022-01-24T07:13:45.501 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2022-01-24T07:13:45.501 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2022-01-24T07:13:45.501 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2022-01-24T07:13:45.502 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2022-01-24T07:13:45.502 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 14562, 2022-01-24T07:13:45.502 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 334264890, 2022-01-24T07:13:45.502 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0 2022-01-24T07:13:45.503 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.503 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2022-01-24T07:13:45.503 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2022-01-24T07:13:45.503 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2022-01-24T07:13:45.504 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2022-01-24T07:13:45.504 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 30564, 2022-01-24T07:13:45.504 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 30564, 2022-01-24T07:13:45.504 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2022-01-24T07:13:45.504 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2022-01-24T07:13:45.505 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2022-01-24T07:13:45.505 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2022-01-24T07:13:45.505 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2022-01-24T07:13:45.505 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2022-01-24T07:13:45.505 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2022-01-24T07:13:45.506 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2022-01-24T07:13:45.506 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 286, 2022-01-24T07:13:45.506 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2022-01-24T07:13:45.506 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 139, 2022-01-24T07:13:45.507 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2022-01-24T07:13:45.507 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2022-01-24T07:13:45.507 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.507 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2022-01-24T07:13:45.508 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 189670, 2022-01-24T07:13:45.508 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 91588, 2022-01-24T07:13:45.508 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 91588, 2022-01-24T07:13:45.508 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 98082, 2022-01-24T07:13:45.508 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2022-01-24T07:13:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 1560, 2022-01-24T07:13:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 233, 2022-01-24T07:13:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 105, 2022-01-24T07:13:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 105, 2022-01-24T07:13:45.509 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 130, 2022-01-24T07:13:45.510 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2022-01-24T07:13:45.510 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 2, 2022-01-24T07:13:45.510 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 222365688, 2022-01-24T07:13:45.510 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 433037786, 2022-01-24T07:13:45.511 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2022-01-24T07:13:45.511 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2022-01-24T07:13:45.511 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3104, 2022-01-24T07:13:45.511 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 263.143827011, 2022-01-24T07:13:45.511 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.084775717 2022-01-24T07:13:45.512 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.512 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2022-01-24T07:13:45.512 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.512 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2022-01-24T07:13:45.512 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 22, 2022-01-24T07:13:45.513 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 70697, 2022-01-24T07:13:45.513 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 70675, 2022-01-24T07:13:45.513 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 13, 2022-01-24T07:13:45.513 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 3475, 2022-01-24T07:13:45.513 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 3462, 2022-01-24T07:13:45.514 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 11, 2022-01-24T07:13:45.514 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 151031, 2022-01-24T07:13:45.514 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 151020, 2022-01-24T07:13:45.514 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2022-01-24T07:13:45.515 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 70479, 2022-01-24T07:13:45.515 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 70479, 2022-01-24T07:13:45.515 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 124324, 2022-01-24T07:13:45.515 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 315596 2022-01-24T07:13:45.515 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.516 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2022-01-24T07:13:45.516 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 176386, 2022-01-24T07:13:45.516 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 2600, 2022-01-24T07:13:45.516 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 143020, 2022-01-24T07:13:45.516 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 222, 2022-01-24T07:13:45.517 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_slave_request": 4550, 2022-01-24T07:13:45.517 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2022-01-24T07:13:45.517 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31000, 2022-01-24T07:13:45.517 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 192.093648463, 2022-01-24T07:13:45.517 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006196569 2022-01-24T07:13:45.518 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.518 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2022-01-24T07:13:45.518 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2023, 2022-01-24T07:13:45.518 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 185.880803589, 2022-01-24T07:13:45.519 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.091883738 2022-01-24T07:13:45.519 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.519 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2022-01-24T07:13:45.519 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.519 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.520 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.520 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.520 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2022-01-24T07:13:45.520 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.520 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.521 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.521 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.521 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2022-01-24T07:13:45.521 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 39248, 2022-01-24T07:13:45.521 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 786.515779081, 2022-01-24T07:13:45.522 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.020039639 2022-01-24T07:13:45.522 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.522 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2022-01-24T07:13:45.522 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.523 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.523 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.523 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.523 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2022-01-24T07:13:45.523 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.524 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.524 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.524 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.524 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2022-01-24T07:13:45.524 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.525 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.525 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.525 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.525 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2022-01-24T07:13:45.525 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.526 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.526 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.526 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.526 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2022-01-24T07:13:45.526 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.527 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.527 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.527 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.527 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2022-01-24T07:13:45.528 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.528 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.528 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.528 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.528 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2022-01-24T07:13:45.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 223, 2022-01-24T07:13:45.529 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.391312077, 2022-01-24T07:13:45.529 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.019691982 2022-01-24T07:13:45.529 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.529 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2022-01-24T07:13:45.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.530 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.530 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.530 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.531 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2022-01-24T07:13:45.531 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.531 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.531 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.531 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.532 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2022-01-24T07:13:45.532 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7738, 2022-01-24T07:13:45.532 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 49.402679274, 2022-01-24T07:13:45.532 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006384424 2022-01-24T07:13:45.532 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.533 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2022-01-24T07:13:45.533 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1239, 2022-01-24T07:13:45.533 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.679114895, 2022-01-24T07:13:45.533 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001355217 2022-01-24T07:13:45.533 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.534 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2022-01-24T07:13:45.534 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 30999, 2022-01-24T07:13:45.534 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 585.767477470, 2022-01-24T07:13:45.534 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.018896334 2022-01-24T07:13:45.534 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.535 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2022-01-24T07:13:45.535 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.535 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.535 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.535 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.536 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2022-01-24T07:13:45.536 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 216, 2022-01-24T07:13:45.536 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 39.013389904, 2022-01-24T07:13:45.536 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.180617545 2022-01-24T07:13:45.536 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.537 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2022-01-24T07:13:45.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.537 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.537 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.538 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.538 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2022-01-24T07:13:45.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.538 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.538 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.539 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.539 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2022-01-24T07:13:45.539 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2, 2022-01-24T07:13:45.539 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.117070400, 2022-01-24T07:13:45.539 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.058535200 2022-01-24T07:13:45.540 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.540 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2022-01-24T07:13:45.540 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.540 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.540 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.541 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.541 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2022-01-24T07:13:45.541 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.541 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.541 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.542 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.542 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2022-01-24T07:13:45.542 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.542 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.543 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.543 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.543 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2022-01-24T07:13:45.543 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.543 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.544 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.544 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.544 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2022-01-24T07:13:45.544 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.544 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.545 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.545 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.545 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2022-01-24T07:13:45.545 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 26820, 2022-01-24T07:13:45.545 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1112.518053114, 2022-01-24T07:13:45.546 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.041480911 2022-01-24T07:13:45.546 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.546 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2022-01-24T07:13:45.546 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0 2022-01-24T07:13:45.546 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.547 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2022-01-24T07:13:45.547 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2022-01-24T07:13:45.547 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2022-01-24T07:13:45.547 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 0, 2022-01-24T07:13:45.547 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2022-01-24T07:13:45.548 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2022-01-24T07:13:45.548 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 24012, 2022-01-24T07:13:45.548 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 12006, 2022-01-24T07:13:45.548 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 3793 2022-01-24T07:13:45.548 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.549 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2022-01-24T07:13:45.549 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2022-01-24T07:13:45.549 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2022-01-24T07:13:45.549 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2022-01-24T07:13:45.550 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2022-01-24T07:13:45.550 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2022-01-24T07:13:45.550 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2022-01-24T07:13:45.550 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2022-01-24T07:13:45.551 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2022-01-24T07:13:45.551 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2022-01-24T07:13:45.551 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2022-01-24T07:13:45.551 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2022-01-24T07:13:45.551 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2022-01-24T07:13:45.552 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_bytes": 0, 2022-01-24T07:13:45.552 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Buffer_items": 0, 2022-01-24T07:13:45.552 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_bytes": 0, 2022-01-24T07:13:45.552 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Extent_items": 0, 2022-01-24T07:13:45.552 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_bytes": 0, 2022-01-24T07:13:45.553 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_Blob_items": 0, 2022-01-24T07:13:45.553 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_bytes": 0, 2022-01-24T07:13:45.553 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_SharedBlob_items": 0, 2022-01-24T07:13:45.553 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2022-01-24T07:13:45.553 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2022-01-24T07:13:45.554 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2022-01-24T07:13:45.554 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2022-01-24T07:13:45.554 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2022-01-24T07:13:45.554 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2022-01-24T07:13:45.555 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2022-01-24T07:13:45.555 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2022-01-24T07:13:45.555 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2022-01-24T07:13:45.555 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2022-01-24T07:13:45.555 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2022-01-24T07:13:45.556 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2022-01-24T07:13:45.556 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2022-01-24T07:13:45.556 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2022-01-24T07:13:45.556 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2022-01-24T07:13:45.556 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2022-01-24T07:13:45.557 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 1072015, 2022-01-24T07:13:45.557 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 184, 2022-01-24T07:13:45.557 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 5896, 2022-01-24T07:13:45.557 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 67, 2022-01-24T07:13:45.558 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2022-01-24T07:13:45.558 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2022-01-24T07:13:45.558 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2022-01-24T07:13:45.558 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2022-01-24T07:13:45.558 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2022-01-24T07:13:45.559 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2022-01-24T07:13:45.559 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 5896, 2022-01-24T07:13:45.559 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 78, 2022-01-24T07:13:45.559 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2022-01-24T07:13:45.560 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2022-01-24T07:13:45.560 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2022-01-24T07:13:45.560 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2022-01-24T07:13:45.560 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 69592, 2022-01-24T07:13:45.560 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 405, 2022-01-24T07:13:45.561 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2022-01-24T07:13:45.561 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2022-01-24T07:13:45.561 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2022-01-24T07:13:45.561 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2022-01-24T07:13:45.562 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.562 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2022-01-24T07:13:45.562 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 1, 2022-01-24T07:13:45.562 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2022-01-24T07:13:45.562 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 33240, 2022-01-24T07:13:45.563 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 460252477, 2022-01-24T07:13:45.563 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 33, 2022-01-24T07:13:45.563 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 33239, 2022-01-24T07:13:45.563 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 33240, 2022-01-24T07:13:45.563 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 477, 2022-01-24T07:13:45.564 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 32763, 2022-01-24T07:13:45.564 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2022-01-24T07:13:45.564 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2022-01-24T07:13:45.564 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 121, 2022-01-24T07:13:45.564 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 4150, 2022-01-24T07:13:45.565 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 476, 2022-01-24T07:13:45.565 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 3585, 2022-01-24T07:13:45.565 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 217, 2022-01-24T07:13:45.565 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2022-01-24T07:13:45.566 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2022-01-24T07:13:45.566 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2022-01-24T07:13:45.566 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 135, 2022-01-24T07:13:45.566 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 23187, 2022-01-24T07:13:45.566 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2022-01-24T07:13:45.567 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2022-01-24T07:13:45.567 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2022-01-24T07:13:45.567 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 1, 2022-01-24T07:13:45.567 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 8300, 2022-01-24T07:13:45.567 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2022-01-24T07:13:45.568 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2022-01-24T07:13:45.568 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2022-01-24T07:13:45.568 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2022-01-24T07:13:45.568 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2022-01-24T07:13:45.568 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2022-01-24T07:13:45.569 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2022-01-24T07:13:45.569 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2022-01-24T07:13:45.569 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2022-01-24T07:13:45.569 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 2, 2022-01-24T07:13:45.570 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2022-01-24T07:13:45.570 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2022-01-24T07:13:45.570 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2022-01-24T07:13:45.570 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2022-01-24T07:13:45.570 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2022-01-24T07:13:45.571 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2022-01-24T07:13:45.571 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2022-01-24T07:13:45.571 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2022-01-24T07:13:45.571 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2022-01-24T07:13:45.571 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2022-01-24T07:13:45.572 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2022-01-24T07:13:45.572 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2022-01-24T07:13:45.572 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2022-01-24T07:13:45.572 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2022-01-24T07:13:45.573 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2022-01-24T07:13:45.573 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2022-01-24T07:13:45.573 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 0, 2022-01-24T07:13:45.573 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2022-01-24T07:13:45.573 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 0, 2022-01-24T07:13:45.574 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 6, 2022-01-24T07:13:45.574 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 6, 2022-01-24T07:13:45.574 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2022-01-24T07:13:45.574 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2022-01-24T07:13:45.575 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 2952, 2022-01-24T07:13:45.575 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2022-01-24T07:13:45.575 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 373 2022-01-24T07:13:45.575 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.575 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2022-01-24T07:13:45.576 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2022-01-24T07:13:45.576 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2022-01-24T07:13:45.576 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2022-01-24T07:13:45.576 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2022-01-24T07:13:45.576 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.577 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2022-01-24T07:13:45.577 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 1, 2022-01-24T07:13:45.577 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 9, 2022-01-24T07:13:45.577 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 1, 2022-01-24T07:13:45.577 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 1, 2022-01-24T07:13:45.578 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 22202, 2022-01-24T07:13:45.578 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 8366 2022-01-24T07:13:45.578 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.578 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2022-01-24T07:13:45.578 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.579 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:45.579 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.579 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 300711, 2022-01-24T07:13:45.579 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 112294916, 2022-01-24T07:13:45.580 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.580 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 300711, 2022-01-24T07:13:45.580 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.580 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.580 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 300711, 2022-01-24T07:13:45.581 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 112294916, 2022-01-24T07:13:45.581 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.581 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.581 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.581 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.582 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.582 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.582 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2022-01-24T07:13:45.582 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.582 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2022-01-24T07:13:45.583 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.583 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:45.583 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:45.583 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.584 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:45.584 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 33240, 2022-01-24T07:13:45.584 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 463340649, 2022-01-24T07:13:45.584 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 9916, 2022-01-24T07:13:45.584 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 463340649, 2022-01-24T07:13:45.585 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.585 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.585 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.585 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.585 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.586 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.586 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2022-01-24T07:13:45.586 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 1, 2022-01-24T07:13:45.586 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2022-01-24T07:13:45.586 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.587 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2022-01-24T07:13:45.587 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2022-01-24T07:13:45.587 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.587 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2022-01-24T07:13:45.587 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 33240, 2022-01-24T07:13:45.588 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 33240, 2022-01-24T07:13:45.588 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 33239, 2022-01-24T07:13:45.588 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 33239, 2022-01-24T07:13:45.588 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.589 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.589 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.589 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.589 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.589 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.590 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2022-01-24T07:13:45.590 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.590 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:45.590 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.590 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 30564, 2022-01-24T07:13:45.591 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 3088188, 2022-01-24T07:13:45.591 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.591 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 30564, 2022-01-24T07:13:45.591 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.592 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.592 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 479, 2022-01-24T07:13:45.592 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 3088188, 2022-01-24T07:13:45.592 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.592 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.593 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.593 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.593 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.593 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2022-01-24T07:13:45.593 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55f1adc7fae0": { 2022-01-24T07:13:45.594 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2022-01-24T07:13:45.594 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2022-01-24T07:13:45.594 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2022-01-24T07:13:45.594 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 189670, 2022-01-24T07:13:45.594 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 428843482, 2022-01-24T07:13:45.595 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2022-01-24T07:13:45.595 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 189670, 2022-01-24T07:13:45.595 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2022-01-24T07:13:45.595 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2022-01-24T07:13:45.596 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 3104, 2022-01-24T07:13:45.596 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 428843482, 2022-01-24T07:13:45.596 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2022-01-24T07:13:45.596 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2022-01-24T07:13:45.596 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2022-01-24T07:13:45.597 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2022-01-24T07:13:45.597 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.597 INFO:teuthology.orchestra.run.smithi145.stdout: } 2022-01-24T07:13:45.597 INFO:teuthology.orchestra.run.smithi145.stdout:} 2022-01-24T07:13:45.599 INFO:tasks.check_counter:Daemon mds.i mds.exported=283 2022-01-24T07:13:45.599 INFO:tasks.check_counter:Daemon mds.i mds.imported=277 2022-01-24T07:13:45.599 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2022-01-24T07:13:45.609 INFO:tasks.kclient:Unmounting kernel clients... 2022-01-24T07:13:45.610 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2022-01-24T07:13:45.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-24T07:13:45.610 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.0 2022-01-24T07:13:45.725 DEBUG:teuthology.orchestra.run.smithi164:> rmdir -- /home/ubuntu/cephtest/mnt.0 2022-01-24T07:13:45.730 INFO:teuthology.orchestra.run:waiting for 300 2022-01-24T07:13:51.770 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2022-01-24T07:13:51.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-24T07:13:51.771 DEBUG:teuthology.orchestra.run.smithi164:> sudo umount /home/ubuntu/cephtest/mnt.1 2022-01-24T07:16:41.590 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:16:41.595 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:16:41.599 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:17:11.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:17:11.789 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:17:11.792 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:17:41.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:17:41.969 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:17:41.971 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:18:12.102 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:18:12.105 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:18:12.108 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:18:42.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:18:42.317 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:18:42.320 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:19:12.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:19:12.523 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:19:12.525 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:19:42.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:19:42.701 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:19:42.704 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:20:12.901 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:20:12.905 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:20:12.908 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:20:43.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:20:43.101 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:20:43.104 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:21:13.244 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:21:13.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:21:13.251 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:21:43.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:21:43.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:21:43.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:22:13.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:22:13.622 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:22:13.626 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:22:43.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:22:43.817 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:22:43.820 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:23:13.993 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:23:13.996 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:23:13.999 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:23:44.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:23:44.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:23:44.208 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:24:14.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:24:14.413 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:24:14.415 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:24:44.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:24:44.592 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:24:44.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:25:14.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:25:14.813 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:25:14.816 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:25:44.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:25:44.991 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:25:44.994 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:26:15.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:26:15.178 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:26:15.181 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:26:45.354 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:26:45.358 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:26:45.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:27:15.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:27:15.564 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:27:15.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:27:45.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:27:45.760 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:27:45.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:28:15.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:28:15.949 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:28:15.952 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:28:46.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:28:46.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:28:46.135 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:28:51.780 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-24T07:28:51.782 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-01-24T07:29:16.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:29:16.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:29:16.332 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:29:46.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:29:46.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:29:46.501 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:30:16.674 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:30:16.678 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:30:16.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:30:46.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:30:46.874 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:30:46.877 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:31:17.083 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:31:17.165 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:31:17.168 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:31:47.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:31:47.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:31:47.359 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:32:17.537 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:32:17.541 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:32:17.544 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:32:47.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:32:47.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:32:47.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:33:18.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:33:18.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:33:18.006 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:33:48.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:33:48.197 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:33:48.203 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:34:18.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:34:18.395 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:34:18.399 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:34:48.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:34:48.598 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:34:48.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:35:18.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:35:18.776 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:35:18.780 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:35:48.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:35:48.973 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:35:48.976 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:36:19.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:36:19.151 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:36:19.154 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:36:49.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:36:49.338 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:36:49.341 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:37:19.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:37:19.527 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:37:19.530 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:37:49.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:37:49.690 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:37:49.693 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:38:19.865 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:38:19.869 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:38:19.872 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:38:50.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:38:50.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:38:50.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:39:20.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:39:20.252 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:39:20.255 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:39:50.434 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:39:50.438 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:39:50.441 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:40:20.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:40:20.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:40:20.610 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:40:50.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:40:50.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:40:50.803 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:41:21.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:41:21.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:41:21.141 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:41:51.326 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:41:51.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:41:51.333 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:42:21.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:42:21.509 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:42:21.512 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:42:51.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:42:51.713 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:42:51.717 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:43:21.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:43:21.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:43:21.911 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:43:52.108 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:43:52.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:43:52.115 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:44:22.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:44:22.308 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:44:22.311 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:44:52.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:44:52.504 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:44:52.507 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:45:22.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:45:22.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:45:22.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:45:52.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:45:52.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:45:52.881 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:46:23.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:46:23.066 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:46:23.069 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:46:53.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:46:53.253 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:46:53.256 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:47:23.453 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:47:23.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:47:23.459 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:47:53.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:47:53.570 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:47:53.573 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:48:23.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:48:23.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:48:23.752 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:48:53.933 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:48:53.937 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:48:53.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:49:24.103 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:49:24.107 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:49:24.110 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:49:54.316 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:49:54.319 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:49:54.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:50:24.483 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:50:24.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:50:24.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:50:54.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:50:54.653 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:50:54.656 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:51:24.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:51:24.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:51:24.809 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:51:54.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:51:54.994 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:51:54.997 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:52:25.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:52:25.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:52:25.185 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:52:55.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:52:55.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:52:55.380 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:53:25.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:53:25.573 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:53:25.576 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:53:55.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:53:55.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:53:55.796 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:54:25.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:54:25.981 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:54:25.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:54:56.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:54:56.160 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:54:56.163 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:55:26.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:55:26.505 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:55:26.516 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:55:56.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:55:56.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:55:56.721 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:56:26.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:56:26.914 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:56:26.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:56:57.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:56:57.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:56:57.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:57:27.235 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:57:27.238 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:57:27.241 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:57:57.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:57:57.426 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:57:57.429 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:58:27.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:58:27.621 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:58:27.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:58:57.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:58:57.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:58:57.838 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:59:28.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:59:28.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:59:28.024 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:59:58.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:59:58.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T07:59:58.220 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:00:28.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:00:28.391 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:00:28.396 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:00:58.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:00:58.567 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:00:58.570 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:01:28.705 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:01:28.709 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:01:28.713 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:01:58.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:01:58.852 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:01:58.855 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:02:29.017 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:02:29.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:02:29.025 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:02:59.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:02:59.202 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:02:59.205 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:03:29.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:03:29.379 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:03:29.382 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:03:59.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:03:59.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:03:59.578 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:04:29.768 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:04:29.772 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:04:29.775 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:04:59.964 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:04:59.970 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:04:59.973 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:05:30.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:05:30.189 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:05:30.192 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:06:00.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:06:00.392 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:06:00.395 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:06:30.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:06:30.570 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:06:30.573 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:07:00.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:07:00.684 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:07:00.687 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:07:30.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:07:30.879 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:07:30.882 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:08:01.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:08:01.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:08:01.078 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:08:31.284 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:08:31.288 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:08:31.291 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:09:01.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:09:01.491 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:09:01.494 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:09:31.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:09:31.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:09:31.673 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:10:01.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:10:01.866 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:10:01.869 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:10:32.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:10:32.053 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:10:32.056 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:11:02.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:11:02.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:11:02.259 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:11:32.441 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:11:32.445 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:11:32.448 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:12:02.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:12:02.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:12:02.578 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:12:32.758 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:12:32.761 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:12:32.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:13:02.937 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:13:02.941 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:13:02.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:13:33.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:13:33.119 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:13:33.122 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:14:03.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:14:03.323 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:14:03.326 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:14:33.515 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:14:33.519 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:14:33.522 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:15:03.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:15:03.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:15:03.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:15:33.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:15:34.461 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:15:34.464 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:16:04.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:16:04.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:16:04.965 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:16:35.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:16:35.153 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:16:35.156 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:17:05.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:17:05.348 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:17:05.351 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:17:35.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:17:35.543 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:17:35.546 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:18:05.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:18:05.723 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:18:05.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:18:35.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:18:35.885 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:18:35.888 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:19:06.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:19:06.090 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:19:06.093 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:19:36.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:19:36.285 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:19:36.288 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:20:06.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:20:06.481 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:20:06.484 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:20:36.673 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:20:36.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:20:36.679 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:21:06.852 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:21:06.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:21:06.858 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:21:37.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:21:37.043 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:21:37.046 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:22:07.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:22:07.240 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:22:07.243 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:22:37.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:22:37.360 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:22:37.362 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:23:07.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:23:07.539 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:23:07.542 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:23:37.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:23:37.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:23:37.730 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:24:07.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:24:07.947 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:24:07.950 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:24:38.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:24:38.126 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:24:38.128 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:25:08.309 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:25:08.312 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:25:08.315 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:25:38.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:25:38.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:25:38.505 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:26:08.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:26:08.705 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:26:08.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:26:38.871 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:26:38.875 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:26:38.878 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:27:09.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:27:09.080 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:27:09.083 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:27:39.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:27:39.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:27:39.261 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:28:09.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:28:09.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:28:09.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:28:39.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:28:39.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:28:39.668 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:29:09.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:29:09.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:29:09.865 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:29:40.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:29:40.058 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:29:40.061 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:30:10.251 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:30:10.254 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:30:10.258 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:30:40.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:30:40.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:30:40.446 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:31:10.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:31:10.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:31:10.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:31:40.820 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:31:40.823 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:31:40.826 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:32:10.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:32:10.944 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:32:10.947 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:32:41.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:32:41.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:32:41.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:33:11.292 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:33:11.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:33:11.299 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:33:41.552 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:33:41.556 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:33:41.559 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:34:11.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:34:11.746 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:34:11.749 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:34:41.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:34:41.908 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:34:41.911 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:35:12.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:35:12.094 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:35:12.097 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:35:42.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:35:42.274 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:35:42.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:36:12.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:36:12.462 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:36:12.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:36:42.645 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:36:42.648 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:36:42.651 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:37:12.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:37:12.845 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:37:12.848 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:37:43.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:37:43.040 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:37:43.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:38:13.215 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:38:13.219 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:38:13.221 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:38:43.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:38:43.389 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:38:43.392 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:39:13.591 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:39:13.594 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:39:13.597 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:39:43.795 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:39:43.798 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:39:43.801 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:40:13.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:40:13.985 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:40:13.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:40:44.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:40:44.156 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:40:44.159 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:41:14.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:41:14.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:41:14.330 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:41:44.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:41:44.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:41:44.501 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:42:14.673 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:42:14.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:42:14.679 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:42:44.877 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:42:44.881 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:42:44.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:43:15.048 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:43:15.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:43:15.054 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:43:45.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:43:45.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:43:45.251 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:44:15.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:44:15.452 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:44:15.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:44:45.643 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:44:45.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:44:45.650 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:45:15.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:45:15.776 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:45:15.779 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:45:45.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:45:45.971 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:45:45.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:46:16.155 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:46:16.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:46:16.161 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:46:46.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:46:46.363 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:46:46.366 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:47:16.532 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:47:16.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:47:16.539 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:47:46.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:47:46.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:47:46.709 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:48:16.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:48:16.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:48:16.879 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:48:47.052 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:48:47.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:48:47.107 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:49:17.289 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:49:17.292 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:49:17.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:49:47.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:49:47.488 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:49:47.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:50:17.689 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:50:17.692 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:50:17.695 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:50:47.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:50:47.890 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:50:47.893 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:51:18.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:51:18.093 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:51:18.097 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:51:48.260 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:51:48.264 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:51:48.267 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:52:18.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:52:18.455 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:52:18.458 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:52:48.651 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:52:48.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:52:48.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:53:18.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:53:18.850 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:53:18.852 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:53:49.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:53:49.038 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:53:49.041 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:54:19.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:54:19.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:54:19.237 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:54:49.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:54:49.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:54:49.432 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:55:19.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:55:19.608 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:55:19.611 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:55:49.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:55:49.786 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:55:49.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:56:19.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:56:19.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:56:19.968 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:56:50.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:56:50.076 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:56:50.079 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:57:20.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:57:20.273 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:57:20.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:57:50.508 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:57:50.512 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:57:50.515 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:58:20.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:58:20.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:58:20.709 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:58:50.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:58:50.893 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:58:50.895 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:59:21.103 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:59:21.107 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:59:21.111 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:59:51.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:59:51.299 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T08:59:51.302 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:00:21.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:00:21.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:00:21.498 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:00:51.671 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:00:51.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:00:51.678 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:01:21.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:01:21.846 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:01:21.849 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:01:52.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:01:52.032 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:01:52.035 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:02:22.208 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:02:22.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:02:22.216 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:02:52.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:02:52.408 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:02:52.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:03:22.582 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:03:22.585 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:03:22.587 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:03:52.760 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:03:52.763 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:03:52.766 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:04:22.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:04:22.960 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:04:22.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:04:53.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:04:53.147 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:04:53.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:05:23.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:05:23.318 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:05:23.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:05:53.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:05:53.496 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:05:53.499 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:06:23.672 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:06:23.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:06:23.679 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:06:53.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:06:53.787 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:06:53.790 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:07:23.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:07:23.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:07:23.952 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:07:54.108 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:07:54.111 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:07:54.114 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:08:24.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:08:24.299 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:08:24.303 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:08:54.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:08:54.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:08:54.499 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:09:24.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:09:24.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:09:24.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:09:54.882 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:09:54.887 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:09:54.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:10:25.130 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:10:25.133 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:10:25.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:10:55.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:10:55.260 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:10:55.263 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:11:25.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:11:25.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:11:25.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:11:55.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:11:55.653 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:11:55.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:12:25.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:12:25.849 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:12:25.852 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:12:56.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:12:56.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:12:56.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:13:26.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:13:26.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:13:26.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:13:56.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:13:56.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:13:56.412 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:14:26.602 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:14:26.605 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:14:26.608 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:14:56.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:14:56.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:14:56.796 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:15:26.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:15:26.981 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:15:26.984 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:15:57.163 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:15:57.167 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:15:57.170 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:16:27.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:16:27.363 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:16:27.366 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:16:57.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:16:57.553 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:16:57.557 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:17:27.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:17:27.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:17:27.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:17:57.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:17:57.917 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:17:57.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:18:28.100 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:18:28.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:18:28.106 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:18:58.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:18:58.218 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:18:58.221 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:19:28.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:19:28.420 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:19:28.423 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:19:58.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:19:58.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:19:58.627 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:20:28.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:20:28.798 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:20:28.801 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:20:58.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:20:58.984 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:20:58.987 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:21:29.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:21:29.188 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:21:29.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:21:59.289 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:21:59.292 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:21:59.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:22:29.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:22:29.489 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:22:29.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:22:59.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:22:59.668 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:22:59.671 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:23:29.801 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:23:29.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:23:29.807 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:23:59.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:23:59.992 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:23:59.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:24:30.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:24:30.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:24:30.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:25:00.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:25:00.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:25:00.327 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:25:30.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:25:30.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:25:30.459 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:26:00.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:26:00.658 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:26:00.661 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:26:30.850 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:26:30.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:26:30.857 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:27:01.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:27:01.157 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:27:01.161 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:27:31.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:27:31.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:27:31.365 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:28:01.562 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:28:01.566 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:28:01.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:28:31.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:28:31.770 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:28:31.773 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:29:01.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:29:01.941 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:29:01.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:29:32.126 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:29:32.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:29:32.133 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:30:02.323 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:30:02.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:30:02.330 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:30:32.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:30:32.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:30:32.501 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:31:02.690 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:31:02.694 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:31:02.697 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:31:32.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:31:32.888 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:31:32.891 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:32:03.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:32:03.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:32:03.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:32:33.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:32:33.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:32:33.177 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:33:03.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:33:03.370 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:33:03.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:33:33.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:33:33.557 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:33:33.560 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:34:03.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:34:03.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:34:03.757 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:34:33.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:34:33.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:34:33.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:35:04.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:35:04.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:35:04.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:35:34.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:35:34.342 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:35:34.345 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:36:04.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:36:04.520 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:36:04.523 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:36:34.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:36:34.710 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:36:34.713 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:37:04.877 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:37:04.881 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:37:04.884 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:37:35.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:37:35.060 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:37:35.063 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:38:05.253 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:38:05.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:38:05.260 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:38:35.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:38:35.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:38:35.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:39:05.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:39:05.621 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:39:05.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:39:35.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:39:35.826 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:39:35.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:40:06.002 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:40:06.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:40:06.009 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:40:36.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:40:36.186 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:40:36.189 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:41:06.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:41:06.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:41:06.358 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:41:36.531 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:41:36.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:41:36.538 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:42:06.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:42:06.722 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:42:06.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:42:36.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:42:36.910 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:42:36.914 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:43:07.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:43:07.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:43:07.068 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:43:37.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:43:37.244 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:43:37.247 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:44:07.419 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:44:07.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:44:07.426 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:44:37.616 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:44:37.620 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:44:37.623 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:45:07.795 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:45:07.799 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:45:07.802 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:45:37.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:45:37.985 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:45:37.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:46:08.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:46:08.155 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:46:08.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:46:38.323 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:46:38.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:46:38.329 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:47:08.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:47:08.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:47:08.510 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:47:38.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:47:38.685 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:47:38.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:48:08.852 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:48:08.856 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:48:08.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:48:39.040 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:48:39.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:48:39.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:49:09.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:49:09.222 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:49:09.225 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:49:39.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:49:39.418 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:49:39.421 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:50:09.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:50:09.598 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:50:09.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:50:39.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:50:39.778 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:50:39.780 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:51:09.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:51:09.974 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:51:09.977 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:51:40.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:51:40.188 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:51:40.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:52:10.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:52:10.383 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:52:10.386 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:52:40.490 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:52:40.493 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:52:40.503 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:53:10.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:53:10.681 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:53:10.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:53:40.865 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:53:40.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:53:40.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:54:11.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:54:11.113 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:54:11.116 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:54:41.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:54:41.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:54:41.314 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:55:11.512 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:55:11.515 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:55:11.518 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:55:41.690 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:55:41.694 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:55:41.697 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:56:11.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:56:11.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:56:11.876 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:56:42.040 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:56:42.044 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:56:42.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:57:12.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:57:12.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:57:12.251 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:57:42.427 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:57:42.432 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:57:42.436 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:58:12.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:58:12.615 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:58:12.619 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:58:42.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:58:42.794 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:58:42.797 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:59:12.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:59:12.981 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:59:12.984 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:59:43.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:59:43.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T09:59:43.206 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:00:13.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:00:13.397 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:00:13.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:00:43.590 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:00:43.593 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:00:43.596 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:01:13.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:01:13.755 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:01:13.759 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:01:43.948 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:01:43.952 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:01:43.955 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:02:14.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:02:14.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:02:14.068 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:02:44.232 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:02:44.237 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:02:44.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:03:14.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:03:14.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:03:14.427 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:03:44.606 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:03:44.610 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:03:44.613 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:04:14.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:04:14.814 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:04:14.817 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:04:45.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:04:45.009 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:04:45.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:05:15.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:05:15.206 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:05:15.208 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:05:45.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:05:45.393 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:05:45.396 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:06:15.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:06:15.596 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:06:15.599 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:06:45.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:06:45.785 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:06:45.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:07:15.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:07:15.970 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:07:15.973 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:07:46.130 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:07:46.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:07:46.137 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:08:16.317 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:08:16.320 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:08:16.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:08:46.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:08:46.508 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:08:46.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:09:16.708 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:09:16.712 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:09:16.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:09:46.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:09:46.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:09:46.953 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:10:17.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:10:17.153 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:10:17.156 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:10:47.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:10:47.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:10:47.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:11:17.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:11:17.544 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:11:17.547 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:11:47.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:11:47.740 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:11:47.742 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:12:17.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:12:17.928 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:12:17.931 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:12:48.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:12:48.141 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:12:48.144 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:13:18.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:13:18.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:13:18.331 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:13:48.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:13:48.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:13:48.501 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:14:18.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:14:18.686 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:14:18.690 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:14:48.886 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:14:48.889 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:14:48.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:15:19.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:15:19.068 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:15:19.071 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:15:49.252 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:15:49.255 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:15:49.258 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:16:19.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:16:19.461 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:16:19.464 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:16:49.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:16:49.572 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:16:49.575 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:17:19.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:17:19.768 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:17:19.771 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:17:49.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:17:49.955 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:17:49.958 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:18:20.130 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:18:20.133 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:18:20.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:18:50.318 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:18:50.321 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:18:50.324 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:19:20.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:19:20.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:19:20.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:19:50.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:19:50.696 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:19:50.699 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:20:20.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:20:20.901 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:20:20.904 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:20:51.085 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:20:51.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:20:51.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:21:21.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:21:21.230 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:21:21.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:21:51.401 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:21:51.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:21:51.407 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:22:21.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:22:21.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:22:21.578 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:22:51.734 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:22:51.738 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:22:51.741 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:23:21.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:23:21.911 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:23:21.916 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:23:52.101 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:23:52.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:23:52.109 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:24:22.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:24:22.275 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:24:22.278 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:24:52.451 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:24:52.454 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:24:52.457 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:25:22.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:25:22.633 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:25:22.636 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:25:52.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:25:52.820 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:25:52.823 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:26:23.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:26:23.016 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:26:23.019 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:26:53.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:26:53.196 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:26:53.199 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:27:23.370 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:27:23.374 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:27:23.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:27:53.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:27:53.661 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:27:53.663 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:28:23.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:28:23.850 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:28:23.853 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:28:54.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:28:54.037 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:28:54.039 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:29:24.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:29:24.232 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:29:24.235 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:29:54.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:29:54.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:29:54.424 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:30:24.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:30:24.599 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:30:24.602 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:30:54.791 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:30:54.795 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:30:54.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:31:25.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:31:25.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:31:25.105 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:31:55.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:31:55.294 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:31:55.297 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:32:25.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:32:25.474 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:32:25.477 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:32:55.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:32:55.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:32:55.669 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:33:25.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:33:25.839 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:33:25.843 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:33:56.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:33:56.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:33:56.031 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:34:26.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:34:26.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:34:26.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:34:56.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:34:56.427 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:34:56.430 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:35:26.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:35:26.614 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:35:26.618 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:35:56.799 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:35:56.802 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:35:56.805 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:36:27.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:36:27.022 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:36:27.025 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:36:57.198 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:36:57.202 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:36:57.205 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:37:27.370 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:37:27.374 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:37:27.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:37:57.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:37:57.552 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:37:57.555 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:38:27.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:38:27.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:38:27.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:38:57.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:38:57.970 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:38:57.973 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:39:28.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:39:28.156 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:39:28.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:39:58.348 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:39:58.351 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:39:58.354 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:40:28.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:40:28.522 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:40:28.525 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:40:58.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:40:58.719 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:40:58.722 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:41:28.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:41:28.897 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:41:28.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:41:59.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:41:59.030 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:41:59.034 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:42:29.211 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:42:29.214 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:42:29.216 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:42:59.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:42:59.403 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:42:59.405 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:43:29.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:43:29.579 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:43:29.582 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:43:59.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:43:59.760 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:43:59.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:44:29.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:44:29.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:44:29.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:45:00.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:45:00.152 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:45:00.155 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:45:30.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:45:30.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:45:30.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:46:00.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:46:00.502 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:46:00.505 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:46:30.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:46:30.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:46:30.675 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:47:00.798 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:47:00.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:47:00.804 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:47:30.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:47:30.972 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:47:30.975 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:48:01.130 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:48:01.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:48:01.137 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:48:31.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:48:31.338 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:48:31.341 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:49:01.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:49:01.509 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:49:01.512 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:49:31.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:49:31.704 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:49:31.707 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:50:01.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:50:01.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:50:01.928 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:50:32.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:50:32.047 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:50:32.050 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:51:02.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:51:02.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:51:02.220 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:51:32.401 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:51:32.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:51:32.408 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:52:02.651 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:52:02.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:52:02.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:52:32.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:52:32.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:52:32.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:53:03.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:53:03.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:53:03.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:53:33.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:53:33.220 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:53:33.223 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:54:03.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:54:03.407 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:54:03.410 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:54:33.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:54:33.604 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:54:33.607 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:55:03.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:55:03.800 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:55:03.803 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:55:33.951 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:55:33.954 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:55:33.957 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:56:04.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:56:04.133 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:56:04.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:56:34.325 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:56:34.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:56:34.332 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:57:04.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:57:04.524 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:57:04.527 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:57:34.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:57:34.728 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:57:34.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:58:04.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:58:04.909 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:58:04.912 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:58:35.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:58:35.138 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:58:35.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:59:05.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:59:05.301 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:59:05.307 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:59:35.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:59:35.497 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T10:59:35.500 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:00:05.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:00:05.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:00:05.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:00:35.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:00:35.903 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:00:35.906 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:01:06.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:01:06.216 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:01:06.219 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:01:36.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:01:36.403 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:01:36.407 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:02:06.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:02:06.595 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:02:06.598 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:02:36.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:02:36.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:02:36.807 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:03:06.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:03:06.982 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:03:06.985 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:03:37.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:03:37.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:03:37.172 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:04:07.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:04:07.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:04:07.359 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:04:37.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:04:37.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:04:37.539 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:05:07.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:05:07.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:05:07.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:05:37.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:05:37.937 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:05:37.941 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:06:08.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:06:08.131 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:06:08.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:06:38.312 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:06:38.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:06:38.318 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:07:08.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:07:08.489 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:07:08.492 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:07:38.673 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:07:38.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:07:38.679 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:08:08.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:08:08.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:08:08.850 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:08:39.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:08:39.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:08:39.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:09:09.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:09:09.164 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:09:09.168 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:09:39.348 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:09:39.352 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:09:39.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:10:09.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:10:09.565 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:10:09.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:10:39.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:10:39.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:10:39.738 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:11:09.918 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:11:09.922 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:11:09.925 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:11:40.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:11:40.118 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:11:40.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:12:10.301 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:12:10.305 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:12:10.308 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:12:40.481 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:12:40.485 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:12:40.488 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:13:10.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:13:10.663 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:13:10.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:13:40.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:13:40.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:13:40.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:14:11.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:14:11.062 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:14:11.065 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:14:41.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:14:41.249 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:14:41.252 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:15:11.442 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:15:11.446 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:15:11.449 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:15:41.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:15:41.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:15:41.653 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:16:11.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:16:11.838 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:16:11.841 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:16:42.021 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:16:42.025 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:16:42.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:17:12.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:17:12.211 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:17:12.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:17:42.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:17:42.406 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:17:42.409 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:18:12.607 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:18:12.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:18:12.613 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:18:42.811 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:18:42.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:18:42.818 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:19:13.017 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:19:13.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:19:13.024 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:19:43.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:19:43.211 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:19:43.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:20:13.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:20:13.436 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:20:13.441 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:20:43.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:20:43.639 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:20:43.642 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:21:13.797 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:21:13.801 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:21:13.804 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:21:43.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:21:43.990 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:21:43.993 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:22:14.155 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:22:14.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:22:14.162 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:22:44.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:22:44.339 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:22:44.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:23:14.515 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:23:14.520 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:23:14.523 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:23:44.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:23:44.631 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:23:44.633 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:24:14.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:24:14.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:24:14.811 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:24:44.983 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:24:44.986 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:24:44.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:25:15.188 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:25:15.191 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:25:15.193 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:25:45.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:25:45.373 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:25:45.376 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:26:15.546 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:26:15.550 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:26:15.553 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:26:45.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:26:45.746 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:26:45.749 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:27:15.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:27:15.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:27:15.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:27:46.134 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:27:46.137 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:27:46.139 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:28:16.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:28:16.308 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:28:16.310 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:28:46.527 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:28:46.530 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:28:46.533 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:29:16.724 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:29:16.728 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:29:16.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:29:46.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:29:46.897 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:29:46.901 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:30:17.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:30:17.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:30:17.106 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:30:47.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:30:47.312 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:30:47.315 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:31:17.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:31:17.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:31:17.494 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:31:47.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:31:47.670 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:31:47.673 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:32:17.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:32:17.867 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:32:17.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:32:48.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:32:48.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:32:48.058 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:33:18.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:33:18.251 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:33:18.254 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:33:48.434 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:33:48.438 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:33:48.441 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:34:18.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:34:18.633 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:34:18.636 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:34:48.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:34:48.804 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:34:48.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:35:18.995 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:35:18.999 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:35:19.002 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:35:49.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:35:49.187 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:35:49.190 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:36:19.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:36:19.384 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:36:19.387 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:36:49.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:36:49.554 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:36:49.557 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:37:19.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:37:19.744 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:37:19.747 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:37:49.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:37:49.912 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:37:49.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:38:20.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:38:20.090 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:38:20.093 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:38:50.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:38:50.278 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:38:50.282 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:39:20.478 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:39:20.482 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:39:20.485 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:39:50.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:39:50.687 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:39:50.690 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:40:20.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:40:20.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:40:20.909 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:40:51.083 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:40:51.087 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:40:51.090 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:41:21.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:41:21.278 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:41:21.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:41:51.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:41:51.468 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:41:51.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:42:21.661 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:42:21.665 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:42:21.668 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:42:51.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:42:51.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:42:51.838 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:43:22.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:43:22.016 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:43:22.019 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:43:52.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:43:52.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:43:52.217 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:44:22.386 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:44:22.390 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:44:22.393 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:44:52.524 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:44:52.527 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:44:52.530 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:45:22.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:45:22.731 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:45:22.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:45:52.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:45:52.918 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:45:52.922 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:46:23.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:46:23.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:46:23.117 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:46:53.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:46:53.302 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:46:53.305 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:47:23.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:47:23.488 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:47:23.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:47:53.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:47:53.684 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:47:53.687 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:48:23.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:48:23.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:48:23.799 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:48:53.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:48:53.992 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:48:53.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:49:24.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:49:24.179 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:49:24.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:49:54.348 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:49:54.352 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:49:54.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:50:24.562 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:50:24.566 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:50:24.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:50:54.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:50:54.768 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:50:54.771 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:51:24.959 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:51:24.963 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:51:24.966 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:51:55.139 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:51:55.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:51:55.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:52:25.326 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:52:25.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:52:25.333 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:52:55.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:52:55.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:52:55.504 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:53:25.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:53:25.680 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:53:25.683 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:53:55.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:53:55.884 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:53:55.887 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:54:26.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:54:26.063 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:54:26.066 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:54:56.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:54:56.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:54:56.261 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:55:26.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:55:26.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:55:26.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:55:56.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:55:56.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:55:56.660 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:56:26.850 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:56:26.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:56:26.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:56:56.963 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:56:56.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:56:56.971 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:57:27.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:57:27.157 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:57:27.160 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:57:57.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:57:57.342 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:57:57.346 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:58:27.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:58:27.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:58:27.498 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:58:57.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:58:57.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:58:57.703 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:59:27.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:59:27.961 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:59:27.964 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:59:58.128 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:59:58.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T11:59:58.135 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:00:28.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:00:28.261 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:00:28.265 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:00:58.445 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:00:58.449 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:00:58.453 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:01:28.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:01:28.600 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:01:28.603 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:01:58.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:01:58.715 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:01:58.718 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:02:28.891 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:02:28.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:02:28.897 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:02:59.094 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:02:59.098 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:02:59.100 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:03:29.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:03:29.230 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:03:29.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:03:59.411 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:03:59.415 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:03:59.418 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:04:29.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:04:29.603 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:04:29.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:04:59.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:04:59.774 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:04:59.777 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:05:29.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:05:29.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:05:29.971 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:06:00.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:06:00.156 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:06:00.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:06:30.348 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:06:30.351 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:06:30.354 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:07:00.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:07:00.464 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:07:00.470 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:07:30.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:07:30.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:07:30.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:08:00.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:08:00.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:08:00.809 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:08:30.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:08:30.985 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:08:30.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:09:01.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:09:01.188 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:09:01.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:09:31.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:09:31.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:09:31.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:10:01.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:10:01.563 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:10:01.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:10:31.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:10:31.776 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:10:31.779 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:11:01.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:11:01.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:11:01.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:11:32.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:11:32.153 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:11:32.156 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:12:02.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:12:02.356 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:12:02.359 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:12:32.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:12:32.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:12:32.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:13:02.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:13:02.722 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:13:02.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:13:32.922 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:13:32.925 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:13:32.928 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:14:03.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:14:03.122 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:14:03.126 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:14:33.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:14:33.300 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:14:33.303 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:15:03.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:15:03.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:15:03.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:15:33.672 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:15:33.675 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:15:33.678 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:16:03.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:16:03.837 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:16:03.840 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:16:33.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:16:33.952 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:16:33.969 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:17:04.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:17:04.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:17:04.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:17:34.321 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:17:34.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:17:34.330 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:18:04.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:18:04.528 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:18:04.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:18:34.680 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:18:34.684 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:18:34.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:19:04.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:19:04.829 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:19:04.832 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:19:35.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:19:35.023 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:19:35.027 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:20:05.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:20:05.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:20:05.215 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:20:35.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:20:35.424 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:20:35.427 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:21:05.607 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:21:05.611 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:21:05.614 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:21:35.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:21:35.797 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:21:35.799 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:22:05.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:22:05.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:22:05.935 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:22:36.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:22:36.112 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:22:36.115 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:23:06.279 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:23:06.282 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:23:06.284 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:23:36.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:23:36.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:23:36.466 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:24:06.645 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:24:06.650 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:24:06.654 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:24:36.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:24:36.829 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:24:36.832 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:25:07.015 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:25:07.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:25:07.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:25:37.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:25:37.225 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:25:37.228 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:26:07.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:26:07.386 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:26:07.390 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:26:37.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:26:37.569 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:26:37.572 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:27:07.759 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:27:07.762 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:27:07.766 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:27:37.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:27:37.935 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:27:37.939 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:28:08.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:28:08.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:28:08.133 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:28:38.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:28:38.301 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:28:38.304 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:29:08.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:29:08.497 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:29:08.499 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:29:38.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:29:38.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:29:38.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:30:08.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:30:08.877 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:30:08.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:30:39.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:30:39.082 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:30:39.085 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:31:09.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:31:09.295 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:31:09.298 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:31:39.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:31:39.500 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:31:39.503 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:32:09.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:32:09.705 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:32:09.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:32:39.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:32:39.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:32:39.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:33:10.048 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:33:10.051 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:33:10.054 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:33:40.243 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:33:40.247 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:33:40.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:34:10.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:34:10.504 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:34:10.507 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:34:40.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:34:40.684 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:34:40.691 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:35:10.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:35:10.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:35:10.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:35:41.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:35:41.073 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:35:41.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:36:11.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:36:11.243 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:36:11.246 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:36:41.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:36:41.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:36:41.432 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:37:11.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:37:11.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:37:11.610 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:37:41.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:37:41.803 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:37:41.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:38:11.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:38:11.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:38:11.993 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:38:42.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:38:42.161 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:38:42.164 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:39:12.345 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:39:12.350 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:39:12.353 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:39:42.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:39:42.553 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:39:42.555 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:40:12.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:40:12.731 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:40:12.734 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:40:42.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:40:42.886 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:40:42.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:41:13.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:41:13.085 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:41:13.089 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:41:43.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:41:43.270 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:41:43.273 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:42:13.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:42:13.432 DEBUG:teuthology.orchestra.run.smithi145:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:42:13.435 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-24T12:42:18.365 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-01-24T12:42:18.367 DEBUG:teuthology.task.console_log:Killing console logger for smithi142 2022-01-24T12:42:18.368 DEBUG:teuthology.task.console_log:Killing console logger for smithi145 2022-01-24T12:42:18.368 DEBUG:teuthology.task.console_log:Killing console logger for smithi164 2022-01-24T12:42:18.368 DEBUG:teuthology.exit:Finished running handlers